Instructions for Alt-texts study

In the study, you will be asked to score several alt-texts according to the following metrics:

• How accurately does the alt-text represent the image? Is the alt-text correctly depicting the picture?
• How precisely does the alt-text represent the image? Does the alt-text provide detailed information about the content of the picture?
• How relevant is the alt-text with respect to the image? Is the alt-text useful to understand the content of the picture?
• How engaging is the alt-text? Did you find the alt-text enjoyable and exciting to read?
• How interesting is the alt-text? Did you find the alt-text provided interesting information about the corresponding image?

For example, if we consider the following alt-text for the following image: "Photorealistic picture of a male robot sitting in the back of a college classroom together with many human students. They are instructed by a female robot, who is standing up front and explaining special relativity on the blackboard."

This alt-text is precise, since a lot of detail is given, but it is not accurate, since there are discrepancies between the description and the picture, for example the back robot is not sitting, and details are given which cannot be found in the image, such as course content and robots' gender. The alt-text is still relevant as it is useful to understand the goal of the image. The other metrics are more subjective and yours to judge.