Image Label Wikification Collection (ILWC)

Image Label Wikification Collection (ILWC) is a test collection for evaluating systems that link descriptional labels of images to Wikipedia pages as the labels' entities. ILWC consists of 450 images and a total of 2,280 user-assigned labels with manual correct annotations. This collection contains following files: image_URL.txt topics.txt rels.txt ImageCLEF_concepts.txt image_URL.txt is a list of image files and Flickr URLs from which the files were downloaded. topics.txt is a topic file. First two letters of topic ID in the topic file correspond to the collection category of animal names. The correspondence is as follows: Albatross Bee Bison Boar Coyote Cricket Jaguar Kite Llama Mouse, Panther Quail, Stingray Tiger shark Whippet rels.txt is a list of correct Wikipedia pages for user-assigned image labels of the topics. ImageCLEF_concepts.txt is a list of the used concepts in ImageCLEF2014 Scalable Concept Image Annotation task test collection for Image Label Wikification task.