遇见数据集

2012 Imageclef Webupv Collection

收藏
Zenodo2020-09-20 更新2026-05-25 收录
数据链接:
官方服务:

资源简介:

This document describes the WEBUPV dataset compiled for the ImageCLEF<br> 2012 Scalable image annotation task. The data mentioned here<br> indicates what is ready for download. However, upon request or<br> depending on feedback from the participants, additional data can be<br> released. For debugging purposes, thumbnails of the images in the<br> dataset can be obtained from a web server using '{IID}' the image<br> identifier: http://risenet.prhlt.upv.es/db/img/{IID}.jpg The following is the directory structure of the collection, and bellow<br> there is a brief description of what each compressed file<br> contains. The corresponding MD5 checksums of the files shown (for<br> verifying a correct download) can be found in the md5sums.txt. Directory structure<br> ------------------- .<br> |<br> |--- README.txt<br> |--- md5sums.txt<br> |--- webupv_train_lists.zip<br> |--- webupv_devel_lists.zip<br> |--- webupv_test_lists.zip<br> |--- baseline.zip<br> |<br> |--- feats_textual/<br> | |<br> | |--- webupv_train_textual.rawfeat.gz<br> | |--- webupv_train_textual.scofeat.gz<br> | |--- webupv_train_textual.keywords.gz<br> |<br> |--- feats_visual/<br> |<br> |--- webupv_{train|devel|test}_visual_gist.feat.gz<br> |--- webupv_{train|devel|test}_visual_sift_*.feat.gz<br> |--- webupv_{train|devel|test}_visual_csift_*.feat.gz<br> |--- webupv_{train|devel|test}_visual_rgbsift_*.feat.gz<br> |--- webupv_{train|devel|test}_visual_opponentsift_*.feat.gz<br> |--- webupv_{train|devel|test}_visual_colorhist.feat.gz Contents of files<br> ----------------- * webupv_train_lists.zip<br> -&gt; train_iids.txt : IDs of the images in the training set (250000).<br> -&gt; train_rids.txt : IDs of the webpages in the training set.<br> -&gt; train_rimgsrc.txt : The URLs of the images as referenced in each<br> of the webpages. This can also be useful as a<br> textual feature. <br> * webupv_devel_lists.zip<br> -&gt; devel_iids.txt : IDs of the images in the development set (1000).<br> -&gt; devel_concepts.txt : List concepts for the development set.<br> -&gt; devel_gnd.txt : Ground truth concepts for the development set<br> images. <br> * webupv_test_lists.zip<br> -&gt; test_iids.txt : IDs of the images in the test set (2000).<br> -&gt; test_concepts.txt : List concepts for the test set.<br> -&gt; test_gnd.txt : Ground truth concepts for the test set images. <br> * baseline.zip An archive that includes code for computing the evaluation measures<br> for two baseline techniques for the "Scalable concept image<br> annotation" subtask. See the included README.txt for details. <br> * feats_textual/webupv_train_textual.rawfeat.gz The raw text extracted from the webpages near where the images<br> appeared. Each line starts with the image and webpage IDs followed<br> by the text extracted. The position of the image within the text is<br> indicated by the special word '{X}'. The extracted text is somewhat<br> filtered (e.g. there are no HTML tags), although removed words and<br> tags have been replaced by full stops '.' to preserve word<br> distances. The title of the webpage is always included, and it is<br> the first sentence of the text. In total the file has 275749 lines<br> since the images can appear in more than one webpage. <br> * feats_textual/webupv_train_textual.scofeat.gz The processed text extracted from the webpages near where the images<br> appeared. Each line corresponds to one image, having the same order<br> as the train_iids.txt list. The lines start with the image ID,<br> followed by the number of extracted unique words and the<br> corresponding word-score pairs. The scores were derived taking into<br> account 1) the term frequency (TF), 2) the document object model<br> (DOM) attributes, and 3) the word distance to the image. The scores<br> are all integers and for each image the sum of scores is always<br> &lt;=100000 (i.e. it is normalized). <br> * feats_textual/webupv_train_textual.keywords.gz The words used to find the images when querying image search<br> engines. Each line corresponds to an image (in the same order as<br> in train_iids.txt). The lines are composed of triplets: [keyword] [rank] [search_engine] where [keyword] is the word used to find the image, [rank] is the<br> position given to the image in the query, and [search_engine] is a<br> single character indicating in which search engine it was found<br> ('g':google, 'b':bing, 'y':yahoo). <br> * feats_visual/webupv_*.feat.gz The visual features in a simple ASCII text sparse format. The first<br> line of the file indicates the number of vectors (N) and the<br> dimensionality (DIMS). Then each line corresponds to one vector,<br> starting with the number of non-zero elements and followed by pairs<br> of dimension-value, being the first dimension 0. In summary the file<br> format is: N DIMS<br> nz1 Dim(1,1) Val(1,1) ... Dim(1,nz1) Val(1,nz1)<br> nz2 Dim(2,1) Val(2,1) ... Dim(2,nz2) Val(2,nz2)<br> ...<br> nzN Dim(N,1) Val(N,1) ... Dim(N,nzN) Val(N,nzN) The order of the features is the same as in the lists<br> devel_iids.txt, test_iids.txt and train_iids.txt. The procedure to extract the SIFT based features in this<br> subdirectory was conducted as follows. Using the ImageMagick<br> software, the images were first rescaled to having a maximum of 240<br> pixels, of both width and height, while preserving the original<br> aspect ratio, employing the command: convert {IMGIN}.jpg -resize '240&gt;x240&gt;' {IMGOUT}.jpg Then the SIFT features where extracted using the ColorDescriptor<br> software from Koen van de Sande<br> (http://koen.me/research/colordescriptors). As configuration we<br> used, 'densesampling' detector with default parameters, and a hard<br> assignment codebook using a spatial pyramid as<br> 'pyramid-1x1-2x2'. The number in the file name indicates the size of<br> the codebook. All of the vectors of the spatial pyramid are given in<br> the same line, thus keeping only the first 1/5th of the dimensions<br> would be like not using the spatial pyramid. The codebook was<br> generated using 1.25 million randomly selected features and the<br> k-means algorithm. <br> Contact<br> ------- For further questions, please contact:<br> Mauricio Villegas &lt;mauvilsa@upv.es&gt;

提供机构:
Zenodo
创建时间:
2018-05-05
二维码
社区交流群
二维码
科研交流群
商业服务