allenai/pixmo-points

PixMo-Points是一个包含图像与指代表达式配对的数据集，其中指代表达式标记了图像中表达的位置。该数据集通过人工注释收集，包含了多样化的点和表达，其中许多是高频率（10+）的表达。PixMo-Points是PixMo数据集集合的一部分，用于提供Molmo模型家族的指向能力。数据集中的图像以URL形式存储，需要单独下载。点的坐标以像素为单位，标签字段包含指向对象的名称或更复杂的指代表达式。收集方法字段指定了图像是用于高频计数（counting）还是通用指向（pointing）。图像哈希值用于验证下载的图像是否与注释的图像匹配。

PixMo-Points is a dataset of images paired with referring expressions and points marking the locations the referring expression refers to in the image. It was collected using human annotators and contains a diverse range of points and expressions, with many high-frequency (10+) expressions. PixMo-Points is a part of the PixMo dataset collection and was used to provide the pointing capabilities of the Molmo family of models. Images are stored as URLs that will need to be downloaded separately. The points field contains the x, y coordinates specified in pixels. The label field contains the string name of what is being pointed at, this can be a simple object name or a more complex referring expression. The collection_method field specifies whether the image was chosen to target high-frequency counting (counting) or general pointing (pointing). Image hashes are included to support double-checking that the downloaded image matches the annotated image.