pixmo-points-eval

# PixMo-Points-Eval
PixMo-Points-Eval is a subset of [PixMo-Points](https://huggingface.co/datasets/allenai/pixmo-points) that has been human-filtered and annotated with segmentation masks.
It is used for pointing evaluations.
PixMo-Points is a part of the [PixMo dataset collection](https://huggingface.co/collections/allenai/pixmo-674746ea613028006285687b) and was used to
provide the pointing capabilities of the [Molmo family of models](https://huggingface.co/collections/allenai/molmo-66f379e6fe3b8ef090a8ca19)

## Loading
```python
data = datasets.load_dataset("allenai/pixmo-points-eval", split="test")
```

## Data Format
Images are stored as URLs that will need to be downloaded separately. Note URLs can be repeated in the data.

The `points` field contains the x, y coordinates specified in pixels.

The `label` field contains the string name of what is being pointed at, this can be a simple object name or a more complex referring expression.

The `masks` field contains the segmentation masks for the points.

## Image Checking
Image hashes are included to support double-checking that the downloaded image matches the annotated image.
It can be checked like this:

```python
from hashlib import sha256
import requests

example = data[0]
image_bytes = requests.get(example["image_url"]).content
byte_hash = sha256(image_bytes).hexdigest()
assert byte_hash == example["image_sha256"]
```

## License
This dataset is licensed under ODC-BY-1.0. It is intended for research and educational use in accordance with Ai2's [Responsible Use Guidelines](https://allenai.org/responsible-use).

# PixMo-Points-Eval

PixMo-Points-Eval 是 [PixMo-Points](https://huggingface.co/datasets/allenai/pixmo-points) 的一个子集，经过人工筛选并标注了分割掩码（segmentation masks），用于指向评估任务。
PixMo-Points 隶属于 [PixMo 数据集合集](https://huggingface.co/collections/allenai/pixmo-674746ea613028006285687b)，曾用于为 [Molmo 系列模型](https://huggingface.co/collections/allenai/molmo-66f379e6fe3b8ef090a8ca19) 提供指向交互能力。

## 加载方式
python
data = datasets.load_dataset("allenai/pixmo-points-eval", split="test")

## 数据格式
图像以 URL 形式存储，需单独下载。需注意，数据中可能存在重复的 URL。
`points` 字段存储以像素为单位的 x、y 坐标。
`label` 字段存储被指向目标的字符串名称，可为简单的物体名称或更复杂的指代表达式。
`masks` 字段存储对应指向点的分割掩码。

## 图像校验
数据集包含图像哈希值，用于验证下载的图像与标注图像一致。校验代码示例如下：
python
from hashlib import sha256
import requests

example = data[0]
image_bytes = requests.get(example["image_url"]).content
byte_hash = sha256(image_bytes).hexdigest()
assert byte_hash == example["image_sha256"]

## 许可证
本数据集采用 ODC-BY-1.0 许可证开源，仅可用于研究与教育用途，并需遵循 AI2 的 [负责任使用指南](https://allenai.org/responsible-use).