PointPrompt: A Multi-modal Prompting Dataset for Segment Anything Model

Each folder in 'Prompting data.zip' corresponds to a single category (Bird, Cat, Bus etc), and each of these contain folders corresponding to a single participant (st1, st2 etc). Each participant folder should contain 5 subfolders: 'masks' contains the binary masks produced for each image, in the format a_b_mask.png, where 'a' corresponds to the image number (0 to 399) and 'b' indexes through timestamps in the prompting process 'points' contains the inclusion and exclusion points formatted as a_green.npy and a_red.npy respectively, where 'a' corresponds to the image number. Each of these files is a list of lists corresponding to the prompted points at each timestep. The outer list is of size (t,), where 't' is the number of timesteps for that image, an each inner list is fo size (n,2), where 'n' is the number of points at a given timestep 'scores' contains the scores at each timestep for every image (mIoU) 'sorts' contains sorted timestamp indexes, going from max to min based on the score 'eachround' indicates which timesteps belong to each of the two rounds (if they exist). Each file contains a list of lenght t (number of timestamps) where values of 0 corresponds to timestamps that belong to the first round and values of 1 correspond to timestamps that belong to the second round Quick usage: -To get the best (highes score) mask for a given image : masks[sorts[0]] -To get the best set of prompts for that image : green[sorts[0]] and red[sorts[0]] -To get which round produced the highest score in that image : eachround[sorts[0]]‘Prompting data.zip’内的每个文件夹对应单一类别（如鸟类、猫科、巴士等），每个类别文件夹下均设有对应单个参与者的子文件夹（st1、st2等）。每个参与者文件夹需包含5个子文件夹：`masks` 文件夹存放为每张图像生成的二值掩码，命名格式为`a_b_mask.png`，其中`a`代表图像编号（取值范围0至399），`b`为提示流程中时间戳的索引；`points` 文件夹分别存储纳入点与排除点，对应命名格式分别为`a_green.npy`与`a_red.npy`，其中`a`代表图像编号，每个文件为嵌套列表结构：外层列表长度为`t`（`t`为该图像的总时间步数），每个内层列表维度为`(n, 2)`，其中`n`为对应时间步的提示点数量；`scores` 文件夹存储每张图像在每个时间步的评分（平均交并比mIoU，mean Intersection over Union）；`sorts` 文件夹包含按评分从高到低排序的时间步索引；`eachround` 文件夹标注每个时间步所属的轮次（若存在两轮），每个文件为长度为`t`（总时间步数）的列表，值为0表示该时间步属于第一轮，值为1表示属于第二轮。 快速使用指南： - 若需获取指定图像的最佳（评分最高）掩码：可通过`masks[sorts[0]]`获取 - 若需获取该图像的最佳提示集：可分别通过`green[sorts[0]]`与`red[sorts[0]]`获取纳入点与排除点 - 若需得知该图像的最高评分来自哪一轮：可通过`eachround[sorts[0]]`获取