PointPrompt: A Multi-modal Prompting Dataset for Segment Anything Model

Each folder in 'Prompting data.zip' corresponds to a single category (Bird, Cat, Bus etc), and each of these contain folders corresponding to a single participant (st1, st2 etc). Each participant folder should contain 5 subfolders: 'masks' contains the binary masks produced for each image, in the format a_b_mask.png, where 'a' corresponds to the image number (0 to 399) and 'b' indexes through timestamps in the prompting process 'points' contains the inclusion and exclusion points formatted as a_green.npy and a_red.npy respectively, where 'a' corresponds to the image number. Each of these files is a list of lists corresponding to the prompted points at each timestep. The outer list is of size (t,), where 't' is the number of timesteps for that image, an each inner list is fo size (n,2), where 'n' is the number of points at a given timestep 'scores' contains the scores at each timestep for every image (mIoU) 'sorts' contains sorted timestamp indexes, going from max to min based on the score 'eachround' indicates which timesteps belong to each of the two rounds (if they exist). Each file contains a list of lenght t (number of timestamps) where values of 0 corresponds to timestamps that belong to the first round and values of 1 correspond to timestamps that belong to the second round Quick usage: -To get the best (highes score) mask for a given image : masks[sorts[0]] -To get the best set of prompts for that image : green[sorts[0]] and red[sorts[0]]-To get which round produced the highest score in that image : eachround[sorts[0]]提示数据压缩包（Prompting data.zip）内的每个文件夹对应单一类别（如鸟类、猫、公交车等），每个类别文件夹下包含对应单个参与者（st1、st2等）的子文件夹。每个参与者文件夹需包含5个子文件夹： `masks`：存放为每张图像生成的二值掩码，文件命名格式为`a_b_mask.png`，其中`a`为图像编号（0至399），`b`为提示过程中时间戳的索引。 `points`：存放每张图像的包含点与排除点，分别以`a_green.npy`和`a_red.npy`格式命名，其中`a`为图像编号。每个文件均为列表的列表，对应每个时间步的提示点：外层列表维度为(t,)，其中`t`为该图像的时间步总数；内层列表维度为(n, 2)，其中`n`为当前时间步的提示点数量。 `scores`：存放每张图像在每个时间步的评分（平均交并比，mean Intersection over Union, mIoU）。 `sorts`：存放按评分从高到低排序的时间步索引。 `eachround`：指示每个时间步属于两轮提示中的哪一轮（若存在）。每个文件为长度为`t`（时间步总数）的列表，其中值为0表示该时间步属于第一轮，值为1表示属于第二轮。 快速使用指南： - 若要获取指定图像的最佳（评分最高）掩码：使用`masks[sorts[0]]` - 若要获取该图像的最佳提示点集：使用`green[sorts[0]]`与`red[sorts[0]]` - 若要获取生成该图像最高评分的提示轮次：查看`eachround[sorts[0]]`