aggfda/ScreenSpot-Pro

---
task_categories:
- image-text-to-text
license: mit
language:
- en
tags:
- agent
pretty_name: SS-Pro
size_categories:
- 1K<n<10K
---

# ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use
<div style="display: flex; gap: 10px;">
<a href="https://github.com/likaixin2000/ScreenSpot-Pro-GUI-Grounding">
<img src="https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white" alt="github" class="img-fluid" />
</a>
<a href="https://likaixin2000.github.io/papers/ScreenSpot_Pro.pdf">
<img src="https://img.shields.io/badge/arXiv-paper-b31b1b.svg?style=for-the-badge" alt="paper" class="img-fluid" />
</a>
<a href="https://gui-agent.github.io/grounding-leaderboard/">
<img src="https://img.shields.io/badge/Leaderboard-8A2BE2?style=for-the-badge" alt="paper" class="img-fluid" />
</a>
</div>

Note: Data viewer is not configured because the large size of the images will trigger loading errors.
&nbsp;
# Data Details

| Category | Abbr. | Application | Edition & Version | OS | Icons | Texts |
|-----------------------------------|-------|-------------------|--------------------|----------|-------|-------|
| **Development and Programming** | | | | | | |
| | VSC | Visual Studio Code| 1.95 | macOS | 22 | 33 |
| | PyC | PyCharm | 2023.3 | macOS | 38 | 40 |
| | AS | Android Studio | 2022.2 | macOS | 44 | 36 |
| | Qrs | Quartus | II 13.0 SP1 | Windows | 32 | 13 |
| | VM | VMware | Fusion 13.6.1 | macOS | 9 | 32 |
| **Creative** | | | | | | |
| | PS | Photoshop | 2020 | Windows | 25 | 26 |
| | PR | Premiere | 2025 | Windows | 24 | 28 |
| | AI | Adobe Illustrator | 2025 | Windows | 19 | 12 |
| | Bl | Blender | 4.0.2 | Windows | 15 | 56 |
| | FL | FruitLoops Studio | 20.8.3 | Windows | 31 | 26 |
| | UE | Unreal Engine | 5.4.4 | Windows | 6 | 29 |
| | DR | DaVinci Resolve | 19.0.3 | macOS | 23 | 21 |
| **CAD and Engineering** | | | | | | |
| | CAD | AutoCAD | Mechanical 2019 | Windows | 7 | 27 |
| | SW | SolidWorks | Premium 2018 x64 | Windows | 14 | 63 |
| | Inv | Inventor | Professional 2019 | Windows | 11 | 59 |
| | Vvd | Vivado | 2018.3 | Windows | 32 | 48 |
| **Scientific and Analytical** | | | | | | |
| | MAT | MATLAB | R2022b | Windows | 19 | 74 |
| | Org | Origin | 2018 | Windows | 43 | 19 |
| | Stt | Stata | SE 16 | Windows | 41 | 8 |
| | Evw | EViews | 10 | Windows | 7 | 43 |
| **Office Suite** | | | | | | |
| | Wrd | Word | Office 365 (16.90) | macOS | 15 | 69 |
| | PPT | PowerPoint | Home and Student 2019 | Windows| 25 | 57 |
| | Exc | Excel | Office 365 (16.82) | macOS | 13 | 51 |
| **Operating System Commons** | | | | | | |
| | Win | Windows | 11 Professional | - | 47 | 34 |
| | mac | macOS | Sonoma 14.5 | - | 23 | 42 |
| | Lnx | Linux | Ubuntu 24.04 | - | 19 | 31 |

# Citation
```plain
@misc{screenspotpro,
author = {Kaixin Li and Ziyang Meng and Hongzhan Lin and Ziyang Luo and Yuchen Tian and Jing Ma and Zhiyong Huang and Tat-Seng Chua},
title = {ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use},
year = {2025},
note = {Preprint},
url = {https://likaixin2000.github.io/papers/ScreenSpot_Pro.pdf},
}
```