macpaw-research/GUIrilla-Trees

---
license: cc-by-nc-4.0
---
# GUIrilla-Trees

[](https://arxiv.org/abs/2510.16051)

## Description

**GUIrilla MacApp Trees** is a large-scale dataset of hierarchical, accessibility-driven representations of macOS applications.

Each tree captures UI states and user interactions across full-desktop environments, providing a structured view of how applications evolve under user actions. Built using the macOS Accessibility API, these trees encode both the semantic structure of UI elements and their transitions over time.

This dataset serves as a reusable structural abstraction of desktop GUI behavior and can be used for:
- UI understanding and structured representation learning
- Retrieval and search over application states
- Automated UI testing and analysis
- Training and evaluation of desktop agents

Unlike screenshot-only datasets, GUIrilla-Trees exposes the underlying accessibility hierarchy, enabling more precise and semantically grounded modeling of user interfaces.

---
## License
**CC-BY-NC-4.0** (see `LICENSE`).
## Citation
```
@article{garkot2025guirilla,
title={GUIrilla: A Scalable Framework for Automated Desktop UI Exploration},
author={Garkot, Sofiya and Shamrai, Maksym and Synytsia, Ivan and Hirna, Mariya},
journal={arXiv preprint arXiv:2510.16051},
year={2025},
url={https://arxiv.org/abs/2510.16051}
}
```