Distinguishing GUI Component States for Blind Users using Large Language Models

# Data Code Repository This repository contains open-source data code that provides utilities for the paper named "Here comes trouble! Distinguishing GUI Component States for Blind Users using Large Language Models". The code is designed to facilitate data-related tasks and promote reproducibility in research and data analysis projects. ## Features - Attribute identification and extraction: Including real-time recognition and extraction of GUI components in the view type, resource-id, color, action of four attributes - Components State Distinction: Provides the prompt needed for large language models, covering their specific design schemes and chain of thought reasoning processes as well as contextual learning content. - Implementation: Offers specific methods to realize the process, including the setting of relevant parameters and the use of functions. ## Installation To use the data code, you can down or clone the required code. Notably, before using the code, make sure the necessary environment configuration is done. ## Dependencies The data code has the following dependencies: Python (version 3.6 or higher) NumPy Pandas Seaborn Scikit-learn Openai Android Studio (version 4.0) Install the required dependencies using pip: pip install numpy.. ##License This data code is distributed under the MIT License. See LICENSE for more information. ##Copyright All copyright of the tool is owned by the author of the paper.