In this project, participants will be asked to annotate images and text. They will need to provide the action type, text to be entered, and action phase. They will also be required to draw a bounding box on the screenshot where the text will be entered. The maximum number of tasks to be collected for each app is 10.
To collect high-quality annotated data that captures typical user interactions within a specified iOS app. This will help improve AI understanding of app usage patterns.