Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents
EvoSkill-GUI introduces training-free skill revision for GUI agents, boosting MobileWorld, AndroidWorld, and OSWorld success by up to 16.2%.
EvoSkill-GUI is a training-free framework in which each GUI-agent skill is a structured multi-file package containing retrieval metadata, executable plans, backup localization, failure-recovery rules, and failure cases. A reflect-revise-reuse loop lets the executor make in-rollout revisions while an isolated critic diagnoses failed trajectories under strict information isolation. On MobileWorld, AndroidWorld, and OSWorld it improves multiple base models by up to +16.2%, +6.0%, and +10.5% respectively, with evolved skill libraries transferring to related tasks. Code is released on GitHub.
30