When Agents See Differently: Exposing UI Desynchronization Threats in Mobile Agents
Researchers expose 'human-agent UI desynchronization' attacks where repackaged APKs invisibly mislead mobile AI agents into attacker-chosen actions.
The paper introduces human-agent UI desynchronization: agents ingest digital screenshots and accessibility metadata that reveal content human users cannot perceive due to occlusion and luminance-contrast limits. An automated framework embeds perturbations into repackaged APK clones that steer mobile agents toward attacker-designated actions without access to runtime user instructions or online adaptation. Evaluations across five mobile-agent frameworks and three backbone models on 546 tasks achieved average misleading rates of 77.9% and 66.9%. A questionnaire study with 186 participants found the visual perturbations difficult for humans to notice.
- Same UI state presents materially different information to human users versus agents via screenshots and accessibility metadata.
- Automated framework constructs instruction-agnostic desynchronization attacks realized in deployable, repackaged APKs.
- Achieved 77.9% average misleading rate across five agent frameworks and 66.9% across three backbone models.
- 186-participant study shows attack perturbations are hard for human users to detect.
Full article250 words · extracted from arxiv.org · click to collapse
Mobile agents are increasingly capable of autonomously interacting with mobile applications and performing consequential actions on behalf of users. Effective human oversight of such agents relies on a basic premise: users and agents observe consistent information from the same interface. We show that this premise can be systematically violated. Users perceive mobile interfaces through physical displays and the human visual system, making their observations subject to occlusion and luminance contrast limitations. In contrast, agents consume digital screenshots that may retain such content and accessibility representations that expose nonvisual widget metadata. The same UI state can therefore present materially different information to users and agents, a mismatch we term human-agent UI desynchronization. We investigate whether a repackaged clone of a legitimate APK can exploit this desynchronization to steer an agent toward attacker-designated actions, while remaining fully functional and behaviorally consistent with the original application for human users. We demonstrate that this threat is feasible: perturbations embedded before deployment can induce such deviations without access to runtime user instructions, agent detection or online adaptation. To systematically expose and evaluate this threat, we develop an automated framework that constructs user runtime instruction-agnostic UI desynchronization attacks and realizes them in deployable APKs. We conduct static and dynamic evaluations across five mobile-agent frameworks and three backbone models on 546 tasks involving various applications, achieving average misleading rates of 77.9% and 66.9%, respectively. A complementary questionnaire-based study with 186 participants finds that the visual perturbations used in our attacks are difficult for human users to notice.
Text extracted automatically; images, tables and formatting may be missing. Original: https://arxiv.org/abs/2609.16732