GUIAuditor: Enabling Post-hoc Child Safety Forensics via Action-Guided GUI Provenance on Mobile Devices
GUIAuditor uses an on-device model to record mobile GUI activity for later guardian safety review.
Researchers present GUIAuditor, a mobile system that records GUI provenance so a guardian can later review a child's interactions. A multimodal large language model turns GUI events into a narrative, while evidence distillation cuts data requiring analysis by more than 89.2 percent versus periodic sampling. On 295 clips it reached 95.23 percent macro-F1 for significant events and returned the correct evidence first for over 90.20 percent of questions. Tests on three smartphones added about 2.1 watts, 7.4 seconds of per-event latency, and roughly 3.1 GB peak memory.
- GUIAuditor creates queryable GUI provenance from a child's mobile interactions.
- Distillation reduces analyzed data by more than 89.2 percent versus periodic sampling.
- It reached 95.23 percent macro-F1 and over 90.20 percent top-result retrieval.
- On-device inference added about 2.1W, 7.4 seconds, and 3.1GB peak memory.
From the original article
1 min read at arxiv.orgThe proliferation of smart devices exposes children to online risks like grooming and financial scams that are deeply embedded within legitimate applications. Current approaches rely on automated prevention and detection, a paradigm that is fundamentally limited by its inherent fallibility. Whether rule-based or AI-driven, they inevitably produce false positives and negatives, failing to provide reliable protection.
By Junlin Liu · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.