Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights
SportSAGE uses a semantic action graph schema to ground agent-generated sports highlights and let viewers query, navigate, and verify narratives.
The semantic action graph represents a sports match as performer, action, recipient, moment, and state nodes connected by role, temporal, and outcome edges, with a closed vocabulary and frame-addressable moments. Instantiated in SportSAGE, a design probe pairing a four-module agentic highlight pipeline with a graph interface, it was evaluated with 12 soccer fans. Participants were satisfied with generated highlight quality and used the interface to search, navigate, and interpret match highlights, suggesting one small human-readable schema can ground both agent generation and human interpretation.
- Closed-vocabulary graph with frame-addressable moments supports verification
- Pairs four-module agentic highlight pipeline with queryable interface
- Evaluated via feedback from 12 soccer fans
- Same schema serves agent grounding and human interpretation
- Products
- SportSAGE
From the original article
1 min read at arxiv.orgGenerative agents are increasingly used to select and narrate video highlights, but they typically operate over unstructured or frame-level representations. Their output is consequently difficult for a viewer to verify and steer toward individual preferences.
By Tica Lin · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.