Gricea: An Open Science Platform for Conversational AI Research
Gricea packages conversational-AI studies as reusable artifacts and shows most papers omit replication details.
Gricea is an open-science platform that represents conversational AI studies as configurable, deployable artifacts combining study procedures, participant-facing systems, and task behavior. In a replication effort, configurations from 93 percent of eligible CUI 2026 papers were reproduced, while 96 percent of papers lacked information needed for faithful replication. A user study found researchers and practitioners from varied backgrounds could build runnable studies for open-ended questions.
- Gricea packages procedures, interfaces, and task behavior as runnable artifacts.
- Configurations from 93 percent of eligible CUI 2026 papers were replicated.
- Missing information in 96 percent of papers blocks faithful replication.
- Researchers built runnable studies for open-ended conversational-AI questions.
From the original article
1 min read at arxiv.orgWe need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse.
By Nikhil Sharma · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.