Gricea: An Open Science Platform for Conversational AI Research
Gricea packages conversational AI studies as runnable, shareable research artifacts, replicating 93% of eligible CUI 2026 paper configurations.
Gricea is an open-science platform that represents conversational AI studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. A replication study using Gricea reproduced configurations from 93% of eligible CUI 2026 papers while flagging that 96% of papers omit information needed for faithful replication. A follow-up user study showed researchers and practitioners from diverse backgrounds could successfully construct runnable studies addressing open-ended research questions.
- Open-science platform couples study procedures, participant-facing systems, and conversational task behavior
- Replicated 93% of eligible CUI 2026 paper configurations
- Found 96% of papers lacked information needed for faithful replication
- User study demonstrated construction of runnable studies for open-ended research questions
Full article148 words · extracted from huggingface.co · click to collapse
We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. Informed by a formative analysis of prior CAI research, Gricea couples study procedures, participant-facing systems, and conversational task behavior in. In a replication study using Gricea, we replicated configurations 93% of eligible CUI 2026 papers; while also flagging missing information in 96% of papers that hinder faithful replication --- further motivating Gricea's need. In a user study, researchers and practitioners from diverse backgrounds successfully constructed runnable studies addressing various open-ended research questions. Together, these findings demonstrate Gricea's support for constructing, reproducing, and extending CAI studies through shared research artifacts, enabling cumulative knowledge building through open science.
Text extracted automatically; images, tables and formatting may be missing. Original: https://huggingface.co/papers/2609.22039