ZeroHour

Search: “in-context learning”

3 stories in the last 3d

In-Context Robot Learning with VLM Agentsnew

GPT-Policy uses commercial VLM agents like GPT-6 Astra for in-context robot learning, translating demonstrations and feedback into verified robot actions without gradient updates.

The paper (arXiv 2609.19138) presents GPT-Policy, a framework combining a context compiler that preserves task-relevant visual transitions, a VLM such as GPT-6 Astra that proposes robot-tool actions, and a constrained controller that verifies and executes each action. Real-robot trials show human video demonstrations improve task completion even without robot action labels, while aligned action references yield further gains on contact-sensitive tasks. Evaluation covers success and efficiency metrics, matched model comparisons, and controlled context ablations.

Hugging Face daily papers · 1d agoAI research

Large Language Models Develop Belief State Geometry In-Context

Probing six open-source LLMs on HMM-generated data shows belief states are linearly decodable (R² 0.83–0.99), suggesting in-context learning approximates Bayesian prediction.

Researchers prompted six open-source LLMs with data from 40 hidden Markov models selected for non-trivial belief structure and probed residual-stream activations for belief states (posteriors over hidden states). Belief states were linearly decodable with peak R² values of 0.83–0.99 across HMM/LLM combinations, spanning early to late layers. Patching and steering the probe-identified subspace preserved downstream prediction quality while control interventions degraded performance substantially, establishing functional relevance. The results provide representation-level evidence that in-context learning approximates optimal Bayesian prediction over a context-inferred generative model.

arXiv cs.AI / cs.LG / cs.CL · 1d agoAI research1

LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence

LimiX-2, a tabular foundation model built on Contextual Mechanism Networks, outperforms existing tabular models on TabArena, TALENT, and BCCO.

Researchers introduced LimiX-2, a new model in the LimiX family that adopts the Contextual Mechanism Networks (CMNs) paradigm and is pretrained with Context-Conditional Masked Modeling (CCMM) on synthetic datasets generated by structural causal models. Unlike tabular PFNs centered on p(y | x, D_context), CMNs learn mechanism-oriented joint modeling of p(x, y | D_context). Evaluations on TabArena, TALENT, and BCCO show LimiX-2 outperforms current dataset-specific models and tabular foundation models. Its feature attention also encodes direct causal relationships, enabling accurate causal skeleton recovery.

Hugging Face daily papersupdated · 1d agofirst · 2d agoAI research 2 sources