Search: “perception”

8 stories in the last 7d

Realtime-Venus introduces two 9B full-duplex interaction models (Omni and Audio) that outperform Gemini 3.1 Live and GPT-4o on continuation metrics.

Realtime-Venus is a proactive full-duplex interaction system built on two separately trained 9B models: Realtime-Venus-Omni for audio-visual interaction and Realtime-Venus-Audio for spoken interaction. A dual-loop runtime lets foreground interaction continue while Realtime-Venus-Harness asynchronously executes background reasoning and tool tasks. Realtime-Venus-Omni leads on six of eight video benchmarks, including StreamingBench (70.2%), OVO-Bench (64.7%), and Daily-Omni (81.3%), while Realtime-Venus-Audio tops MMAU (78.0%) and MMAU-Pro (63.2%). On Full-Duplex-Bench v1.5, Realtime-Venus-Audio handles 75% of interruptions and exceeds Gemini 3.1 Live and GPT-4o on all three continuation metrics.

Hugging Face daily papersSep 11, 20:00 UTC · 5d agoAI research

MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education

Introduces MUSE, a twelve-task benchmark evaluating vision-language models on artistic image understanding in situated educational, Southeast Asian contexts.

MUSE is a benchmark assessing large vision-language models on artistic image understanding across twelve tasks spanning visual perception, semantic and affective interpretation, cultural understanding, and compositional reasoning. It decouples image annotation from question generation for controllable difficulty and curates images centering Singaporean and Southeast Asian multicultural contexts alongside Western art. Evaluations of open-source and proprietary models found substantial disparities, especially in affective interpretation and compositional reasoning.

arXiv cs.AI / cs.LG / cs.CLSep 16, 17:26 UTC · 18h agoAI research

Founder’s cost-cutting obsession drove Unitree lead in cheap humanoid robots

Report details Unitree founder Wang Xingxing's extreme cost-cutting and micromanagement driving cheap humanoid robots amid record core staff attrition.

Caijing Magazine reporting portrays Unitree founder Wang Xingxing as a micromanaging, cost-obsessed leader who personally approves expenses over 100 yuan (~$15) and runs a penalty-heavy incentive system at the 480-employee humanoid robot maker. Employees report the highest attrition of core staff in company history during 2025-2026, and Wang scored every senior executive 1 out of 1.5. The company, which recently IPO'd and explores large AI models for physical AI autonomy, called the reporting misinformation without specifics.

Ars Technica · AISep 14, 19:38 UTC · 2d agoAI industry

HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness

Researchers introduce HarnessVLN, a zero-shot training-free agent harness that sets new training-free SOTA on vision-language navigation benchmarks including R2R and HM3D.

HarnessVLN is a zero-shot, training-free framework for embodied vision-language navigation that coordinates perception, retrieval, grounding, navigation, recovery, and termination through a unified tool interface. It validates planner proposals against spatial evidence, geometric feasibility, and subgoal consistency, using hierarchical event memory and a persistent Spatiotemporal Graph that stores reusable spatial evidence and failure annotations. It reports success rates of 60.8% on R2R, 53.9% on RxR, 76.0% on HM3D-v2, and 59.3% on HM3D-OVON, surpassing prior training-free state of the art, with real-world humanoid deployment demonstrated.

Hugging Face daily papersSep 13, 20:00 UTC · 3d agoAI research

AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video

AlayaVista is a camera-controllable streaming video world model that decouples panoramic scene evolution from perspective synthesis, trained on a 1,318-hour 4K dataset.

AlayaVista builds a 360-degree scene prior from a single perspective image, evolves it as a camera-conditioned panoramic latent state, and maps it to perspective video via a latent viewport renderer plus a perspective refiner. Chunk-autoregressive generation and few-step distillation enable efficient streaming. The authors introduce MUGEN, a real-world panoramic video dataset with 1,318 hours of at-least-4K video and rich semantic and geometric annotations.

Hugging Face daily papersSep 12, 20:00 UTC · 4d agoAI research

StepAudio 3 Realtime Technical Report

StepAudio 3 Realtime debuts an audio-language model with Think-While-Speaking reasoning, delivering full-duplex voice dialogue with top benchmark results.

StepAudio 3 Realtime is an audio-language foundation model built around a continuous listen-converse-think-act loop for real-time spoken interaction. Think-While-Speaking runs private reasoning in parallel with speech, reaching a 73.0 macro average on StepAudioChat in reasoning mode. The model reports 90.6 on MMSU, 98.9 overall on the Artificial Analysis Full-Duplex Bench, and 56.0% macro task success on tau-Voice. An integrated Voice Agent handles asynchronous tool execution without disrupting dialogue flow.

Hugging Face daily papersSep 11, 20:00 UTC · 5d agoAI research

Jensen Huang explains why Nvidia will grow an astounding 70% next year

Nvidia CEO Jensen Huang reiterated at a Goldman Sachs conference that revenue could grow 70% year-over-year next year, reaching roughly $680 billion.

Speaking at the Goldman Sachs Communicopia + Technology conference, Huang reaffirmed guidance of about 70% revenue growth next year, implying roughly $680 billion after an expected ~$400 billion this fiscal year. He cited the Grace-Blackwell system (36 Grace CPUs with 72 Blackwell GPUs) experiencing 27% month-over-month order growth and claimed $100 billion in revenue-generating contracts at companies Nvidia invests in. Huang argued Nvidia underpins models from OpenAI, Anthropic, and Google and tracks global data center capacity, while dismissing concerns about circular deals and competition from hyperscalers, Cerebras, and Etched.

TechCrunch · AISep 10, 21:51 UTC · 6d agoAI industry

Physical AI Takes the Wheel: How the World’s Robotaxi Leaders Are Building With NVIDIA Technologies

NVIDIA details a three-computer robotaxi platform that Uber, Lyft, May Mobility, Mercedes-Benz and others are adopting to scale autonomous fleets.

NVIDIA says every major commercial robotaxi program runs on its stack, spanning training (DGX with Alpamayo VLA models), simulation and validation (Omniverse, Cosmos, AlpaSim on RTX PRO), and in-vehicle compute (DRIVE Hyperion 10 with dual DRIVE AGX Thor chips). Adding meta-action and chain-of-thought reasoning data to a VLA model reduced minimum average displacement error by 43%, from 2.08 to 1.18. Uber plans NVIDIA DRIVE Hyperion-based fleets across 28 cities by 2028, partnering with Autobrains, Avride, Lucid, May Mobility, Mercedes-Benz, Momenta, Nissan, Nuro, Pony.ai, Stellantis, Waabi, Wayve, WeRide and Zoox. DRIVE Hyperion 10 combines 14 cameras, nine radars, three lidars and 12 ultrasonics with redundant compute and NVIDIA Halos safety validation.

NVIDIA BlogSep 10, 16:00 UTC · 6d agoAI industry