Search: “interactive-art”

Smart search ranks by meaning as well as keywords (one row per story, last 45 days).

Diffusion TV: Experiencing Diffusion Models through Tangible, Embodied Interaction

Researchers present Diffusion TV, a CRT-based installation where antenna manipulation lets audiences physically experience diffusion model denoising.

Diffusion TV is an interactive installation built around a modified CRT television where turning the antenna controls the clarity of AI-generated images and sounds, mirroring the denoising process of diffusion models. Three channels present AI-generated animals from the past, present, and future within a temporal and ecological narrative. The authors frame the work as an embodied, non-verbal alternative to explainable AI that highlights intermediate generative states rather than final outputs.

arXiv cs.AI / cs.LG / cs.CL·Sep 4, 17:51 UTC · 12d agoAI research

12

MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education

Introduces MUSE, a twelve-task benchmark evaluating vision-language models on artistic image understanding in situated educational, Southeast Asian contexts.

MUSE is a benchmark assessing large vision-language models on artistic image understanding across twelve tasks spanning visual perception, semantic and affective interpretation, cultural understanding, and compositional reasoning. It decouples image annotation from question generation for controllable difficulty and curates images centering Singaporean and Southeast Asian multicultural contexts alongside Western art. Evaluations of open-source and proprietary models found substantial disparities, especially in affective interpretation and compositional reasoning.

arXiv cs.AI / cs.LG / cs.CL·Sep 16, 17:26 UTC · 14h agoAI research

20

ChatGPT Sketch turns your bad drawings into detailed AI images

OpenAI launched ChatGPT Images 2.5 with a Sketch feature that turns user doodles into images, plus 50% lower latency.

OpenAI released ChatGPT Images 2.5 and a new Sketch feature, activated by typing @Sketch, that lets users draw doodles inside ChatGPT and use them as image generation prompts. The update claims more natural lighting, richer textures, better multi-turn instruction following, and up to 50% latency reduction versus Images 2.0. Users can also leave inline comments on parts of an image to request specific edits. It is available for ChatGPT, ChatGPT Work, and Codex users on desktop, mobile, and web.

The Verge · AI·Sep 8, 20:16 UTC · 8d agoAI industry1

30

Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation

Vidu S2 delivers real-time 720p interactive avatar generation plus real-time video editing with style, clothing, character, and background replacement.

Vidu S2 comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. S2-Avatar supports real-time 720p generation, dynamic references updatable at any moment, and stronger instruction following such as dancing, while S2-Editing performs real-time style rendering, clothing replacement, character replacement, and background replacement. The work also explores real-time spatial video generation for both models, reports outperforming all baselines, and offers a playable online demo at vidu.com.

Hugging Face daily papers·Sep 9, 20:00 UTC · 7d agoModel release

40

DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination

DeCAL, a contact-aware dexterous vision-language-action model with visuo-tactile fusion, reports 71% average task success.

DeCAL is a physically-grounded dexterous vision-language-action (VLA) model built on a Mixture-of-Transformers architecture with specialized experts for understanding, imagination, and action generation. It introduces Adaptive Visuo-Tactile Fusion with contact-aware gating and Visuo-Tactile Latent Co-Imagination to jointly model visual and tactile dynamics. It reports state-of-the-art results with a 71% average success rate and 83.4% progress success rate, plus generalization to unseen scenarios.

arXiv cs.AI / cs.LG / cs.CL·Sep 8, 17:47 UTC · 8d agoAI research1

30

Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers

Hugging Face details building and using multi-vector late-interaction embedding models with Sentence Transformers for retrieval workloads.

Hugging Face published a guide on multi-vector, late-interaction embedding models (ColBERT-style) supported through Sentence Transformers. The post covers how practitioners can build and use these models for retrieval and RAG pipelines. It is a developer tooling and technique write-up, not a security advisory.

Hugging Face Blog·Aug 18, 00:00 UTC · Aug 18, 2026AI tools & infra1

42

Agentic Visual Generation: From Generative Models to Agentic Control

Researchers propose an L0-L4 control taxonomy for agentic visual generation, classifying controllers from fixed conditioning to experience-adaptive decision-making.

This paper proposes a taxonomy for agentic visual generation organized by what the controller can directly control in the generation process, rather than by planning depth, tool count, or model size. Levels range from L1 Conditioning Control through L2 Execution Control, L3 Outcome-Adaptive Control, and L4 Experience-Adaptive Control, with L0 Fixed Support denoting systems without a deployed decision-making controller. The framework is applied across image, video, editing, 3D, world, slide, and user-interface generation to map how controller capabilities and mechanisms have evolved across the field.

Hugging Face daily papers·Sep 5, 20:00 UTC · 11d agoAI research

22

Affora: A Design System for Agent-Friendly Interfaces

Affora is a design system making interfaces legible to computer-use agents while preserving human workflows, with reusable components and executable checks.

Affora supports both human users and computer-use agents through a shared interface rather than a separate agent-only surface. Three controlled studies cover component implementations, visual variation, and interaction-design principles, producing guidance from individual components to complete sites with reusable implementations and executable checks. Evaluation on independently authored interfaces shows gains where agent-readability deficits exist, limited effects where they do not, and a workflow case gives preliminary evidence of reduced interaction cost.

arXiv cs.AI / cs.LG / cs.CL·Sep 16, 17:46 UTC · 14h agoAI research

20

LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows

LynnReal-Omni unifies controllable video generation tasks in a 32B multimodal diffusion transformer, with a 27B Flash variant rendering 540p clips in 377 ms.

LynnReal-Omni is a native multimodal video generation framework built on a 32B shared multimodal diffusion transformer unifying text-to-video, image-conditioned generation, reference guidance, structural control, editing, restoration and long-video generation, accepting heterogeneous inputs like 3D renders and game recordings for agentic visual workflows. A dedicated 27B Flash model enables real-time rendering, producing a 22-frame 540p video in 377 ms on one H100 versus 843 ms for the full model. The work introduces a curated multi-shot audiovisual data pipeline and MSAVP, a 100-prompt, 20-metric evaluation design covering instruction following, plausibility, visual quality, temporal behavior and audio coordination.

Hugging Face daily papers·Sep 13, 20:00 UTC · 3d agoAI research

28

What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies

Researchers diagnose conditional visual grounding failures in visuomotor imitation policies and show targeted interventions substantially improve distractor robustness.

The paper studies why ACT-based visuomotor imitation policies fail when visually similar distractor objects or receptacles are introduced, finding sensitivity depends on both distractor type and manipulation stage. Interventions including distractor augmentation, phase-dependent attention regularization, and appearance-based visual prompting improve target selection while preserving spatial control information, with gains in simulation and on a physical UR3e. The same failure pattern is confirmed in a pretrained vision-language-action policy on a state-conditioned medical instrument-handling task.

arXiv cs.AI / cs.LG / cs.CL·Sep 4, 17:27 UTC · 12d agoAI research

18

Training a coding model to paint watercolours with TRL and OpenEnv

Hugging Face tutorial trains a coding model with TRL and OpenEnv to paint watercolours through generated code.

A Hugging Face blog walkthrough uses the TRL reinforcement learning library and the OpenEnv environment framework to train a coding model. The target task is generating code that produces watercolour-style drawings, serving as a hands-on reinforcement learning training example. No article body was available in the feed, so specifics are limited to the title.

Hugging Face Blog·Sep 3, 00:00 UTC · 14d agoAI tools & infra1

18

Pocket's AI made my game ideas real. Now Meta controls the results.

A hands-on review finds Pocket's AI turns game ideas into interactive mobile apps, but sharing stays locked inside Meta's platform.

Ars Technica tested Pocket's AI, which converts prompts for game concepts into interactive mobile "gizmos" that run on Meta's platform. The review concludes these creations are easy to make but hard to share outside Meta's ecosystem, giving Meta control over distribution and results.

Ars Technica · AI·Aug 31, 10:00 UTC · 16d agoAI industry

20

OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning

OmniHarness learns symbolic policies for visual generation agents, reaching a 95.0% resolve rate on ComfyBench Creative tasks, 27.5 points above the strongest baseline.

OmniHarness abstracts verified executions into symbolic policies for visual generation task families, which are instantiated, adapted, and composed for new tasks while model parameters remain fixed. Intermediate verification guides refinement and failure recovery during execution, and self-directed inquiry generates practice tasks near capability limits before downstream objectives are specified. Experiments across six benchmarks, three MLLM backbones, and three visual agent frameworks show strong performance; on ComfyBench Creative tasks it achieves a 95.0% resolve rate, exceeding the strongest baseline by 27.5 percentage points. Frozen policy snapshots improve existing visual agent systems through plug-and-play reuse.

Hugging Face daily papers·Sep 12, 20:00 UTC · 4d agoAI research

33

Enabling Creative Exploration for Vibe Design Agents

Separating design-direction exploration from code generation via structured specifications broadens UI alternatives without destabilizing output.

The paper proposes an inference architecture for vibe design agents that makes design direction an explicit intermediate decision: a Verbalized Sampling-inspired pre-pass proposes structured design specifications with typicality scores, an external selector samples one, and a downstream generator realizes it under fixed settings. Across 168 prompts with 1,255 paired comparisons per temperature, theme sampling broadens selection coverage and screenshot variation, with LLM-judge preferences varying across interventions and prompt complexity. An online experiment with over 300,000 tasks found the code-export increase statistically uncertain, though negative feedback events decreased alongside modest operational costs.

Hugging Face daily papers·Sep 13, 20:00 UTC · 3d agoAI research

28

Adobe is trying to make its AI generators idiot-proof in Premiere

Adobe adds in-timeline generative media to Premiere, letting editors generate video and audio clips using Firefly, Veo, Runway, Luma, and Kling models.

Adobe's new Generative Media tool lets Premiere editors highlight empty gaps in the timeline and generate context-aware, editable video, sound effects, music, and soundscapes without leaving the project. Editors can choose among underlying models including Adobe Firefly, Google Veo, Runway, Luma, and Kling. Beta AI audio tools can separate overlapping speakers and duck music under speech, and an AI Assistant is coming to After Effects for plain-language project commands.

The Verge · AI·Sep 8, 13:00 UTC · 8d agoAI industry

22

SenseNova-U1.5: Towards Native Unified Visual Intelligence

SenseTime releases SenseNova-U1.5, an 8B-MoT encoder-free multimodal model unifying visual understanding, reasoning, and generation with native 4K resolution.

SenseNova-U1.5 is an 8B mixture-of-transformers multimodal model with an encoder-free, VAE-free architecture that understands, reasons about, and generates visual content at native resolutions up to 4K. Post-training optimizes specialized experts for visual aesthetics, bilingual text rendering, infographic generation, and image editing, consolidated through multi-expert on-policy distillation. Evaluations report gains in image fidelity, text rendering, multi-reference editing, and instruction following. The team plans to open-source training code including supervised fine-tuning, reinforcement learning, and on-policy distillation.

Hugging Face daily papers·Sep 9, 20:00 UTC · 7d agoModel release

48

.blend URL Viewer

Simon Willison demos a .blend URL viewer built with GPT-6 Astra in Codex and ChatGPT Images 2.5 generating Blender models.

Simon Willison used ChatGPT Images 2.5 to generate a Faberge egg concept image themed after the TV show Pluribus, then had Codex running GPT-6 Astra (high) execute a Blender local skill to build a 3D model from it. He published the result as a .blend URL viewer tool and continues experimenting with agentic Blender workflows. The post is a hands-on demo of AI-driven creative tooling rather than a security or release announcement.

Simon Willison·Sep 9, 23:58 UTC · 7d agoAI tools & infra

15

Subtlefakes: Slightly Altered Nonconsensual AI Images Are Taking Over X

404 Media documents 'subtlefakes' — near-realistic AI-edited nonconsensual celebrity images on X spread by engagement-farming accounts, including images of actor Xochitl Gomez.

The article describes a rising trend of 'subtlefakes': AI-generated or lightly edited images of celebrities made more revealing or provocative without nudity, posted by verified engagement-farming accounts that earn revenue from X's impressions-based payouts. Actor Xochitl Gomez shared side-by-side comparisons showing real parking-lot and red-carpet photos altered into suggestive poses. The author argues these images are hard to detect and moderate because they avoid nudity, bypassing guardrails in mainstream generators, and notes some were made with X's own Grok.

404 Media·Aug 20, 13:34 UTC · 27d agoAI safety & security1

22

One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing

Researchers introduce EditVid, a training-free video editing framework scoring 78.16 FiVE-Acc versus 58.95 for the strongest comparable baseline.

EditVid is a unified training-free framework for diverse instruction-guided and subject-guided video editing. It combines sparse causal memory for local coherence, correspondence-based post-attention token injection for long-range identity preservation, and soft latent blending for edit locality. On the FiVE benchmark it reaches 78.16 FiVE-Acc against 58.95 for the strongest evaluated training-free baseline, with competitive results on IVEBench. A user study showed 51.8% overall preference for EditVid over 7 competing methods.

Hugging Face daily papers·Sep 2, 20:00 UTC · 14d agoAI research

38

Cocomelon's Studio Tells Its Artists to Start Experimenting With AI

Moonbug Entertainment, studio behind Cocomelon and Blippi, issued generative AI guidelines requiring human authorship and legal review of all AI use.

Moonbug Entertainment, producer of Cocomelon, Little Baby Bum, Blippi, and Mia's Magic Playground, shared its 'Studio AI Bible' and generative AI policy with 404 Media. The guidelines permit AI for ideation, storyboarding, and utility tasks but require substantial human creative input on core elements, legal approval of every tool, and a 'provenance and isolation' filing system to preserve copyright. A spokesperson said generative AI is not currently used in aired episodes. Moonbug content has hundreds of millions of YouTube subscribers, with Cocomelon spinoffs on Netflix, a Universal movie in development, and a Disney+ move planned next year.

404 Media·Aug 27, 15:33 UTC · 20d agoAI industry

22

Show HN: LLM Attention Visualization

A developer released a browser-based tool that visualizes which past tokens influence each LLM output token using aggregated, value-weighted attention scores.

A Show HN project presents a React application built on Transformers.js that renders per-token attention influence by aggregating attention weights scaled by value-vector magnitudes across all attention heads and layers. To expose internal tensors, the author instrumented the ONNX computation graph, hosted a modified model on Hugging Face, and pre-generated prompts to avoid long model downloads in the browser. Demos with a 600-million-parameter model show how verbatim copying draws heavily on source tokens and how single outputs blend information from multiple phrases.

Hacker News · AI·Sep 8, 16:59 UTC · 8d agoAI tools & infraHN 41↑ · 9 comments

28

Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control

Zing-0.5 is a released 5B autoregressive world model enabling real-time keyboard and text control at 24 FPS for roughly $0.009 per stream-minute.

Zing-0.5 is a 5B autoregressive world model designed for playability, combining magnitude-aware keyboard inputs with temporally aligned text instructions in jointly annotated videos. It uses event-scale supervision via distribution-matching distillation from a segment-level teacher and four-step generation with context-preserving streaming for real-time 832x480 inference at 24 FPS. The model scores 81.0 overall and 88.5 consistency across 158 WBench Navigation cases, and the weights, inference code, and Zing-SGLang serving implementation are publicly released.

Hugging Face daily papers·Sep 14, 20:00 UTC · 2d agoModel release

46

Instagram’s AI detection is a mess (again)

Instagram is mislabeling ordinary edited photos as AI Content while some AI imagery goes unlabeled, repeating a 2024 detection failure.

The Verge documents weeks of erroneous AI Content labels on Instagram, including images edited only with Canva's Background Remover or an iPhone Photos app, while some generative images escape tagging. Canva said some of its assistive AI tools were being tagged as generative and claims the issue is fixed, though users still report tagging. Meta scans IPTC and C2PA metadata and uses signals like Google's SynthID, but remains vague about detection criteria; one tester found only Meta AI-created or edited images reliably triggered labels, and an image-poisoned photo was tagged. A similar mislabeling wave hit Instagram in 2024.

The Verge · AI·Sep 4, 12:00 UTC · 12d agoAI industry

35

Studying Image Tokenizers as Visual Languages in Unified Multimodal Models

A controlled pure-autoregressive testbed shows task-specific validation losses rank image tokenizers differently, with I2T loss the most consistent signal.

Researchers built a controlled pure-autoregressive testbed and tracked task-specific validation losses during multimodal continual pretraining across text, image, text-to-image (T2I), and image-to-text (I2T) prediction. They find losses should be analyzed per task because they exhibit distinct scaling behavior and rank tokenizers differently, and that the loss-performance relationship depends on the predicted token space. I2T loss, computed over a shared text vocabulary, correlates consistently with both generation and visual understanding performance after supervised finetuning. Case studies revisit the discriminator, semantic supervision, and vocabulary size as tokenizer design axes.

arXiv cs.AI / cs.LG / cs.CL·Sep 8, 17:57 UTC · 8d agoAI research1

30

BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender

Blender-VideoBench evaluates agentic video understanding by having agents programmatically reconstruct real videos in Blender scenes.

BVB (Blender-VideoBench) tests whether multimodal agents truly understand videos by requiring programmatic reconstruction of real-world videos as animated Blender scenes via a lightweight Mini-BVB harness under identical sandbox and cost constraints. Evaluation uses Dual VQA for spatiotemporal fact preservation and Latent Similarity for perceptual match, combined in a square-root mean overall score. Across 51 configurations from 10 model families, the best model reaches 88.6 Latent Similarity but retains only 53.7% of source-correct spatiotemporal answers, showing semantic retention remains the main challenge.

Hugging Face daily papers·Sep 13, 20:00 UTC · 3d agoAI research

30

Sure, Meta’s AI Muse works, but it sure creeps me out

Hands-on review finds Meta's Muse AI agent completes shopping and email tasks but surfaces personal Instagram API data beyond user-visible ad-topic settings.

Meta launched Muse, its first agentic AI productivity assistant, which performs tasks like shopping, email management, trip planning, media generation, and creating webpages or documents via a cloud-based virtual computer. The Verge's hands-on found it successfully deleted thousands of promotional emails and completed an Amazon purchase, but it also revealed detailed personal interests inferred from Instagram and Facebook account API data that is not visible in the apps' ad-topic settings. Meta says Muse only exchanges data needed for third-party integrations and does not share information with advertisers; the reviewer frames privacy unease as the main adoption hurdle.

The Verge · AI·updated 07:28 UTC · 48m ago·first Sep 10, 15:00 UTC · 6d agoAI industry 12 sources

78

MOONWALK: Mediating Operations with Intent-Evidence-Action Alignment Across Junior-Supervisor Review Workflows in Animation/VFX Pre-Production

MOONWALK introduces an intent-evidence-action alignment workflow for animation/VFX reviews where AI handles administrative coordination while artists keep creative authority.

MOONWALK is a pre-production review system that articulates creative intent into a shared project record, anchors review judgments to grounded evidence, and converts authorized decisions into concrete revision tasks. AI components handle administrative coordination such as flagging missing context and organizing notes, not creative direction. An in-studio study against a chat-only AI interface showed stronger intent alignment, decision traceability, and checklist executability.

arXiv cs.AI / cs.LG / cs.CL·Sep 9, 16:10 UTC · 7d agoAI research

15

Learning 3D Editing without Paired Supervision via Generative Prior Distillation

New framework distills 2D editing and VLM priors into a feed-forward 3D editing model without paired 3D training data.

The method, PriorEdit3D, learns feed-forward instruction-guided 3D editing by distilling knowledge from foundation models instead of using ground-truth 3D pairs. Through a differentiable rendering pipeline it supervises a 2D visual prior from an image editing model at the main view and a Vision-Language Model semantic prior at novel views for instruction fidelity and identity preservation. A 3D-aware Distribution Matching regularization constrains outputs to the manifold of realistic 3D assets defined by a pretrained image-to-3D teacher. Experiments report superior instruction fidelity and cross-view consistency over state-of-the-art baselines, with code released on GitHub.

Hugging Face daily papers·Sep 3, 20:00 UTC · 13d agoAI research

30

Mi-Ripple: Restoring Images Degraded by Iterative AI Editing

Mi-Ripple is a diagnosis-guided restoration workflow that removes digital ripple artifacts introduced by iterative AI image editing while preserving structure.

Iterative reference-conditioned image editing can introduce grid-like and granular textures known as digital ripple. Mi-Ripple separates periodic lattice artifacts from content-entangled granular texture, then applies selective spectral notching, structure-aware smoothing, and cleaned-reference regeneration. In fourteen notch-only executions, whole-image residual standard deviation was 0.08-0.44 in CIELAB lightness units, and reference cleaning reduced output debris density by 45% in a paired example.

Hugging Face daily papers·Sep 9, 20:00 UTC · 7d agoAI research

25

ActionSplice: In-Flight Action Editing for Interactive World Models

ActionSplice enables in-flight action editing in chunk-autoregressive video world models via a lightweight corrector, avoiding rollback or waiting for the next chunk.

ActionSplice is an inference framework that formulates in-flight action editing for chunk-autoregressive video world models as Counterfactual State Transport (CST), where a lightweight corrector transports the interrupted backbone-native representation toward the matched state induced by the revised action. The world model and sampler remain frozen, and sampling resumes without replaying completed evaluations. Across minWM-Wan Action2V and HY-WM1.5, the retargeting variant CST-R reduces rollback-relative LPIPS by 61.5% and 75.9% versus direct condition swapping, while the temporal-splicing variant CST-T reduces suffix LPIPS by 56.1% and 77.5% with 2.73x and 1.69x pixel-ready speedups over waiting.

Hugging Face daily papers·Sep 7, 20:00 UTC · 9d agoAI research

22