Search: “music-generation”

Suno replaces its AI models with a new one trained on licensed music as copyright suits pile up

Suno launched its v6 model family trained on licensed music from Warner, BMG and Believe as copyright lawsuits from Sony and Universal continue.

Suno unveiled a new model family — Suno v6, experimental v6 wild, and faster v6 mini — trained on licensed data from Warner Music Group, BMG and Believe, and plans to retire older models. New capabilities include prompt-based song editing, use of text/images/video as references, and instrument separation, plus a planned opt-in artist remix program. Suno settled with Warner last year and BMG last month, but still faces suits from Sony, Universal Music Group and artists like Jason Isbell, and has raised over $819 million to date.

TechCrunch · AI·Sep 9, 12:05 UTC · 7d agoModel release

YuE2 · Frontier Music with Symbolic Planning

YuE2, a 3.59B-parameter music generation model, scores 6.9632 on SongBench, beating Suno v5 via symbolic planning.

YuE2 is a music generation model of roughly 3.59B parameters and 28 layers supporting song creation, covering, and agentic editing through editable ABC symbolic scores. Its best-of-8 setting reaches 6.9632 on SongBench, the highest mean among 15 evaluated settings on WildSongBench (192 prompts), ahead of Suno v5 at 6.8721. The project also introduces MERT2, whose 632M-parameter encoders achieve state of the art on 14 of 15 MARBLE metrics, and SheetSage2, which transcribes beats, downbeats, key, chords, structure, and melody with SOTA on 10 of 13 benchmark metrics.

Hacker News · AI·updated Sep 11, 03:35 UTC · 6d ago·first Sep 11, 00:33 UTC · 6d agoModel release 2 sourcesHN 43↑ · 35 comments

StepAudio 3 Music Technical Report

StepAudio 3 Music introduces long-form text-controlled music generation using ABC-notation planning and flow-matching diffusion, ranking near the top music arena.

StepAudio 3 Music generates long-form, text-controlled music using a 50-Hz single-codebook tokenizer with 65,536 entries and a flow-matching diffusion Transformer over VAE latents. A Mixture-of-Experts autoregressive model first plans an arrangement in ABC notation (ABC-CoT) before predicting music tokens. With DPO fine-tuning, it tops AudioBox content and production quality scores and reaches Quality Elo 1105 on the Artificial Analysis Music Arena, behind Suno V5.5 and Mureka. Generation covers songs, accompaniment from dry vocals, and cover synthesis up to 5 minutes 30 seconds at 48-kHz output.

Hugging Face daily papers·Sep 10, 20:00 UTC · 6d agoAI research

CMA-OT: Hierarchical Expert Supervision for Dance-to-Music Generation

CMA-OT aligns a music generator's latent features with hierarchical expert representations via curriculum learning and scale-aware optimal transport, improving dance-to-music quality.

CMA-OT introduces curriculum-guided multi-scale representation alignment with scale-aware optimal transport for dance-to-music generation. An external music expert provides hierarchical supervision over the generator's latent features, progressively transferring musical knowledge for stable representation learning. The optimal transport mechanism handles temporal mismatch and semantic variation across expert scales. Experiments on two datasets show state-of-the-art rhythmic synchronization, perceptual quality, and overall music generation.

arXiv cs.AI / cs.LG / cs.CL·Sep 11, 17:46 UTC · 5d agoAI research

StepAudio 3 Gen Technical Report

StepAudio 3 Gen unifies TTS, voice design, music, and sound effects via discrete autoregressive modeling over RVQ tokens.

StepAudio 3 Gen is a general-purpose audio generation model covering zero-shot TTS, voice design, vocal generation, sound effects, music, vibe speech, and mixed audio in one framework. It uses discrete autoregressive modeling over residual vector quantization (RVQ) tokens rather than the diffusion Transformer paradigm, with a StepAudio Tokenizer representing audio at 12.5 Hz in a shared 16x2048 residual code space. Key design principles include interference-aware progressive pretraining, an RVQ Adaptor for multi-codebook acoustic representations, and shared discrete autoregressive modeling. The model reports state-of-the-art performance on TTS and voice design while retaining strong generation across speech, vocals, sound effects, and music.

Hugging Face daily papers·Sep 10, 20:00 UTC · 6d agoAI research

Roland is getting into generative AI music with Melody Flip

Roland launched Melody Flip, a DAW plugin that generates genre-themed MIDI loops rather than complete songs like Suno or Udio.

Roland's Melody Flip is a DAW plug-in offering around 250 genre-based 'Palettes' for generating melodies, chord progressions, basslines, and drum patterns, either from scratch or derived from a reference track. Users can control genre, note density, BPM, and key but cannot use text prompts, and outputs are simple loops with General MIDI-style tones intended for MIDI export into a DAW. The launch follows well-received hardware releases like the SH-4d, Gaia 2, and TR-1000, though music-community sentiment toward generative AI may limit goodwill.

The Verge · AI·Sep 4, 17:51 UTC · 12d agoAI industry

m-a-p/YuE2-3B — new model trending #30 on Hugging Face

M-A-P released YuE2-3B, an open music generation model that outperforms Suno v5 on WildSongBench and runs locally on a 24GB GPU.

The M-A-P (multimodal-art-projection) team released YuE2-3B, an open-weights music generation model that turns lyrics and a style prompt into full songs with vocals and accompaniment. It uses an AR-NAR Mixture-of-Transformers backbone with symbolic planning and flow matching through a VAE, and supports editable scores (melody and chords, including ABC notation) plus agentic editing workflows. On 192 WildSongBench prompts it reports a SongBench average of 6.9632 (best-of-8) versus 6.8721 for Suno v5, claimed as state of the art among evaluated open and proprietary models. It runs 48 kHz stereo inference locally on a single 24GB NVIDIA GPU without quantization, with companion releases including YuE2-Vae, MERT-v2 encoders, the WildSongBench dataset, and SheetSage2.

Hugging Face trending models·Sep 9, 18:30 UTC · 7d agoModel release1

Adobe is trying to make its AI generators idiot-proof in Premiere

Adobe adds in-timeline generative media to Premiere, letting editors generate video and audio clips using Firefly, Veo, Runway, Luma, and Kling models.

Adobe's new Generative Media tool lets Premiere editors highlight empty gaps in the timeline and generate context-aware, editable video, sound effects, music, and soundscapes without leaving the project. Editors can choose among underlying models including Adobe Firefly, Google Veo, Runway, Luma, and Kling. Beta AI audio tools can separate overlapping speakers and duck music under speech, and an AI Assistant is coming to After Effects for plain-language project commands.

The Verge · AI·Sep 8, 13:00 UTC · 8d agoAI industry

TART: A Modular Tool for Technique-Aware Audio-to-Tablature Guitar Transcription

TART pipeline transcribes guitar audio to tablature with fingering and technique labels, outperforming prior baselines by up to 8.5 Tab F1 points.

TART is a modular four-stage pipeline for audio-to-tablature guitar transcription, combining an audio-to-MIDI transcription model, an expressive technique classifier, an audio-conditioned T5 encoder-decoder for string-fret assignment, and an automated tablature generator. In zero-shot evaluation on GuitarSet, EGDB, and two noisy augmented benchmarks, it averages 81.35% audio-to-MIDI F50 (+6.67 over the best baseline), 71.8% string-fret Tab F1 (+8.5), and 54.08% end-to-end Tab F1. The authors state it is the first framework to generate tablature with both fingering and expressive technique annotations directly from guitar audio.

arXiv cs.AI / cs.LG / cs.CL·Sep 10, 17:55 UTC · 6d agoAI research2

Suno releases its first AI music model made with record industry help

Suno released its v6 music model family (v6, v6-wild, v6-mini), the first trained with licensed data from Warner Music Group, BMG, and Believe.

Suno's v6 comes in three variants: v6, the more unpredictable v6-wild, and resource-light v6-mini offered free to all users. The model was trained from the ground up on a new dataset including licensed content from Warner Music Group, BMG, and Believe, plus user data, though it is unclear if all dubiously obtained content was excluded. v6 shows dramatically improved genre fidelity, adds plain-language chat editing of individual song elements, multi-element mashups, and prompts based on images, video, or audio. The Verge notes it still cannot produce intentional imperfections like off-key vocals, and v6 starts rolling out now with older models eventually retired.

The Verge · AI·Sep 9, 21:42 UTC · 7d agoModel release

Elevenlabs makes Music v2.5 available via app and API with free and pro tier options

ElevenLabs releases Music v2.5 via app and API, claiming fuller, more natural songs preferred over v2 in blind listening tests.

ElevenLabs launched Music v2.5 for ElevenMusic, reporting that listeners preferred it in a blind test across 47,885 comparison pairs, especially for R&B, Soul, Hip-Hop, Rock, and orchestral tracks. The free tier offers five lossless downloads per day and Pro includes 400 per month, with attribution required on free and commercial use restricted by industry. Tracks based on other artists' songs are blocked, and v2 remains available alongside the API. ElevenLabs says existing Music models were trained on 'licensed stems and music,' distinguishing it from competitor Suno, which faces lawsuits for training on copyrighted content; a Universal Music Group licensing deal covers only future separate products.

The Decoder·Sep 13, 13:40 UTC · 3d agoAI industry

A Vinyl Bar in Shibuya is a startup from a former Spotify leader for making music apps

Former Spotify innovation head raises $5.5M pre-seed for A Vinyl Bar in Shibuya, a startup building playful music-creation apps with selective generative AI features.

A Vinyl Bar in Shibuya, founded by former Spotify head of innovation Máuhan M Zonoozy, raised a $5.5M pre-seed round from Mantis VC, SV Angel, Boxgroup, Quiet Capital and others. The startup ships small music-play apps including Speed Surfer, Usersound, Stacks, Drops, Sampler, and the iOS mixer app bop, plus a new prompt-based sound creation feature. Zonoozy says the company deliberately avoids infusing AI into every product, arguing human taste and participation become more valuable as AI-generated content grows abundant.

TechCrunch · AI·Sep 14, 13:55 UTC · 2d agoAI industry 2 sources

Kaininja: Extending Native 3D Generators to the Part Level

KaiNinja extends TRELLIS.2 native 3D generation to part-level assets via a dual-volume O-Voxel representation, cutting whole-object Chamfer distance by 40%.

KaiNinja extends the TRELLIS.2 native 3D generator to produce part-level assets instead of one fused mesh, enabling downstream editing, rigging, and simulation. A dual-volume form of the O-Voxel representation solves the problem that a single volume cannot represent interfaces where two parts touch. The model needs no segmentation network, is partly trained on LLM-agent-authored part data, lowers whole-object Chamfer distance by 40%, and raises strict part F-score by 16% versus other part-generation pipelines.

Hugging Face daily papers·Sep 13, 20:00 UTC · 3d agoAI research

Universal Music is launching an AI music platform with ElevenLabs

Universal Music Group partners with ElevenLabs on a licensed AI music platform enabling fan-made remixes, with artists opting in.

Universal Music Group announced a multi-year licensing agreement with ElevenLabs to build an AI platform letting users create remixes, mashups, and new takes from UMG's licensed catalog. Artists can choose whether to participate, and the companies promise fair compensation; the platform will remain separate from ElevenLabs' Music API and ElevenMusic generator. UMG already runs an AI music project with Udio and has licensing deals with Spotify, Nvidia, and Klay.

The Verge · AI·Sep 10, 15:38 UTC · 6d agoAI industry

AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing

Open-source speech foundation model AuK unifies generation and editing, trained on 1.95 million hours, with distilled AuK-Flash achieving 4.5x speedup.

AuK is an open-source foundational model that unifies speech generation and editing through natural-language instructions and audio context, trained on approximately 3.03 billion instruction-audio instances and 1.95 million hours of supervision across five task families including generation, content editing, and acoustic editing. It combines a multimodal LLM for semantic conditioning, a VAE jointly trained on speech, general audio, and music, and a hybrid rectified-flow Transformer using dual-stream MMDiT blocks followed by unified single-stream DiT blocks. Post-training applies human-feedback preference optimization for editing and reward-based reinforcement learning for generation, and the distilled AuK-Flash performs 4-step inference without classifier-free guidance at a 4.5x wall-clock speedup. Source code and model weights are released.

Hugging Face daily papers·Sep 7, 20:00 UTC · 9d agoModel release2

LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows

LynnReal-Omni unifies controllable video generation tasks in a 32B multimodal diffusion transformer, with a 27B Flash variant rendering 540p clips in 377 ms.

LynnReal-Omni is a native multimodal video generation framework built on a 32B shared multimodal diffusion transformer unifying text-to-video, image-conditioned generation, reference guidance, structural control, editing, restoration and long-video generation, accepting heterogeneous inputs like 3D renders and game recordings for agentic visual workflows. A dedicated 27B Flash model enables real-time rendering, producing a 22-frame 540p video in 377 ms on one H100 versus 843 ms for the full model. The work introduces a curated multi-shot audiovisual data pipeline and MSAVP, a 100-prompt, 20-metric evaluation design covering instruction following, plausibility, visual quality, temporal behavior and audio coordination.

Hugging Face daily papers·Sep 13, 20:00 UTC · 3d agoAI research

Google Research Releases ToolGrad: Answer-First Framework Hits 99.8% Pass Rate for Tool-Use Data Generation

Google Research and partners introduce ToolGrad, a verified tool-chain-first data generation framework reaching 99.8% pass rate and boosting Gemma-3-12B to 83.1 on BFCL.

Researchers from Google, the University of Tokyo, RIKEN AIP, and Tohoku University released ToolGrad, which inverts query-first tool-use data generation by executing and verifying API chains before annotating them with user queries. On the ToolBench database of 16,000+ APIs, ToolGrad raised generation pass rate from 63.8% to 99.8% while increasing tool uses per sample from 2.1 to 3.4 and cutting tool-use steps from 34.3 to 20.0. Fine-tuning Gemma-3 at 1B, 4B, and 12B parameters on the 500-sample ToolGrad-500 dataset lifted ToolGrad-12B to 83.1 on the Berkeley Function Calling Leaderboard, near Gemini 2.5 Pro at 83.2 and ahead of GPT-5 at 74.4. Code is Apache-2.0, with the dataset, PyPI package, and models available on Hugging Face.

MarkTechPost·Sep 11, 06:01 UTC · 6d agoAI research1

AgenticGen: Reward-Guided Agentic Video Generation for Advertising

AgenticGen applies DPO and GRPO reward-guided reasoning to ad video generation, improving TikTok CTR 2.72%, CVR 2.63%, and Advv 9.61%.

AgenticGen decomposes advertising video generation into two trainable reasoning stages, strategy selection and draft generation, supervised by online business feedback. It learns a performance-based reward from accumulated online feedback plus a rubric-based reward aligned with human quality standards, then optimizes policies with DPO followed by GRPO using process and outcome rewards. Online A/B experiments in the TikTok advertising system show CTR up 2.72%, CVR up 2.63%, and Advv up 9.61% over an SFT baseline.

Hugging Face daily papers·Aug 30, 20:00 UTC · 17d agoAI research

Gradium Launches Voice Design: Write a Prompt, Get a Brand New Synthetic Voice in Seconds

Gradium, a Kyutai spinout, launched Voice Design, generating custom synthetic voices from text descriptions in seconds across five languages.

Gradium, a Paris-based voice AI company spun out of Kyutai, launched Voice Design, which generates new synthetic voices from 1-500 character text descriptions in seconds without needing reference audio or speaker consent. The feature is live in the Gradium API and Studio, free on every plan including the free tier, and kept voices run on the standard streaming TTS endpoint at the same latency as catalog voices. Vendor-run blind pairwise listening tests across 7,627 comparisons report a 72.6% win rate, 13.6 points ahead of ElevenLabs at 59.0%, placing first in all five tested languages, with the largest margins on regional accents such as Quebecois French (97%).

MarkTechPost·Sep 9, 07:29 UTC · 7d agoAI industry

Generative Marketing Mix Modeling: A Causal Inference Framework Linking GEO and GEM to Business Impact

Paper proposes Generative Marketing Mix Modeling to causally estimate Generative Engine Optimization and Marketing effects on business outcomes.

The authors develop GMMM, a causal inference framework for measuring how often users see and notice a firm's name in generated answers, which standard marketing data ignore. For GEO it combines repeated generated answers with question counts, shares of generative-system usage and notice probabilities; for GEM it uses sponsored placement records with notice probabilities. The framework compares expected business responses under alternative treatment sequences, establishes identification conditions, and is evaluated on simulated product-recommendation answers in English and Japanese.

arXiv cs.AI / cs.LG / cs.CL·Sep 10, 17:57 UTC · 6d agoAI research

Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech

Researchers distill a compact 82M-parameter Thai TTS from synthetic OmniVoice data, enabling on-device fixed-voice synthesis without reference audio.

The paper uses a large voice-cloning model (OmniVoice) as a synthetic data source to train Wayu-Paxa-TTS-Edge, an 82M-parameter fixed-voice Thai TTS student. The model achieves 68.2% Challenge-Set Keyword Accuracy (85.5% of Gemini 3.1), 91.4% pause precision, and CERs of 3.7% on Thai and 1.1% on English. It outperforms its teacher on pause placement and is open-sourced with its evaluation framework.

Hugging Face daily papers·Sep 2, 20:00 UTC · 14d agoAI research

Agentic Visual Generation: From Generative Models to Agentic Control

Researchers propose an L0-L4 control taxonomy for agentic visual generation, classifying controllers from fixed conditioning to experience-adaptive decision-making.

This paper proposes a taxonomy for agentic visual generation organized by what the controller can directly control in the generation process, rather than by planning depth, tool count, or model size. Levels range from L1 Conditioning Control through L2 Execution Control, L3 Outcome-Adaptive Control, and L4 Experience-Adaptive Control, with L0 Fixed Support denoting systems without a deployed decision-making controller. The framework is applied across image, video, editing, 3D, world, slide, and user-interface generation to map how controller capabilities and mechanisms have evolved across the field.

Hugging Face daily papers·Sep 5, 20:00 UTC · 11d agoAI research

A Deep Generative Model for Synthesizing Labeled Wireless Signals

Researchers propose IIns-GAN, a GAN that synthesizes realistic labeled ultra-wideband wireless signals, cutting dataset costs for wireless sensing training.

The paper introduces Inter-Instance Generative Adversarial Networks (IIns-GAN), a deep generative method that synthesizes realistic wireless signals with position-related labels to avoid costly real-world measurement and labeling. Unlike environment-model-based synthesis, the generated signals adapt to different environment scenarios and support training tasks such as distance estimation and environment identification. Experiments on public Ultra-Wideband (UWB) datasets show the synthetic signals closely mirror real measurements and improve model training performance.

arXiv cs.AI / cs.LG / cs.CL·Sep 4, 17:44 UTC · 12d agoAI research

Suno launches v6 music models built with Warner, BMG, and Believe

Suno launches v6, v6-wild, and free v6-mini music models co-developed with Warner Music Group, BMG, and Believe, retiring all older models.

Suno's flagship v6 serves Pro and Premier subscribers, v6-wild targets experimentation, and v6-mini is free; all three understand vocals, instrumentation, structure, mood, and multimodal inputs, with text-based editing of individual song sections. The models were built with Warner Music Group, BMG, and Believe following Warner's November 2025 licensing settlement, while Universal and Sony continue litigating and a Munich court found v3.5 and v4 infringed six works. Suno reports more than 100 million users, over two million paying subscribers, and $300 million ARR after raising $400 million at a $5.4 billion valuation in June.

The Decoder·Sep 9, 14:06 UTC · 7d agoModel release

OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning

OmniHarness learns symbolic policies for visual generation agents, reaching a 95.0% resolve rate on ComfyBench Creative tasks, 27.5 points above the strongest baseline.

OmniHarness abstracts verified executions into symbolic policies for visual generation task families, which are instantiated, adapted, and composed for new tasks while model parameters remain fixed. Intermediate verification guides refinement and failure recovery during execution, and self-directed inquiry generates practice tasks near capability limits before downstream objectives are specified. Experiments across six benchmarks, three MLLM backbones, and three visual agent frameworks show strong performance; on ComfyBench Creative tasks it achieves a 95.0% resolve rate, exceeding the strongest baseline by 27.5 percentage points. Frozen policy snapshots improve existing visual agent systems through plug-and-play reuse.

Hugging Face daily papers·Sep 12, 20:00 UTC · 4d agoAI research

Claude's new system prompt really doesn't want to reproduce song lyrics

Anthropic published updated Claude consumer system prompts, including changes steering the model away from reproducing song lyrics, likely over copyright concerns.

Anthropic publishes system prompts for Claude.ai and Claude mobile apps, including historic revisions, and has reorganized them into an index with per-model pages such as the Haiku 4.5 page showing the original October 15, 2025 prompt and an updated January 18, 2026 version. The latest consumer prompt strongly discourages reproducing song lyrics, a behavioral constraint likely tied to copyright considerations. Prompts for Claude Cowork and Claude Code are not included in the published set.

Simon Willison·Sep 2, 14:16 UTC · 14d agoAI safety & security1

When Vibe Hacking Turns AI into the Junior Hacker Every Adversary Always Wanted

The Hacker News·Aug 4, 11:30 UTC · Aug 4, 2026Vulnerability

Characterizing Language Generation in the Limit: Finite Witnesses and a Separation-Width Hierarch

New work characterizes language generation in the limit via finite witnesses, proves a full separation-width hierarchy, and formalizes all results in Lean.

The paper fully characterizes when language generation in the limit is possible for arbitrary families over a countable universe: each target must admit a finite positive witness such that targets activated by any finite sample share an infinite common intersection. It defines positive separation width and proves every level of the resulting hierarchy occurs, with countable families admitting singleton witnesses and unions of families with infinite common cores requiring unbounded finite witnesses. The characterization, a universal normalization, and a diagonal capture lemma are machine-checked in the Lean proof assistant, with the development maintained on GitHub.

arXiv cs.AI / cs.LG / cs.CL·Sep 9, 17:54 UTC · 7d agoAI research1

Reflection-aware Generative Novel View Synthesis

Ref-GeNVS is a training-free method for reflection-consistent generative novel view synthesis that treats mirror images as two complementary views.

An arXiv paper proposes Ref-GeNVS, a training-free approach to generative novel view synthesis in scenes containing mirrors. It estimates the mirror plane, reflects camera poses to create virtual views, and applies mirror-gated attention plus reflection injection within a multi-view diffusion model. On synthetic and real mirror scenes, Ref-GeNVS outperforms recent generative NVS methods while requiring no fine-tuning.

arXiv cs.AI / cs.LG / cs.CL·Sep 4, 17:33 UTC · 12d agoAI research