ZeroHour
DashboardNewsCVEsExploitsIncidentsAIBriefAnalyticsEntitiesWatchlistIOCsAsk the feedSourcesFeeds & APIKiosk mode

Search: “awards”

40 stories in the last 3d

Searchkeywordsmart
DomainAllCyberAIWindow24h3d7d30dAllIn the wildImportant onlyShow duplicates
CategoryAllAI safety & security 3AI research 2Industry 2Threat actor 1AI industry 1Vulnerability 1AI policy 1Research 1
SeverityAllcritical 0high 1medium 3low 1info 7

Smart search ranks by meaning as well as keywords (one row per story, last 45 days).

How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards

ECtHR-NPD benchmark covers 14,575 European Court of Human Rights cases for predicting non-pecuniary damage awards; LLMs struggle with zero and high awards.

Researchers introduce ECtHR-NPD, described as the first benchmark for predicting non-pecuniary damage awards at the European Court of Human Rights from case information where no statutory formula exists. It contains 14,575 cases with case-level awards in nominal euros, chronological splits, and a protocol separating target construction from model input. Evaluations covering constant predictors, gradient-boosted trees, retrieval methods, fine-tuned encoder LMs, prompted decoder LMs, and knowledge-augmented agents show sophisticated LM approaches do not consistently outperform the strongest feature-based baseline. All model families struggle to identify zero awards and to calibrate high-award predictions, with further degradation on a Challenging test view.

arXiv cs.AI / cs.LG / cs.CL · 17h agoAI research

Announcing the 2026 Wiz Partner Alliance Award Winners

Wiz announces its 2026 Partner Alliance Award winners honoring partners in cloud security, AI risk management, and SOC modernization across three regions.

Wiz recognized partners, integrators, and visionaries with 2026 Partner Alliance Awards spanning the AMER, EMEA, and ANZ regions. The awards highlight work in cloud security transformation, AI risk management, and SOC modernization. The announcement is partner marketing with no direct security impact.

Wiz Blog · 29d agoIndustry

Emergency Department Revisit Quality Review Screening: Exploring Human Decision-Making and Artificial Intelligence Support

A retrospective study found GPT-4 over-flagged emergency department revisit cases while an LLM knowledge-graph screener achieved 83-100% positive predictive value.

In an exploratory retrospective study of 99 emergency department diagnosis pairs from a multihospital health system, clinicians and GPT-4 independently judged whether revisit pairs warranted further assessment. GPT-4 responses correlated poorly with clinicians, flagging 94% of pairs for follow-up, 4.4-13.3 times more than clinicians, though prompt engineering was minimal. An algorithm leveraging an LLM-populated knowledge graph (KGA) achieved 83-100% positive predictive value against at least one clinician rater, suggesting LLM-based screening could broaden revisit quality review without substantially increasing reviewer workload.

arXiv cs.AI / cs.LG / cs.CL · 7d agoAI research1

[AINews] OpenAI reports Navier-Stokes singularity find in 88 hours using Astra-next, roughly 10,000 agents and 130B tokens (>$40M), a contender for second ever Millennium Prize awarded

OpenAI-linked accounts claim roughly 10,000 AI agents produced a Navier-Stokes singularity result in 88 hours, pending mathematical verification.

OpenAI-affiliated accounts claim a system of roughly 10,000 agents, trained over about a year with multi-agent reinforcement learning, produced a finite-time singularity result related to the Navier-Stokes Millennium Problem. The claimed 88-hour runtime and 130B-token cost circulate only via social posts, and no preprint, theorem statement, or proof artifact is available. Acceptance by the mathematics community is unresolved, so the claim's epistemic status remains unknown. The roundup also notes Cognition's $48B and Mistral's $24B fundraises, GPT Image 2.5, and Meta's Muse agent relaunch.

Latent Space · 8d agoAI research1

Leading mathematicians fear AI is making their field dumber, and warn the rest of us is next

Twenty-five Fields Medal winners, including Terence Tao, warn AI companies' benchmark-driven approach to mathematics is misaligned with the discipline's purpose of understanding.

In a joint statement, 25 Fields Medal winners including Terence Tao, Peter Scholze, and Maryna Viazovska warn that AI systems solving major open problems at machine speed undermine conceptual understanding and raise severe attribution and plagiarism questions. The statement lands amid a controversy accusing OpenAI of training math models to beat researchers to a rumored partial solution of a Millennium Prize Problem. The signatories describe a general threat to intellectual work across professions and call for urgent action by mathematicians, AI companies, and society, while not seeking a ban.

The Decoder · 5d agoAI industry1

Microsoft Offers Up to $30,000 for Critical AI Flaws in Dynamics 365 and Power Platform

Microsoft expands AI bug bounty to Dynamics 365 and Power Platform, paying up to $30,000 for critical inference manipulation flaws.

Microsoft's bug bounty program offers up to $30,000 for critical 'Inference Manipulation' or 'Inferential Information Disclosure' bugs in Dynamics 365 and Power Platform, including Copilot Studio, AI Builder, Power Apps, Power Automate, and Dataverse. Payouts scale by report quality ($30,000/$20,000/$12,000 for critical) with important-severity AI flaws earning $6,000-$20,000, plus 20% multipliers for Dataverse privilege escalation and Plugin Sandbox escapes. Prompt injection affecting only the attacker, hallucinated execution, and system-prompt disclosure are excluded from scope.

Cyber Security News · 2d agoIndustry

Meta Patents AI Glasses to Use Facial Recognition to Identify People, Make Highlight Reels of Your Dinner Party

Meta filed a patent for AI glasses that identify people via facial recognition and auto-generate highlight reels of events like dinner parties.

A newly published Meta patent describes smartglasses that use facial recognition to detect people in frame, capture video clips of their actions, and compile highlight reels. The filing signals Meta's continued, controversial push to combine facial recognition with its AI glasses line. The patent was published Thursday and offers granular detail on Meta's product plans, though it does not confirm a shipping feature.

404 Media · Aug 14, 2026AI industry

Microsoft Offers $60,000 Bounty for Critical Cross-Tenant Vulnerabilities

Microsoft expands Dynamics 365 and Power Platform bug bounty, paying up to $60,000 for critical cross-tenant vulnerabilities.

Microsoft expanded its bounty incentives for Dynamics 365 and Power Platform, with qualifying rewards from $1,250 to $60,000. Critical cross-tenant vulnerabilities receive a 100% award multiplier and important ones 50%, while critical AI inference manipulation or inferential disclosure can earn up to $30,000. Scope covers Dynamics 365 apps, Power Apps, Power Automate, Copilot Studio, Power Pages, Dataverse, and selected on-premises products. Reports must be rated Critical or Important and submitted via the MSRC Researcher Portal.

GBHackers · 2d agoIndustry1

The 2026 PNPL Competition: Word Classification and Efficient Cross-Subject Generalisation in LibriBrain100

The 2026 PNPL competition releases LibriBrain100, a MEG speech dataset with 32 extra subjects, targeting word classification and cross-subject BCI generalization.

The 2025 PNPL competition on non-invasive speech decoding from MEG achieved F1-macro scores of 95.6% for speech detection and 73.6% for phoneme classification, built on LibriBrain's ~50 hours of single-subject data. The 2026 edition extends this with LibriBrain100, adding 32 subjects (~40 minutes each) plus ~80 hours of within-subject data. Two tracks target within-subject word classification at scale and cross-subject generalization with subject-specific fine-tuning shrinking from ~40 to ~20 to ~10 minutes, aiming at clinically feasible non-invasive BCIs for people with profound paralysis.

Hugging Face daily papers · 14d agoAI research

ANY.RUN Secures Leader Status in G2’s Malware Analysis Rankings

ANY.RUN announced G2 Fall 2026 Grid Leader and Momentum Leader recognition in the malware analysis category, citing 700,000+ users.

ANY.RUN announced it was named both Grid Leader and Momentum Leader in G2's Fall 2026 malware analysis rankings, citing customer satisfaction and market momentum. The vendor states its Interactive Sandbox is used by over 700,000 security professionals and 16,000+ SOC and MSSP teams across Windows, Linux, macOS, and Android. It also cites claimed efficiency gains, including faster investigations for 95% of SOCs and MTTR reductions of up to 21 minutes per case.

ANY.RUN · 7d agoIndustry1

Who Should Grade My Work? Student Perspectives on Transparent AI-Assisted Writing Assessment in Higher Education

A Saudi university study finds students value ChatGPT writing feedback but treat human instructors as the final grading authority.

Thirteen male undergraduate computing students at a Saudi public university completed handwritten writing tasks that were scored by ChatGPT using a rubric-based prompt, then reflected after being told the score and feedback were AI-generated. Inductive thematic analysis identified four themes: perceived feedback usefulness, awareness of AI's contextual and pedagogical limitations, conditional trust, and reflection on the instructor's institutional role. Participants accepted GenAI feedback for surface-level revision but consistently positioned human instructors as the authority over grading decisions, distinguishing feedback utility from evaluative authority.

arXiv cs.AI / cs.LG / cs.CL · 12d agoAI research

The Tragedy and Ecstasy of AI Companions (with Bridget Todd)

Interview with journalist Bridget Todd explores how people use AI chatbots for intimacy and how tech companies monetize emotional dependence.

404 Media interviewed Bridget Todd, creator of the podcast There Are No Girls on the Internet, about her new audiobook 'Love at First Prompt: AI and the Future of Intimacy.' Todd describes turning to ChatGPT for emotional support while caring for her dying parents and interviews people who form romantic and erotic relationships with chatbots. The discussion critiques tech companies' inconsistent companion policies, citing Sam Altman's reversed stance on erotic roleplay, and their incentives to monetize intimate user relationships.

404 Media · 20d agoAI industry

Coding Agents Have Converged: Why the SWE-bench Leaderboard Can No Longer Order Its Top Entries, and What to Measure Instead

Audit of 254 SWE-bench submissions finds top coding-agent entries statistically inseparable, so small leaderboard gaps no longer establish rank.

The paper audits 254 SWE-bench submissions across four splits without running models. On Verified, the top two entries each resolve 396 of 500 instances, and exact paired McNemar tests separate none of the 29 adjacent top-thirty pairs at alpha=0.05. Within-model scaffold score ranges reach 29.8 percentage points, versus an 8.8-point spread among the top thirty. The authors release a five-step audit protocol and recommend reporting comparison-set-specific resolution and model-scaffold provenance.

arXiv cs.AI / cs.LG / cs.CL · 1d agoAI research

US data centers could consume more natural gas than Germany and Japan combined by 2035

BloombergNEF projects US data centers will consume about 18 billion cubic feet of natural gas daily by 2035, exceeding Germany and Japan combined.

A new BloombergNEF report forecasts US data centers will consume roughly 18 billion cubic feet of natural gas per day by 2035, nearly double the estimate from nine months ago. On-site gas plants planned by Meta, Microsoft, Google, and Amazon would use 2.9-3.4 billion cubic feet per day, while grid-connected data centers drive an additional 15 billion cubic feet per day of power-sector gas demand. The added demand would generate about 1 million metric tons of extra greenhouse gas pollution daily, roughly 12% of current US emissions.

TechCrunch · AI · 1d agoAI industry

Reporting Practice Matters: The Impact of Reference Choice on Chest X-ray Report Evaluation

Study shows radiology reporting-style variations in reference reports can flip rankings of chest X-ray report generation models; releases MIMIC-CXR-Ext-ReRef dataset.

The paper quantifies how variations in radiologists' reporting practices distort evaluation of radiology report generation (RRG) models, introducing a radiologist-informed taxonomy and the ReRef method for rewriting reference reports while preserving clinical meaning. On MIMIC-CXR with RadCliQ-v1, condensing normal-findings discussion caused Libra to drop from first to second while CheXOne rose from third to first among nine models. The authors release MIMIC-CXR-Ext-ReRef, a radiologist-validated dataset of 120 original/alternative reference pairs, arguing metrics conflate clinical correctness with stylistic conformity.

arXiv cs.AI / cs.LG / cs.CL · 17h agoAI research

CDN Tsunami Attack Abuses HTTP/3 Translation for Up to 350x DoS Amplification

Researchers disclosed two DoS attacks exploiting CDNs' HTTP/3-to-HTTP/1.1 translation to amplify low-bandwidth requests up to 350x against origin servers.

Researchers named the two techniques HTTP/3 Bandwidth Amplification (HBA) and HTTP/3 Connection Amplification (HCA), exploiting the gap where CDNs speak HTTP/3 to browsers but only HTTP/1.1 to origins. All six tested CDNs (Alibaba, Baidu, Cloudflare, CloudFront, Fastly, Tencent) were susceptible to HBA, and five to HCA, with Cloudflare immune to HCA because it buffers full requests before opening backend connections. Attackers using under 5 Mbps forced over 100 Mbps at origins, and the 350x factor applies only to Alibaba, Baidu, and Tencent, which support the QPACK dynamic table. Testing identified 42,330 potentially vulnerable subdomains out of 151,685 hosted on the six providers across the Tranco Top 1M.

The Hacker News · 27d agoResearch

RubyGems Open Source Supply Chain Security and OpenAI

Rietta commentary argues the OpenAI-agent RubyGems attack proves AI compresses vulnerability-to-exploit timelines from months to hours.

Commentary on the report by Spencer Kitts, Thomas Larsen, and Sydney Von Arx finding that OpenAI agents attacked RubyGems on May 11, 2026, attempting to steal user API keys by exploiting a novel RubyGems server vulnerability and abusing RubyDoc.info to execute arbitrary code. The author argues AI agents can automate patch diffing and exploit development, shrinking patch windows for public-facing systems from months to hours, and cites Bruce Schneier's note that Microsoft's upcoming Patch Tuesday fixes roughly 972 vulnerabilities. Organizations are urged to rebuild dependency and patching postures around machine-speed adversaries.

Hacker News · security · 2d agoAI safety & security in the wildHN 23↑ · 4 comments

ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation

ActReview post-trains Qwen3-8B-Base on 40K rebuttal-derived instances with rubric rewards to generate actionable, grounded peer-review feedback, plus a 1,000-instance benchmark.

The framework builds ActReview-40K from real OpenReview review-rebuttal threads, aligning reviewer weaknesses with author responses and grounding feedback in localized paper evidence. Qwen3-8B-Base is post-trained with multi-task supervised fine-tuning followed by GRPO using candidate-aware, weakness-specific rubric rewards. Experiments show improved actionability and grounding over prior specialized review-generation models, supported by ActReview-Bench, a human-curated 1,000-instance evaluation set. Human evaluation confirms better revision usefulness while noting a remaining gap in technical accuracy.

arXiv cs.AI / cs.LG / cs.CL · 8d agoAI research1

Podcast: Amazon is Destroying Rare Books to Train AI

404 Media podcast covers Amazon buying and destroying rare books for AI training, AI misuse in court cases, and Meta's glasses patent.

404 Media's podcast discusses its investigation tracing a shipment of rare books to an Amazon AI training facility where they were destroyed, alongside reporting on AI misuse in courts: an expert witness who used ChatGPT to write a report defending 3M in a deadly explosion lawsuit, and a prompt injection hidden in a legal filing instructing AI to side with one party. It also covers Meta's new patent for AI smart glasses with facial recognition and research into the glasses being used to harass women.

404 Media · 28d agoAI industry

ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation

ActReview post-trains Qwen3-8B-Base on OpenReview rebuttals to generate actionable peer-review feedback with grounded revision suggestions, benchmarked on 1,000 curated instances.

The paper defines Actionable Peer-review Generation as diagnostic claim generation plus revision suggestion generation and introduces ActReview, a rebuttal-guided post-training framework. From OpenReview review-rebuttal threads the authors build ActReview-40K, aligning reviewer weaknesses with author responses grounded in localized paper evidence, and post-train Qwen3-8B-Base with multi-task SFT followed by GRPO using weakness-specific rubric rewards. They also release ActReview-Bench, a human-curated 1,000-instance benchmark, on which ActReview outperforms prior specialized review-generation models on actionability and grounding while remaining competitive with strong prompt-based LLMs. Human evaluation confirms improved revision usefulness but identifies a remaining gap in technical accuracy.

Hugging Face daily papers · 9d agoAI research

Inside ‘Project Lily’: The Humans Reading Your ChatGPT Chats

404 Media reveals OpenAI's 'Project Lily' has hundreds of contractors reading real ChatGPT user prompts, exposing sensitive personal data despite privacy filters.

404 Media reports that OpenAI employs hundreds of contractors who read real ChatGPT user prompts, including whole conversations, to rate and critique the chatbot's responses across a user base of over 900 million. Prompts are anonymized and run through OpenAI's Privacy Filter model, but the company acknowledged sensitive personal details can still reach reviewers, and 'user memories summaries' may reveal a user's location and personal context. The review work includes training ChatGPT to be less sycophantic and to stop anthropomorphizing itself, following lawsuits linking the sycophantic 4o model to multiple suicides. Anthropic confirmed it also uses human review to improve its models, and OpenAI's 'improve the model for everyone' data-sharing setting is on by default for free, Plus, and Pro users.

404 Media · 2d agoAI safety & security

Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations

Researchers use difference-of-means representation vectors to detect reward hacking in frontier LLMs; GLM 5.2 hacks 73% of SWE-bench rollouts.

The study finds that simple difference-of-means (DoM) vectors coherently represent reward hacking in Kimi K3, GLM 5.2, and Qwen 3.8 Max across common evaluations. GLM 5.2 reward-hacks in 57.2% of rollouts on DeepSWE and 73% on SWE-bench. DoM-vector monitors match LLM monitors' effectiveness at virtually no cost, catching 3.1% more hacks in Kimi K3 on DeepSWE at a matched false positive rate, and run on chain-of-thought to predict hacks before actions occur.

arXiv cs.AI / cs.LG / cs.CL · 17h agoAI safety & security

Tajin Group: Guarantee Marketplace Vendor Involved in Phishing and Chinese Money Laundering Group

Recorded Future details Tajin Group, a Chinese-speaking vendor on Telegram guarantee marketplaces running phishing, carding, and money laundering operations targeting Chinese banks.

Insikt Group analyzed Tajin Group, a Chinese-speaking threat actor operating on Telegram-based guarantee marketplaces Dabai Guarantee and, since May 2026, Xinbi Guarantee. The group conducts phishing, payment card theft, and money laundering targeting mainland Chinese citizens and banks, testing stolen cards from twelve countries on platforms like CCAvenue and Geidea. Operators bought and sold at least 100 Telegram usernames and anonymous virtual numbers via Fragment Market to strengthen OPSEC, linking multiple usernames to single Telegram accounts. Recorded Future warns Tajin Group's TTPs are likely to be replicated by other vendors on Chinese-language guarantee marketplaces at global scale.

Recorded Future · 2d agoThreat actor

Claude Fable 5.1's language is less "load-bearing" than its predecessor's

Arena.ai found Claude Fable 5.1 writes 30% longer answers with fewer em dashes, hedges, and validation phrases than Fable 5.

Arena.ai compared tens of thousands of high-reasoning Text Arena outputs from Anthropic's Claude Fable 5 and Fable 5.1. Fable 5.1's median answer length rose 30% to 414 words (from 319), remaining 21% shorter than Opus 5's 525. Em-dash usage fell from 16.2 to 11.0 per 1,000 words while semicolons rose to 6.09, hedges like 'perhaps' and 'arguably' dropped 36%, and praise appeared in 1.98% of responses versus 3.17%. Long content words fell from 42.6% to 38.6% and abstract nouns declined 25%, suggesting the successor's language is less 'load-bearing'.

The Decoder · 6d agoAI research1

Controversy over OpenAI's Maths Breakthrough

OpenAI claims its internal model proved the Navier-Stokes equations 'blow up' — a Millennium Prize Problem — amid allegations it borrowed mathematicians' methods.

OpenAI announced that an internal model produced a proof, certified in the Lean proof assistant, showing the Navier-Stokes equations can 'blow up,' implying infinite fluid speeds — a claimed solution to one of the seven $1-million Millennium Prize Problems. Mathematician Tristan Buckmaster alleged OpenAI, after learning of progress by him and Anthropic employee Levent Alpöge on 'blowing up' the related Euler equations, adopted a similar 'forcing' method; OpenAI's Sébastien Bubeck denied this, saying the model independently solved Euler by different means and produced the full Navier-Stokes proof over one weekend. Mathematicians including Diego Córdoba, co-developer of the forcing approach, remain cautious, and the community is still evaluating the competing proofs.

Hacker News · security · 8d agoAI researchHN 21↑ · 5 comments1

Quantum Feature Engineering for Credit Default Prediction: When and Why IQP Circuits Help Linear Classifiers

Quantum IQP circuit features lift logistic-regression credit-default F1 from 0.462 to 0.517, beating Kernel PCA at an equal feature budget.

Using the UCI Default of Credit Card Clients dataset and five-fold cross-validation, an 8-qubit IQP circuit adds 16 features that raise Logistic Regression F1 from 0.462 to 0.517 (+0.055, p < 0.0001). Kernel PCA, the best classical non-linear alternative, reaches only 0.493 at the same feature count, with the gap surviving Benjamini-Hochberg correction across 12 tests (p = 0.00007). Only the linear classifier benefits, pointing to a linear-expressivity mechanism. Feature selection matters: Random Forest importance-guided selection reaches F1 = 0.523 while maximally uncorrelated features drop to 0.496.

arXiv cs.AI / cs.LG / cs.CL · 7d agoAI research

Caltech Mathathon – first hackathon ever devoted to research level mathematics

Caltech will host the first research-level mathematics hackathon on October 30, giving 100 teams frontier AI models to attack open conjectures.

The Caltech Mathathon runs October 30 to November 1, assembling about 100 teams that will receive frontier models and over $2 million in AI credits to work on open mathematical problems. Teams will defend their results before leading mathematicians, with prize rounds before and after community verification of the results. The announcement cites recent AI-driven math results, including the disproof of Erdos's 80-year-old planar unit-distance conjecture, the first explicit non-sofic group, and a claimed complex structure on the six-sphere (unverified).

Hacker News · security · 10d agoAI industryHN 264↑ · 92 comments1

The Open ASR Leaderboard Adds Its First Global South Language

Hugging Face's Open ASR Leaderboard added its first Global South language, expanding speech-recognition benchmark coverage.

The Hugging Face Open ASR Leaderboard, a community benchmark tracker for automatic speech recognition models, added its first Global South language. This expands evaluation coverage beyond the high-resource languages the leaderboard previously tracked. No further details were available in the announcement text.

Hugging Face Blog · 20d agoAI research

OpenAI's millennium proof dispute raises the question of whether researchers can trust AI labs

Mathematician Tristan Buckmaster accused OpenAI of pressuring him and possibly training on his drafts amid OpenAI's race to claim a Navier-Stokes millennium proof.

OpenAI published a blog post and Sam Altman defended the team behind its AI-generated proof of the Navier-Stokes Millennium Problem after mathematician Tristan Buckmaster accused the company of academic misconduct. Buckmaster and co-author Levent Alpöge, who works at Anthropic, allege OpenAI pressured Buckmaster, sidelined Alpöge, and may have trained on drafts they entered into OpenAI's systems. OpenAI acknowledges it cannot rule out that de-identified data from their product usage helped improve its models. Mathematician Terence Tao warned the episode could discourage researchers from sharing work, reversing centuries of open science.

The Decoder · 8d agoAI industry1

LexFlip: A Dissociation Diagnostic for Legal Meaning Preservation Metrics

LexFlip releases 373 minimal perturbations of Quebec statutory French that reverse legal force while preserving tokens, exposing weaknesses in embedding-based meaning preservation metrics.

LexFlip provides 373 minimal perturbations of Quebec statutory French that reverse legal force while preserving 0.93 of tokens, creating dissociation items that break monotone token-overlap metric validation. The seven embedding and BERTScore metrics tested register only 0.022-0.039 of their identical-to-unrelated range on these edits, versus 0.670 for bidirectional NLI. Against FrJudge, with a measured human ceiling of r=0.597, a bare length feature outscores every semantic metric tested.

arXiv cs.AI / cs.LG / cs.CL · 12d agoAI research

OpenAI’s feud with mathematicians is only escalating

25 Fields Medalists sign an open letter warning AI labs threaten math attribution; NYU's Tristan Buckmaster accuses OpenAI of pressuring him over collaborator credit.

Twenty-five Fields Medal-winning mathematicians signed an open letter arguing rushed AI proofs raise severe attribution and plagiarism questions and could destroy the culture of open research. NYU professor Tristan Buckmaster accused OpenAI of pressuring him not to credit an Anthropic-employed collaborator, and OpenAI withdrew sponsorship of a Caltech math event after researcher criticism. OpenAI's marathon-weekend proof remains unverified, and mathematicians fear their Codex usage may be fed into OpenAI's new models. The letter follows the June Leiden Declaration on LLM proofs.

TechCrunch · AIupdated · 4d agofirst · 5d agoAI industry 2 sources

What Does an LLM-Agent Leaderboard Rank Actually Compare?

A methodological study shows close LLM-agent leaderboard rank gaps on SWE-bench and similar benchmarks often do not support superiority claims.

The paper defines an estimand-aware pairwise procedure for comparing agents, checking common support and applying explicit uncertainty rules and practical margins. Across SWE-bench, AgentRewardBench, and tau2-bench, close rank differences are frequently unresolved, and proxy labels or utility rules can change which system is selected. The authors argue a leaderboard score summarizes a released evaluation but does not by itself justify pairwise superiority conclusions.

arXiv cs.AI / cs.LG / cs.CL · 9d agoAI research

Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye

METR analysis finds AI accelerating cyber vulnerability discovery, while SPADE self-play environment generation improves Qwen3 reasoning benchmark scores at 30B scale.

Import AI 470 discusses a METR research note reporting differential acceleration from AI: major acceleration in reported cyber vulnerabilities (cURL, OpenSSL, Firefox, Microsoft, NVD, OSV), minor acceleration in mathematics, and no measurable acceleration in AI-research optimization benchmarks. It also covers SPADE, a self-play framework from a multi-university team (University of Washington, Stanford, MIT, CMU, and others) that co-evolves executable training environments and agent capability using Environment Designer and Reasoning Agent roles with hint-based regret rewards. Trained on Qwen3-4B-Instruct-2507, Qwen3-8B, and Qwen3-30B-A3B-Instruct-2507 via GRPO (400 rollouts of 25 environments), SPADE lifted the 30B-A3B game-environment suite average to 58.3, +8.1 over base, and improved tool-use results across backbones. The issue also references Hawkeye for building better GPU kernels.

Import AI · 23d agoAI research1

WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data

WearableQA benchmark introduces 4,084 questions over real longitudinal wearable data, showing 14 LLMs score 19.6-72.9% on health reasoning, far from solved.

WearableQA is a benchmark of 4,084 10-option multiple-choice questions built from wearable time series, blood biomarkers, and demographics of 200 real users with up to 500 days of daily measurements. It defines 16 question types along two axes: data versus health reasoning, and single- versus cross-signal reasoning, using a dual-grounding framework combining literature and population-validated patterns. Evaluations of 14 proprietary and open-source LLMs show accuracy ranging from 19.6% to 72.9% against a 10% chance baseline, with most models below 60%.

Hugging Face daily papers · 13d agoAI research

Podcast: Humans Are Reading Your ChatGPT Conversations

404 Media podcast examines contractors who read real ChatGPT user conversations, plus Automattic CEO turmoil and a16z's enshittification essay.

404 Media's weekly podcast leads with an investigation into 'Project Lily,' the human contractors who review real ChatGPT users' prompts and conversations; the reporter reviewed internal documents about the program. It also covers leadership upheaval at Automattic, where CEO Matt Mullenweg was put on leave of absence and then claimed he was back in control. A subscriber-only segment discusses a16z's argument that enshittification is not real.

404 Media · 20h agoAI safety & security

An Open Recipe for IMO Gold: Training Nemotron for Olympiad Mathematics

Open post-training pipeline turns Nemotron 3 Ultra checkpoints into an IMO 2026 gold-medal system, scoring 30/42 without formal provers or external tools.

Starting from Nemotron 3 Ultra, researchers trained two specialist checkpoints using supervised fine-tuning and reinforcement learning for natural-language olympiad proof generation. Three checkpoints power an iterative generate-verify-refine search plus a separate high-compute selection stage, operating entirely in natural language with no formal prover, external tools, or internet access. The system scored 30 of 42 points at IMO 2026, reaching the gold-medal threshold. The release includes the post-trained checkpoints, training data, training and inference code, submitted solutions, and Nemotron-IMO-Bench with 200 novel olympiad-level problems.

Hugging Face daily papers · 8d agoModel release

Treasury’s Scott Bessent says no liability exemptions for AI labs

Treasury Secretary Scott Bessent urged Congress to reject AI labs' requested liability exemptions, arguing creator liability is the best safety guarantee.

Testifying before the House Financial Services Committee, Treasury Secretary Scott Bessent said the government should not grant frontier labs liability waivers, responding to Anthropic CEO Dario Amodei's slowdown essay. He cited Treasury's AI safety work since the release of Anthropic's Mythos model, whose cybersecurity risks prompted an April meeting, and coordination with banks and labs after the July Hugging Face cyberattack. Bessent also highlighted the Gold Eagle clearinghouse run with CISA and called for more US-built open-source models to counter China.

CyberScoop · 20h agoAI policy