ZeroHour
DashboardNewsCVEsExploitsIncidentsAIBriefAnalyticsEntitiesWatchlistIOCsAsk the feedSourcesFeeds & APIKiosk mode

Search: “inference”

48 stories

Searchkeywordsmart Sortlatesthotimportancerelevance
DomainAllCyberAIWindow24h3d7d30dAllIn the wildImportant onlyShow duplicates
CategoryAllVulnerability 202AI research 102AI tools & infra 96Policy & legal 90Exploit / PoC 85AI safety & security 69Malware 66Research 66Data breach 52AI industry 49Model release 46Threat actor 41Ransomware 39Phishing & fraud 36
SeverityAllcritical 253high 116medium 188low 162info 370

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

NVIDIA Blog · 17h agoAI industry 2 sources

Architecting memory and storage in the AI era

Analysis argues AI inference shifts data-center bottlenecks to memory and storage, urging balanced compute, memory, storage, and network architecture over raw compute.

MIT Technology Review, citing Tirias Research principal analyst Jim McGregor, argues that AI inference and agentic workloads make data movement the key constraint, elevating memory and storage from background hardware to strategic assets. The piece says RAG and real-time inference require continuous data retrieval and caching that legacy infrastructure cannot support. It frames infrastructure planning as a business decision balancing performance, efficiency, cost, and scalability in healthcare, finance, and customer-facing AI.

MIT Technology Review · AI · 12d agoAI industry

Sparks Fly: NVIDIA Accelerates Local AI at IFA 2026

NVIDIA announces local AI push at IFA 2026 with faster llama.cpp/vLLM inference, PAIR routing tool, and October RTX Spark PCs.

At IFA 2026, NVIDIA announced simplified local AI support for agents in Hermes Agent, OpenClaw, and Perplexity Portable Computer, plus new llama.cpp and vLLM optimizations delivering up to 1.9x faster local inference. NVIDIA also unveiled PAIR, a Personal AI Router for distributing inference across a local network's PCs, and compact RTX Spark Windows PCs from Lenovo and Acer arriving in October. The post recaps recent local-capable model releases including Nemotron 3.5 Lightning (30B), Qwen3.8-Flash-Next and Qwen3.8-27B, DeepSeek v4 Flash (284B MoE, 13B active), Meta Muse Glimmer (30B), Z.ai GLM-5.3-Flash, LTX 2.5, and MiniMax-H3 with the FastH3 distilled variant.

NVIDIA Blog · 13d agoAI industry

[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6

OpenAI unveiled Jalapeno custom inference chip claiming 1.5-1.9x better perf-per-watt than NVIDIA GB200/GB300, deploying in-house by year-end.

At the 37th Hot Chips conference, OpenAI published first benchmark details for its custom Jalapeno inference chip, claiming 1.5-1.9x more work per watt, 1.7-3.6x lower end-to-end latency, and 2.1-4.1x higher interactive-workload performance versus NVIDIA GB200/GB300, with the 700W-rated part staying at or below 550W in tests. Deployment into OpenAI's own infrastructure begins by year-end, with Gen 2 deep in development and Gen 3 underway. OpenAI also said GPT-Astra and Codex helped write low-level kernels, reportedly 1.5-1.8x faster than human-expert code for selected attention and MoE blocks. Cerebras CS-5, Groq 3 LPX and Apple M6 were also featured at the conference.

Latent Space · 21d agoAI industry

Jalapeño’s first results show industry-leading speed and efficiency in AI inference

OpenAI's Jalapeño custom inference chip shows faster, more power-efficient inference with higher throughput and lower latency.

OpenAI announced first results for Jalapeño, its custom AI inference chip. The company claims industry-leading speed and efficiency, delivering higher throughput and lower latency for modern models compared with existing options. The chip targets more power-efficient serving of large models at scale.

OpenAI News · 23d agoAI industry

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog · 1d agoAI industry

[AINews] 10% worse, 100x cheaper, 10000x faster: Why Simulation is taking over

Latent Space argues AI training pipeline stages—rewards, data, teachers, curricula, environments—are flipping from human-made to model-made simulation.

Latent Space's AINews essay traces how each component of AI training has turned synthetic since 2022: reward models (InstructGPT, RLAIF), synthetic pretraining data (Microsoft Phi, NVIDIA Nemotron-4 340B), model teachers (Alpaca, DeepSeek-R1 distillation), and self-generated curricula (Self-Rewarding Language Models, SPIN). In 2026 it highlights Karpathy's autoresearch loop—700 experiments yielding 20 kept improvements, cutting GPT-2 training time from 2.02 to 1.80 hours—and Z.ai's GLM-5.3 fully synthetic RL environment, judging, and verification stack. It frames these shifts as 'simulation': 10% worse but 100x cheaper and 10,000x faster than human equivalents.

Latent Space · 26d agoAI industry

AWS is using Qualcomm for AI inference while Qualcomm uses AWS Bedrock to design the chips

Qualcomm will design custom AI inference chips for AWS while using Bedrock for chip design, its third major data center win since June.

Qualcomm is designing custom AI inference chips for AWS across multiple product generations and co-developing optical interconnects with up to 1.6 Tbps bandwidth. In return, Qualcomm uses Amazon Bedrock to accelerate its chip design process. The deal is Qualcomm's third major data center win since June, after Meta adopted the Dragonfly C1000 server processor and Microsoft began deploying Qualcomm's HBC memory architecture in Azure; Qualcomm targets $15 billion in data center revenue by 2029.

The Decoder · 7d agoAI industry1

Opaque recurrence, and other AI terms that you should probably know

TechCrunch updates its plain-English glossary defining common AI terms from AGI and agents to chain-of-thought reasoning.

TechCrunch maintains a regularly updated glossary of AI terminology, defining terms such as AGI, AI agents, API endpoints, chain of thought, coding agents, compute, deep learning, and diffusion. It highlights 'opaque recurrence', the reasoning technique in OpenAI's new Astra model that has drawn attention from AI safety researchers. The piece is an educational living document rather than new research or a product announcement.

TechCrunch · AI · 9d agoAI industry1

[AINews] Fal’s H3 Max Live breaks the infinite videogen barrier

Fal post-trained MiniMax H3 into a 'Max' variant with 35x-faster inference, enabling faster-than-realtime AI video generation and infinite streams.

Fal post-trained MiniMax's H3 model into a 'Max' variant and optimized it for its in-house inference engine, achieving roughly 35x the speed of the official endpoint. The optimization enables faster-than-realtime video generation, demonstrated by an infinite interactive AI-generated stream productized by levels.io. The roundup also notes Meta Muse Code's general availability with an SDK, open DeepSeek-V4-Flash-Vision-Exp weights, GLM-5.3-Flash's strong agentic cost/performance rankings, and Tencent's 770B-parameter Hy4 Preview MoE with 49B active parameters.

Latent Space · 16d agoAI industry

With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents

NVIDIA puts Groq 3 LPX into full production and extends Vera Rubin NVL72 rack-scale systems for fast token generation in agentic AI inference.

NVIDIA announced that Groq 3 LPX is in full production as part of an extension of the Vera Rubin NVL72 rack-scale platform aimed at agentic AI inference. The announcement frames the next era of inference as full-stack AI factory co-design across chips, networking, and systems rather than a single component breakthrough. The focus is improving token generation speed for agent workloads.

NVIDIA Blog · 23d agoAI industry

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)new

Latent Space AI news roundup: Steve Yegge shuts down Gas Town, Databricks reports 60% higher coding spend on GPT-6 Astra, OpenAI launches misalignment disclosure framework.

Latent Space's AI News digest for September 15-16, 2026 leads with Steve Yegge shutting down his Gas Town orchestrator despite spending thousands monthly on coding-agent subscriptions. Databricks rolled out GPT-6 Astra to roughly 3,500 engineers, reporting superior long-horizon performance over Opus 5 and Sol 5.6 but a ~60% increase in coding spend. OpenAI published a formal framework for disclosing model misalignment incidents with six case reports, while Microsoft and Google Research released safety papers on 'capability laundering' and the Fuse motive-inference benchmark. Xiaomi shared live RL training telemetry for MiMo-V2.6, estimated at $493k/day for the 1T-class Pro run.

Latent Space · 34m agoAI industry 12 sources

Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama

Opinion piece urges migrating 35KB preprompts from Anthropic/OpenAI to self-hosted Ollama, citing session privacy risks and safety filters blocking security research.

The author documents gotchas migrating 35KB preprompts from Claude Opus to self-hosted Ollama, motivated by fears that frontier providers train on user sessions, citing the OpenAI Navier-Stokes controversy. The piece argues inference providers cannot audit their own retention or training pipelines and that only self-hosted hardware offers verifiable privacy. It also criticizes frontier safety filters for refusing vulnerability research tasks and calls for models that support exploitability testing in CI/CD pipelines.

Hacker News · AI · 2d agoAI industryHN 41↑ · 13 comments1

Tell HN: OpenAI brings back 5 hour limit for plus and business standard users

OpenAI reinstated a 5-hour usage limit for Plus and Business Standard subscribers, sparking Hacker News debate about subsidized inference pricing and subscription value.

A Hacker News discussion reports that OpenAI has brought back a 5-hour usage limit for Plus and Business Standard users. Commenters debated whether cheap tokens are a subsidized customer acquisition strategy, whether AI companies have sustainable margins on inference, and how switching costs between providers affect dependency. The thread reflects community sentiment on pricing and usage caps rather than an official policy announcement.

Hacker News · security · 9d agoAI industryHN 126↑ · 142 comments

[AINews] Andrew Ng gets into AI Engineering

Andrew Ng relaunches DeepLearning.AI around AI Engineering, defining four core skills from an analysis of 10,000+ job postings and expert interviews.

Andrew Ng, cofounder of Google Brain and Coursera, relaunched DeepLearning.AI with a focus on AI Engineering, basing the curriculum direction on an analysis of over 10,000 job postings plus interviews and surveys. He identifies four key skills: building and deploying AI applications, software engineering fundamentals, effective use of coding agents, and shaping the build with product sense. The Latent Space AI News issue also recaps agent ecosystem developments, including NVIDIA's 'Skill Lift' evaluation proposal showing skill scan scores correlate only weakly (Spearman rho = 0.14) with judged quality, and Konwinski's open-source persistent-agent 'microharness' Headlong, which achieved an unattended self-debugging repair in 48 minutes.

Latent Space · 23d agoAI industry1

[AINews] OpenAI shuts off Cursor

OpenAI cut off API access to coding tool Cursor after its SpaceX acquisition, citing contract violations by Elon Musk's companies.

OpenAI disabled Cursor's access following the closing of Cursor's acquisition by SpaceX, citing its experience with Elon Musk's companies violating contracts; Cursor responded that OpenAI accounts for only 5% of its traffic. The weekly digest also covers major open-weight releases: Z.ai's GLM-5.3 (744B total/40B active, 1M context) and Tencent's Hy4-preview (770B/49B, ~#5 on Code Arena WebDev), plus Alibaba's Qwen3.8-Flash (125B/6B). vLLM published benchmarks showing no universal winner among speculative decoding methods across model families.

Latent Space · 19d agoAI industry1

Product showcase: AI Paper Trail shows the privacy cost of talking to AI

Proton launched AI Paper Trail, a free tool that analyzes ChatGPT or Claude exports and reports what personal data can be inferred from AI conversations.

Proton released AI Paper Trail, a free web tool that analyzes the 200 most recent prompts from exported ChatGPT or Claude conversation histories and generates a privacy report with an AI Exposure Score, inferred personal data categories, and an estimated advertising value. In a hands-on test it identified 47 data points, returned a 58/100 exposure score, estimated $185 in advertising value, and flagged five red flags spanning location, interests, finances, and relationships. Proton states that uploaded data is deleted after analysis and is not stored on its Lumo servers.

Help Net Security · 24d agoAI industry

Teaching Everyone to Fish for Tokens

Analysis argues open-source AI now depends heavily on Nvidia's financing, with a reported $26 billion bet shaping the open-weights ecosystem's future.

An Interconnects essay examines whether the open-source model recipe, exemplified by Ai2's Olmo and Nvidia's Nemotron releases, can become economically self-sustaining. It reports Nvidia is spending roughly $26 billion on near-open-source models to drive demand for its chips, and argues the open ecosystem faces an existential financing window over the next few years. The author predicts open models may fork toward efficiency, specialization, and on-prem enterprise agents rather than competing head-on with closed frontier labs.

Interconnects · Aug 17, 2026AI industry

OpenAI’s GPT-5.6 Sol runs up to 14× faster with Ultrafast mode

OpenAI launched GPT-5.6 Sol Ultrafast mode in limited preview, running up to 14x faster at 750 tokens per second via Cerebras inference.

OpenAI's GPT-5.6 Sol Ultrafast mode is available in limited preview through the OpenAI API, delivering up to 14x faster processing and up to 750 output tokens per second, powered by Cerebras under the companies' ultra-low-latency inference partnership. Preview customers are testing it in production for coding, commerce, financial research, and support applications. OpenAI is also using Ultrafast internally for incident response tasks such as log analysis and trace review, and for research workflows with multiple same-day experiment iterations.

Help Net Security · Aug 14, 2026AI industry

Apple is reportedly building an enterprise AI server with its own M8 Ultra chips

Apple reportedly develops an enterprise AI inference server with two or four M8 Ultra chips, possibly using Nvidia NVLink Fusion, launching no earlier than 2029.

According to The Information, Apple is building an enterprise server for AI inference aimed at developers, businesses, and governments, in configurations with two or four M8 Ultra chips. Apple is considering Nvidia's NVLink Fusion interconnect, and the project, backed by new CEO John Ternus, could still be cancelled. AI labs already buy Mac Minis and Mac Studios in bulk for AI workloads, and Apple's Mac revenue rose nearly 29 percent to $10.4 billion last quarter.

The Decoderupdated · 10h agofirst · 13h agoAI industry 3 sources

Coding Is Over. Get over It

A JPMorgan Chase engineer reflects on AI agents outpacing hand-coding, questioning ROI while predicting inference costs will become negligible.

A personal essay by a software engineer with 15+ years at JPMorgan Chase describes how AI coding agents now outperform him and have transformed his workflow. He argues AI ROI is unmeasurable, praises cheap small models such as GPT 5.6 Luna, and cites Claude Code head Boris Cherny's advice to discard AGENTS.md/Claude.md rule files. He contends coding is no longer scarce, worries entry-level jobs will be automated first, and predicts AI's bigger impact lies outside coding.

Hacker News · security · 4d agoAI industryHN 20↑ · 26 comments2

[AINews] Poolside gets $12B reverse-execuhire to NVIDIA; founders stay for $1B, employees go for $6B, Infraco scaling to 7GW neocloud

NVIDIA struck a $12B deal with AI coding startup Poolside, licensing its Model Factory and hiring 109 of its technical employees.

NVIDIA spent roughly $12B in an unusual reverse-execuhire of Poolside, licensing the company's Model Factory while hiring 109 of its ~115 technical staff; founders retain a $1B stake and employees receive about $6B. Poolside had raced to raise $2B to fund a 40,000 GB300 cluster after missing a six-week funding window, and founders argue frontier-scale training now requires an order of magnitude more compute plus contracted data center space. An infrastructure arm spun out in January 2026 is scaling toward 7GW as a neocloud. The newsletter also recaps OpenAI and Anthropic agent-platform releases.

Latent Space · 27d agoAI industry

University of Manchester Uses NVIDIA Earth-2 to Forecast Air Pollution Across the UK

University of Manchester retrained NVIDIA Earth-2 CorrDiff and StormCast on Isambard-AI to forecast UK air pollution at 2-3 km resolution.

University of Manchester researchers led by professor David Topping adapted NVIDIA's Earth-2 generative AI frameworks to forecast air pollution across the UK. Earth-2 CorrDiff was retrained in two days on a single eight-GPU node of Isambard-AI (5,448 GH200 Grace Hopper Superchips, 21 exaflops) using a year of hourly simulated pollution data, producing a UK-wide model at 2-3 square kilometer resolution. The team added Earth-2 StormCast for time-dependent forecasts that ingest real air quality observations, and demonstrated the workflow runs on the DGX Spark desktop AI system. Open-source training data and workflows are planned so other countries and cities can build similar pollution models.

NVIDIA Blog · 1d agoAI industry

From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production

NVIDIA detailed DSX power-management results: Lambda gained 24% token throughput at fixed power, and an AI factory auto-shed 1MW via Emerald AI's grid program.

NVIDIA says Lambda's first validation of DSX MaxLPS on HGX B200 servers ran 19 nodes within a 16-node power budget, lifting cluster token throughput 24% (roughly 4M to 5M tokens/second) and improving performance per watt by 23%. NVIDIA projects DSX MaxLPS can enable up to 40% more GPU capacity for Vera Rubin NVL72 factories within the same megawatt budget. Emerald AI's Conductor platform, running at NVIDIA's Eos factory with Silicon Valley Power, responded to over 200 utility demand signals, automatically dropping power from 4MW to 3MW without interrupting priority workloads. The first dedicated DSX Flex commercial deployment is planned at a 96-megawatt Manassas, Virginia facility.

NVIDIA Blog · 1d agoAI industry

Apple's Siri AI Can Be Swapped Out for Claude, ChatGPT, Code Shows

Code analysis of iOS 27 and macOS Golden Gate frameworks shows Apple engineered Siri to deeply interoperate with third-party AI models like Claude and GPT-5.6.

Code sleuth 'pdfu' uncovered private frameworks in iOS 27 and macOS Golden Gate revealing a 'Model Delegation' mechanism that lets Claude act as a Siri extension like the built-in ChatGPT extension. A second 'Inference Providing' protocol in Model Manager Services can fully replace Siri's server-side model with models such as GPT-5.6, which then receives Apple's Siri planner prompt and tool definitions to perform system actions and process personal data. The EU Digital Markets Act, which requires Apple to give third parties effective access to iOS features, may have shaped this approach. The entitlement is not yet open to third parties and Claude is not yet available in the macOS 27 Golden Gate RC.

Hacker News · AI · 2d agoAI industryHN 57↑ · 14 comments

The Rise of the Forward Deployed Engineer — and How To Do the Job Right

Palantir veteran Vinoo Ganesh traces the forward deployed engineer role and shares practices for building effective FDE teams.

Kepler CEO and former Palantir forward deployed engineer Vinoo Ganesh argues that labs, startups, and PE firms hire FDEs without a shared definition of the role. He recounts Palantir's Project Frontline rotation, which trained about 250 software engineers as FDEs, many now leading forward deployed teams at OpenAI, Anthropic, xAI, and Anduril. A 2013 failure of the Phoenix transaction store at a bank, where real-world data gaps caused roughly 2.3 million keyspaces and an out-of-memory crash, illustrates why FDEs must own the gap between design and production reality. At Kepler he places the FDE function inside product rather than sales.

Latent Space · 4d agoAI industry 4 sources1

NVIDIA Brings Real-Time AI to Broadcast, Sports and Global Streaming at IBC

NVIDIA expanded its AI for Media suite at IBC 2026, adding NIM microservices for synthetic video detection, body pose, frame generation, upscaling and HDR.

At IBC 2026 in Amsterdam, NVIDIA announced a major expansion of NVIDIA AI for Media, a collection of GPU-accelerated SDKs, NIM microservices and blueprints for broadcast and streaming workflows. The Synthetic Video Detector (SVD) NIM microservice reaches 99.3% accuracy on text-to-video and 97.7% on image-to-video content, while Video Frame Generation boosts frame rates 2x-4x and Video Super Resolution adds 10-bit support; TrueHDR converts SDR to HDR at up to roughly 2,000 nits. Partners including Dalet, TwelveLabs, Wowza, Vizrt and Ross Video are integrating the new services into verification, compliance and live-production workflows.

NVIDIA Blog · 7d agoAI industry

NVIDIA to Acquire Hugging Face

NVIDIA agreed to acquire Hugging Face for $12.93 billion while pledging to keep the platform open, multi-cloud and vendor-neutral.

NVIDIA announced an agreement to acquire Hugging Face for $12,930,300,000. Hugging Face hosts more than 3 million models, 500,000 datasets and 1 million applications used by over 18 million developers and 200,000 companies. NVIDIA says the platform will remain open, with no requirement to use NVIDIA compute, and will continue supporting multi-cloud and multi-accelerator development and deployment. NVIDIA is already Hugging Face's largest contributor of open models and datasets, with more than 500 models and 250 open datasets released.

NVIDIA Blog · 13d agoAI industry

‘Now We Can Know Everything and Do Anything,’ Jensen Huang Says at Dreamforce

Salesforce unveiled Koa, its first CRM reasoning model post-trained on NVIDIA Nemotron 3 Super, announced during Jensen Huang's Dreamforce keynote.

At Salesforce Dreamforce, NVIDIA CEO Jensen Huang joined Marc Benioff onstage as Salesforce announced Koa, its first CRM reasoning model, post-trained from NVIDIA Nemotron 3 Super using NeMo RL, NeMo Gym, and NeMo AutoModel. Koa was fine-tuned on a proprietary synthetic dataset drawn from nearly three decades of enterprise CRM deployments across 14+ industries, with no customer data used in training or inference. On Salesforce's CRM Bench of real-world tasks, Koa matches or exceeds leading model performance on CRM actions with 3x fewer errors. Koa already powers an employee agent in Slack, enters customer pilots in October with Formula 1, UChicago Medicine, Baxter Credit Union, 1-800Accountant, Engine, and Xero, and reaches general availability in Winter 2026 in U.S. regions.

NVIDIA Blog · 1d agoAI industry

OpenAI’s feud with mathematicians is only escalating

25 Fields Medalists sign an open letter warning AI labs threaten math attribution; NYU's Tristan Buckmaster accuses OpenAI of pressuring him over collaborator credit.

Twenty-five Fields Medal-winning mathematicians signed an open letter arguing rushed AI proofs raise severe attribution and plagiarism questions and could destroy the culture of open research. NYU professor Tristan Buckmaster accused OpenAI of pressuring him not to credit an Anthropic-employed collaborator, and OpenAI withdrew sponsorship of a Caltech math event after researcher criticism. OpenAI's marathon-weekend proof remains unverified, and mathematicians fear their Codex usage may be fed into OpenAI's new models. The letter follows the June Leiden Declaration on LLM proofs.

TechCrunch · AIupdated · 4d agofirst · 5d agoAI industry 2 sources

Thelio Mira AI Linux Workstation: 192 GB GPU Memory

System76 launches the Thelio Mira AI Linux workstation from $3,299 with dual NVIDIA RTX Pro 6000 GPUs and 192 GB GPU memory for local AI workloads.

System76's Thelio Mira AI is a locally built (Denver, Colorado) Linux workstation for AI training, fine-tuning, and inference, starting at $3,299. Configurations go up to a 16-core AMD Ryzen 9000 CPU, 192 GB DDR5 RAM, and dual NVIDIA RTX Pro 6000 Blackwell GPUs delivering 192 GB of (ECC) GPU memory with liquid cooling, dual PCIe 5.0 x16 slots, and up to three M.2 NVMe drives. It ships with Pop!_OS 24.04 LTS or Ubuntu and is positioned as a way to avoid recurring cloud GPU costs.

Hacker News · AI · 6d agoAI industryHN 44↑ · 27 comments

AI spend per employee slumped at top firms in August — summer doldrums or a warning sign?

Ramp data across 70,000 companies shows August AI adoption grew just 0.4% while per-employee spend at top-spending firms fell nearly 10% to $7,205 amid declining token prices.

Ramp's spending data shows 56% of its customers paid for AI products in August, up only 0.4% month-over-month, with spend per employee in the top 1% of firms down almost 10% to $7,205. Average token costs have dropped to $0.68 per million tokens from a 2026 peak of $1.15 in March after price cuts by OpenAI and Anthropic, and the labs have not yet offset the cuts with volume, with customers shifting to cheaper models like ChatGPT 5.6-Terra and Claude Sonnet. The US Census Bureau's broader survey shows only 22% of businesses report using AI, suggesting Ramp's tech-heavy client base overstates adoption, while only 6.4% of AI-spending businesses used model-serving or inference platforms in August.

TechCrunch · AI · 7d agoAI industry

Mistral raises €3B as sovereign AI becomes big business

Mistral AI raised a €3B Series D at a €21B+ valuation, led by Samsung Electronics, to scale European compute capacity and sovereign AI services.

French AI lab Mistral AI raised €3 billion (~$3.58B) at a post-money valuation above €21 billion, which it calls the largest equity round ever completed by a European technology company. Samsung Electronics led the round, with EQT's Scaleup Europe Fund and PSG Equity as co-leads; a16z, Nvidia, Salesforce Ventures, Advent, BlackRock, and Luxembourg also participated. The company plans to build 1 GW of European compute capacity by 2030, offer region-selectable query processing, and host third-party open-weight models as part of a sovereign AI strategy. Mistral operates in 20 countries and targets governments and enterprises seeking control over AI models and data residency.

TechCrunch · AI · 8d agoAI industry

OpenAI reports AI "research interns" and warns about its own pace at the same time

OpenAI claims its automated research intern milestone is met, with agents now doing 3.1 workdays per human day, while Pachocki warns monitoring is weakening.

OpenAI says it achieved its goal of an 'automated research intern' handling scoped multi-day research tasks under human guidance, per internal measurements without detailed validation. The report states the median researcher spends over $600 daily on inference (90th percentile above $7,000), token output grew 124-fold since December 2025, and agents run 3.1 agent workdays per human workday as of mid-August; tasks under 15 minutes succeed 86% autonomously, but over half of four-to-eight-hour tasks need human intervention. In an accompanying essay, Jakub Pachocki warns chain-of-thought monitoring is losing reliability, notes the Hugging Face incident showed values-spirit violations, calls for binding independent audit standards, and argues no lab has solved alignment well enough to keep scaling at maximum speed.

The Decoder · 9d agoAI industry

When AI quietly breaks things, who pays?

Reed Smith partner David Halbreich explains how AI companies can avoid D&O/E&O coverage gaps around mergers, governance warranties, and claims timing.

In an interview, insurance recovery partner David Halbreich of Reed Smith outlines insurance pitfalls for AI companies under claims-made D&O and E&O policies. He highlights 'straddle' claims after mergers that fall between tail coverage and go-forward policies, potentially leaving policyholders with no coverage. He also warns that governance artifacts submitted in insurance applications, such as bias testing records and model cards, can become warranties carriers use to deny claims, and discusses who should answer AI-use questions and how business interruption coverage applies to cloud and compute vendor outages.

Help Net Security · 14d agoAI industry

[AINews] OpenAI to reach AGI bar by end-2026

OpenAI chief scientist Jakub Pachocki says unreleased Astra model meets the 'Automated AI Research Intern' goal; Altman expects internal AGI declaration by December 2026.

OpenAI chief scientist Jakub Pachocki says the unreleased Astra model fulfills the September 2026 'Automated AI Research Intern' target. Sam Altman told TIME he expects OpenAI to declare AGI achieved internally by December 2026. The roundup also covers Zhipu's GLM-5.3-Flash (320B total parameters, 18B active, 1M context), Google's Gemini Omni 1.1 Flash video model topping the Text-to-Video Arena, and the $399 open-source Microduck biped robot from Pollen Robotics and Hugging Face.

Latent Space · 20d agoAI industry