Search: “ryzen-ai”

Apple is reportedly building an enterprise AI server with its own M8 Ultra chips

Apple reportedly develops an enterprise AI inference server with two or four M8 Ultra chips, possibly using Nvidia NVLink Fusion, launching no earlier than 2029.

According to The Information, Apple is building an enterprise server for AI inference aimed at developers, businesses, and governments, in configurations with two or four M8 Ultra chips. Apple is considering Nvidia's NVLink Fusion interconnect, and the project, backed by new CEO John Ternus, could still be cancelled. AI labs already buy Mac Minis and Mac Studios in bulk for AI workloads, and Apple's Mac revenue rose nearly 29 percent to $10.4 billion last quarter.

The Decoder·updated Sep 16, 22:02 UTC · 9h ago·first Sep 16, 18:16 UTC · 13h agoAI industry 3 sources

Why Scaling AI Compute Performance Requires a New Power Architecture

NVIDIA argues AI factories need 800 VDC power distribution as dense GPU racks outgrow traditional AC-based delivery.

NVIDIA's blog contends each generation of accelerated computing demands higher rack density and more efficient, scalable power distribution. It frames the bottleneck as how power moves from the grid to the GPU rather than raw wattage, and describes limitations of traditional AC power delivery. NVIDIA advocates a new 800 VDC power architecture for AI factories.

NVIDIA Blog·Aug 11, 15:00 UTC · Aug 11, 2026AI industry

Delivering Vera: NVIDIA’s First CPU Built for Agents Is Shipping Now

NVIDIA's Vera CPU, its first processor built for AI agents, is now shipping at scale to partners across the AI ecosystem.

NVIDIA announced that Vera, its first CPU designed specifically for agentic AI workloads, has begun shipping at scale. Vice President of Hyperscale and HPC Ian Buck is hand-delivering early Vera CPU systems to organizations across the AI ecosystem, signaling full production availability of the data-center processor.

NVIDIA Blog·Aug 27, 13:00 UTC · 20d agoAI industry

Microsoft’s Project Zenith puts large AI models directly on developer PCs

Microsoft's Project Zenith delivers a ready-to-code Windows 11 experience running 30B+ parameter AI models locally on 64GB+ unified-memory PCs, starting with AMD Ryzen AI Halo.

Project Zenith is a preconfigured Windows 11 developer experience for PCs with at least 64 GB of unified memory and 250 GB/s or higher memory bandwidth, capable of running AI models with more than 30 billion parameters locally without metered cloud tokens. First systems are powered by AMD Ryzen AI Halo, with additional OEM and silicon partner devices expected in coming months. The environment ships with WSL and Linux containers, pinned developer tools, and day-one AI agent security features including OS-enforced agent identity and containment through Microsoft Execution Containers (MXC).

Help Net Security·Sep 8, 04:30 UTC · 9d agoAI industry1

Arm Mali G2-Ultra NX GPU: desktop-class mobile gameplay with AI-native graphics

Arm unveiled Mali G2-Ultra NX, its first AI-native mobile GPU with in-shader neural acceleration, third-gen ray tracing, and up to 24% higher benchmark performance.

Arm announced the Mali G2-Ultra NX, the first AI-native Mali GPU, integrating neural accelerators directly into shader cores alongside a new execution engine and third-generation hardware ray tracing. It introduces Neural Super Sampling (NSS), Neural Frame Rate Upscaling (NFRU), and Neural Super Sampling and Denoising (NSSD); the Neural Dawn demo with Sumo Digital showed up to 4x performance efficiency and 70% lower external memory traffic versus native rendering. Arm claims up to 24% higher benchmark performance, 13% lower DRAM traffic on ray tracing benchmarks, and up to 120 FPS with NFRU. Over 14 billion Mali GPUs have shipped to date.

Hacker News · AI·Sep 8, 04:06 UTC · 9d agoAI industryHN 71↑ · 53 comments1

Nvidia is the central bank of AI

The Economist's interactive briefing argues Nvidia functions as AI's central bank, controlling the compute supply underpinning the industry's growth.

An Economist interactive briefing titled 'Nvidia is the central bank of AI' examines the chipmaker's dominant control over AI compute supply. The link drew 45 points and 23 comments on Hacker News. The listing provides only engagement metrics, with the full analysis hosted on the Economist's site.

Hacker News · security·Sep 12, 15:08 UTC · 4d agoAI industryHN 45↑ · 23 comments

Speculative Decoding in vLLM on AMD GPUs

vLLM benchmarks speculative decoding on AMD Instinct MI300X and MI355X GPUs across five drafting methods including EAGLE-3 and native MTP.

The vLLM project documents draft-and-verify speculative decoding support for AMD GPUs via ROCm, comparing native MTP, Gemma 4 MTP, EAGLE-3, DFlash, and DSpark drafting approaches. Output-token throughput effects varied with drafting method, proposal length, model family, draft checkpoint, workload, and acceptance behavior. The post also covers how to enable each method plus practical tuning and observability considerations.

Hacker News · AI·Sep 7, 09:26 UTC · 9d agoAI tools & infraHN 141↑ · 52 comments1

AI models flub these intelligence tests. Can you fare any better?

MIT Technology Review examines puzzle and game benchmarks where current AI models still underperform, probing the limits of machine intelligence tests.

MIT Technology Review explores puzzles and games as benchmarks for gauging AI progress, tracing the practice back to the origins of machine learning in a 1959 article by IBM's Arthur Samuel. The piece highlights intelligence-style tests that today's models still fail and questions what those results reveal about model capabilities. It situates gaming benchmarks within the broader debate over measuring machine intelligence.

MIT Technology Review · AI·Aug 26, 09:00 UTC · 21d agoAI research

Securing the Infrastructure of Intelligence

NVIDIA positions AI factories combining chips, networking, power and data as the defining infrastructure of the AI economy needing full-stack security.

NVIDIA's blog argues that AI factories are the defining infrastructure of the AI era, transforming energy and data into intelligence that powers businesses and countries. It frames compute as revenue and lists the full stack of critical resources required: advanced chips, packaging, memory, networking, land and power. The piece is a corporate positioning article about securing this infrastructure, with no specific incident or product announcement detailed in the excerpt.

NVIDIA Blog·Aug 17, 12:34 UTC · Aug 17, 2026AI industry

Inside NVIDIA’s cuDNN Graph API: Fusion, Autotuning, and Plan Reuse with cuDNN Frontend

MarkTechPost tutorial walks through NVIDIA's cuDNN Frontend graph API, covering kernel fusion, autotuning, plan reuse, and CUDA graph capture on Colab GPUs.

The tutorial explains how to express GPU computations as operation graphs via the cuDNN Frontend graph API, running the five-step build pipeline of validate, build operation graph, create execution plans, check support, and build plans. It progresses from a single fused convolution with bias and ReLU to autotuning across engine configs, FP8-style epilogues, attention, plan serialization, dynamic shapes, and CUDA graph capture. Each kernel is benchmarked against a PyTorch reference on a single Colab GPU to verify correctness and measure cost. The piece also covers practical setup issues like making libcudnn.so visible to the frontend's dynamic loader.

MarkTechPost·Sep 15, 21:37 UTC · 1d agoAI tools & infra2

Thelio Mira AI Linux Workstation: 192 GB GPU Memory

System76 launches the Thelio Mira AI Linux workstation from $3,299 with dual NVIDIA RTX Pro 6000 GPUs and 192 GB GPU memory for local AI workloads.

System76's Thelio Mira AI is a locally built (Denver, Colorado) Linux workstation for AI training, fine-tuning, and inference, starting at $3,299. Configurations go up to a 16-core AMD Ryzen 9000 CPU, 192 GB DDR5 RAM, and dual NVIDIA RTX Pro 6000 Blackwell GPUs delivering 192 GB of (ECC) GPU memory with liquid cooling, dual PCIe 5.0 x16 slots, and up to three M.2 NVMe drives. It ships with Pop!_OS 24.04 LTS or Ubuntu and is positioned as a way to avoid recurring cloud GPU costs.

Hacker News · AI·Sep 10, 23:10 UTC · 6d agoAI industryHN 44↑ · 27 comments

Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye

METR analysis finds AI accelerating cyber vulnerability discovery, while SPADE self-play environment generation improves Qwen3 reasoning benchmark scores at 30B scale.

Import AI 470 discusses a METR research note reporting differential acceleration from AI: major acceleration in reported cyber vulnerabilities (cURL, OpenSSL, Firefox, Microsoft, NVD, OSV), minor acceleration in mathematics, and no measurable acceleration in AI-research optimization benchmarks. It also covers SPADE, a self-play framework from a multi-university team (University of Washington, Stanford, MIT, CMU, and others) that co-evolves executable training environments and agent capability using Environment Designer and Reasoning Agent roles with hint-based regret rewards. Trained on Qwen3-4B-Instruct-2507, Qwen3-8B, and Qwen3-30B-A3B-Instruct-2507 via GRPO (400 rollouts of 25 environments), SPADE lifted the 30B-A3B game-environment suite average to 58.3, +8.1 over base, and improved tool-use results across backbones. The issue also references Hawkeye for building better GPU kernels.

Import AI·Aug 24, 13:12 UTC · 23d agoAI research1

Architecting memory and storage in the AI era

Analysis argues AI inference shifts data-center bottlenecks to memory and storage, urging balanced compute, memory, storage, and network architecture over raw compute.

MIT Technology Review, citing Tirias Research principal analyst Jim McGregor, argues that AI inference and agentic workloads make data movement the key constraint, elevating memory and storage from background hardware to strategic assets. The piece says RAG and real-time inference require continuous data retrieval and caching that legacy infrastructure cannot support. It frames infrastructure planning as a business decision balancing performance, efficiency, cost, and scalability in healthcare, finance, and customer-facing AI.

MIT Technology Review · AI·Sep 4, 18:39 UTC · 12d agoAI industry

Retrospectively Reverse-Engineering Apple's Neural Engine

A developer reverse-engineers Apple's M1 Neural Engine architecture, mapping compute cores, MAC datapaths, and schedulers to explain the NPU's decline as transformers displaced CNN workloads.

A developer who previously maintained a reverse-engineered Linux driver for Apple's Neural Engine (ANE) published a retrospective deep dive mapping the M1 ANE's full internal architecture: compute, datapath, scheduler, memory, and execution model. The M1 ANE has 16 compute cores with 128 FP16 (or 256 INT8) MAC lanes each, totaling 2048 parallel MAC lanes, using 32-bit Q16.16 fixed-point accumulation with FP16 readout and an accumulator that saturates at 2^15. The author argues the ANE's dataflow was architected around the predictable reuse patterns of 2017-era CNN workloads (dating to the A11 Bionic), which autoregressive transformer decode broke, limiting its usefulness for general ML. With Apple's M5 folding ANE cores into GPU cores to tout LLM performance, the post frames this as the beginning of the end for the standalone NPU.

Hacker News · AI·Sep 12, 07:54 UTC · 4d agoAI researchHN 54↑ · 7 comments2

Robots are waiting for a ChatGPT moment: Nvidia’s Les Karpas explains why at TechCrunch Disrupt 2026

NVIDIA Inception's Les Karpas will discuss at TechCrunch Disrupt 2026 why robotics lacks a ChatGPT moment, citing missing internet-scale physical AI datasets.

NVIDIA Inception's Global Head of Physical AI, Les Karpas, will speak on the Real World AI Stage at TechCrunch Disrupt 2026, held October 13-15 at San Francisco's Moscone West. His core argument is that general-purpose robots lack an internet-wide dataset for physical AI, unlike language models from OpenAI and Anthropic. Founders from Shield AI, Colossal Biosciences, FieldAI, and Foxglove will join related sessions.

TechCrunch · AI·Sep 16, 15:00 UTC · 16h agoAI industry

Mines, Minds, and Machines: The Journey of AI

Recorded Future essay traces AI's supply chain from minerals and chips to embodied AI, mapping geopolitical rivalry and cyber operations at every stage.

Recorded Future published an analysis following the supply chain of the fourth industrial revolution: minerals become chips, chips become data centers, and data centers become models that are acquiring physical capabilities. It argues geopolitical rivalry and cyber operations now run along every link, from mine to embodied AI machines.

Recorded Future·Aug 11, 00:00 UTC · Aug 11, 2026AI industry

Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training

NVIDIA researchers detail an end-to-end system for online draft co-training that speeds speculative decoding in large-scale long-context RL post-training.

The paper tackles scaling online draft co-training for speculative decoding in RL post-training, where rollout generation dominates cost. It extends packed, load-balanced zigzag ring attention to merge rank-local branch attention with causal main-sequence attention for context parallelism, and introduces TapChannel to transport target features across pipeline-parallel stages without changing the schedule. Experiments show co-trained drafts tracking the policy baseline with substantial rollout and end-to-end speedups up to 122B parameters and strong scaling at 256K tokens.

Hugging Face daily papers·Sep 6, 20:00 UTC · 10d agoAI research1

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog·Sep 15, 16:55 UTC · 1d agoAI industry

Φ-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?

Researchers release Phi-Bench, a benchmark evaluating frontier LLMs on open-ended, long-horizon engineering and optimization of the LLM infrastructure stack.

Phi-Bench evaluates LLMs on open-ended engineering of the LLM infrastructure stack, derived from optimization problems studied in frontier research and grounded in real-world code repositories. Tasks range from localized kernel-level function completion to long-horizon implementation and end-to-end system optimization. Experiments on frontier LLMs reveal current capabilities and limitations on the path toward autonomous optimization of future AI infrastructure.

Hugging Face daily papers·Sep 8, 20:00 UTC · 8d agoAI research1

Design Docs Are All You Need: An AI-native Machine-Learning Performance Tool

Researchers present SMART, an ML performance-modeling library regenerated by AI coding agents from natural-language design docs instead of code.

The paper describes SMART, a symbolic performance-modeling library whose main branch contains almost no code: the repository is a DAG of self-contained design documents, and coding sub-agents regenerate implementations from only the docs on version updates. Reliability rests on a worked-example doc style used as in-context demonstrations and a minimal operator IR with SymPy cost expressions, offering both fast analytical roll-up and fine-grained modulo-scheduling modes. Regenerated implementations reproduce hand-audited reference models, including DeepSeek-V3 serving on a TPU pod slice, to round-off precision.

arXiv cs.AI / cs.LG / cs.CL·Sep 4, 17:08 UTC · 12d agoAI research1

Teaching Everyone to Fish for Tokens

Analysis argues open-source AI now depends heavily on Nvidia's financing, with a reported $26 billion bet shaping the open-weights ecosystem's future.

An Interconnects essay examines whether the open-source model recipe, exemplified by Ai2's Olmo and Nvidia's Nemotron releases, can become economically self-sustaining. It reports Nvidia is spending roughly $26 billion on near-open-source models to drive demand for its chips, and argues the open ecosystem faces an existential financing window over the next few years. The author predicts open models may fork toward efficiency, specialization, and on-prem enterprise agents rather than competing head-on with closed frontier labs.

Interconnects·Aug 17, 15:07 UTC · Aug 17, 2026AI industry

Wazuh and AI For Enhanced SOC Workflows

Wazuh details AI-powered SOC workflows via its AI Analyst, self-hosted Llama 3 via Ollama, and Claude 3.5 Haiku integrations.

Wazuh outlines how AI can augment SOC analysts handling high alert volumes. The Wazuh AI Analyst on Wazuh Cloud uses Amazon Bedrock and Anthropic Claude to generate scheduled security posture reports. Self-hosted options include Llama 3 with Ollama, FAISS, and LangChain for privacy-sensitive threat hunting, plus an OpenSearch Assistant integration with Claude 3.5 Haiku. This is a vendor-contributed piece describing product capabilities rather than an incident or vulnerability.

The Hacker News·Aug 21, 11:21 UTC · 26d agoTools

Implementation of Machine Learning Workflows with NVIDIA cuML, RAPIDS, GPU Benchmarking, Explainability, Clustering, and Model Inference

Hands-on tutorial implements NVIDIA cuML and RAPIDS to GPU-accelerate scikit-learn-style ML workflows with benchmarking, clustering, and inference.

The tutorial demonstrates NVIDIA cuML as a GPU-accelerated machine learning framework, using cuml.accel to speed up unmodified scikit-learn scripts with zero code changes and the native cuML API for CuPy/cuDF interoperability. It benchmarks CPU versus GPU implementations of PCA, K-Means, nearest-neighbor search, logistic regression, random forests, and DBSCAN on datasets up to 200,000 samples with 64 features. It also builds GPU pipelines with UMAP, t-SNE, and HDBSCAN, validates GPU-generated SHAP explanations, uses the FIL library for forest inference, and covers model serialization and GPU/CPU portability.

MarkTechPost·Sep 13, 01:42 UTC · 4d agoAI tools & infra

Kimsuky Builds Offline AI Stack to Boost Phishing and Automate Malware Development

The Hacker News·Aug 10, 13:21 UTC · Aug 10, 2026Malware

How XPUs Meet a World-Class AI Factory

NVIDIA argues AI factories with custom XPUs and NVLink Fusion connectivity must optimize tokens-per-second, tokens-per-watt, cost and uptime.

NVIDIA published a blog explaining that AI factories running continuously are economically defined by delivered output: tokens per second, tokens per watt, cost per token, utilization and uptime. It argues hyperscalers and AI-native companies building custom XPUs need infrastructure designed as a complete factory rather than collections of individual accelerators. The piece promotes NVIDIA's NVLink Fusion and full-stack XPU connectivity as the foundation for such world-class AI factory builds.

NVIDIA Blog·Aug 24, 15:00 UTC · 23d agoAI industry

FOMO in the SOC: Where AI Platforms like Claude Actually Fit

The Hacker News·Aug 3, 11:30 UTC · Aug 3, 2026Malware

UAT-10147 Uses AI to Scale Server Attacks, Deploys SPECTRE With EDR Bypass and Linux Rootkit

Cisco Talos exposes UAT-10147, a Chinese-speaking group using AI tools to automate intrusions, deploy SPECTRE, BadIIS, and rootkits against web servers worldwide.

Cisco Talos detailed UAT-10147, a Chinese-speaking cybercrime group conducting SEO fraud and data theft against Windows and Linux web servers in education, media, technology, and gaming sectors, with most victims in Brazil, Bolivia, China, Canada, and Vietnam. The actor exploits publicly disclosed vulnerabilities for initial access, including Zimbra (CVE-2022-27925) and Alibaba Nacos (CVE-2021-29441), and abuses Linux LPE flaws like CVE-2022-0847 and CVE-2021-3156 for root. Its toolset includes AI-assisted frameworks DeepAudit and PentestGPT, plus implants such as SPECTRE, BadIIS, Quasar RAT, Gh0stCringe, and Noodle RAT. An exposed directory contained a target list of roughly 170,000 URLs, with the US, India, UK, Germany, and Netherlands as top destinations.

The Hacker News·Aug 27, 18:33 UTC · 20d agoThreat actor in the wildCVE-2022-0995CVE-2021-3156CVE-2015-5287+8 CVEs

NVIDIA AI Factory Compute Is Becoming an Investable Asset Class

NVIDIA partners with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR to mobilize over $500 billion of third-party capital for AI infrastructure financing.

NVIDIA announced partnerships with major financial firms including Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR. The independent financing platforms are designed to mobilize more than $500 billion of third-party capital to support AI infrastructure buildout. NVIDIA frames the move as positioning AI factory compute as an investable asset class.

NVIDIA Blog·Aug 12, 00:38 UTC · Aug 12, 2026AI industry

Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI

Hugging Face released @huggingface/kernels, a library offering 200+ WebGPU compute kernels to accelerate AI inference locally in browsers.

Hugging Face introduced the @huggingface/kernels package, bundling more than 200 optimized WebGPU compute kernels for running AI workloads locally. The release targets browser-based and on-device inference, reducing reliance on server-side compute. No article body was available beyond the title, so benchmark results and supported models are not specified.

Hugging Face Blog·Sep 1, 00:00 UTC · 16d agoAI tools & infra