18 stories in the last 30d
Z.ai's GLM team describes building its own in-house inference infrastructure for serving GLM models, surfaced via a Hacker News link post.
Z.ai published a blog post titled 'GLM Built Its Own Inference Infrastructure', which appeared on Hacker News with 40 points and 14 comments. The available text contains only the title and engagement metrics, so no technical details about hardware, throughput, or model versions can be confirmed from this item.
browser-use released Jev Ultrafast, an open-source browser agent that uses a dynamic, indexed action space for web automation.
Hacker News is linking to the browser-use Jev Ultrafast GitHub repository, described as a browser agent with a dynamic, indexed action space. The submission reached 40 points and 4 comments. The source text contains only submission metadata, so architecture and benchmark details are not available.
A new site tracks release dates and training cutoffs for 20 AI models across 8 labs, exposing months-long staleness gaps.
A community-built page, launched via Show HN, tracks release dates and training cutoff dates for 20 current models from 8 labs including OpenAI, Anthropic, Google DeepMind, Meta, Mistral AI, Alibaba, DeepSeek, and xAI. Only 10 of the 20 models have lab-published cutoff dates, with data available as models.json. For example, GPT-6 Astra shipped September 3, 2026 with an April 30, 2026 cutoff. The page argues web search tools paper over, but never close, the staleness gap.
Datamimic is an open-source test data generation tool aimed at keeping coding agents from inventing their own test fixtures.
A Hacker News discussion (40 points) highlights Datamimic, an open-source rapiddweller GitHub project for generating realistic synthetic test data. The tool targets AI coding agents, aiming to prevent them from fabricating their own inconsistent test worlds. Only the repository link was shared, so details are limited.
Tutorial optimizes flight paths to cut jet fuel costs using open-source Scikit-decide planning framework and OpenAP aircraft performance models.
A technical walkthrough demonstrates wind-aware flight path optimization using Scikit-decide, an open-source framework for reinforcement learning and automated planning, paired with OpenAP fuel-consumption models built by Dr. Junzi Sun at TU Delft and NOAA wind data. A Boeing 787-9 flying EWR to FCO can require roughly $68K in fuel, and adjusted routing could save thousands. The post uses Python 3.12, DuckDB with spatial extensions, and QGIS for map rendering.
Panel is an open-source research workspace where AI agents dynamically build their own panes, posted on Hacker News.
Panel, shared as a Show HN project on GitHub, is a research workspace in which the agent can construct its own panes rather than using a fixed interface. The post received 41 points and 8 comments on Hacker News. It targets agentic research workflows with a dynamically generated UI.
Ordewell is an open-source tool that decomposes a single goal into an ordered plan of coding-agent tasks, posted on Hacker News.
Ordewell, shared as a Show HN project on GitHub, converts one high-level goal into an ordered plan of tasks for coding agents to execute. The post received 40 points and 29 comments on Hacker News. It focuses on task planning and orchestration for autonomous coding agents.
OpenArch provides PyTorch reference implementations of modern LLM architectures for developers and researchers.
OpenArch is a GitHub project offering PyTorch implementations of modern large language model architectures. The repository attracted 43 points and 7 comments on Hacker News. It targets developers and researchers who want readable, runnable versions of current LLM architectures.
GitHub project 'CUDA for AMD on Windows' trends on Hacker News, aiming to run CUDA workloads on AMD GPUs under Windows.
A GitHub repository named CUDA-for-AMD-Windows drew 45 points and 5 comments on Hacker News. The project targets making NVIDIA's CUDA software stack work on AMD GPUs under Windows, which matters to developers running GPU compute or inference on non-NVIDIA hardware. No security impact is described.
New open-source project Litelm launched on GitHub as a leaner alternative to the LiteLLM multi-provider LLM gateway.
Litelm is a community-published GitHub project positioned as a stripped-down alternative to LiteLLM, a widely used gateway/SDK for routing requests to multiple LLM providers. The post drew modest attention on Hacker News with 45 points and 17 comments. The listing provides no further technical details, benchmarks, or feature specifics.
A GitHub project streams Moonshot's 2.8T-parameter Kimi K3 from four SSDs to run at 1 token/s on a MacBook Pro.
A GitHub repository (argonautlabsai/deltafin) demonstrates running Moonshot AI's Kimi K3, a 2.8-trillion-parameter model, on a MacBook Pro by streaming its weights from four SSDs at 1 token per second. The project drew 55 points and 22 comments on Hacker News, highlighting consumer-hardware inference for extremely large models.
A developer released a browser-based tool that visualizes which past tokens influence each LLM output token using aggregated, value-weighted attention scores.
A Show HN project presents a React application built on Transformers.js that renders per-token attention influence by aggregating attention weights scaled by value-vector magnitudes across all attention heads and layers. To expose internal tensors, the author instrumented the ONNX computation graph, hosted a modified model on Hugging Face, and pre-generated prompts to avoid long model downloads in the browser. Demos with a 600-million-parameter model show how verbatim copying draws heavily on source tokens and how single outputs blend information from multiple phrases.
Developer releases I-have-ADHD, an open-source skill that stops coding agents from burying direct answers under verbose output.
A GitHub project titled I-have-ADHD packages a 'skill' intended to make AI coding agents answer directly instead of hiding the answer inside lengthy output. It gained traction on Hacker News with 45 points and 42 comments. It targets prompt/agent configuration rather than introducing a new model or infrastructure component.
TauricResearch's TradingAgents, an open-source multi-agent LLM framework for financial trading, gained traction on Hacker News with 94 points and 60 comments.
The TradingAgents GitHub repository from TauricResearch presents a multi-agent LLM framework for financial trading and surfaced on Hacker News with 94 points and 60 comments. It targets developers building agentic trading systems on top of LLMs.
A teardown reveals Claude Code runs in Firecracker microVMs with a Rust PID 1 and MITM'd egress, while Instinct rents E2B sandboxes with git-based memory.
The author inspects the virtual machines hosting cloud agents: Claude Code runs in a Firecracker microVM with a custom Rust init (process_api) as PID 1, a 324 MB Bun harness on a read-only disk, and 443-only MITM'd SSE egress to api.anthropic.com with host-rotated OAuth tokens and no inbound access. Instinct rents E2B sandbox-as-a-service Firecracker microVMs (Ubuntu 22.04, 2 vCPU, 1.9 GB RAM) where agent memory is a git repo of Markdown committed by the agent and pushed to S3 as a single bundle, using short-lived STS credentials. Both platforms rely on Firecracker, differing mainly in fleet operator and guest boot configuration.
vLLM benchmarks speculative decoding on AMD Instinct MI300X and MI355X GPUs across five drafting methods including EAGLE-3 and native MTP.
The vLLM project documents draft-and-verify speculative decoding support for AMD GPUs via ROCm, comparing native MTP, Gemma 4 MTP, EAGLE-3, DFlash, and DSpark drafting approaches. Output-token throughput effects varied with drafting method, proposal length, model family, draft checkpoint, workload, and acceptance behavior. The post also covers how to enable each method plus practical tuning and observability considerations.
Developer launches Engrim, an open-source local-first SQLite memory engine giving AI CLI agents persistent memory.
Engrim, shared on Hacker News (89 points), is a universal, local-first memory layer built on SQLite for AI CLI tools. It targets agent-style CLI applications that need durable cross-session memory without cloud dependencies. Details beyond the repository description were not provided in the source text.
Trail of Bits releases Coop, running Claude Code and OpenAI Codex agents inside isolated virtual machines for safer agentic coding.
Coop, published on GitHub by security firm Trail of Bits, provides isolated VM environments for executing AI coding agents such as Claude Code and Codex. Isolation contains the filesystem and network side effects of autonomous agent actions, reducing risk from unsupervised tool use. The project drew 61 points and 16 comments on Hacker News.