30
30
30
Inside NVIDIA’s cuDNN Graph API: Fusion, Autotuning, and Plan Reuse with cuDNN Frontend
MarkTechPost tutorial walks through NVIDIA's cuDNN Frontend graph API, covering kernel fusion, autotuning, plan reuse, and CUDA graph capture on Colab GPUs.
The tutorial explains how to express GPU computations as operation graphs via the cuDNN Frontend graph API, running the five-step build pipeline of validate, build operation graph, create execution plans, check support, and build plans. It progresses from a single fused convolution with bias and ReLU to autotuning across engine configs, FP8-style epilogues, attention, plan serialization, dynamic shapes, and CUDA graph capture. Each kernel is benchmarked against a PyTorch reference on a single Colab GPU to verify correctness and measure cost. The piece also covers practical setup issues like making libcudnn.so visible to the frontend's dynamic loader.
18
30
30
30
30
30
AWS’s new sign-up gives accounts spend caps, email invites, and agent-set permissions
AWS's new sign-up flow gives fresh accounts agent-configured permissions, email-based team access, and per-project monthly spend caps starting at $20.
New AWS customers can sign up with Google, GitHub, or Apple identities, start with $100 in Free Tier credits, and build inside a project where AWS and coding agents automatically configure permissions and install tools like the AWS CLI and Agent Toolkit. In a demo, an agent deployed a Lambda function, DynamoDB table, and API Gateway endpoint without any manually written IAM policies. Paid projects get monthly spend limits starting at $20 that pause the project when reached, and the gradual rollout applies to new customers only.
35
Saving Jet Fuel
Tutorial optimizes flight paths to cut jet fuel costs using open-source Scikit-decide planning framework and OpenAP aircraft performance models.
A technical walkthrough demonstrates wind-aware flight path optimization using Scikit-decide, an open-source framework for reinforcement learning and automated planning, paired with OpenAP fuel-consumption models built by Dr. Junzi Sun at TU Delft and NOAA wind data. A Boeing 787-9 flying EWR to FCO can require roughly $68K in fuel, and adjusted routing could save thousands. The post uses Python 3.12, DuckDB with spatial extensions, and QGIS for map rendering.
12
NVIDIA Open-Sources OSMO: One YAML Orchestrates Physical AI Training, Simulation, and Robot Testing
NVIDIA open-sourced OSMO, a Kubernetes-native YAML orchestrator running physical-AI training, simulation, and robot testing across mixed GPU tiers.
OSMO (Apache-2.0, latest release 6.3.1) lets teams describe training, simulation, and hardware-in-the-loop pipelines in a single YAML and routes tasks across datacenter GPUs (GB200), workstation RTX hardware, and edge devices like Jetson AGX Thor. It ships Helm charts and containers on NGC, uses the KAI Scheduler with NVLink topology-aware placement, and includes RBAC, OAuth2, and TLS termination. NVIDIA says it is battle-tested on GR00T, Isaac Lab, Isaac Sim, and Isaac ROS, and integrates with Claude Code, OpenAI Codex, and Cursor agents.
48
GPT-6 Astra needs leaner prompts and fewer guardrails, OpenAI recommends
OpenAI's Eric Provencher advises developers using GPT-6 Astra to shorten skill descriptions, trim AGENTS.md reading requirements, relax approval rules, and define clear completion goals.
OpenAI's Eric Provencher published guidance on adapting developer setups when switching to GPT-6 Astra, arguing that overly long skill descriptions, blanket reading requirements, and rigid approval rules waste context or make the agent stop too early. Skills are Markdown prompt files whose names and descriptions enter Codex's context, and too many or conflicting skills cause truncation and wrong skill selection. He recommends selective document references in AGENTS.md, explicit permissions for safe operations like local test runs, and defining upfront what "done" means, since Astra may stop earlier than GPT-5.6 Sol even without restrictions.
32
Top 5 AI Gateways for Enterprise (2026 Guide)
A 2026 buyer's guide ranks NeuralTrust TrustGate, Kong AI Gateway, and Cloudflare AI Gateway as top enterprise AI gateways for security and governance.
The guide evaluates enterprise AI gateways on security, governance, routing, observability, and agent ecosystem support. NeuralTrust TrustGate ranks first for identity-aware agent governance across models, MCP servers, tools, and agent-to-agent traffic, with SaaS, hybrid, and private deployment options. Kong AI Gateway is recommended for organizations with mature API infrastructure, while Cloudflare AI Gateway emphasizes caching, retries, model fallbacks, and prompt/response guardrails.
12
RTK reports token savings, but our cost benchmarks disagree
Quesma's $1,500 benchmark found RTK cuts reported token output but changes Claude Code and DeepSeek coding costs by only about 5% on Terminal-Bench 2.1.
Quesma benchmarked RTK (Rust Token Killer), a popular tool with 79k GitHub stars that filters terminal output for AI coding agents, whose README claims up to 90% output reduction. Across 1,740 Terminal-Bench 2.1 attempts running Claude Code with Fable 5.0 and OpenCode with DeepSeek V4 Pro 0813, total costs moved only -5% for Fable and +5% for DeepSeek, with pass rates dropping 1-2%. RTK's own rtk gain metric reported 349.2 million tokens saved (an 89% reduction) across 445 DeepSeek attempts, but this did not correlate with actual cost savings, and cached terminal-output reads cost as little as 1/10 to 1/30 of regular input tokens. A bug in rtk find 0.45.0 caused one agent to loop with 339 consecutive errors, costing roughly 9x the baseline attempt, though the task still passed.
42
Meet Redis LangCache: A Managed Semantic Cache That Cuts LLM API Costs by Up to 90% and Returns Cache Hits Up to 15x Faster
Redis launches LangCache, a managed semantic cache matching LLM prompts by meaning, cutting API costs up to 90% and returning hits up to 15x faster.
Redis LangCache is a fully managed semantic caching service in public preview on Redis Cloud, accessed via a REST API with Python and JavaScript SDKs. It embeds incoming prompts, vector-searches stored entries, and returns a cached response when similarity clears a configured threshold, skipping the LLM call entirely. Redis claims up to 90% cost savings and up to 15x faster cache hits; a demo run showed 0.37 seconds versus 2.232 seconds direct inference (about 6x) with zero LLM tokens. Customer Mangoes.ai reports a 70% hit rate, 70% lower LLM spend, and 4x faster responses on a patient-care voice app.
30
OpenAI Launches the Agents API in Public Beta, Putting the Codex Harness Behind One API Call
OpenAI released its Agents API in public beta, exposing the managed Codex harness with hosted or self-hosted sandboxes, MCP tools, and subagents.
The Agents API is a managed service built on the open-source Codex harness, handling context compaction, tool search, programmatic tool calling, and multi-agent orchestration. Agents run in OpenAI-hosted sandboxes, self-hosted environments, or partner sandboxes from Blaxel, Cloudflare, Daytona, DigitalOcean, E2B, Modal, Oracle, Runloop, and Vercel. Data residency is US-only and Zero Data Retention is unsupported. Examples use model gpt-6-astra; vendor-reported results include SafetyKit cutting case review cost 60% and Ciridae achieving 4x lower subagent latency.
78
UC Berkeley Researchers Release CUA-Lite, an Open Platform Unifying Sandboxes, Data, Evaluation and RL for Computer-Use Agents
UC Berkeley's CUA-Lite is an open platform unifying computer-use agent sandboxes, datasets, evaluation and RL; Lite.OSWorld cuts OSWorld memory 4.1 GB to 0.9 GB.
UC Berkeley researchers released CUA-Lite, an open platform placing agents, environments, traces, and training for computer-use agents behind one action space, one LiteSample schema, and one command across desktop, browser, and mobile. Lite.OSWorld reproduces the OSWorld task suite and evaluators in plain Docker containers (0.9 GB RAM vs 4.1 GB, cold start 23.8s, ~4.6× more parallel instances), with scores matching the QEMU/KVM VM across 13 models. The platform claims 30k+ verifiable tasks, 15+ benchmarks, 10+ agents, and 20+ datasets on Hugging Face including Aguvis, OpenCUA, and ScaleCUA. A documented SFT run lifts Qwen3-VL-2B-Instruct mean episode return from 0.138 to 0.237 on the 332-task lite.osworld split.
45
Nous Research Adds One-Click Local Model Setup to Hermes Desktop
Nous Research's Hermes Desktop now offers one-click local model setup that reads hardware, picks a fitting quantization, downloads weights, and configures llama.cpp automatically.
Hermes Desktop, the MIT-licensed build of the open-source Hermes Agent, now sets up local models in one click: it reads the machine's hardware, selects a model that fits, downloads weights, and configures the inference runtime. It manages a pinned llama.cpp build with CUDA, Metal, Vulkan, HIP, and CPU backends, and shows green/amber/red memory-fit verdicts per catalog model before download. Quantization floors at 4-bit, and recommended models guarantee at least a 64K context window protected by ordered RAM offload (expert weights first, never the attention cache). It runs on macOS 12+, Windows 10/11, and Linux with no account required for local models.
25
Using Blender with coding agents on macOS
Simon Willison demonstrates driving the Blender macOS app with ChatGPT Codex coding agents to render scenes via Python, costing roughly $4.24 at API rates.
Willison documents installing the full Blender application from blender.org and using ChatGPT Codex on macOS to render a pelican-riding-a-bicycle scene through Blender's Python API. He refined the output with follow-up prompts. AgentsView estimated the equivalent API cost at $4.24 for gpt-6-astra.
25
numbat - AI agent observability, (Fri, Sep 4th)
SANS reviews Perplexity's open source numbat, a Go-based tool giving security teams observability, detection rules, and enforcement for AI agents like Claude and Gemini.
Numbat, Perplexity AI's open source observability tool, monitors desktop, CLI, IDE, and gateway AI agents through local hooks, OTLP/HTTP logs, and on-disk session artifacts. It ships detection rules mapped to MITRE ATT&CK (e.g., recon.network_sweep / T1046), supports enforcement mode, and packages investigations with SHA256-verified manifests and timelines. The SANS review positions it as a response to unmanaged AI agent and MCP server sprawl highlighted by the OpenAI/Hugging Face incident.
42
GitLab 19.3 helps enterprises scale agentic development securely
GitLab 19.3 runs its Duo Agent Platform AI Gateway inside Dedicated single-tenant environments and adds Secrets Manager plus agentic SAST remediation.
GitLab 19.3 lets GitLab Dedicated customers run the Duo Agent Platform AI Gateway within the same single-tenant environment and region, with support for bring-your-own inference models. The release adds Secrets Manager in limited availability scoping secrets to environment and branch across Kubernetes, Terraform, and OpenTofu, plus bulk SAST false positive detection and agentic vulnerability resolution generating ready-to-merge fixes. Flow Creator Agent creates automation flows from plain-language descriptions, and GitLab Credits usage caps are now generally available.
32
30
30
30
30
30
30
30
30
30
30
30
30
30
30
30
30
30
30