ZeroHour

Search: “utilization”

148 stories

Same Cluster, 33 Points More Utilization: What Changed Was the Order

A Dharma AI blog post on Hugging Face claims GPU cluster utilization rose 33 points after changing job ordering.

A community blog post published on Hugging Face, part of a GPU management series by Dharma AI, discusses improving utilization on the same GPU cluster. According to the title, reordering jobs or tasks was the change that produced roughly 33 additional points of utilization. No article body was available for further detail.

Hugging Face Blog · Aug 17, 2026AI tools & infra

Rapidly scaling online storage to serve over 1 billion ChatGPT users

OpenAI's Habitat online storage platform now handles over 70 million requests per second and 500 PB of data for 1 billion users.

OpenAI details the evolution of Habitat, its online storage platform backing ChatGPT and other products, which began in mid-2024 as a Python client-side library over Azure Cosmos DB. Habitat now processes more than 70 million requests per second, serves over 500 petabytes of data across nearly 40 geographic regions, and supports over 1 billion users weekly. By mid-2025 the client library approach became brittle, so OpenAI moved Habitat into a standalone service to centralize deployments, observability, and multi-tenancy reliability. This is part one of a two-part series; a future post will cover read optimization and scaling the Azure Cosmos DB partnership.

OpenAI News · 5d agoAI tools & infra1

Implementation of Machine Learning Workflows with NVIDIA cuML, RAPIDS, GPU Benchmarking, Explainability, Clustering, and Model Inference

Hands-on tutorial implements NVIDIA cuML and RAPIDS to GPU-accelerate scikit-learn-style ML workflows with benchmarking, clustering, and inference.

The tutorial demonstrates NVIDIA cuML as a GPU-accelerated machine learning framework, using cuml.accel to speed up unmodified scikit-learn scripts with zero code changes and the native cuML API for CuPy/cuDF interoperability. It benchmarks CPU versus GPU implementations of PCA, K-Means, nearest-neighbor search, logistic regression, random forests, and DBSCAN on datasets up to 200,000 samples with 64 features. It also builds GPU pipelines with UMAP, t-SNE, and HDBSCAN, validates GPU-generated SHAP explanations, uses the FIL library for forest inference, and covers model serialization and GPU/CPU portability.

MarkTechPost · 3d agoAI tools & infra

Saving Jet Fuel

Tutorial optimizes flight paths to cut jet fuel costs using open-source Scikit-decide planning framework and OpenAP aircraft performance models.

A technical walkthrough demonstrates wind-aware flight path optimization using Scikit-decide, an open-source framework for reinforcement learning and automated planning, paired with OpenAP fuel-consumption models built by Dr. Junzi Sun at TU Delft and NOAA wind data. A Boeing 787-9 flying EWR to FCO can require roughly $68K in fuel, and adjusted routing could save thousands. The post uses Python 3.12, DuckDB with spatial extensions, and QGIS for map rendering.

numbat - AI agent observability, (Fri, Sep 4th)

SANS reviews Perplexity's open source numbat, a Go-based tool giving security teams observability, detection rules, and enforcement for AI agents like Claude and Gemini.

Numbat, Perplexity AI's open source observability tool, monitors desktop, CLI, IDE, and gateway AI agents through local hooks, OTLP/HTTP logs, and on-disk session artifacts. It ships detection rules mapped to MITRE ATT&CK (e.g., recon.network_sweep / T1046), supports enforcement mode, and packages investigations with SHA256-verified manifests and timelines. The SANS review positions it as a response to unmanaged AI agent and MCP server sprawl highlighted by the OpenAI/Hugging Face incident.

SANS Internet Storm Center · 11d agoAI tools & infra

DataGrout helps enterprises control AI usage, governance and LLM costs

SelectHub launched DataGrout, an LLM cost and governance platform combining dynamic context pruning, symbolic inference and MCP gating, claiming about 60% token reduction.

SelectHub launched DataGrout, an LLM inference optimization and AI governance platform combining dynamic context pruning, a symbolic inference layer, and an MCP gateway with per-call token and cost monitoring. Early tests claim roughly 60% token reduction on data-intensive ERP and CRM integration tasks without accuracy loss. The platform connects via its Conduit SDK, MCP or JSON-RPC, offers its own MCP servers for SaaS apps such as Salesforce, SAP and ServiceNow, and supports bring-your-own-key LLM access or gateways like Amazon Bedrock and Kong.

Help Net Security · Aug 13, 2026AI tools & infra1