30
30
Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL
Hugging Face blog describes running async GRPO reinforcement learning with LoRA across HF Jobs using a storage bucket and proxy instead of NCCL.
A Hugging Face blog post titled 'Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL' explains an asynchronous Group Relative Policy Optimization training setup using LoRA adapters distributed across Hugging Face Jobs workers. The architecture coordinates training through an object storage bucket and a proxy server, removing the need for NCCL collective communication. No full article text was available at classification time.
25
How Hugging Face Inference Endpoints, Jobs, and Buckets Power Search on Papers with Code
Hugging Face explains how Inference Endpoints, Jobs, and Buckets power semantic search on Papers with Code.
Hugging Face describes the infrastructure behind search on Papers with Code, built on its Inference Endpoints, Jobs, and Buckets services. The post is a product-focused engineering walkthrough with no security impact.
20
Record, train, and deploy from one place with Strands Agents, LeRobot, and Hugging Face Storage Buckets
Hugging Face, Strands Agents, and LeRobot integrate with Storage Buckets for a unified record-train-deploy robotics data workflow.
Hugging Face announced an integrated robotics workflow combining LeRobot, Amazon's Strands Agents, and Hugging Face Storage Buckets. The setup lets developers record robot data, stream it in a data loop, train models, and deploy agents from a single place. No article body was available, so details beyond the title are limited.
30
30
30
30
30
Ask HN: How do you manage skills files?
A Hacker News thread debates whether agent skill files are worth managing, citing 2–4x output-token reductions on flagship models in one company's testing.
Commenters argue skills are stored prompts that help less-technical users compensate for weak prompting, while one participant reports company testing found skills reduce flagship-model output tokens by roughly 2–4x, a gap growing with newer models. Others note skills can bundle reusable scripts and inline commands for deterministic context building, and that harnesses now execute backticked commands before the agent sees the skill. Some argue improving model capability makes downloadable skills redundant.
15
Perplexity Details Its GPU Embedding Stack: How Ivy, Tulip and ROSE Serve pplx-embed
Perplexity details its GPU embedding serving stack (Ivy, Tulip, ROSE), which reuses LLM prefill/decode kernels, CUDA graphs, and LazyTensors to cut launch overhead.
Perplexity engineers published a deep dive on the serving infrastructure behind pplx-embed, used across Perplexity Search and its API platform. The stack comprises Ivy (Rust HTTP gateway), Tulip (gRPC scheduling and batching), and ROSE (Runtime-Optimized Serving Engine), which reuses LLM prefill and decode kernels rather than running a separate embedding engine. Optimizations include whole-model CUDA graphs with lazy capture and a LazyTensor abstraction that overlaps CPU batch preparation with in-flight GPU work. Benchmarks are reported against vLLM v0.22.0 in BF16, with FlashAttention 4 generally fastest but FlashInfer 3 winning on Qwen-based models at very long sequence lengths.
33
30
30
30
30
30
30
30
30
30
30