Skip to content
NewA calmer, faster ZeroHour

NVIDIA Announces CUDA Rust with cuda-oxide (SIMT) and cutile-rs (Tile) for Compile-Time-Safe GPU Kernels

MarkTechPostby Asif Razzaq ()4 min read5 · 1 read
AI summary · glm-5.3-flashSummaries by Vani AI

NVIDIA launches CUDA Rust via open-source cuda-oxide (SIMT) and cutile-rs (Tile), bringing compile-time-safe Rust GPU kernels.

NVIDIA announced CUDA Rust, making Rust a first-class language for GPU kernels through two NVlabs open-source projects: cuda-oxide for the SIMT model and cutile-rs for the Tile model. Both use Rust's ownership and borrow checker to catch buffer aliasing bugs at compile time. cutile-rs is published on crates.io, runs on stable Rust 1.89+ with CUDA 13.3, and is already used in Hugging Face's Grout inference engine and mistral.rs; cuda-oxide is early alpha requiring nightly Rust, CUDA 12.x, and compute capability 8.0+. cuda-oxide compiles Rust MIR through the community Pliron IR framework and LLVM to PTX, while cutile-rs JIT-compiles kernels via CUDA Tile IR.

Key facts
  • cuda-oxide (SIMT) is early alpha, needing nightly Rust and CUDA 12.x+
  • cutile-rs (Tile) runs on stable Rust 1.89+ with CUDA 13.3
  • cutile-rs already powers Hugging Face Grout and mistral.rs
  • Both projects reject buffer aliasing at compile time; neither is production-ready
  • Planned interop keeps C++ and Python access for Rust kernel developers
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

4 min read at marktechpost.com

NVIDIA has announced CUDA Rust, a push to make Rust a first-class language for GPU kernels. Two open-source NVlabs projects cover the two CUDA programming models: cuda-oxide compiles SIMT kernels from Rust MIR through Pliron and LLVM to PTX, while cutile-rs JIT-compiles Tile kernels through CUDA Tile IR on stable Rust 1. 89+.

MarkTechPost

By Asif Razzaq · marktechpost.com

Read the full article at MarkTechPost

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.