KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation
KernelZero-7B beats Claude-4.5-Sonnet and DeepSeek-V4-Pro on CUDA and Triton kernel generation.
KernelZero co-evolves a Proposer that generates Torch modules and a Coder that translates them into CUDA or Triton kernels. Frontier-driven module generation supplies training data aligned with the Coder's weaknesses, and Correctness-Aware Group Relative Policy Optimization improves performance only after correctness is reliable. KernelZero-7B surpasses Claude-4.5-Sonnet on CUDA and DeepSeek-V4-Pro on Triton. On KernelBench Levels 1 and 2, CUDA pass@1 is 75.8% and 69.6%, with pass@10 of 100% and 97%; Triton pass@1 is 77.2% and 72.5%.
58