Scalability Analysis of Distributed Kolmogorov-Arnold Network Training on High-Performance Computing Systems
An empirical study shows distributed Kolmogorov-Arnold Network training reaches 74.7% parallel efficiency at 8 A100 GPUs, with overheads driven by All-Reduce choices.