QAM: Quadratic-Accurate Checkpoint Merging via Sequential Consistency
QAM merges checkpoints to match sequential gradient descent through second order, with an O(h^3) error bound.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #openeurollm
Complex KDA: Understanding and Enhancing the Expressivity of Kimi Delta Attention
Complex KDA extends Kimi Delta Attention so one transition can represent 2D rotations and stronger state tracking.