Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility
SAE reconstruction converges on far less data, but one-to-one feature matches keep rising with more tokens.
1 stories, newest first · one card per story
SAE reconstruction converges on far less data, but one-to-one feature matches keep rising with more tokens.
Today 2.2K readers · 3K views · 459 reads · all time 111K views