Parts-of-Speech as Emergent Categories in SAE Latent Space
Sparse autoencoder latents encode part-of-speech in distributed groups, not one-to-one grammatical features.
The paper uses part-of-speech tags to test what linguistic structure sparse autoencoder latents expose in language models. PoS distinctions are highly recoverable from SAE activations but do not map one latent to one category, and the effect is not explained by lexical memorization. Open and closed classes differ, with categories supported by compact, overlapping groups of sparse latents that remain stable on held-out data. The authors conclude SAEs localize morpho-syntactic information in a distributed, category-dependent way rather than as atomic grammatical features.
- Part-of-speech is highly recoverable from SAE activations, not one latent per tag.
- The signal is not reducible to lexical memorization.
- Open and closed PoS classes differ substantially in feature support.
- Compact latent groups stay stable on held-out data but overlap related categories.
Full article136 words · extracted from huggingface.co · click to collapse
Sparse AutoEncoders (SAEs) offer a promising way to inspect language model representations, but it is still unclear what kind of linguistic structure their latents expose. We use part-of-speech (PoS) categories as a controlled test case to study whether morpho-syntactic information is encoded by individual latents or by structured groups of features. We find that PoS distinctions are highly recoverable from SAE activations, but do not align with one-to-one latent / category mappings. This recoverability is not reducible to lexical memorisation, and Open and Closed PoS classes differ substantially. Categories are supported by compact groups of sparse latents, with substantial variation across tags. These groups remain stable on held-out data, while also showing overlap between related categories. Our results show that SAEs localise morpho-syntactic information in a distributed and category-dependent form rather than through atomic grammatical features.
Text extracted automatically; images, tables and formatting may be missing. Original: https://huggingface.co/papers/2609.29362