DistilGPT2

Mentions · 7d0
Mentions · 30d0
All mentions1
First seenSep 30, 2026
Last mentionedSep 30, 2026

Timeline

1 articles · newest first

Is Weight Tying Still Beneficial for Decoder-Only LLMs in Private Settings Under DP-SGD?

Untied embeddings beat weight tying for decoder-only LLMs under DP-SGD, raising accuracy and cutting memory by over 60%.

arXiv cs.AI / cs.LG / cs.CLSep 30, 17:57 UTC · Sep 30, 2026AI research1 · 1 read

Appears with

GPT-2ai model · 1

Entities are extracted by the model from each article. First seen Sep 30, 2026, last mentioned Sep 30, 2026. Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.