AutoCompress Framework for Hardware-Guided Model Compression
AutoCompress optimizes LLM architectures for latency and memory constraints, improving accuracy over Minitron by up to 6.57 percentage points.
1 stories, newest first · one card per story
AutoCompress optimizes LLM architectures for latency and memory constraints, improving accuracy over Minitron by up to 6.57 percentage points.
Today 1K readers · 1.5K views · 474 reads · all time 184K views