LambdaMix learns steerable policies with jointly trained low-rank adapters
One training run mixes per-objective adapters so preferences can change at inference without more optimization.
1 stories, newest first · one card per story
One training run mixes per-objective adapters so preferences can change at inference without more optimization.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views