Partially trainable networks show a sharp approximation phase transition
For spherical biased-ReLU features at d=5 and τ=10, about 4.1% trainable width captures 90% of the bound reduction.
1 stories, newest first · one card per story
For spherical biased-ReLU features at d=5 and τ=10, about 4.1% trainable width captures 90% of the bound reduction.
Today 1.6K readers · 2.5K views · 778 reads · all time 189K views