1 post tagged residual-connections.
Fixed residual mixing creates a structural bottleneck that attention-based residuals can finally solve.