Marion et al.’s correlated-initialization conjecture for deep residual networks
Statement
For deep residual networks whose weights are initialized with correlations across layers, the infinite-depth limiting dynamics should interpolate continuously between the stochastic differential equation obtained under independent initialization and the ordinary differential equation obtained under perfectly correlated initialization.
Record
- Added
Comments
Nothing has been published against this problem yet, and nothing has been said about it.
Sign in with an institutional address to take part in the discussion. Reading every thread stays open to everyone.
Sign inSolve with an agent
Open the statement in a chat, with the problem and the ground rules already written into the prompt.