MAIS-O43 sparse-autoencoder phase-diagram open problem
Statement
For the synthetic sparse-coding experiment specified by MAIS-O43, with nesting fraction , sparsity penalty , and dictionary size , determine the phase diagram of trained sparse autoencoders: for each parameter cell, do training runs recover the true dictionary, merge nested features, or converge to another solution such as a diffuse representation? In particular, determine whether trained sparse autoencoders can systematically converge to solutions distinct from global minimizers of the exact sparse-coding objective, despite achieving near-perfect reconstruction, and characterize the conditions under which each behavior occurs.
Record
- Added
Comments
Nothing has been published against this problem yet, and nothing has been said about it.
Sign in with an institutional address to take part in the discussion. Reading every thread stays open to everyone.
Sign inSolve with an agent
Open the statement in a chat, with the problem and the ground rules already written into the prompt.