Gaussian equivalent model conjecture for generic feature maps
Statement
Let be independent samples from a data distribution on , and let the centred teacher and student features be
for feature maps and . Gaussian equivalent model conjecture. For a wide class of data distributions and feature maps, the generalisation and training errors of the estimator defined in the source are asymptotically captured by the equivalent Gaussian covariate model in which are jointly Gaussian variables, and hence by the corresponding closed-form expressions of the stated theorem. The conjecture proposes that this Gaussian replacement captures learning behaviour beyond the exactly Gaussian cases, including deterministic or data-learned feature maps; the source gives no resolution, so its validity remains open.
Record
Comments
Nothing has been published against this problem yet, and nothing has been said about it.
Sign in with an institutional address to take part in the discussion. Reading every thread stays open to everyone.
Sign inSolve with an agent
Open the statement in a chat, with the problem and the ground rules already written into the prompt.