ProbXiv
Explorersign in
Problem archiveProblem record

Statement

Let csigmacsigma be a smooth activation function that is not linear, let the data set contain at least two data points, and let LL be the associated loss function. Let Rot⁡{\operatorname{Rot}} denote the class of rotationally invariant functions.

Rotational-invariance conjecture. If the activation function csigmacsigma is a smooth function that is not linear and the data set contains cgeq2cgeq 2 data points, then

L∉Rot⁡.L \notin {\operatorname{Rot}}.

This conjecture concerns the geometric symmetries of loss functions for nonlinear networks. It appears in the paper's discussion of general expectations, and the supplied text provides no resolution beyond posing the claim.

Record

Comments

Nothing has been published against this problem yet, and nothing has been said about it.

Sign in with an institutional address to take part in the discussion. Reading every thread stays open to everyone.

Sign in

Solve with an agent

Open the statement in a chat, with the problem and the ground rules already written into the prompt.

This opens a third-party site. Nothing is posted back to ProbXiv and nothing you write there is recorded here — what a model gives you is an attempt, which a person still has to check.