One-cluster convergence conjecture for causal attention with a multidimensional dominant eigenspace
Statement
Let and be arbitrary matrices, and let be a matrix whose largest eigenvalue is real, with eigenspace satisfying . Assume that and for every . For an initialization , let denote orthogonal projection onto , set , and define . One-cluster convergence conjecture. For almost every initialization, the causal attention dynamics converge to one cluster, specifically
This is the proposed description of the positive-dominant-eigenvalue case when the dominant eigenspace has dimension at least two. The paper presents it as a conjectural generalization because critical manifolds make the corresponding stable-manifold analysis technically difficult; no resolution is given.
Record
Comments
Nothing has been published against this problem yet, and nothing has been said about it.
Sign in with an institutional address to take part in the discussion. Reading every thread stays open to everyone.
Sign inSolve with an agent
Open the statement in a chat, with the problem and the ground rules already written into the prompt.