Imperial College Researcher Shows Self-Attention Solves Quantum Pair Correlations Where Neural Nets Fail
A new paper argues that self-attention works like the Dyson equation from many-body physics, which would explain why sum-pooling models break down on correlated quantum states.