NN3: Energy Separation: How the Primes Teach Us to Build Modular Neural Networks

Training large neural networks is constrained by the need for synchronized gradient computation across all parameters. Even "embarrassingly parallel" architectures communicate through shared loss functions, creating bottlenecks that limit scalability. The loss function couples what should be independent. It is the bottleneck. We show that the Energy Separation Theorem from the Canvas Model's proof of the Riemann Hypothesis provides a principled path to true modularity. On the prime lattice, the spectral energy separates exactly across primes: E = E_0 + \sum_p E_p, with no cross-terms. Each prime independently minimizes its own energy. The Riemann zeta function—one of the most complex objects in mathematics—is computed by an ensemble of modules that do not communicate, do not share parameters, and do not coordinate their optimization. What this paper provides: · A principled condition for loss separation. A loss function is separable when it can be written as \mathcal{L}(W_1, \ldots, W_K) = \mathcal{L}_0 + \sum_i \mathcal{L}_i(W_i) with vanishing cross-derivatives \partial^2 \mathcal{L} / \partial W_i \partial W_j = 0 for i \neq j. When the loss separates, the gradient for module i depends only on \mathcal{L}_i. No gradient communication is required. No synchronization is needed.· Sufficient conditions for architectural separation: Additive output (y = \sum_i f_i(x; W_i)), additive loss (\mathcal{L} = \sum_i \ell(y_i, y_i^*)), disjoint parameters, and known targets for each module. These conditions are architectural choices that guarantee exact separation.· A concrete separable architecture (Sum-of-Experts). The network output is the sum of independent module outputs. Each module trains on its own device with no communication. The training loop is embarrassingly parallel at the loss-function level. The primes are the existence proof that such separation is possible; the architecture is the blueprint for achieving it.· Empirical validation on a synthetic separable task. The target is the sum of three independent functions. Separable modules achieve better accuracy than a single network with the same total capacity, train in half the time (parallel execution), and the cross-derivatives are identically zero throughout training—verified by explicit computation.· Validation on multi-task MNIST. Three tasks (digit classification, even/odd, greater than 4) are assigned to independent modules. Separable modules match or exceed the accuracy of shared-backbone and separate-network baselines while training each module independently. Training time for K modules on K devices is constant as K grows.· The blind separation problem (unsolved). The experiments assume known targets for each module. In real-world tasks without natural decompositions, the decomposition must be discovered from data. The Energy Separation Theorem guarantees that a decomposition exists; it does not provide an algorithm for finding it. Four approaches are proposed (data-driven, functional, emergent, residual) but none are complete. This is the central open problem opened by this work.· Comparison to existing modular architectures. Mixture of Experts requires a gating network (high communication). Pathways uses shared layers (communication). Ensemble methods achieve loss separation but cannot specialize modules. Separable modules achieve both specialization and independence. Why this matters: The primes train independently. Their energies separate. Their contributions to the Euler product do not interfere. The Riemann zeta function—encoding the distribution of primes, connected to the zeros on the critical line, the subject of the greatest unsolved problem in mathematics for 165 years—is computed by an ensemble of modules that do not communicate, do not share parameters, and do not coordinate their optimization. This is not a metaphor. It is a mathematical fact, proved in the Canvas Model's resolution of the Riemann Hypothesis. If the primes can do it, neural network modules can do it. The architectural challenge now is to solve the blind separation problem—to discover the decomposition when it is not given—and to scale separable architectures to the tasks where communication bottlenecks currently limit what can be built. Keywords: Energy Separation Theorem, modular neural networks, separable loss, Riemann zeta function, prime lattice, distributed training, communication-free optimization, sum-of-experts, blind separation, mixture of experts, Canvas Model