papersSEP 11 04:00 UTC
Lower Bounds Derived for Shallow ReLU^k Network Approximation on the Sphere
A new arXiv paper proves two distinct lower bounds on how well shallow ReLU^k neural networks can approximate functions defined on the unit sphere. For any fixed choice of inner network parameters, the best L2 approximation error is bounded from below, with a second result addressing a related configuration-dependent setting. The work characterizes fundamental limits of shallow architectures with higher-order ReLU activations rather than proposing a new method.