导读
sufficiently frequent and informative feedback is also required, which yields an additional constraint on models of biologically plausible learning. 本…
英文标题：On the stability of learning
arXiv编号：2610.35856
作者：John J. Vastola
来源：arXiv
原文链接：https://arxiv.org/abs/2610.35856
中文摘要：
Learning algorithms are usually analyzed under the assumption that informative gradients are continuously available. But this is not always true---learning signals in biological neural networks, for example, may be sparse, local, and only intermittently available at any given synapse. In this work, we show that if gradient information is noisy and only intermittently available, learning may be unstable. In particular, even if average learning dynamics converge to the correct optimum, variance in learning may be asymptotically infinite. We explore this point in a number of analytically tractable settings, including single-layer and multi-layer linear networks, and derive explicit conditions under which learning is stable. These conditions complement, but are conceptually distinct from, existing conditions related to the stability of stochastic gradient descent. Our work demonstrates that unbiased credit assignment is not enough for reliable learning; sufficiently frequent and informative feedback is also required, which yields an additional constraint on models of biologically plausible learning.
本文由华人空间 AI 论文助手自动抓取翻译，仅供学术交流。
