聖塔非研究所

更多數據的危害:下一代水庫運算的不穩定性和正規化

2025-07-01 · 已發表論文 · 更新 2026/08/30 下午12:48

摘要 It has been found recently that more data can, counter intuitively, hurt the performance of deep 神經 網絡s. Here, we show that a more extreme version of the phenomenon occurs in data driven …

本頁只刊出中文翻譯與中文說明;英文原文請見下方原文連結。

原文連結

論文資訊

  • 類型:已發表論文
  • 日期:2025-07-01

摘要

It has been found recently that more data can, counter-intuitively, hurt the performance of deep 神經 網絡s. Here, we show that a more extreme version of the phenomenon occurs in data-driven models of dynamical systems. To elucidate the underlying mechanism, we focus on next-generation reservoir computing (NGRC)-a popular framework for learning dynamics from data. We find that, despite learning a better representation of the flow map with more training data, NGRC can adopt an ill-conditioned "integrator" and lose stability. We link this data-induced instability to the auxiliary dimensions created by the delayed states in NGRC. Based on these findings, we propose simple strategies to mitigate the instability, either by increasing regularization strength in tandem with data size, or by carefully

※ 此為已發表論文,全文需透過期刊付費取得