A tighter generalization bound for reservoir computing

Xinyu Han, Yi Zhao, Michael Small

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

While reservoir computing (RC) has demonstrated astonishing performance in many practical scenarios, the understanding of its capability for generalization on previously unseen data is limited. To address this issue, we propose a novel generalization bound for RC based on the empirical Rademacher complexity under the probably approximately correct learning framework. Note that the generalization bound for the RC is derived in terms of the model hyperparameters. For this reason, it can explore the dependencies of the generalization bound for RC on its hyperparameters. Compared with the existing generalization bound, our generalization bound for RC is tighter, which is verified by numerical experiments. Furthermore, we study the generalization bound for the RC corresponding to different reservoir graphs, including directed acyclic graph (DAG) and Erdos-R e nyi undirected random graph (ER graph). Specifically, the generalization bound for the RC whose reservoir graph is designated as a DAG can be refined by leveraging the structural property (i.e., the longest path length) of the DAG. Finally, both theoretical and experimental findings confirm that the generalization bound for the RC of a DAG is lower and less sensitive to the model hyperparameters than that for the RC of an ER graph.

Original languageEnglish
Article number043115
JournalChaos
Volume32
Issue number4
DOIs
Publication statusPublished - 1 Apr 2022

Fingerprint

Dive into the research topics of 'A tighter generalization bound for reservoir computing'. Together they form a unique fingerprint.

Cite this