TY - JOUR
T1 - Reservoir computing with higher-order interactive coupled pendulums
AU - Li, Xueqi
AU - Small, Michael
AU - Lei, Youming
N1 - Funding Information:
This work is supported by the National Natural Science Foundation of China (Grant No. 12072262), and by the Shaanxi Computer Society and Xi'an Xiangteng Microelectronics Technology Co., Ltd. We express our gratitude to the anonymous reviewers for thoughtful suggestions. The authors declare no potential conflicts of interest with respect to the research, authorship, and publication of this manuscript.
Publisher Copyright:
© 2023 American Physical Society.
PY - 2023/12
Y1 - 2023/12
N2 - The reservoir computing approach utilizes a time series of measurements as input to a high-dimensional dynamical system known as a reservoir. However, the approach relies on sampling a random matrix to define its underlying reservoir layer, which leads to numerous hyperparameters that need to be optimized. Here, we propose a nonlocally coupled pendulum model with higher-order interactions as a novel reservoir, which requires no random underlying matrices and fewer hyperparameters. We use Bayesian optimization to explore the hyperparameter space within a minimal number of iterations and train the coupled pendulums model to reproduce the chaotic attractors, which simplifies complicated hyperparameter optimization. We illustrate the effectiveness of our technique with the Lorenz system and the Hindmarsh-Rose neuronal model, and we calculate the Pearson correlation coefficients between time series and the Hausdorff metrics in the phase space. We demonstrate the contribution of higher-order interactions by analyzing the interaction between different reservoir configurations and prediction performance, as well as computations of the largest Lyapunov exponents. The chimera state is found as the most effective dynamical regime for prediction. The findings, where we present a new reservoir structure, offer potential applications in the design of high-performance modeling of dynamics in physical systems.
AB - The reservoir computing approach utilizes a time series of measurements as input to a high-dimensional dynamical system known as a reservoir. However, the approach relies on sampling a random matrix to define its underlying reservoir layer, which leads to numerous hyperparameters that need to be optimized. Here, we propose a nonlocally coupled pendulum model with higher-order interactions as a novel reservoir, which requires no random underlying matrices and fewer hyperparameters. We use Bayesian optimization to explore the hyperparameter space within a minimal number of iterations and train the coupled pendulums model to reproduce the chaotic attractors, which simplifies complicated hyperparameter optimization. We illustrate the effectiveness of our technique with the Lorenz system and the Hindmarsh-Rose neuronal model, and we calculate the Pearson correlation coefficients between time series and the Hausdorff metrics in the phase space. We demonstrate the contribution of higher-order interactions by analyzing the interaction between different reservoir configurations and prediction performance, as well as computations of the largest Lyapunov exponents. The chimera state is found as the most effective dynamical regime for prediction. The findings, where we present a new reservoir structure, offer potential applications in the design of high-performance modeling of dynamics in physical systems.
UR - http://www.scopus.com/inward/record.url?scp=85181030719&partnerID=8YFLogxK
U2 - 10.1103/PhysRevE.108.064304
DO - 10.1103/PhysRevE.108.064304
M3 - Article
C2 - 38243442
AN - SCOPUS:85181030719
SN - 2470-0045
VL - 108
JO - Physical Review E
JF - Physical Review E
IS - 6
M1 - 064304
ER -