Journal
NANOPHOTONICS
Volume 12, Issue 5, Pages 937-947Publisher
WALTER DE GRUYTER GMBH
DOI: 10.1515/nanoph-2022-0415
Keywords
information processing capacity; memory capacity; nonlinear oscillator; reservoir computing
Ask authors/readers for more resources
This article investigates the relationship between information processing capacity and task performance, finding poor correlation between them. A new method for calculating task mean square error is proposed, and it is found that there is good consistency between predicted and actual errors as long as the task input sequences do not have long autocorrelation times.
In the reservoir computing literature, the information processing capacity is frequently used to characterize the computing capabilities of a reservoir. However, it remains unclear how the information processing capacity connects to the performance on specific tasks. We demonstrate on a set of standard benchmark tasks that the total information processing capacity correlates poorly with task specific performance. Further, we derive an expression for the normalized mean square error of a task as a weighted function of the individual information processing capacities. Mathematically, the derivation requires the task to have the same input distribution as used to calculate the information processing capacities. We test our method on a range of tasks that violate this requirement and find good qualitative agreement between the predicted and the actual errors as long as the task input sequences do not have long autocorrelation times. Our method offers deeper insight into the principles governing reservoir computing performance. It also increases the utility of the evaluation of information processing capacities, which are typically defined on i.i.d. input, even if specific tasks deliver inputs stemming from different distributions. Moreover, it offers the possibility of reducing the experimental cost of optimizing physical reservoirs, such as those implemented in photonic systems.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available