Bridging Known and Unknown Dynamics: Machine Learning Inference From Sparse Observations

In applications, an anticipated issue is where the system of interest has never been encountered before and sparse observations can be made only once. Can the dynamics be faithfully reconstructed? We address this challenge by developing a hybrid transformer and reservoir-computing scheme. The transformer is trained without using data from the target system, but with essentially unlimited synthetic data from known chaotic systems. The trained transformer is then tested with the sparse data from the target system, and its output is further fed into a reservoir computer for predicting its long-term dynamics or the attractor. The power of the proposed hybrid machine-learning framework is demonstrated using various prototypical nonlinear systems, where the dynamics can be faithfully reconstructed even with 80% sparsity. The framework provides a paradigm of reconstructing complex and nonlinear dynamics in the extreme situation where training data do not exist and the observations are random and sparse.