Filtering Nonlinear Turbulent Dynamical Systems through Conditional Gaussian Statistics

In this paper, a general conditional Gaussian framework for filtering complex turbulent systems is introduced. Despite the conditional Gaussianity, such systems are nevertheless highly nonlinear and are able to capture the non-Gaussian features of nature. The special structure of the filter allows closed analytical formulas for updating the posterior states and is thus computationally efficient. An information-theoretic framework is developed to assess the model error in the filter estimates. Three types of applications in filtering conditional Gaussian turbulent systems with model error are illustrated. First, dyad models are utilized to illustrate that ignoring the energy-conserving nonlinear interactions in designing filters leads to significant model errors in filtering turbulent signals from nature. Then a triad (noisy Lorenz 63) model is adopted to understand the model error due to noise inflation and underdispersion. It is also utilized as a test model to demonstrate the efficiency of a novel algorithm, which exploits the conditional Gaussian structure, to recover the time-dependent probability density functions associated with the unobserved variables. Furthermore, regarding model parameters as augmented state variables, the filtering framework is applied to the study of parameter estimation with detailed mathematical analysis. A new approach with judicious model error in the equations associated with the augmented state variables is proposed, which greatly enhances the efficiency in estimating model parameters. Other examples of this framework include recovering random compressible flows from noisy Lagrangian tracers, filtering the stochastic skeleton model of the Madden-Julian oscillation (MJO), and initialization of the unobserved variables in predicting the MJO/monsoon indices.