**Research article**
18 Sep 2020

**Research article** | 18 Sep 2020

# Reconstructing coupled time series in climate systems using three kinds of machine-learning methods

Yu Huang, Lichao Yang, and Zuntao Fu

**Yu Huang et al.**Yu Huang, Lichao Yang, and Zuntao Fu

- Laboratory for Climate and Ocean-Atmosphere Studies, Department of Atmospheric and Oceanic Sciences, School of Physics, Peking University, Beijing, 100871, China

- Laboratory for Climate and Ocean-Atmosphere Studies, Department of Atmospheric and Oceanic Sciences, School of Physics, Peking University, Beijing, 100871, China

**Correspondence**: Zuntao Fu (fuzt@pku.edu.cn)

**Correspondence**: Zuntao Fu (fuzt@pku.edu.cn)

Received: 11 Oct 2019 – Discussion started: 04 Nov 2019 – Revised: 15 Jul 2020 – Accepted: 09 Aug 2020 – Published: 18 Sep 2020

Despite the great success of machine learning, its application in climate dynamics has not been well developed. One concern might be how well the trained neural networks could learn a dynamical system and what will be the potential application of this kind of learning. In this paper, three machine-learning methods are used: reservoir computer (RC), backpropagation-based (BP) artificial neural network, and long short-term memory (LSTM) neural network. It shows that the coupling relations or dynamics among variables in linear or nonlinear systems can be inferred by RC and LSTM, which can be further applied to reconstruct one time series from the other. Specifically, we analyzed the climatic toy models to address two questions: (i) what factors significantly influence machine-learning reconstruction and (ii) how do we select suitable explanatory variables for machine-learning reconstruction. The results reveal that both linear and nonlinear coupling relations between variables do influence the reconstruction quality of machine learning. If there is a strong linear coupling between two variables, then the reconstruction can be bidirectional, and both of these two variables can be an explanatory variable for reconstructing the other. When the linear coupling among variables is absent but with the significant nonlinear coupling, the machine-learning reconstruction between two variables is direction dependent, and it may be only unidirectional. Then the convergent cross mapping (CCM) causality index is proposed to determine which variable can be taken as the reconstructed one and which as the explanatory variable. In a real-world example, the Pearson correlation between the average tropical surface air temperature (TSAT) and the average Northern Hemisphere SAT (NHSAT) is weak (0.08), but the CCM index of NHSAT cross mapped with TSAT is large (0.70). And this indicates that TSAT can be well reconstructed from NHSAT through machine learning.

All results shown in this study could provide insights into machine-learning
approaches for paleoclimate reconstruction, parameterization scheme, and
prediction in related climate research.**Highlights:**

- i
The coupling dynamics learned by machine learning can be used to reconstruct time series.

- ii
Reconstruction quality is direction dependent and variable dependent for nonlinear systems.

- iii
The CCM index is a potential indicator to choose reconstructed and explanatory variables.

- iv
The tropical average SAT can be well reconstructed from the average Northern Hemisphere SAT.

Applying neural-network-based machine learning in climate fields has attracted great attention (Reichstein et al., 2019). A machine-learning approach can be applied to downscaling and data mining analyses (Mattingly et al., 2016; Racah et al., 2017) and can also be used to predict the time series of climate variables, such as temperature, humidity, runoff, and air pollution (Zaytar and Amrani, 2016; Biancofiore et al., 2017; Kratzert et al., 2019; Feng et al., 2019). Besides, previous studies found that some temporal dynamics of the underlying complex systems can be encoded in these climatic time series. For example, chaos is a crucial property of climatic time series (Lorenz, 1963; Patil et al., 2001). Thus, there is significant concern regarding the ability of machine-learning algorithms to reconstruct the temporal dynamics of the underlying complex systems (Pathak et al., 2017; Du et al., 2017; Lu et al., 2018; Carroll, 2018; Watson, 2019). The chaotic attractors in the Lorenz system and the Rossler system can be reconstructed by machine learning (Pathak et al., 2017; Lu et al., 2018; Carroll, 2018), and the Poincaré return map and Lyapunov exponent of the attractor can be recovered as well (Pathak et al., 2017; Lu et al., 2017). These results are important to deeply understand the applicability of machine learning in climate fields.

Though applying machine learning to climate fields has been attracting much attention, there are still open questions about what can be learned by machine learning during the training process and what is the key factor determining the performance of the machine-learning approach to climatic time series. These issues are crucial for investigating why machine learning cannot perform well with some datasets and how to improve the performance for them. One possible key factor is the coupling between different variables. Because different climate variables are coupled with one another in different ways (Donner and Large, 2008), the coupled variables will share their information content with one another through the information transfer (Takens, 1981; Schreiber, 2000; Sugihara et al., 2012). Furthermore, a coupling often results in the fact that the observational time series are statistically correlated (Brown, 1994). Correlation is a crucial property for the climate system, and it often influences the analysis of climatic time series. The Pearson coefficient is often used to detect the correlation, but it can only detect the linear correlation. It is known that when the Pearson correlation coefficient is weak, most of the tasks based on traditional regression methods will fail at dealing with the climatic data, such as fitting, reconstruction, and prediction (Brown, 1994; Sugihara et al., 2012; Emile-Geay and Tingley, 2016). However, a weak linear correlation does not mean that there is no coupling relation between the variables. Previous studies (Sugihara et al., 2012; Emile-Geay and Tingley, 2016) have suggested that although the linear correlation of two variables is potentially absent, it might be nonlinearly coupled. For instance, the linear cross-correlations of sea air temperature series observed in different tropical areas are overall weak, but they can be strong locally and vary with time (Ludescher et al., 2014); such a time-varying correlation is an indicator of nonlinear correlation (Sugihara et al., 2012). These nonlinear correlations of the sea air temperature series have been found to be conductive to the better El Niño predictions (Ludescher et al., 2014; Conti et al., 2017). The linear correlations between the ENSO/PDO index (El Niño–Southern Oscillation and Pacific Decadal Oscillation) and some proxy variables are also overall weak, but nonlinear coupling relations between them can be detected and contribute greatly to reconstructing longer paleoclimate time series (Mukhin et al., 2018). These studies indicate that nonlinear coupling relations would contribute to the better analysis, reconstruction, and prediction (Hsieh et al., 2006; Donner, 2012; Schurer et al., 2013; Badin et al., 2014; Drótos et al., 2015; Van Nes et al., 2015; Comeau et al., 2017; Vannitsem and Ekelmans, 2018). Accordingly, when applying machine learning to climatic series, is it necessary to pay attention to the linear or nonlinear relationships induced by the physical couplings? This question is what we want to address in this study.

In a recent study (Lu et al., 2017), a machine-learning method called
reservoir computer was used to reconstruct the unmeasured time series in the
Lorenz 63 model (Lorenz, 1963). It was found that the *Z* variable can be well
reconstructed from the *X* variable by reservoir computer, but it failed to
reconstruct *X* from *Z*. Lu et al. (2017) demonstrated that the
nonlinear coupling dynamic between *X* and *Z* was responsible for this asymmetry
in the reconstruction. This could be explained by the nonlinear
observability in control theory (Hermann and Krener, 1977; Lu et al., 2017):
for the Lorenz 63 equation, both sets, $\left(X\right(t),Y(t),Z(t\left)\right)$ and $(-X(t),-Y(t),Z(t\left)\right)$, could be its
solutions. Therefore, when *Z*(*t*) was acting as an observer, it cannot
distinguish *X*(*t*) from −*X*(*t*), and the information content of *X* was incomplete for
*Z*(*t*), which determined that *X* cannot be reconstructed by machine learning. The
nonlinear observability for a nonlinear system with a known equation can be
easily analyzed (Hermann and Krener, 1977; Schumann-Bischoff et al., 2016; Lu
et al., 2017). But for the observational data from a complex system without
any explicit equation, the nonlinear observability is hard to infer,
and few studies ever investigated this question. Furthermore, does such
asymmetric nonlinear observability in the reconstruction also exist in
nonlinearly coupled climatic time series? This is still an open question.

In this paper, we apply machine-learning approaches to learn the coupling relation between climatic time series (training period) and then reconstruct the series (testing period). Specifically, we aim to make progress on how the machine-learning approach is influenced by the physical couplings of climatic series, and the abovementioned questions are addressed. There are several variants of machine-learning methods (Reichstein et al., 2019), and recent studies (Lu et al., 2017; Reichstein et al., 2019; Chattopadhyay et al., 2020) suggest that three of them are more applicable to sequential data (like time series): reservoir computer (RC), backpropagation-based (BP) artificial neural network, and long short-term memory (LSTM) neural network. Here we adopt these three methods to carry out our study and provide a performance comparison among them. We first investigate their performance dependence on different coupling dynamics by analyzing a hierarchy of climatic conceptual models. Then we use a novel method to select explanatory variables for machine learning, and this can further detect the nonlinear observability (Hermann and Krener, 1977; Lu et al., 2017) for a complex system without any known explicit equations.

Finally, we will discuss a real-world example from the climate system. It is known that there exist atmospheric energy transportation systems between the tropics and the Northern Hemisphere, and this can result in coupling between the climate systems in these two regions (Farneti and Vallis, 2013). Due to the underlying complicated processes, it is difficult to use a set of formulas to cover the coupling relation between the average tropical surface air temperature (TSAT) series and the Northern Hemisphere surface air temperature (NHSAT) series. We employ machine-learning methods to investigate whether the NHSAT time series can be reconstructed from the TSAT time series and whether the TSAT time series can also be reconstructed from the NHSAT time series. In this way, the conclusions from our model simulations can be further tested and generalized.

Our paper is organized as follows. In Sect. 2, the methods for reconstructing time series and detecting coupling relation are introduced. The analyzed data and climate conceptual models are described in Sect. 3. In Sect. 4, we will investigate the association between the coupling relation and reconstruction quality by machine learning and present an application to real-world climate series. Finally the summary is given in Sect. 5.

## 2.1 Learning coupling relations and reconstructing coupled time series

Firstly, we introduce our workflow for learning couplings of dynamical
systems by machine learning and reconstructing the coupled time series. The
total time series can be divided into two parts: the training series (time
lasting denoted as *t*) and the testing series (time lasting denoted as *t*^{′}). For
the systems of toy models, the coupling relation or dynamics is stable and
unchanged with time; i.e., there is the stable coupling or dynamic relation
$b\left(t\right)=F\left[{a}_{\mathrm{1}}\right(t),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}(t),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},\phantom{\rule{0.125em}{0ex}}{a}_{n}(t\left)\right]$ among inputs ${a}_{\mathrm{1}}\left(t\right),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}\left(t\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},\phantom{\rule{0.125em}{0ex}}{a}_{n}\left(t\right)$ and output *b*(*t*). If this inherent coupling relation can
be inferred by machine learning in the training series, the inferred
coupling relation should be reflected by machine learning in the testing
series. Therefore, the workflow of our study can be summarized as follows
(Fig. 1):

- i
During the training period, ${a}_{\mathrm{1}}\left(t\right),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}\left(t\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}\left(t\right)$ and

*b*(*t*) are input into the machine-learning frameworks to learn the coupling or dynamic relation $b\left(t\right)=F\left[{a}_{\mathrm{1}}\right(t),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}(t),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}(t\left)\right]$. The inferred coupling relation is denoted as $b\left(t\right)=\widehat{F}\left[{a}_{\mathrm{1}}\right(t),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}(t),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},\phantom{\rule{0.125em}{0ex}}{a}_{n}(t\left)\right]$. Then it is tested whether this coupling relation can be reconstructed by machine learning. - ii
The second step is accomplished with the testing series to apply the inferred coupling relation $\widehat{F}$ together with only ${a}_{\mathrm{1}}\left({t}^{\prime}\right),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}\left({t}^{\prime}\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}\left({t}^{\prime}\right)$ to derive

*b*(*t*^{′}), denoted as $\widehat{b}\left({t}^{\prime}\right)$; $\widehat{b}\left({t}^{\prime}\right)$ is called “the reconstructed*b*(*t*^{′})”, since only ${a}_{\mathrm{1}}\left({t}^{\prime}\right),{a}_{\mathrm{2}}\left({t}^{\prime}\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}\left({t}^{\prime}\right)$ and the inferred coupling relation $\widehat{F}$ have been taken into account. - iii
The first objective of this study is to answer the question of whether the coupling relation $b\left(t\right)=F\left[{a}_{\mathrm{1}}\right(t),{a}_{\mathrm{2}}(t),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}(t\left)\right]$ can be reconstructed by machine learning, i.e., whether the inferred coupling relation $\widehat{F}$ can approximate the real coupling relation

*F*. Since we do not intend to reach an explicit formula of the reconstructed coupling relation $\widehat{F}$, we will answer this question indirectly by comparing the reconstructed series $\widehat{b}\left({t}^{\prime}\right)$ with the original series*b*(*t*^{′}). If $\widehat{b}\left({t}^{\prime}\right)\approx b\left({t}^{\prime}\right)$, then it can be regarded as $\widehat{F}\approx F$, and machine learning can indeed learn the intrinsic coupling relation among ${a}_{\mathrm{1}}\left(t\right),{a}_{\mathrm{2}}\left(t\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},\phantom{\rule{0.125em}{0ex}}{a}_{n}\left(t\right)$ and*b*(*t*). - iv
If machine learning can infer the intrinsic coupling relation between ${a}_{\mathrm{1}}\left(t\right),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}\left(t\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}\left(t\right)$ and

*b*(*t*), the inferred coupling relation $\widehat{F}$ can be applied to reconstruct output*b*(*t*^{′}) even if only ${a}_{\mathrm{1}}\left({t}^{\prime}\right),\phantom{\rule{0.125em}{0ex}}{a}_{\mathrm{2}}\left({t}^{\prime}\right),\phantom{\rule{0.125em}{0ex}}\mathrm{\dots}\phantom{\rule{0.125em}{0ex}},{a}_{n}\left({t}^{\prime}\right)$ are available.

## 2.2 Machine-learning methods

### 2.2.1 Reservoir computer

A newly developed neural network called RC (Du et al., 2017; Lu et al.,
2017; Pathak et al., 2018) has three layers: the input layer, the reservoir
layer, and the output layer (see Fig. 2). If *a*(*t*) and
*b*(*t*) denote two time series from a system, then the following steps can
be taken to estimate *b*(*t*) from *a*(*t*).

- i
(*a**t*) (a vector with length*L*) is input into the input layer and reservoir layer. There are four components in these layers: the initial reservoir state(*r**t*) (a vector with dimension*N*, representing the*N*neurons), the adjacent matrix**M**(size*N*×*N*) representing connectivity of the*N*neurons, the input-to-reservoir weight matrix**W**_{in}(size*N*×*L*), and the unit matrix**E**(size*N*×*N*), which is crucial for modulating the bias in the training process (Lu et al., 2018). The elements of**M**and**W**_{in}are randomly chosen from a uniform distribution in the interval [−1, 1], and we set*N*=1000 here. (We have tested that this choice yields good performance.) These components are employed to derive output as an updated reservoir state*r*^{*}(*t*):$$\begin{array}{}\text{(1)}& {\mathit{r}}^{*}\left(t\right)=\mathrm{tanh}[M\phantom{\rule{0.125em}{0ex}}\cdot \phantom{\rule{0.125em}{0ex}}r(t)\phantom{\rule{0.125em}{0ex}}+\phantom{\rule{0.125em}{0ex}}{\mathbf{W}}_{\mathrm{in}}\phantom{\rule{0.125em}{0ex}}\cdot \phantom{\rule{0.125em}{0ex}}a(t)\phantom{\rule{0.125em}{0ex}}+\phantom{\rule{0.125em}{0ex}}E].\end{array}$$ - ii
*r*^{*}(*t*) then transfers to the output layer that consists of the reservoir-to-output matrix**W**_{out}. And*r*^{*}(*t*) will be used to estimate the value of $\widehat{b}\left(t\right)$ (see Eq. 2).$$\begin{array}{}\text{(2)}& \widehat{b}\left(t\right)={\mathbf{W}}_{\mathrm{out}}\cdot {r}^{*}\left(t\right)\end{array}$$The mathematical form of

**W**_{out}is defined as$$\begin{array}{}\text{(3)}& {\mathbf{W}}_{\mathrm{out}}=\mathrm{arg}\phantom{\rule{0.25em}{0ex}}{\text{min}}_{{\mathbf{W}}_{\mathrm{out}}}\u2225{\mathbf{W}}_{\mathrm{out}}\cdot {r}^{*}\left(t\right)-b\left(t\right)\u2225+\mathit{\alpha}\u2225{\mathbf{W}}_{\mathrm{out}}\u2225,\end{array}$$

and it is a trainable matrix that fits the relation between *r*^{*}(*t*) and *b*(*t*) in the training
process. ∥⋅ ∥ denotes the
*L*_{2} norm of a vector (*L*_{2} represents the least square method) and
*α* is the ridge regression coefficient, whose values are determined
after the training.

After this reservoir neural network is trained, we can use it to estimate
*b*(*t*), and the estimated value is noted as $\widehat{b}\left(t\right)$.

### 2.2.2 Backpropagation-based artificial neural network

Here, the used BP neural network is a traditional neural computing
framework, and it has been widely used in climate research (Watson, 2019;
Reichstein et al., 2019; Chattopadhyay et al., 2020). There are six layers
in the BP neural network: the input layer has 8 neurons and four hidden layers
with 100 neurons each; the output layer has 8 neurons. In each layer, the
connectivity weights of the neurons need to be computed during the training
process, where the backpropagation optimization with the complicated
gradient decent algorithm is used (Dueben and Bauer, 2018). A crucial
difference between the BP and the RC neural networks is as follows: unlike
RC, all neuron states of the BP neural network are independent of the
temporal variation of time series (Reichstein et al., 2019; Chattopadhyay et
al., 2020), while the neurons of RC can track temporal evolution (such as
the neuron state ** r**(

*t*) in Fig. 2) (Chattopadhyay et al., 2020). If

*a*(

*t*) and

*b*(

*t*) are two time series of a system, we can reconstruct

*b*(

*t*) from

*a*(

*t*) through the BP neural network.

### 2.2.3 Long short-term memory neural network

The LSTM neural network is an improved recurrent neural network to deal with
time series (Reichstein et al., 2019; Chattopadhyay et al., 2020). As Fig. 3
shows, LSTM has a series of components: a memory cell, an input gate, an
output gate, and a forget gate. When a time series *a*(*t*) is input to train this
neural network, the information of *a*(*t*) will flow through all these
components, and then the parameters at different components will be computed
for fitting the relation between *a*(*t*) and *b*(*t*). The governing equations for the
LSTM architecture are shown in the appendix. After the training is
accomplished, *a*(*t*) can be used to reconstruct *b*(*t*) by this neural network.

The crucial improvement of LSTM on the traditional recurrent neural network (Reichstein et al., 2019) is that LSTM has a forget gate which controls the information of the previous time to flow into the neural network. This will enable the neuron states of LSTM to track the temporal evolution of time series (Kratzert et al., 2019; Reichstein et al., 2019; Chattopadhyay et al., 2020), and this is the crucial difference between the LSTM and the BP neural networks.

Here, we also test the LSTM neural network without the forget gate and call
it LSTM^{*}. This means that the information of the previous time
cannot flow into the LSTM^{*} neural network, which does not have any
memory of the past information. We will compare the performance of LSTM
with that of LSTM^{*}, so the role of the neural network memory
for the previous information can be presented.

## 2.3 Evaluation of reconstruction quality

The root-mean-square error (RMSE) of residuals is used here to evaluate the
quality of reconstruction (Hyndman and Koehler, 2006). The residual
represents the difference between the real series *b*(*t*^{′}) and the reconstructed
series $\widehat{b}\left({t}^{\prime}\right)$, and it is defined as

In order to fairly compare the errors of reconstructing different processes with different variability and units (Hyndman and Koehler, 2006; Pennekamp et al., 2019; Huang and Fu, 2019), we normalize the RMSE as

## 2.4 Coupling detection

### 2.4.1 Linear correlation

As mentioned in the introduction, the linear Pearson correlation is a
commonly used method to quantify the linear relationship between two
observational variables. The Pearson correlation between two series, *a*(*t*) and
*b*(*t*), is defined as

The terms “mean” and “SD” denote the average and standard deviation for the series, respectively.

### 2.4.2 Convergent cross mapping

To measure the nonlinear coupling relation between two observational
variables, we choose the convergent cross mapping (CCM) method that has been
demonstrated to be useful for many complex nonlinear systems (Sugihara et
al., 2012; Tsonis et al., 2018; Zhang et al., 2019). Considering *a*(*t*) and
*b*(*t*) as two observational time series, we begin with the cross mapping
(Sugihara et al., 2012) from *a*(*t*) to *b*(*t*) through the following steps:

- i
Embedding

*a*(*t*) (with length*L*) into the phase space is performed with a vector ${\mathit{M}}_{a}\left({t}_{i}\right)=\mathit{\{}{a}_{{t}_{i}},\phantom{\rule{0.125em}{0ex}}{a}_{{t}_{i}-\mathit{\tau}},\phantom{\rule{0.125em}{0ex}}\mathrm{\dots},\phantom{\rule{0.125em}{0ex}}{a}_{{t}_{i}\phantom{\rule{0.125em}{0ex}}-\phantom{\rule{0.125em}{0ex}}(m-\mathrm{1})\mathit{\tau}}\mathit{\}}$ (*t*_{i}represents a historical moment in the observations), where embedding dimension (*m*) and time delay (*τ*) can be determined through the false nearest-neighbor algorithm (Hegger and Kantz, 1999). - ii
Estimating the weight parameter

*w*_{i}denotes the associated weight between two vectors*M*_{a}(*t*) and*M*_{a}(*t*_{i}) (*t*denotes the excepted time in this cross mapping), and it is defined as$$\begin{array}{}\text{(7)}& {\displaystyle}{w}_{i}\phantom{\rule{0.125em}{0ex}}={\displaystyle \frac{{u}_{i}}{{\sum}_{i=\mathrm{1}}^{m+\mathrm{1}}{u}_{i}}},\text{(8)}& {\displaystyle}{u}_{i}\phantom{\rule{0.125em}{0ex}}=\phantom{\rule{0.125em}{0ex}}\mathrm{exp}{\displaystyle \frac{d\phantom{\rule{0.125em}{0ex}}\left[{\mathit{M}}_{a}\right(t),\phantom{\rule{0.125em}{0ex}}{\mathit{M}}_{a}({t}_{i}\left)\right]}{d\phantom{\rule{0.125em}{0ex}}\left[{\mathit{M}}_{a}\right(t),\phantom{\rule{0.125em}{0ex}}{\mathit{M}}_{a}({t}_{\mathrm{1}}\left)\right]}},\end{array}$$where

*d*[*M*_{a}(*t*),*M*_{a}(*t*_{i})] denotes the Euler distance between vectors*M*_{a}(*t*) and*M*_{a}(*t*_{i}). The nearest neighbor to*M*_{a}(*t*) generally corresponds to the largest weight. - iii
Cross mapping the value of

*b*(*t*) is performed through$$\begin{array}{}\text{(9)}& \widehat{b}\left(t\right)\phantom{\rule{0.125em}{0ex}}=\phantom{\rule{0.125em}{0ex}}{\sum}_{i=\mathrm{1}}^{m+\mathrm{1}}{w}_{i}b\left({t}_{i}\right).\end{array}$$$\widehat{b}\left(t\right)$ denotes the estimated value of

*b*(*t*) with this phase-space cross mapping. Then, we will evaluate the cross mapping skill (Sugihara et al., 2012; Tsonis et al., 2018) as:$$\begin{array}{}\text{(10)}& {\mathit{\rho}}_{a\to b}\phantom{\rule{0.125em}{0ex}}=\phantom{\rule{0.125em}{0ex}}\text{corr.}\phantom{\rule{0.125em}{0ex}}\left[b\right(t),\phantom{\rule{0.125em}{0ex}}\phantom{\rule{0.125em}{0ex}}\widehat{b}(t\left)\right].\end{array}$$

The cross mapping skill from *b* to *a* is also measured according to the above
steps (marked as *ρ*_{b→a}). Sugihara et al. (2012)
and Tsonis et al. (2018) defined the causal inference
according to *ρ*_{a→b} and *ρ*_{b→a} as (i) if *ρ*_{a→b} is convergent when *L* is increased and *ρ*_{a→b} is of high
magnitude, then *b* is suggested to be a causation of *a*. (ii) Besides, if *ρ*_{b→a} is also convergent when *L* is increased and is of high magnitude,
then the causal relationship between *a* and *b* is bidirectional (*a* and *b* cause
each other). In our study, all values of the CCM indices are measured when
they are convergent with the data length (Tsonis et al., 2018).

According to previous studies (Sugihara et al., 2012; Ye et al., 2015), the
CCM index is related to the ability of using one variable to reconstruct
another variable: if *b* influences *a* but *a* does not influence *b*, the information
content of *b* can be encoded in *a* (through the information transfer from *b* to
*a*), but the information content of *a* is not encoded in *b* (there exists no
information transfer from *a* to *b*). In this way, the time series of *b* can be
reconstructed from the records of *a*. For the CCM index (*ρ*_{a→b}),
its magnitude represents how much information content of *b* is encoded in the
records of *a*. Therefore, the high magnitude of *ρ*_{a→b} means that
*b* causes *a*, and we can get good reconstruction from *a* to *b*. In this paper, we
will test the association between the CCM index and the reconstruction
performance of machine learning.

## 3.1 Time series from conceptual climate models

For a linearly coupled model, the autoregressive fractionally integrated moving
average (ARFIMA) model (Granger and Joyeux, 1980) maps a Gaussian white
noise *ε*(*t*) into a correlated sequence *x*(*t*) (Eq. 11), which can
simulate the linear dynamics of an ocean–atmosphere coupled system
(Hasselmann, 1976; Franzke, 2012; Massah and Kantz, 2016; Cox et al., 2018).

In this model, *d* is a fractional differencing parameter, and *p* and *q* are the
orders of the autoregressive and moving average components, respectively. Here, the
parameters are set as *p*=3, *d*=0.2, and *q*=3. Hence *x*(*t*) is a time series
composed of three components: the third-order autoregressive process
whose coefficients are 0.6, 0.2, and 0.1; the fractional differencing process
with Hurst exponent 0.7; and the third-order moving-average process whose
coefficients are 0.3, 0.2, and 0.1 (Granger and Joyeux, 1980). These two time
series, *ε*(*t*) and *x*(*t*), are used for the reconstruction analysis.

For a nonlinearly coupled model, the Lorenz 63 chaotic system (Lorenz, 1963) depicts the nonlinear coupling relation in a low-dimensional chaotic system. The system reads as

When the parameters are fixed at (*σ*, *μ*, *B*)= (10, 28, 8∕3),
the state in the system is chaotic. We employed the fourth-order Runge–Kutta
integrator to acquire the series output from this Lorenz 63 system. The time
step was taken as 0.01. The time series *X*(*t*) and *Z*(*t*) are used for the
reconstruction analysis.

For a high-dimensional model, the two-layer Lorenz 96 model (Lorenz, 1996) is a high-dimensional chaotic system, and it is commonly used to mimic midlatitude atmospheric dynamics (Chorin and Lu, 2015; Hu and Franzke, 2017; Vissio and Lucarini, 2018; Chen and Kalnay, 2019; Watson, 2019). It reads as

In the first layer of the Lorenz 96 system, there are 18 variables marked as
*X*_{k} (*k* is an integer ranging from 1 to 18), and each *X*_{k} is
coupled with *Y*_{k, j} (*Y*_{k, j} is from the second layer). The
parameters are set as fellows: *J*=20, *h*_{1}=1, *h*_{2}=1, and
*F*=10. The parameter *θ* can alter the coupling strength: when *θ* is decreased, the coupling strength between *X*_{k} and *Y*_{k, j}
will be enhanced. The fourth-order Runge–Kutta integrator and periodic
boundary condition are adopted (i.e., *X*_{0}=*X*_{K} and
${X}_{K+\mathrm{1}}={X}_{\mathrm{1}}$; ${Y}_{k,\phantom{\rule{0.125em}{0ex}}\mathrm{0}}={Y}_{k-\mathrm{1},\phantom{\rule{0.125em}{0ex}}J}$ and ${Y}_{k,\phantom{\rule{0.125em}{0ex}}J+\mathrm{1}}={Y}_{k+\mathrm{1},\phantom{\rule{0.125em}{0ex}}\mathrm{1}})$, and the integral time step is taken as 0.05. The time series
*X*_{1}(*t*) and *Y*_{1, 1}(*t*) are used for the reconstruction analysis.

## 3.2 Real-world climatic time series

TSAT, NHSAT, and the Nino 3.4 index are chosen as the example from real-world
climatic time series used for reconstruction analysis. The original data were
obtained from the National Centers for Environmental Prediction (NCEP)
(https://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis2.html, last access: 16 September 2020) and
KNMI Climate Explorer (http://climexp.knmi.nl, last access: 16 September 2020). The series of TSAT and NHSAT
were obtained from the regional average of gridded daily data in NCEP
Reanalysis 2. The selected spatial range is 20^{∘} N–20^{∘} S for the
tropics and 20–90^{∘} N for the Northern Hemisphere. The selected
temporal range is from 1 September 1981 to 31 December 2018.

For the training and testing datasets before analysis, all the used time series are standardized to take zero mean and unit variance so that any possible impact of mean and variance on the statistical analysis is avoided (Brown, 1994; Hyndman and Koehler, 2006; Chattopadhyay et al., 2020). The total series were divided into two parts: 60 % of the time series for training the neural network and 40 % for the testing series. Specific data lengths of the training series and testing series will also be listed in the results section.

## 4.1 Coupling relation learning

### 4.1.1 Linear coupling relation and machine learning

We first consider the simplest case: the linear coupling relation between
two variables. Here, two time series *x*(*t*) and *ε*(*t*) in the ARFIMA (3,
0.2, 3) model are analyzed. Obviously, there are different temporal
structures in *x*(*t*) and *ε*(*t*), especially for their large-scale
trends (Fig. 4a) and power spectra (Fig. 4b). The marked difference between
*x*(*t*) and *ε*(*t*) lies in their low-frequency variations, and there
are more low-frequency and larger-scale structures in *x*(*t*) than in
*ε*(*t*). We employ neural networks (RC, LSTM, LSTM^{*}, and BP) to
learn the dynamics of this model (Eq. 11) through the procedure shown in
Fig. 1. The training parts of *ε*(*t*) are selected from the gray
shading in Fig. 4a. RC, LSTM, LSTM^{*}, and BP are trained to learn the coupling
relation between *x*(*t*) and *ε*(*t*). Then, the trained neural networks
together with *ε*(*t*) are used to reconstruct *x*(*t*). The
reconstruction results and the performance of different neural networks are
presented in Table 1. It shows that there is a strong linear correlation
(0.88) between *x*(*t*) and *ε*(*t*). This reconstruction result suggests
that the strong linear coupling can be well captured by these three neural
networks since all values of nRMSE are low.

Detailed comparisons between the real and reconstructed series are shown in
Fig. 4c and d. When *ε*(*t*) is input, the trained RC and LSTM
neural networks can be applied to accurately reconstruct *x*(*t*). When *x*(*t*) is
reconstructed from *ε*(*t*) through LSTM, the minimum of nRMSE
(0.01) is reached; all reconstructed series are nearly overlapped with the
real ones and cannot be visually differentiated (see Fig. 4c). For RC, the
reconstruction quality is also good. The good performance of LSTM benefits
from its memory function for the past information (Reichstein et al., 2019;
Chattopadhyay et al., 2020). When the memory function of LSTM is stopped,
the reconstruction of LSTM^{*} is no longer better than that of RC (see Table 1). The reconstruction by BP is successful in this linear system (Fig. 4),
but its performance is not as good as LSTM and RC (Table 1). This
performance difference may be due to the fact that, unlike LSTM and RC, the neuron
states of BP cannot track the temporal evolution of a time series
(Chattopadhyay et al., 2020).

### 4.1.2 Nonlinear coupling relation and machine learning

It is known that a strong linear correlation is useful for training neural
networks and reconstructing time series. When the linear correlation between
variables is very weak, could these machine-learning methods be applied to
learn the underlying coupling dynamics? To address this question, two
nonlinearly coupled time series, *X*(*t*) and *Z*(*t*), in the Lorenz 63 system (Lorenz,
1963) are analyzed.

There is a very weak overall linear correlation between variables *X* and *Z*
(Pearson correlation: 0.002) in the Lorenz 63 model (Table 2), and such a
weak linear correlation results from the time-varying local correlation
between variables *X* and *Z* (see Fig. 5a). For example, *X* and *Z* are negatively
correlated in the time interval of 0–200 but positively correlated in
200-400. This alternation of negative and positive correlation appears over
the whole temporal evolutions of *X*(*t*) and *Z*(*t*), which leads to an overall weak
linear correlation. In this case, we cannot use a feasible linear regression
model between *X*(*t*) and *Z*(*t*) to reconstruct one from the other, since there is no
such good linear dependency as found in the ARFIMA (p, d, q) system (see
Fig. 6a and b).

In a nonlinearly coupled system, it is known that the coupling strength
between two variables cannot be estimated by the linear Pearson correlation
(Brown, 1994; Sugihara et al., 2012). Here, we use CCM to estimate the
coupling strength between *X* and *Z*, and it shows a high magnitude of the
CCM index: ${\mathit{\rho}}_{X\to Z}=\mathrm{0.91}$. According to the CCM theory (see Methods section),
such a high magnitude of the CCM index indicates that the information
content of *Z* is encoded in the time series of *X*. Therefore, we conjecture
that when inputting *X*(*t*) into the neural network, it is not only the information
content of *X*(*t*) but also the information content of *Z*(*t*) that can be learned by the
neural network. And then it is possible to reconstruct *Z*(*t*) from the trained
neural network. We will test this in the following.

Figure 5b shows the results of reconstructing *Z* time series through RC, LSTM,
and BP (upper, middle, and lower subpanels, respectively). Unlike the case of a linear system, the
successful reconstruction for the time series of the Lorenz 63 system depends
on the used machine-learning methods. The series reconstructed by LSTM
nearly overlaps with the real series (Fig. 5b) and has the minimum nRMSE
(0.004; see Table 2); moreover, the RC performs quite well, with only a
little difference found at some peaks and dips (Fig. 5b). These
reconstruction results suggest that even though the linear correlation is
very weak, a strong nonlinear correlation will allow RC and LSTM to fully
capture the underlying coupling dynamics. However, BP and LSTM^{*} perform
poorly, and their reconstruction results have large errors (nRMSE =0.17
for BP, and nRMSE = 0.24 for LSTM^{*}). The reconstructed series heavily
depart from the real series, especially for all peaks and dips, and the
reconstructed values for each extreme point are underestimated (Fig. 5b).
This means that both BP and LSTM^{*} cannot learn the nonlinear coupling.

As mentioned in Sect. 2.2, a BP neural network does not track the temporal
evolution, since its neuron states are independent of the temporal variation
of time series. For LSTM^{*}, it does not include the information of previous
time. Previous studies have revealed that the temporal evolution and memory
are very important properties for a nonlinear time series (Kantz and
Schreiber, 2004; Franzke et al., 2015), and this could not be neglected when
modeling nonlinear dynamics. These might be responsible for the fact that BP and
LSTM^{*} fail in dealing with this nonlinear Lorenz 63 system. Investigations
for the application of BP in other nonlinear relationships need to
be further addressed in the future.

## 4.2 Reconstruction quality and impact factors

From the above results, it is revealed that RC and LSTM are able to learn both linear and nonlinear coupling relations, and the coupled time series can be well reconstructed. In this section, we further investigate what factors can influence the reconstruction quality.

### 4.2.1 Direction dependence and variable dependence

When reconstructing time series of the linear model of Eq. (11), it can be
found that the reconstruction is bidirectional (see Fig. 4d and Table 1):
one variable can be taken as an explanatory variable to reconstruct another
variable well; oppositely, it can also be well reconstructed by another
variable. Furthermore, when the linear correlation is weak but the nonlinear
coupling is strong, will the bidirectional reconstruction be still allowed?
The answer is usually no! For example, when comparing the reconstruction
quality of reconstructing *Z*(*t*) from *X*(*t*) (Fig. 5b) with that of reconstructing *X*(*t*)
from *Z*(*t*) (Fig. 5c), all of the used machine-learning methods fail in
reconstructing *X*(*t*) from *Z*(*t*) (large values of nRMSE are all close to 0.3). This
result is consistent with the nonlinear observability mentioned by (Lu et al., 2017). The reconstruction direction is no longer bidirectional
in this nonlinear system, but the reconstruction quality is
direction dependent and variable dependent.

Therefore, we further discuss how to select the suitable explanatory
variable or the reconstruction direction. Tables 1 and 2 show that the
reconstruction quality in a linear coupled system highly depends on the
Pearson correlation; however, it is different for a nonlinear system. For the
Lorenz 63 system, the bidirectional CCM coefficients between the variables
*X* and *Z* are asymmetric (with a stronger ${\mathit{\rho}}_{X\to Z}=\mathrm{0.91}$ but weaker ${\mathit{\rho}}_{Z\to X}=\mathrm{0.03})$; variable *Z* can be well reconstructed from variable
*X* by machine learning, but *X* cannot be reconstructed from *Z* (Fig. 5b and c). The
CCM index can be taken as a potential indicator to determine the explanatory
variable and reconstructed variable for this nonlinear system. Here the
asymmetric reconstruction quality results from the asymmetric
information transfer between the two nonlinearly coupled variables (Hermann
and Krener, 1977; Sugihara et al., 2012; Lu et al., 2017). In the coupling
relation between *X* and *Z*, much more information content of *Z* is encoded in *X*, so
it performs well for reconstructing *Z* from *X* (Lu et al., 2017), which can
be detected by the CCM index (Sugihara et al., 2012; Tsonis et al., 2018).

### 4.2.2 Generalization to a high-dimensional chaotic system

Choosing direction and variable is important for the application of neural networks in reconstructing nonlinear time series, but this is derived from the low-dimensional Lorenz 63 system. In this subsection, we present the results from a high-dimensional chaotic system of the Lorenz 96 model. Furthermore, we will investigate the association between the CCM index and reconstruction quality in the machine-learning frameworks.

Firstly, we use variables *X*_{1} and *Y*_{1, 1} in Eq. (13) to
illustrate the direction dependence in the high-dimensional system. Details
of *X*_{1} and *Y*_{1, 1} are shown in Fig. 7a, and the Pearson correlation
between *X*_{1} and *Y*_{1, 1} is weak (only −0.11; see Table 3). In Eq. (13),
the forcing from *X*_{1} to *Y*_{1, 1} is much stronger than the forcing
from *Y*_{1, 1} to *X*_{1}. The CCM index shows: ${\mathit{\rho}}_{{Y}_{\mathrm{1},\phantom{\rule{0.125em}{0ex}}\mathrm{1}}\to {X}_{\mathrm{1}}}=\mathrm{0.98}$ and ${\mathit{\rho}}_{{X}_{\mathrm{1}}\to {Y}_{\mathrm{1},\phantom{\rule{0.125em}{0ex}}\mathrm{1}}}=\mathrm{0.61}$. This
indicates that reconstructing *X*_{1} from *Y*_{1, 1} may obtain a better
quality than from *X*_{1} to *Y*_{1, 1}. As expected, by means of RC, the error
of reconstructing *X*_{1} from *Y*_{1, 1} is nRMSE =0.01; however, it is
nRMSE =0.06 in the opposite direction (Table 3). The result of LSTM is
similar to that of RC in this case. Thus, direction dependence does exist in
reconstructing this high-dimensional system, and the result is consistent
with the indication of the CCM index. In this case, performance of the
reconstruction through BP and LSTM^{*} is not good and the same as analyzed in
Sect. 4.2.3.

The reconstruction between *X*_{1} and *X*_{2} in the same layer of the Lorenz
96 system is also shown. There is an asymmetric causal relation (${\mathit{\rho}}_{{X}_{\mathrm{2}}\to {X}_{\mathrm{1}}}=\mathrm{0.37}$ and ${\mathit{\rho}}_{{X}_{\mathrm{1}}\to {X}_{\mathrm{2}}}=\mathrm{0.25})$
between *X*_{1} and *X*_{2}, and their linear correlation is very weak (see
Table 3). The RC gives a better result of reconstructing *X*_{1} from
*X*_{2} (nRMSE =0.13) than reconstructing *X*_{2} from *X*_{1}
(nRMSE =0.17). LSTM also has different results for the reconstructed
*X*_{1} and *X*_{2} (Table 3), where the quality of reconstructing from *X*_{1} to *X*_{2} (nRMSE =0.16) is better than reconstructing from
*X*_{2} to *X*_{1} (nRMSE =0.20). In this case, the reconstruction quality
of LSTM is worse than that of RC, and the reconstruction results by LSTM are
consistent with the indication of the CCM index. Chattopadhyay et al. (2020)
also suggests that LSTM performs worse than RC in some cases, and this might
be related to the use of a simple variant of the LSTM architecture. This
variant of LSTM was tested and it was found that the time-varying local mean
in time series would sometimes influence its performance. However, further
investigation is required for a deeper understanding of the real reason. In
this high-dimensional system, the reconstruction quality is also influenced
by the chosen explanatory variables: the quality of reconstructing *X*_{1}
from *Y*_{1, 1} is better than the quality of reconstructing *X*_{1} from
*X*_{2} through RC and LSTM (see Fig. 7b and c).

Besides, the number of the chosen explanatory variables also influences the
reconstruction quality. If more than one explanatory variable in the same
layer is used, the reconstruction of *X*_{1} from *X*_{2} can be greatly
improved (see Fig. 7b and c). For example, when all of *X*_{2}, *X*_{17}, and
*X*_{18} are acting as the explanatory variables, the nRMSE of reconstructed
*X*_{1} is reduced from 0.13 to 0.08 (Table 3). For both RC and LSTM,
the multivariable reconstruction reaches lower error than those from
unit-variable reconstruction.

In the above results, the CCM index is used to select explanatory variable
for RC and LSTM. Now we employ more variables to test the association
between the CCM index of the data and the performance of RC and LSTM. The
values of the CCM index are calculated between *X*_{1} and *X*_{2}, *X*_{3},
… , *X*_{18}; meanwhile, *X*_{1} is reconstructed
from *X*_{2}, *X*_{3}, … , *X*_{18}. We find a
significant correspondence between the nRMSE and the CCM index (Fig. 8) for
both RC and LSTM. Here we only use a simple LSTM architecture,
and there are many other variants of this architecture where the abnormal
point of LSTM in Fig. 8 might be reduced. The result of Fig. 8 reveals the
robust association between the CCM index and reconstruction quality in the
machine-learning frameworks of RC and LSTM. For other machine-learning
methods, such association deserves further investigation.

### 4.2.3 Performance of BP and LSTM^{*} in the Lorenz 96 system

In nonlinear systems, the performance of reconstruction through BP and LSTM^{*}
is much worse than that of RC and LSTM (Fig. 5). Here we present a simple
experiment to illustrate what might influence the performance of BP and
LSTM^{*} in a nonlinear system.

The experiment is set up as follows: in Eq. (13), the value of *h*_{1} is set as
0, and the value of *θ* is decreased from 0.7 to 0.3. When *θ* is
equal to 0.7, the forcing from *X*_{1} to *Y*_{1, 1} is weak (the
Pearson correlation between *X*_{1} and *Y*_{1, 1} is only 0.48), and
the performance values of BP and LSTM^{*} are not good. When *θ* is equal to
0.3, the forcing is dramatically magnified. As the second subpanel in Fig. 9a
shows, the strong forcing makes *Y*_{1, 1} synchronized to *X*_{1}, and the
Pearson correlation between *X*_{1} and *Y*_{1, 1} is greatly increased
to 0.8. When the forcing strength is magnified, the performance of machine
learning is also enhanced (Fig. 9b): the reconstructed series by BP and the
reconstructed series by LSTM^{*} are much closer to the real target series.
This means that the reconstruction quality of BP and LSTM^{*} is greatly
improved when the linear correlation is increased. This experiment reveals
that the coupling strength in a nonlinear system can alter the Pearson
correlation of the two time series, which further influences the performance of
BP and LSTM^{*} in a nonlinear system.

However, RC and LSTM are not restricted to the Pearson correlation in this
nonlinear system. When *θ* is altered from 0.7 to 0.3, although the
Pearson correlation is changed a lot, the values of the CCM index are kept
consistently above 0.9. For all values of *θ*, RC is able to equally
produce a good-quality reconstruction of *X*_{1}. Figure 9b shows that the
reconstructed series through RC and LSTM always overlap with the real time
series. These results indicate that the performance of both RC and LSTM is
sensitive to the value of CCM index, which is in line with the results given
in Sect. 4.2.2.

## 4.3 Application to real-world climate series: reconstructing SAT

The natural climate series are usually nonstationary and are encoded with the information of many physical processes in the earth system. In the following, we illustrate the utility of the above methods and conclusions by investigating a real-world example.

The daily NHSAT and TSAT time series are shown in Fig. 10a. There are quite different temporal patterns in the NHSAT and TSAT series, with a weak linear correlation (0.08; see Table 4) between them. In the scatter plot for the NHSAT and TSAT (Fig. 10b), the marked nonlinear structure is observed between NHSAT and TSAT. Such a weak linear correlation will make the linear regression method fail to reconstruct one series from the other. Meanwhile, there is no explicit physical expression that can transform TSAT and NHSAT to each other. Now we try to use machine learning to learn their coupling between them and then to reconstruct these climate series. The CCM index when NHSAT cross maps TSAT is 0.70, and the CCM index when TSAT cross maps NHSAT is 0.24 (Table 4). The CCM index means that the information content of TSAT is well encoded in the records of NHSAT, and the information transfer might be mainly from TSAT to NHSAT. This finding is consistent with previous studies (Vallis and Farneti, 2009; Farneti and Vallis, 2013). Further, the CCM analysis indicates that the reconstruction from NHSAT to TSAT might obtain a better quality than that from the opposite direction.

The results validate our conjecture that the nRMSE of reconstruction from NHSAT to TSAT is lower than that from TSAT to NHSAT (Table 4). By using RC, the TSAT time series can be relatively well described by the reconstructed ones (Fig. 11a), with nRMSE equal to 0.13. This nRMSE is a bit high because some extremes of the TSAT time series have not been well described (Fig. 11b). When using TSAT to reconstruct the time series of NHSAT, the reconstructed time series cannot describe the real time series of NHSAT (Fig. 11c), and the corresponding nRMSE is equal to 0.21. Besides, we also use LSTM and BP to reconstruct these natural climate series; the performances of these two neural networks are worse than RC (Table 4). For BP, this worse performance may be due to its inability to deal with nonlinear coupling. LSTM performs worse than RC in this real-world case, which might be induced by the used simple variant of LSTM architecture.

We can further improve the reconstruction quality of TSAT. Considering that the tropical climate system interacts not just with the Northern Hemisphere climate system, we can use the information of other systems to improve the reconstruction. Looking at the time series of the Nino 3.4 index (Fig. 10a), some of its extremes occur at the same time intervals as the extremes of TSAT. Moreover, when the Nino 3.4 index is included in the scatter plot (Fig. 10c), a nonlinear attractor structure is revealed. We combine NHSAT with the Nino 3.4 index to reconstruct the time series of TSAT through RC. The reconstructed TSAT (Fig. 11e) is much closer to the real TSAT series, and the corresponding nRMSE has been reduced to 0.08.

Finally, we make a further comparison between the real TSAT and the reconstructed TSAT. (i) The annual variations of the reconstructed TSAT are close to those of the real TSAT (Fig. 12a). (ii) The power spectra of TSAT and the reconstructed TSAT are compared in Fig. 12b, and the main deviation occurs at the frequency bands of 0–15 d. The reason might be that the local weather processes are not input into this RC reconstruction. This conjecture can be further confirmed through a red-noise test with response time of 15 d for the residual series (this red-noise test is the same as the method used in Roe, 2009). All data points of the residual series lie within the confidence intervals (Fig. 12c). This means that the residual is possibly induced by local weather processes, and this information is not input into RC for the reconstruction.

In this study, three kinds of machine-learning methods are used to reconstruct the time series of toy models and real-world climate systems. One series can be reconstructed from the other series by machine learning when they are governed by the common coupling relation. For the linear system, variables are coupled through the linear mechanism, and a large Pearson coefficient can benefit machine learning with bidirectional reconstruction. For a nonlinear system, the coupled time series often have a small Pearson coefficient, but machine learning can still reconstruct the time series when the CCM index is strong; moreover, the reconstruction quality is direction dependent and variable dependent, which is determined by the coupling strength and causality between the dynamical variables.

Choosing suitable explanatory variables is crucial for obtaining a good reconstruction quality. But the results show that machine-learning performance cannot be explained only by the linear correlation. In this study, we suggest to use the CCM index to select explanatory variables. Especially for the time series of nonlinear systems, the strong CCM index can be taken as a benchmark to select an explanatory variable. When the CCM index is higher than 0.5 in this study, the nRMSE is often smaller than 0.1, with the reconstructed series very close to the real series in the presented results. Thus, the CCM index higher than 0.5 may be considered a criterion for choosing appropriate explanatory variables. It is well known that atmospheric or oceanic motions are nonlinearly coupled over most timescales; therefore, in the natural climate series, there would be similar nonlinear coupling relations as found in the Lorenz 63 and the Lorenz 96 systems (weak Pearson correlation but high CCM coefficient). If only Pearson coefficient is used to select the explanatory variable, then some useful nonlinearly correlated variables may be left out.

Finally, it is worth noting the potential application for machine learning
in climate studies. For instance, when a series *b*(*t*) is unmeasured during some
period because of measuring instrument failure but there are other kinds of
variables without missing observations, then CCM can be applied to select
the suitable variables coupled with *b*(*t*), and RC or LSTM can be employed to
reconstruct the unmeasured part of *b*(*t*) (following Fig. 1). This is useful for
some climate studies, such as paleoclimate reconstruction (Brown, 1994;
Donner 2012; Emile-Geay and Tingley, 2016), interpolation of the missing
points in measurements (Hofstra et al., 2008), and parameterization
schemes (Wilks, 2005; Vissio and Lucarini, 2018). Our study in this article
is only a beginning for reconstructing climate series by machine learning,
and more detailed investigations will be reported soon.

If *a*(*t*) and *b*(*t*) denote two time series and
*a*(*t*) is input into LSTM to estimate *b*(*t*), then the
governing equations for the LSTM architecture (Fig. 3) are as follows:

*f*(t), *i*(t), and *o*(t) denote the
forget gate, input gate, and output gate, respectively. *h*(t)
and *c*(t) represent the hidden state and the cell state, respectively; the
dimension of the hidden layers is set as 200, which could yield the good
performance in our experiment. All these components can be found in Fig. 3,
and the information flow among these components are realized by Eqs. (14)–(20). There are many parameters in the LSTM architecture: *σ*_{f}
is the softmax activation function; *s*_{f}, *s*_{i}, and *s*_{h} are the
biases in the forget gate, the input gate, and the hidden layers, respectively; the weight
matrixes *W*_{f}, *W*_{i}, *W*_{c}, and *W*_{oh} denote the neuron connectivity in each layer. These parameters
need to be computed during training (Chattopadhyay et al., 2020); *a*(*t*) and
$\widehat{b}\left(t\right)$ represent the input and output time series.

The code and data used in this paper are available on request from the authors.

YH, LY, and ZF contributed to the design of this study and the preparation of the article.

The authors declare that they have no conflict of interest.

The authors thank the editor, the two anonymous reviewers, and Zhixin Lu for their constructive suggestions. We also thank Christian L. E. Franzke and Naiming Yuan for their in-depth and helpful discussions. We acknowledge support from the National Natural Science Foundation of China (through grant nos. 41675049 and 41975059).

This research has been supported by the National Natural Science Foundation of China (grant nos. 41475048, 41675049, and 41975059).

This paper was edited by C. T. Dhanya and reviewed by two anonymous referees.

Badin, G. and Domeisen, D. I.: A search for chaotic behavior in stratospheric variability: comparison between the Northern and Southern Hemispheres, J. Atmos. Sci., 71, 4611–4620, 2014.

Biancofiore, F., Busilacchio, M., Verdecchia, M., Tomassetti, B., Aruffo,
E., Bianco, S., and Di Carlo, P.: Recursive neural network model for
analysis and forecast of PM_{10} and PM_{2.5}, Atmos. Pollut. Res., 8,
652–659, 2017.

Brown, P. J.: Measurement, Regression, and Calibration, vol. 12 of Oxford Statistical Science Series, Oxford University Press, USA, 216 pp., 1994.

Carroll, T. L.: Using reservoir computers to distinguish chaotic series, Phys. Rev. E., 98, 052209, https://doi.org/10.1103/PhysRevE.98.052209, 2018.

Chattopadhyay, A., Hassanzadeh, P., and Subramanian, D.: Data-driven predictions of a multiscale Lorenz 96 chaotic system using machine-learning methods: reservoir computing, artificial neural network, and long short-term memory network, Nonlin. Processes Geophys., 27, 373–389, 2020.

Chen, T. C. and Kalnay, E.: Proactive quality control: observing system simulation experiments with the Lorenz'96 Model, Mon. Weather Rev., 147, 53–67, 2019.

Chorin, A. J. and Lu, F.: Discrete approach to stochastic parameterization and dimension reduction in nonlinear dynamics, P. Natl. Acad. Sci. USA, 112, 9804–9809, 2015.

Comeau, D., Zhao, Z., Giannakis, D., and Majda, A. J.: Data-driven prediction strategies for low-frequency patterns of North Pacific climate variability, Clim. Dynam., 48, 1855–1872, 2017.

Conti, C., Navarra, A., and Tribbia, J.: The ENSO Transition Probabilities, J. Climate, 30, 4951–4964, 2017.

Cox, P. M., Huntingford, C., and Williamson, M. S.: Emergent constraint on equilibrium climate sensitivity from global temperature variability, Nature, 553, 319, https://doi.org/10.1038/nature25450, 2018.

Donner, R. V.: Complexity concepts and non-integer dimensions in climate and paleoclimate research, Fractal Analysis and Chaos in Geosciences, Nov 14:1, https://doi.org/10.5772/53559, 2012.

Donner, L. J. and Large, W. G.: Climate modeling, Annu. Rev. Env. Resour., 33, https://doi.org/10.1146/annurev.environ.33.020707.160752, 2008.

Drótos, G., Bódai, T., and Tél, T.: Probabilistic concepts in a changing climate: A snapshot attractor picture, J. Climate, 28, 3275–3288, 2015.

Du, C., Cai, F., Zidan, M. A., Ma, W., Lee, S. H., and Lu, W. D.: Reservoir computing using dynamic memristors for temporal information processing, Nat. Commun., 8, 2204, https://doi.org/10.1038/s41467-017-02337-y, 2017.

Dueben, P. D. and Bauer, P.: Challenges and design choices for global weather and climate models based on machine learning, Geosci. Model Dev., 11, 3999–4009, https://doi.org/10.5194/gmd-11-3999-2018, 2018.

Emile-Geay, J. and Tingley, M.: Inferring climate variability from nonlinear proxies: application to palaeo-ENSO studies, Clim. Past, 12, 31–50, https://doi.org/10.5194/cp-12-31-2016, 2016.

Farneti, R. and Vallis, G. K.: Meridional energy transport in the coupled atmosphere–ocean system: Compensation and partitioning, J. Climate, 26, 7151–7166, 2013.

Feng, X., Fu, T. M., Cao, H., Tian, H., Fan, Q., and Chen, X.: Neural network predictions of pollutant emissions from open burning of crop residues: Application to air quality forecasts in southern China, Atmos. Environ., 204, 22–31, 2019.

Franzke, C. L.: Nonlinear trends, long-range dependence, and climate noise properties of surface temperature, J. Climate, 25, 4172–4183, 2012.

Franzke, C. L., Osprey, S. M., Davini, P., and Watkins, N. W.: A dynamical systems explanation of the Hurst effect and atmospheric low-frequency variability, Sci. Rep., 5, 9068, https://doi.org/10.1038/srep09068, 2015.

Granger, C. W. and Joyeux, R.: An introduction to long-memory time series models and fractional differencing, J. Time. Ser. Anal., 1, 15–29, 1980.

Hasselmann, K.: Stochastic climate models part I, Theory, Tellus, 28, 473–485, 1976.

Hegger, R. and Kantz, H.: Improved false nearest neighbor method to detect determinism in time series data, Phys. Rev. E, 60, 4970, https://doi.org/10.1103/PhysRevE.60.4970, 1999.

Hermann, R. and Krener, A.: Nonlinear controllability and observability, IEEE T. Automat. Control, 22, 728–740, 1977.

Hofstra, N., Haylock, M., New, M., Jones, P., and Frei, C.: Comparison of six methods for the interpolation of daily European climate data, J. Geophys. Res., 113, https://doi.org/10.1029/2008JD010100, 2008.

Hsieh, W. W., Wu, A., and Shabbar, A.: Nonlinear atmospheric teleconnections. Geophys. Res. Lett., 33, L07714, https://doi.org/10.1029/2005GL025471, 2006.

Hu, G. and Franzke, C. L.: Data assimilation in a multi-scale model, Mathematics of Climate and Weather Forecasting, 3, 118–139, 2017.

Huang, Y. and Fu, Z.: Enhanced time series predictability with well-defined structures, Theor. Appl. Climatol., 138, 373–385, 2019.

Hyndman, R. J. and Koehler, A. B.: Another look at measures of forecast accuracy, Int. J. Forecasting., 22, 679–688, 2006.

Kantz, H. and Schreiber, T.: Nonlinear time series analysis, vol. 7, Cambridge university press, UK, 2004.

Kratzert, F., Herrnegger, M., Klotz, D., Hochreiter, S., and Klambauer, G.: NeuralHydrology – Interpreting LSTMs in Hydrology, in: Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Lecture Notes in Computer Science, edited by: Samek, W., Montavon, G., Vedaldi, A., Hansen, L., and Müller K, R., vol. 11700, Springer, Cham, 2019.

Lorenz, E. N.: Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130–141, 1963.

Lorenz, E. N.: Predictability: a problem partly solved, Proc. ECMWF Seminar on Predictability, vol. I, ECMWF, Reading, United Kingdom, 40–58, 1996.

Lu, Z., Pathak. J., Hunt, B., Girvan, M., Brockett, R., and Ott, E.: Reservoir observers: Model-free inference of unmeasured variables in chaotic systems, Chaos, 27, 041102, https://doi.org/10.1063/1.4979665, 2017.

Lu, Z., Hunt, B. R., and Ott, E.: Attractor reconstruction by machine learning, Chaos, 28, 061104, https://doi.org/10.1063/1.5039508, 2018.

Ludescher, J., Gozolchiani, A., Bogachev, M. I., Bunde, A., Havlin, S., and Schellnhuber, H. J.: Very early warning of next El Niño, P. Natl. Acad. Sci. USA, 111, 2064–2066, 2014.

Massah, M. and Kantz, H.: Confidence intervals for time averages in the presence of long-range correlations, a case study on Earth surface temperature anomalies, Geophys. Res. Lett., 43, 9243–9249, 2016.

Mattingly, K. S., Ramseyer, C. A., Rosen, J. J., Mote, T. L., and Muthyala, R.: Increasing water vapor transport to the Greenland Ice Sheet revealed using self-organizing maps, Geophys. Res. Lett., 43, 9250–9258, 2016.

Mukhin, D., Gavrilov, A., Loskutov, E., Feigin, A., and Kurths, J.: Nonlinear reconstruction of global climate leading modes on decadal scales, Clim. Dynam, 51, 2301–2310, 2018.

Pathak, J., Lu, Z., Hunt, B. R., Girvan, M., and Ott, E.: Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data, Chaos, 27, 121102, https://doi.org/10.1063/1.5010300, 2017.

Pathak, J., Hunt, B., Girvan, M., Lu, Z., and Ott, E.: Model-free prediction of large spatiotemporally chaotic systems from data: a reservoir computing approach, Phys. Rev. Lett., 120, 024102, 2018.

Patil, D. J., Hunt, B. R., Kalnay, E., Yorke, J. A., and Ott, E.: Local low dimensionality of atmospheric dynamics, Phys. Rev. Lett., 86, 5878, https://doi.org/10.1103/PhysRevLett.86.5878, 2001.

Pennekamp, F., Iles, A. C., Garland, J., Brennan, G., Brose, U., Gaedke, U., and Novak, M.: The intrinsic predictability of ecological time series and its potential to guide forecasting, Ecol. Monogr., e01359, https://doi.org/10.1002/ecm.1359, 2019.

Racah, E., Beckham, C., Maharaj, T., Kahou, S. E., Prabhat, M., and Pal, C.: ExtremeWeather: A large-scale climate dataset for semi-supervised detection, localization, and understanding of extreme weather events, Adv. Neur. In, 3402–3413, available at: https://dl.acm.org/doi/10.5555/3294996.3295099 (last access: 16 September 2020), 2017.

Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., and Carvalhais, N.: Deep learning and process understanding for data-driven Earth system science, Nature, 566, 195, https://doi.org/10.1038/s41586-019-0912-1, 2019.

Roe, G.: Feedbacks, timescales and seeing red, Ann. Rev. Earth. Plan. Sci., 37, 93–115, 2009.

Schreiber, T.: Measuring information transfer, Phys. Rev. Lett., 85, 461, https://doi.org/10.1103/PhysRevLett.85.461, 2000.

Schurer, A. P., Hegerl, G. C., Mann, M. E., Tett, S. F., and Phipps, S. J.: Separating forced from chaotic climate variability over the past millennium, J. Climate, 26, 6954–6973, 2013.

Schumann-Bischoff, J., Luther, S., and Parlitz, U.: Estimability and dependency analysis of model parameters based on delay coordinates, Phys. Rev. E, 94, 032221, https://doi.org/10.1103/PhysRevE.94.032221, 2016.

Sugihara, G., May, R., Ye, H., Hsieh, C. H., Deyle, E., Fogarty, M., and Munch, S.: Detecting causality in complex ecosystems, Science, 338, 496–500, 2012.

Takens, F.: Detecting strange attractors in turbulence. Dynamical Systems and Turbulence, Lect. Notes Math., 898, 366–381, Springer Berlin Heidelberg, 1981.

Tsonis, A. A., Deyle, E. R., Ye, H., and Sugihara, G.: Convergent cross mapping: theory and an example, in: Advances in Nonlinear Geosciences, 587–600, Springer, Cham, 2018.

Vallis, G. K. and Farneti, R.: Meridional energy transport in the coupled atmosphere–ocean system: Scaling and numerical experiments, Q. J. Roy. Meteor. Soc., 135, 1643–1660, 2009.

Van Nes, E. H., Scheffer, M., Brovkin, V., Lenton, T. M., Ye, H., Deyle, E., and Sugihara, G.: Causal feedbacks in climate change, Nat. Clim. Change, 5, 445, https://doi.org/10.1038/nclimate2568, 2015.

Vannitsem, S. and Ekelmans, P.: Causal dependences between the coupled ocean–atmosphere dynamics over the tropical Pacific, the North Pacific and the North Atlantic, Earth Syst. Dynam., 9, 1063–1083, https://doi.org/10.5194/esd-9-1063-2018, 2018.

Vissio, G. and Lucarini, V.: A proof of concept for scale-adaptive parameterizations: the case of the Lorenz 96 model, Q. J. Roy. Meteor. Soc., 144, 63–75, 2018.

Watson, P. A. G.: Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correction, J. Adv. Model Earth. Sys., 11, 1402–1417, https://doi.org/10.1029/2018MS001597, 2019.

Wilks, D. S.: Effects of stochastic parametrizations in the Lorenz'96 system, Q. J. Roy. Meteor. Soc., 131, 389–407, 2005.

Ye, H., Deyle, E. R., Gilarranz, L. J., and Sugihara, G.: Distinguishing time-delayed causal interactions using convergent cross mapping, Sci. Rep., 5, 14750, https://doi.org/10.1038/srep14750, 2015.

Zaytar, M. A., El, and Amrani, C.: Sequence to sequence weather forecasting with long short-term memory recurrent neural networks, Int. J. Comput. Appl., 143, 7–11, 2016.

Zhang, N. N., Wang, G. L., and Tsonis, A. A.: Dynamical evidence for causality between Northern Hemisphere annular mode and winter surface air temperature over Northeast Asia, Clim. Dynam., 52, 3175–3182, 2019.