A Comparison of LSTM, GRU, and XGBoost for forecasting Morocco's yield curve

The field of time series forecasting has grown significantly over the past several years and is now highly active.  In numerous application domains, deep neural networks are exact and powerful.  They are among the most popular machine learning techniques for resolving big data issues because of these factors.  Historically, there have been numerous methods for accurately predicting the subsequent change in time series data.  The time series forecasting problem and its mathematical underpinnings are first articulated in this study.  Following that, a description of the most popular deep learning architectures used to date with success in time series forecasting is provided, emphasizing both their benefits and drawbacks.  Feedforward networks, recurrent neural networks (such as Elman networks), long- and short-term memory (LSTM), and gated recurrent units (GRU) are given special consideration.  Furthermore, the advantages of the XGBoost boosting tree method have shown its superiority in numerous data mining competitions in recent years.  The high coefficients of the metric measures indicate that the proposed XGBoost model provides good predictive performance, according to the results.

  1. Abbasimehr H., Paki R.  Improving time series forecasting using LSTM and attention models.  Journal of Ambient Intelligence and Humanized Computing.  13, 673–691 (2022).
  2. Sagheer A., Kotb M.  Time series forecasting of petroleum production using deep LSTM recurrent networks.  Neurocomputing.  323, 203–213 (2019).
  3. Hwang J.  Modeling Financial Time Series using LSTM with Trainable Initial Hidden States.  Preprint arXiv:2007.0684 (2020).
  4. Guan Y. J.  Financial time series forecasting model based on CEEMDAN-LSTM.  2022 4th International Conference on Advances in Computer Technology, Information Science and Communications (CTISC). 1–5 (2022).
  5. Yamak P. T., Yujian L., Gadosey P. K.  A Comparison between ARIMA, LSTM, and GRU for Time Series Forecasting.  ACAI'19: Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence.  49–55 (2020).
  6. Alhirmizy S., Qader B.  Multivariate Time Series Forecasting with LSTM for Madrid, Spain pollution.  2019 International Conference on Computing and Information Science and Technology and Their Applications (ICCISTA). 1–5 (2019).
  7. Chniti G., Bakir H., Zaher H.  E-commerce Time Series Forecasting using LSTM Neural Network and Support Vector Regression.  BDIOT'17: Proceedings of the International Conference on Big Data and Internet of Thing.  80–84 (2017).
  8. Hochreiter S., Schmidhuber J.  Long Short-Term Memory.  Neural Computation.  9 (8), 1735–1780 (1997).
  9. Zhai N., Yao P., Zhou X.  Multivariate Time Series Forecast in Industrial Process Based on XGBoost and GRU.  2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference (ITAIC).  1397–1400 (2020).