Customize Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customized advertisements based on the pages you visited previously and to analyze the effectiveness of the ad campaigns.

No cookies to display.

  • Download 27
  • File Size 286.98 KB
  • File Count 1
  • Create Date July 11, 2024
  • Last Updated July 11, 2024

The Application of Transformers and Hybrid Deep Learning Models for Streamflow Forecasting

Ashaf Ahmed and Antoifi Abdoulhalik
Brunel University, Civil Engineering, Uxbridge, United Kingdom of Great Britain – England, Scotland, Wales (ashraf.ahmed@brunel.ac.uk)
Abstract
Hybrid machine learning (ML) models have exhibited great forecasting accuracy across all water-related fields, often showing promising greater performance and computational power over standalone ML algorithms. Meanwhile, transformers have demonstrated remarkable capabilities in natural language processing tasks due to their attention mechanism; their application to time series forecasting, particularly in hydrology or streamflow prediction, is an evolving area. This study compared the performance of Transformers to various hybrid deep learning models in forecasting river streamflow data in Syr Daria. The hybrid models included LSTM with attention mechanism (LSTM-AM), LSTM with Arima (LSTM-AR), and Convolutional Neural Networks combined with LSTM (ConvLSTM). The forecasting performance of each model was tested at three hydrological stations located upstream, midstream, and downstream along the Syr Darya River, respectively. The forecasting performance was evaluated by comparing RMSE, MAE, NSE and KGE values achieved by each model. The streamflow datasets exhibit short-term dependencies that LSTM models can capture effectively, while transformers are more parameter-intensive than LSTMs. Simpler models like LSTMs perform relatively well and achieve comparable predictive accuracy to hybrid models. While LSTM-based models are found to be better suited for short-term forecasting, the transformer model tends to excel in longer-term predictions as they are better at capturing long-range dependencies in sequences. Nonetheless, all the models exhibit a decrement in predictive performance with an increasing forecasting horizon. The findings of this study evidence the suitability of transformers for high-performance and budget-wise river flow forecast applications while minimising data processing time.
How to cite: Ahmed, A. and Abdoulhalik, A.: The Application of Transformers and Hybrid Deep Learning Models for Streamflow Forecasting , EGU General Assembly 2024, Vienna, Austria, 14–19 Apr 2024, EGU24-5798, https://doi.org/10.5194/egusphere-egu24-5798, 2024.