10. Machine Learning Guided Weather Analogs¶
EarthCube 2021 Annual Meeting Presentation
Abstract¶
The Analog Ensemble (AnEn) is a computationally efficient technique for generating ensembles without requiring multiple simulation runs. The weather analogs are sought for a fine geographic scale and within a short time window, and have been shown to be calibrated and accurate.
The core of the AnEn is a metric that quantifies the similarity between current and historical forecasts, and it has as yet been a normalized temporal Euclidean distance based on multivariate forecasts variables. However, forecast variables are usually highly correlated and therefore it is paramount to weight the importance of each variable. Brute force algorithms are usually employed, which are computationally inefficient and might fail to capture non-linear relationships among variables.
This notebook demonstrates Deep Analogs (DA), an implementation of AnEn which employs a Machine Learning (ML) based similarity metric. DA applies Machine Learning methods to improve AnEn and to cope with a much larger search space. First, an embedding network is trained to transform weather variables, and then a similarity is computed in latent space. DA is shown to outperform the Euclidian based AnEn in terms of prediction error and also in its ability to cope with large forecast errors. This notebook aims to showcase the latest research progress in DA and to contribute to bridging weather forecasting with Machine Learning research.
About This Repository¶
This repository is created for the presentation at the 2021 EarthCube Annual Meeting during June 15 - 17, 2021.
The presenter is Weiming Hu.
Please find more information below:
On Analog Ensemble:
On Deep Analog
How to Run¶
You can directly view the content of the notebook by clicking WH_01_Spatio-Temporal_Deep_Analogs_2021.
Or you can start an interactive Jupyter notebook session by clicking the below icon. You will be redirected to Binder.
