I'm currently training a model that uses forecast weather variables as input. So my question is, are the historical forecast data downloaded from this API raw or have they been modified/improved through some process?
For example, is the forecast data provided for July 2 the output produced on July 1? I'm using the NOAA GFS weather model.
Basically what I need to know is if the data that I'm going to use for the model in production (let's say the next 24 hour forecast data from now) will have the same accuracy as the training data that this historical forecast API provides.
The Historical Forecast API combines all available runs. In case of GFS it is updated every 6 hours, therefore the lead-time offset is only a couple of hours. If you want to train for a fixed lead-time offset of 1 day, you can use the Previous Models Runs API and "previous_day_1". More information here: https://openmeteo.substack.com/p/weather-forecasts-from-previous-model-runs
The problem is that the previous model runs provide data from January this year and I need at least one year. I saw that JMA models does provide data from 2018, but the solar radiation variables are not available. Is there any way I can get a full year of historical forecast with temperature, humidity, wind speed and solar radiation data (more specifically, in Spain)?
Both, the regular "Forecast API" as well as "Historical Forecast API" contain the same weather models. If you will have to use both APIs to get historical and forecast data.
Thanks. Only the open-data ECMWF IFS 0.25° as well as AIFS 0.25° are available. Forecasts from the high resolution IFS 9 km cannot be offered due to license restrictions. However, IFS 9 km is available alongside ERA5 in the Historical Weather API with a delay of 2 days.
Hi!
Thanks for creating and improving this great API!
I'm currently training a model that uses forecast weather variables as input. So my question is, are the historical forecast data downloaded from this API raw or have they been modified/improved through some process?
For example, is the forecast data provided for July 2 the output produced on July 1? I'm using the NOAA GFS weather model.
Basically what I need to know is if the data that I'm going to use for the model in production (let's say the next 24 hour forecast data from now) will have the same accuracy as the training data that this historical forecast API provides.
The Historical Forecast API combines all available runs. In case of GFS it is updated every 6 hours, therefore the lead-time offset is only a couple of hours. If you want to train for a fixed lead-time offset of 1 day, you can use the Previous Models Runs API and "previous_day_1". More information here: https://openmeteo.substack.com/p/weather-forecasts-from-previous-model-runs
Thanks for your reply!
The problem is that the previous model runs provide data from January this year and I need at least one year. I saw that JMA models does provide data from 2018, but the solar radiation variables are not available. Is there any way I can get a full year of historical forecast with temperature, humidity, wind speed and solar radiation data (more specifically, in Spain)?
Hi, thank you for the continuous improvments.
Is that possible to get historical forecasts with a horizon (or forecast days) larger than 3 hours ?
Sure. You can just use the regular weather Forecast API. Up to 16 days of forecast are available: https://open-meteo.com/en/docs
thanks ! But weather forecast api can deliver recent past days forecasts only. How can we get historical forecasts from several years ago?
Both, the regular "Forecast API" as well as "Historical Forecast API" contain the same weather models. If you will have to use both APIs to get historical and forecast data.
I’d love to learn more about how the historical data is stored. Have you considered Zarr?
This is an amazing work that will definitely make an easier pipeline for research. Will the dataset contain ECMWF forecast as well?
Thanks. Only the open-data ECMWF IFS 0.25° as well as AIFS 0.25° are available. Forecasts from the high resolution IFS 9 km cannot be offered due to license restrictions. However, IFS 9 km is available alongside ERA5 in the Historical Weather API with a delay of 2 days.