First of all, impressive work! Also enjoying the blog posts, I'm learning a lot about weather and forecasting 👌 Thinking about using this in my next project
I'm still curious about how you serve the data. Specifically:
- about caching, I've been looking at the code base and haven't found anything specific about this. When you talk about caching, you mean the API uses the filesystem caching under the hood, right? Did you have to make any tweaks to improve performance?
- about the db itself, I've read it is a custom filesystem based data base. If I didn't understood bad, data is stored as compressed plain binary and, when a request comes in, it gets decompressed, and formated. Lets say I want to fetch data in a specific time range or apply some filters, how are those kind of operations performed?
Recently I need historical weather data of USA cities. I started checking for few cities and I see a huge difference between the data I get from this API and other websites such as accuweather, world-weather etc.
For example these are the results for Houston (29.7604, 95.3698) on 01.03.2023.
Meteo result: Max Apparent Temp.: -5.3°C Mean Apparent Temp: -9.5°C
Accuweather: Max Temp: 28°C (during the day)
World-weather: Max Temp: 22°C (during the day)
I checked for few different cities and I got similar huge differences between temperatures.
Am I doing something wrong? Is such a gap between results normal?
Thanks for your quick reply! I'm trying to obtain the data from 1 June 2023 till today (or 31 December 2023). Setting the date in the start date field to 2023-01-06 leads automatically to the same date in the field of the end data and vice versa.
Thanks very much for this valuable tool(s)! Unfortunately recently I had difficulties with downloading historical data. It was nog possible to set the data. You you know of this problem and/or do you have a solution?
Hello, could you please explain where the data for "weathercode" in the Historical API originates? I searched and I couldn't find it in ERA5 or CERRA databases...
Hello, I have a question. Could you add a separate field for weekly hourly forecast to specify if a certain hour is daytime or nighttime. Right now only the daily forecast has data about sunrises and sunsets to determine if a certain hour is day or night time. This forces my to use two queries if only hourly time is needed. There must be a 'day' or 'night' label for each hour.
I was wondering: when I use the historical weather API, generate a url for my location and check the output, I notice that the lat and lon are rounded of to the nearest 0.5 degrees, while I would expect the numbers to be rounded of to the nearest 0.25 degrees (43.28, -3.31 becomes 43.0, -3.5 instead of 43.25,-3.25). Do you know the reason or I am making a mistake in my thinking?
Should I be able to get weather data for any lat lng points, or must they be within 5km of a weather station? I'm having trouble getting data for several Greek islands.
Hi, thanks for the article. But I have some questions about getting the data. First is I got a lot of NaN values when I choose era-5-land , is it normal? Second , how can I calculate temperature at the exactly point between two stations?
60 years of historical weather as free API and download
First of all, impressive work! Also enjoying the blog posts, I'm learning a lot about weather and forecasting 👌 Thinking about using this in my next project
I'm still curious about how you serve the data. Specifically:
- about caching, I've been looking at the code base and haven't found anything specific about this. When you talk about caching, you mean the API uses the filesystem caching under the hood, right? Did you have to make any tweaks to improve performance?
- about the db itself, I've read it is a custom filesystem based data base. If I didn't understood bad, data is stored as compressed plain binary and, when a request comes in, it gets decompressed, and formated. Lets say I want to fetch data in a specific time range or apply some filters, how are those kind of operations performed?
Thanks for your time in advance!
This is an amazing work, thanks for sharing 👏🏼
Recently I need historical weather data of USA cities. I started checking for few cities and I see a huge difference between the data I get from this API and other websites such as accuweather, world-weather etc.
For example these are the results for Houston (29.7604, 95.3698) on 01.03.2023.
Meteo result: Max Apparent Temp.: -5.3°C Mean Apparent Temp: -9.5°C
Accuweather: Max Temp: 28°C (during the day)
World-weather: Max Temp: 22°C (during the day)
I checked for few different cities and I got similar huge differences between temperatures.
Am I doing something wrong? Is such a gap between results normal?
Hi there. I found the solution for my problem. If you delete the end date manually and fill in the desired end date it works well after all.
oeps I mean 2023-06-01 ;-)
Thanks for your quick reply! I'm trying to obtain the data from 1 June 2023 till today (or 31 December 2023). Setting the date in the start date field to 2023-01-06 leads automatically to the same date in the field of the end data and vice versa.
Thanks very much for this valuable tool(s)! Unfortunately recently I had difficulties with downloading historical data. It was nog possible to set the data. You you know of this problem and/or do you have a solution?
Hello, could you please explain where the data for "weathercode" in the Historical API originates? I searched and I couldn't find it in ERA5 or CERRA databases...
Hello, I have a question. Could you add a separate field for weekly hourly forecast to specify if a certain hour is daytime or nighttime. Right now only the daily forecast has data about sunrises and sunsets to determine if a certain hour is day or night time. This forces my to use two queries if only hourly time is needed. There must be a 'day' or 'night' label for each hour.
Thanks for the impressive work.
I was wondering: when I use the historical weather API, generate a url for my location and check the output, I notice that the lat and lon are rounded of to the nearest 0.5 degrees, while I would expect the numbers to be rounded of to the nearest 0.25 degrees (43.28, -3.31 becomes 43.0, -3.5 instead of 43.25,-3.25). Do you know the reason or I am making a mistake in my thinking?
Cheers
Thank you so much for this project! It's a gift to the world
Should I be able to get weather data for any lat lng points, or must they be within 5km of a weather station? I'm having trouble getting data for several Greek islands.
Hi, thanks for the article. But I have some questions about getting the data. First is I got a lot of NaN values when I choose era-5-land , is it normal? Second , how can I calculate temperature at the exactly point between two stations?
hello is the workstation and where is the server with the data coming from?