The key challenge of processing weather data are “simply” the big numbers: Multiple numeric weather models with about 250GB of data at least twice a day. A year of world wide observation data. Satellite and radar images every 5 minutes. How to store the data efficiently? And how to query and lighting fast process the weather parameters? This talk gives you insights on one of the “oldest” big data domains in the industry.

You will learn how they worked around these problems in the old days and how new solutions based on sharding and NoSQL offer. We will present practical results from our in-depth PoC’s. You get to know the borders of Elastic Search, options on sharding and how to measure the different setups.