https://tylerblund.com/tag/apache-spark/apache sparkWowchemy (https://wowchemy.com)en-ushttps://tylerblund.com/media/icon_hua2ec155b4296a9c9791d015323e16eb5_11927_512x512_fill_lanczos_center_3.pnghttps://tylerblund.com/tag/apache-spark/https://tylerblund.com/project/realtimeweatheranalysis/Mon, 01 Jan 0001 00:00:00 +0000https://tylerblund.com/project/realtimeweatheranalysis/<h2 id="what-is">What is?:</h2> <p>This project is a introduction to real time data processing with apache&rsquo;s suite of tools</p> <h2 id="design-goals">Design Goals:</h2> <ul> <li>Develop Understanding: Design and implement large data analysis to familiarize with apache&rsquo;s tooling</li> <li>Scale: Learn how to scale pipelines horizontally to optimize</li> </ul> <h2 id="rtweatherumlrtweather_umldrawiosvg"> <figure > <div class="d-flex justify-content-center"> <div class="w-100" ><img alt="rtWeatherUml" src="https://tylerblund.com/project/realtimeweatheranalysis/rtweather_uml.drawio.svg" loading="lazy" data-zoomable /></div> </div></figure> </h2>