Today, Google, Facebook, and Twitter do business with data! We have more and more data at our disposal, which represents real stakes and real value. We therefore need tools to store, process, and analyze it.
Let’s discover two tools that have been making a lot of noise recently!
Apache Cassandra is a scalable NoSQL database, multi-datacenter and very simple to deploy, which allows storage of large quantities of data and is suitable for different data models.
Apache Spark is a distributed and in-memory data processing framework, which perfectly fits the analysis of large data volumes.
During this presentation, we will define the key concepts of Cassandra and Spark, then those of the Spark-Cassandra connector and the Spark ecosystem (MLlib, Spark streaming…).
We will conclude with a demo based on data from an accelerometer, during which we will see how to process and analyze it using Cassandra and its connector, Spark and its Machine Learning libraries (MLlib).
Ludwine Probst is a data engineer at Cityzen Data, where she works on machine learning and processing large volumes of data in real time. She regularly speaks at conferences on data analysis and processing. Finally, she invests heavily in promoting and connecting women in technology, particularly through her roles in the Duchess France association and Ladies Who Code Paris.
Amira LAKHAL is an Agile Java Scala developer at Valtech. She is passionate about agility, functional languages, and the Big Data world. She is committed to the Duchess France association where she participates in connecting women in computing.
Julia is a consultant at Hortis. She has worked as a developer on various Java projects in Madrid, Paris, and Geneva in the banking, energy, transport, and telecommunications sectors. She is a passionate developer highly involved in everything related to the Software Craftsmanship movement and code quality. She is a fan of Java User Groups, Devoxx, and technology watch in general. In 2012, she co-founded jDuchess swiss, an organization aimed at attracting and giving visibility to women in the development world.
