Apache Spark

SWAN: Spark connector and monitor

These notebooks exemplify the usage of SWAN and Spark for analytics and machine learning use cases at CERN.

Analyzing monitoring data

Analyzing LHC logging data

Machine Learning with Apache Spark

Handwritten Digit Classification using Apache Spark and BigDL

LHCb Opendata

This notebok illustrates a nice interplay between LHCb Opendata, Spark and ROOT - all teaching interesting flavour Physics!

 

Spark Course

This gallery shows examples of usage of Apache Spark within SWAN. The full tutorial given at CERN by Prasanth Kothuri and Kasper Surdy can be found on Indico

 

Preparation

Data Frame Tutorial

RDD Tutorial

JDBC Tutorial

 

You are here