Apache Spark

SWAN: Spark connector and monitor

These notebooks exemplify the submission and monitoring of Spark jobs from SWAN.

Analyzing monitoring data

Analyzing LHC logging data

LHCb Opendata

This notebok illustrates a nice interplay between LHCb Opendata, Spark and ROOT - all teaching interesting flavour Physics!

 

Spark Course

This gallery shows examples of usage of Apache Spark within SWAN. The full tutorial given at CERN by Prasanth Kouthuri and Kasper Surdy can be found on Indico

 

Preparation

Data Frame Tutorial

RDD Tutorial

JDBC Tutorial

 

You are here