gangaextension

Final Report | Installation | How it Works | How to use | Code

Google Summer of Code 2018

Large-scale computing backend for Jupyter notebooks

This project is co-mentored by CERN-HSF and Imperial College, London for Google Summer of Code 2018.

Index

Mentors

Introduction

Jupyter Notebook is an interactive computing environment that creates notebooks which contains computer code as well as rich text elements like equations, figures, plots, widgets and theory. Ganga is an open source iPython based interface tool to the computing grid which leverage the power of distributed computing grid and provide scientists an interface supported by a powerful backend where they can submit their computation intensive programs to Ganga as a batch job. HTCondor is a workload management system created by University of Wisconsin-Madison. It is based on High-Throughput Computing which effectively utilizes the computing power of idle computers on a network or on a computing grid and offload computing intensive tasks on the idle machines available on a network or computing grid. This project implements an extension for Jupyter Notebook and also integrate it to SWAN Notebook service which is a cloud data analysis service developed and powered by CERN. This extension easily submits and monitor computation jobs to HTCondor using Ganga toolkit inside Notebook. The frontend extension displays status of ongoing job in Notebook itself and also allow termination of ongoing jobs. The Ganga Tab in Jupyter Tree view displays information and status of all Ganga Jobs.

Features

Documentation

Submitting Jobs

submitting

Resubmitting Failed Jobs

resubmit

Ganga tree tab

treetab

Future Work