Login Sign up

Thursday Oct. 15, 2020, 4 p.m.–Oct. 15, 2020, 4:30 p.m. in Enterprise Jupyter Infrastructure

Notebooker: From research to production in a snap using Jupyter Notebooks

Jon Bannister

Audience level:

Brief Summary

Jupyter Notebooks are awesome tools for research and development, but as soon as you're happy with the outcome the usual process is to throw a messy notebook to a developer and ask them to reproduce it but... not in Jupyter. In this talk, I will explain how we've managed to circumvent the re-implementation step and use the notebooks in production - and how you can do the same.


Background required: not much!

Jupyter has a bunch of tooling which can help with productionisation, and this talk aims to go over some of the issues that I encountered and how I resolved them. Back in 2018, I created a webapp called Notebooker, open-sourced at https://github.com/man-group/notebooker, which aims to address these issues:

I'll go over each point and discuss a) the open source tooling available to address each and b) how I chose to address it in Notebooker. As part of this talk I will heavily mention some key elements, namely jupytext and papermill, which are the foundations upon which Notebooker was built.

In the talk I'm mostly hoping to share my experience as a developer who has had notebooks thrown in his direction for productionisation in the past and spread the knowledge of helpful libraries to attendees who may be facing the same issue. I'd also love to invite contributors who like the Notebooker project to join in.