Loading…
Budapest BI 2015 has ended
International Business Intelligence and analytics conference in the lovely city of Budapest, Hungary
budapestbiforum.com
Back To Schedule
Wednesday, October 14 • 13:30 - 14:00
Luigi Task Orchestrator – three aspects

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Luigi is a Python module for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization and more. I've picked three topics covering the framework itself, the open source aspect of Luigi and the fact that we use Luigi at a Spotify scale:

* Declarative Python Programming in Luigi
* Building an open source community
* Anecdotes of operating Luigi in Spotify

Luigi has a very vibrant community with many pull requests per day and hundreds of contributors. You can check it out at https://github.com/spotify/luigi


Speakers
avatar for Arash Rouhani

Arash Rouhani

Data Engineer, Spotify
Arash Rouhani is working at Spotify as a Data Engineer and is the Chief Maintainer of Luigi. His interest in Reactive Programming lead him to an internship at Facebook which side-tracked him into the realm of Hadoop and Big Data. Arash also have a background in competitive programming... Read More →


Wednesday October 14, 2015 13:30 - 14:00 CEST
Mátyás II.