Seattle, WA
December 10–13, 2018
Click Here for More Information & Registration
View Venue Map
Thursday, December 13 • 2:35pm - 3:10pm
Encoding 250,000 Songs a Day with batch/v1 Jobs - Leigh Capili & John Slivka, Beatport

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
Tasked with rebuilding the way we deliver music to DJ's, the Beatport Infrastructure team set out to use Kubernetes to construct scalable compute for executing batch and on-demand encoding workloads in order to level-up our customer's capabilities for playing and mixing dance music.

What would follow is a 5-month journey of building clusters, thrashing with software dependencies, and trudging through erratic performance and scalability issues with the kubernetes API.

How did we decide to use kubernetes?
Was it easy to prototype?

Is etcd capable of sustainably servicing 10,000 Jobs an hour?
How many Pods can the kubernetes API store?
How do you monitor and manage Job failures?

We'll walk you through our lessons learned and talk about our most exciting moments and deflating realizations.
Join us we re-tell the story of delivering a correct system to production :)

avatar for Leigh Capili

Leigh Capili

DX Engineer, Weaveworks
Leigh is local to Denver and contributes to Kubernetes. At AT&T, Leigh helped design and implement a consistent, hierarchical, and reactive datastore inspired by Facebook's Flux Architecture for declaring state across public clouds and data centers. He helped platform and product... Read More →
avatar for John Slivka

John Slivka

Infrastructure Engineer, Beatport
John Slivka works on the Infrastructure team at Beatport. Previously, he's worked for IBM Cloud and Oracle Cloud Object Storage as a Software Engineer.

Thursday December 13, 2018 2:35pm - 3:10pm
4C 3/4