Loading…
Attending this event?
Seattle, WA
December 10–13, 2018
Click Here for More Information & Registration
View Venue Map
View analytic
Thursday, December 13 • 2:35pm - 3:10pm
Encoding 250,000 Songs a Day with batch/v1 Jobs - Leigh Capili & John Slivka, Beatport

Sign up or log in to save this to your schedule and see who's attending!

Log in to leave feedback.
Tasked with rebuilding the way we deliver music to DJ's, the Beatport Infrastructure team set out to use Kubernetes to construct scalable compute for executing batch and on-demand encoding workloads in order to level-up our customer's capabilities for playing and mixing dance music.

What would follow is a 5-month journey of building clusters, thrashing with software dependencies, and trudging through erratic performance and scalability issues with the kubernetes API.

How did we decide to use kubernetes?
Was it easy to prototype?

Is etcd capable of sustainably servicing 10,000 Jobs an hour?
How many Pods can the kubernetes API store?
How do you monitor and manage Job failures?

We'll walk you through our lessons learned and talk about our most exciting moments and deflating realizations.
Join us we re-tell the story of delivering a correct system to production :)

Speakers
avatar for Leigh Capili

Leigh Capili

Infrastructure Engineer, Beatport
Leigh is a young Cloud Engineer local to Denver who is passionate about Distributed Systems. | Leigh contributes to Kubernetes and likes functional Javascript. | | At AT&T, Leigh helped design and implement a consistent, hierarchical, and reactive datastore inspired by Facebook's... Read More →
avatar for John Slivka

John Slivka

Infrastructure Engineer, Beatport
John Slivka works on the Infrastructure team at Beatport. Previously, he's worked for IBM Cloud and Oracle Cloud Object Storage as a Software Engineer.



Thursday December 13, 2018 2:35pm - 3:10pm
4C 3/4