Loading…
Seattle, WA
December 10–13, 2018
Click Here for More Information & Registration
View Venue Map
Thursday, December 13 • 4:30pm - 5:05pm
Deep Dive: Big Data SIG - Erik Erlandson, Red Hat & Yinan Li, Google

Sign up or log in to save this to your schedule and see who's attending!

Tweet Share
Feedback form is now closed.
This presentation will cover two projects from sig-big-data: Apache Spark on Kubernetes and Apache Airflow on Kubernetes. Kubernetes became a native scheduler backend for Spark in 2.3 and we have been working on expanding the feature set as well as hardening the integration since then. Apache Airflow on Kubernetes achieved a big milestone with the new Kubernetes Operator for natively launching arbitrary Pods and the Kubernetes Executor that is a Kubernetes native scheduler for Airflow. We will give an overview of the current state and present the roadmap of both projects, and give attendees opportunities to ask questions and provide feedback on roadmaps.
Speakers
avatar for Erik Erlandson

Erik Erlandson

Principal Software Engineer, Red Hat
YL

Yinan Li

Software Engineer, Google
Yinan Li is currently a Software Engineer at Google. He focuses on work that enables large-scale data processing on Kubernetes, including the Kubernetes scheduler backend for Apache Spark. Yinan is a co-chair of SIG big-data of Kubernetes. He is also an Apache Spark contributor and... Read More →

K8S SIG Big Data Deep Dive pdf
Thursday December 13, 2018 4:30pm - 5:05pm
Yakima 1 @ TCC The Conference Center (TCC) - Separate from WSCC building
  Maintainers Track