Seattle, WA
December 10–13, 2018
Click Here for More Information & Registration
View Venue Map
Thursday, December 13 • 3:40pm - 4:15pm
Sharded and Federated Prometheus Servers to Monitor Distributed Databases - Jun Li & Viswa Vutharkar, eBay

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
At eBay we have developed a geo-distributed transactional document store called NuData. It is deployed on Kubernetes. The current deployment has thousands of pods across three datacenters, and is monitored by Prometheus. For scalability, our Prometheus cluster has sharded servers to monitor individual infrastructure components and federation servers to retrieve aggregated metrics from sharded servers. For high availability, each sharded/federated server is configured with an active/standby pair over its load-balancer. A routing map ( a time series) is automatically constructed by each shard server and assembled by the federation server, to direct Prometheus queries to the right servers. Today we have over 90 Prometheus servers on two datacenters to collect over 11 M metrics/60 seconds on 400 metrics (and 900 rules), to support health monitoring and performance debugging of NuData.

avatar for Jun Li

Jun Li

Principal Architect, eBay
Jun Li is currently a Principal Architect at eBay. Since he joined eBay in January 2017, he has been leading the effort on monitoring and self-management of NuData, a geo-distributed transactional document store developed in eBay. The monitoring framework is to provide comprehensive... Read More →
avatar for Viswa Vutharkar

Viswa Vutharkar

Sr. MTS, eBay
Technologist, Mentor and Architect in product design & development, product research and analysis, sourcing from and contributing to open source eco systems. Currently at eBay working on a distributed document store on the cloud deployed on internal eBay Kubernetes infrastructure... Read More →

Thursday December 13, 2018 3:40pm - 4:15pm
Ballroom 6B