November 13–15, 2018 - Shanghai, China
Click Here For Information & Registration

To view the Chinese version of this schedule please go here.

Simultaneous translation will be provided for all keynote and breakout sessions.
Wednesday, November 14 • 15:35 - 16:10
A Hybrid Container Cloud With Kubernetes and Hadoop YARN - Jian He & Bushuang Gao, Alibaba

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
Hadoop YARN is a resource management platform to run big data applications such as MapReduce, Spark and it is architecturally different from Kubernetes which well suits long running services. Many organizations keep both of them to fulfill different types of workloads. However, this approach will incur staggering ops and hardware cost.

Looking at the differences in the 2 types of workloads, is it possible to let them share a single cluster while keeping both resource management systems working in harmony? What are the requirements and what hurdles do we need to overcome?

In this talk we will present a framework developed by Alibaba, that can seamlessly run both Kubernetes and Hadoop in a single cluster with the ability of elastic resource sharing. In addition, we will also share lessons we learned in managing both workloads in production to support Alibaba massive commercial platform.


Bushuang Gao

Senior Software Engineer 高级软件工程师, Alibaba
Bushuang Gao is a Senior Engineer at Alibaba. He works in the container platform team and has extensive experience in Kubernetes and container area. Bushuang Gao 现任阿里巴巴高级工程师。他在容器平台团队工作,在 Kubernetes... Read More →
avatar for Jian He

Jian He

Staff Engineer, Alibaba
Jian He is a Staff Engineer at Alibaba where he works on a container infrastructures to support Alibaba massive workloads globally. Prior to that, he worked at Hortonworks Hadoop team, and primarily contributes to the Hadoop open source community and is also the Hadoop committer and... Read More →

Wednesday November 14, 2018 15:35 - 16:10
2F Room 1