Skip to footer
Home Authors Posts by Qifan Shi

Qifan Shi

0 BLOG ARTICLES 0 RESEARCH PAPERS
Qifan is a Senior Software Engineer with the Data Infrastructure team at Uber, and a core contributor for Hadoop containerization. He has been working on multiple systems that effectively orchestrates large-scale HDFS clusters.

Engineering Blog Articles

Containerizing Apache Hadoop Infrastructure at Uber

Introduction

As Uber’s business grew, we scaled our Apache Hadoop (referred to as ‘Hadoop’ in this article) deployment to 21000+ hosts in 5 years, to support the various analytical and machine learning use cases. We built a team with varied

Popular Articles