YARN Archives | Uber Engineering Blog

5 APR

Scaling Uber’s Hadoop Distributed File System for Growth

Uber's Data Infrastructure team overhauled our approach to scaling our storage infrastructure by incorporating several new features and functionalities, including ViewFs, NameNode garbage collection tuning, and an HDFS load management service.

By Ang Zhang and Wei Yan /
Categories: Architecture

9 OCT

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering built AthenaX, our open source streaming analytics platform, to bring large-scale event stream processing to everyone.

By Haohui Mai, Bill Liu, & Naveen Cherukuri /
Categories: Architecture

5 SEP

Meet Michelangelo: Uber’s Machine Learning Platform

Uber Engineering introduces Michelangelo, our machine learning-as-a-service system that enables teams to easily build, deploy, and operate ML solutions at scale.

By Jeremy Hermann & Mike Del Balso /
Categories: Uber Data