Uber's Data Infrastructure team overhauled our approach to scaling our storage infrastructure by incorporating several new features and functionalities, including ViewFs, NameNode garbage collection tuning, and an HDFS load management service.
Uber Engineering built QALM, a smart load management tool allowing for graceful degradation by preserving critical system requests and shedding non-critical requests.
Uber Engineering built Grail, our infrastructure management platform, to aggregate the current state of our systems into a single global view, spanning all zones and regions.
Migrating our Schemaless sharding layer from Python to Go while in production demonstrated that it was possible for us to rewrite the frontend of a massive datastore with zero downtime.
Get to know Uber Aarhus Engineering and the work they do behind the scenes to build and maintain our storage and compute platforms.
Snap your fingers and presto! How Uber Engineering built a fast, efficient data analytics system with Presto and Parquet.