Uber's Data Infrastructure team overhauled our approach to scaling our storage infrastructure by incorporating several new features and functionalities, including ViewFs, NameNode garbage collection tuning, and an HDFS load management service.
Snap your fingers and presto! How Uber Engineering built a fast, efficient data analytics system with Presto and Parquet.
Uber Engineering's data processing platform team recently built and open sourced Hoodie, an incremental processing framework that supports our business critical data pipelines. In this article, we see how Hoodie powers a rich data ecosystem where external sources can be ingested into Hadoop in near real-time.