Peloton: Uber’s Unified Resource Scheduler for Diverse Cluster Workloads
Uber developed Peloton to help us balance resource use, elastically share resources, and plan for future capacity needs.
Uber’s Big Data Platform: 100+ Petabytes with Minute Latency
Responsible for cleaning, storing, and serving over 100 petabytes of analytical data, Uber's Hadoop platform ensures data reliability, scalability, and ease-of-use with minimal latency.
Maximizing Process Performance with Maze, Uber’s Funnel Visualization Platform
Uber developed Maze, our funnel visualization platform, to identify possible UX bottlenecks and provide insight into the various ways riders and drivers interact with our platform.
M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus
M3, Uber's open source metrics platform for Prometheus, facilitates scalable and configurable multi-tenant storage for large-scale metrics.
Databook: Turning Big Data into Knowledge with Metadata at Uber
Databook, Uber's in-house platform for surfacing and exploring contextual metadata, makes dataset discovery and exploration easier for teams across the company.
JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale
Uber open sourced JVM Profiler, our distributed profiler, to enable others to seamlessly collect JVM performance and resource usage metrics.
Engineering a Job-based Forecasting Workflow for Observability Anomaly Detection
Uber’s Observability Applications team overhauled our anomaly detection platform’s workflow to enable the intuitive and performant backfilling of forecasts, paving the way for more intelligent alerting.
Scaling for Growth: A Q&A with Uber’s VP of Core Infrastructure, Matthew Mengerink
Matthew Mengerink, Vice President of Engineering for Uber’s Core Infrastructure group, talks about how converging technologies and cloud computing contribute to stable and scalable growth.
Scaling Uber’s Apache Hadoop Distributed File System for Growth
Uber's Data Infrastructure team overhauled our approach to scaling our storage infrastructure by incorporating several new features and functionalities, including ViewFs, NameNode garbage collection tuning, and an HDFS load management service.
Introducing QALM, Uber’s QoS Load Management Framework
Uber Engineering built QALM, a smart load management tool allowing for graceful degradation by preserving critical system requests and shedding non-critical requests.
Scaling Infrastructure Management with Grail
Uber Engineering built Grail, our infrastructure management platform, to aggregate the current state of our systems into a single global view, spanning all zones and regions.
Code Migration in Production: Rewriting the Sharding Layer of Uber’s Schemaless Datastore
Migrating our Schemaless sharding layer from Python to Go while in production demonstrated that it was possible for us to rewrite the frontend of a massive datastore with zero downtime.
Building Reliable Reprocessing and Dead Letter Queues with Apache Kafka
The Uber Insurance Engineering team extended Kafka’s role in our existing event-driven architecture by using non-blocking request reprocessing and dead letter queues (DLQ) to achieve decoupled, observable error-handling without disrupting real-time traffic.
Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform
Uber Engineering built AthenaX, our open source streaming analytics platform, to bring large-scale event stream processing to everyone.
The Road to uChat: Building Uber’s Internal Chat Solution
Learn how Uber Engineering’s Employee Productivity Tools team built uChat, an internal chat solution capable of scaling to meet the needs of our growing global company.
Engineering Uber Predictions in Real Time with ELK
Uber Engineering architected a real-time trip features prediction system using an open source RESTful search engine built with Elasticsearch, Logstash, and Kibana (ELK).
Engineering On-Demand Transportation for Business with Uber Central
Uber Engineering built Uber Central's architecture by integrating the Uber for Business platform with a custom front-end design tailored to customer feedback.
Re-Architecting Cash and Digital Wallet Payments for India with Uber Engineering
In this article, a software engineer on Uber Engineering's Payments Efficiency Team discusses how we optimized our driver payment platform for cash and digital wallet commissions in India.
Hudi: Uber Engineering’s Incremental Processing Framework on Apache Hadoop
Uber Engineering's data processing platform team recently built and open sourced Hudi, an incremental processing framework that supports our business critical data pipelines. In this article, we see how Hudi powers a rich data ecosystem where external sources can be ingested into Hadoop in near real-time.
Evolving Distributed Tracing at Uber Engineering
This article is about developing Uber Engineering's open source distributed tracing system, Jaeger.
