M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus

M3, Uber's open source metrics platform for Prometheus, facilitates scalable and configurable multi-tenant storage for large-scale metrics.

Databook: Turning Big Data into Knowledge with Metadata at Uber

Databook, Uber's in-house platform for surfacing and exploring contextual metadata, makes dataset discovery and exploration easier for teams across the company.

JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale

Uber open sourced JVM Profiler, our distributed profiler, to enable others to seamlessly collect JVM performance and resource usage metrics.

Engineering a Job-based Forecasting Workflow for Observability Anomaly Detection

Uber’s Observability Applications team overhauled our anomaly detection platform’s workflow to enable the intuitive and performant backfilling of forecasts, paving the way for more intelligent alerting.
Matthew Mengerink, VP of Core Infra

Scaling for Growth: A Q&A with Uber’s VP of Core Infrastructure, Matthew Mengerink

Matthew Mengerink, Vice President of Engineering for Uber’s Core Infrastructure group, talks about how converging technologies and cloud computing contribute to stable and scalable growth.

Scaling Uber’s Apache Hadoop Distributed File System for Growth

Uber's Data Infrastructure team overhauled our approach to scaling our storage infrastructure by incorporating several new features and functionalities, including ViewFs, NameNode garbage collection tuning, and an HDFS load management service.

Introducing QALM, Uber’s QoS Load Management Framework

Uber Engineering built QALM, a smart load management tool allowing for graceful degradation by preserving critical system requests and shedding non-critical requests.

Scaling Infrastructure Management with Grail

Uber Engineering built Grail, our infrastructure management platform, to aggregate the current state of our systems into a single global view, spanning all zones and regions.

Code Migration in Production: Rewriting the Sharding Layer of Uber’s Schemaless Datastore

Migrating our Schemaless sharding layer from Python to Go while in production demonstrated that it was possible for us to rewrite the frontend of a massive datastore with zero downtime.

Building Reliable Reprocessing and Dead Letter Queues with Apache Kafka

The Uber Insurance Engineering team extended Kafka’s role in our existing event-driven architecture by using non-blocking request reprocessing and dead letter queues (DLQ) to achieve decoupled, observable error-handling without disrupting real-time traffic.

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering built AthenaX, our open source streaming analytics platform, to bring large-scale event stream processing to everyone.

The Road to uChat: Building Uber’s Internal Chat Solution

Learn how Uber Engineering’s Employee Productivity Tools team built uChat, an internal chat solution capable of scaling to meet the needs of our growing global company.

Engineering Uber Predictions in Real Time with ELK

Uber Engineering architected a real-time trip features prediction system using an open source RESTful search engine built with Elasticsearch, Logstash, and Kibana (ELK).

Engineering On-Demand Transportation for Business with Uber Central

Uber Engineering built Uber Central's architecture by integrating the Uber for Business platform with a custom front-end design tailored to customer feedback.

Re-Architecting Cash and Digital Wallet Payments for India with Uber Engineering

In this article, a software engineer on Uber Engineering's Payments Efficiency Team discusses how we optimized our driver payment platform for cash and digital wallet commissions in India.

Hudi: Uber Engineering’s Incremental Processing Framework on Apache Hadoop

Uber Engineering's data processing platform team recently built and open sourced Hudi, an incremental processing framework that supports our business critical data pipelines. In this article, we see how Hudi powers a rich data ecosystem where external sources can be ingested into Hadoop in near real-time.

Evolving Distributed Tracing at Uber Engineering

This article is about developing Uber Engineering's open source distributed tracing system, Jaeger.

Engineering the Architecture Behind Uber’s New Rider App

In November 2016 Uber unveiled a sleek new rider app. The app implements a new mobile architecture across both iOS and Android. In this article, Uber Engineering discusses why we felt the need to create a new architecture pattern, and how it helps us reach our goals.

Introducing Chaperone: How Uber Engineering Audits Apache Kafka End-to-End

Uber Engineering explains why and how we built Chaperone, our in-house auditing system for monitoring Kafka pipeline health.

Cherami: Uber Engineering’s Durable and Scalable Task Queue in Go

How Uber engineered Cherami, the resilient, scalable, distributed task queue system written in the Go programming language.

Popular Articles