Pinot Real-Time Ingestion with Cloud Segment Storage
Introduction
Apache Pinot is an open source data analytics engine (OLAP), which allows users to query data ingested from as recently as a few seconds...
Uber’s Fulfillment Platform: Ground-up Re-architecture to Accelerate Uber’s Go/Get Strategy
Introduction to Fulfillment at Uber
Uber’s mission is to help our consumers effortlessly go anywhere and get anything in thousands of cities worldwide. At its...
Containerizing Apache Hadoop Infrastructure at Uber
Introduction
As Uber’s business grew, we scaled our Apache Hadoop (referred to as ‘Hadoop’ in this article) deployment to 21000+ hosts in 5 years, to...
‘Orders Near You’ and User-Facing Analytics on Real-Time Geospatial Data
Introduction
By its nature, Uber’s business is highly real-time and contingent upon geospatial data. PBs of data are continuously being collected from our drivers, riders,...
Analyzing Customer Issues to Improve User Experience
Introduction
The primary goal for customer support is to ensure users’ issues are addressed and resolved in a timely and effective manner. The kind of...
Customer Support Automation Platform at Uber
High Level Overview of the Problem
Introduction
If you’ve used any online/digital service, chances are that you are familiar with what a typical customer service experience...
Tuning Model Performance
Introduction
Uber uses machine learning (ML) models to power critical business decisions. An ML model goes through many experiment iterations before making it to production....
Elastic Distributed Training with XGBoost on Ray
Introduction
Since we productionized distributed XGBoost on Apache Spark™ at Uber in 2017, XGBoost has powered a wide spectrum of machine learning (ML) use cases...
Continuous Integration and Deployment for Machine Learning Online Serving and Models
Introduction
At Uber, we have witnessed a significant increase in machine learning adoption across various organizations and use-cases over the last few years. Our machine...
Efficient and Reliable Compute Cluster Management at Scale
Introduction
Uber relies on a containerized microservice architecture. Our need for computational resources has grown significantly over the years, as a consequence of business’ growth....
Handling Flaky Unit Tests in Java
Introduction to Flaky Tests
Unit testing forms the bedrock of any Continuous Integration (CI) system. It warns software engineers of bugs in newly-implemented code and...
Scaling of Uber’s API gateway
As a recap from the last article, Uber’s API Gateway provides an interface and acts as a single point of access for all of...
The Architecture of Uber’s API gateway
API gateways are an integral part of microservices architecture in recent years. An API gateway provides a single point of entry for all our...
Flipr: Making Changes Quickly and Safely at Scale
Introduction
Uber’s many software systems require a high volume of changes every day. Because of our systems’ size and complexity, it is a significant challenge...
How Uber Deals with Large iOS App Size
The App Size Problem
Uber’s iOS mobile Apps for Rider, Driver, and Eats are large in size. The choice of Swift as our primary programming...
Evolving Schemaless into a Distributed SQL Database
Introduction
In 2016 we published blog posts (I, II) about Schemaless - Uber Engineering’s Scalable Datastore. We went over the design of Schemaless as well...
Fast and Reliable Schema-Agnostic Log Analytics Platform
At Uber, we provide a centralized, reliable, and interactive logging platform that empowers engineers to work quickly and confidently at scale. The logs are...
Uber’s Real-time Data Intelligence Platform At Scale: Improving Gairos Scalability/Reliability
Background
Real-time data (# of ride requests, # of drivers available, weather, game) enables operations teams to make informed decisions like surge pricing, maximum dispatch...
The Journey Towards Metric Standardization
At Uber, business metrics are vital for discovering insights about how we perform, gauging the impact of new products, and optimizing the decision making...
Uber’s Real-Time Push Platform
Uber builds multi-sided marketplaces handling millions of trips every day across the globe. We strive to build real-time experiences for all our users.
The nature...
