Tag: Architecture

Introducing Makisu: Uber’s Fast, Reliable Docker Image Builder for Apache Mesos and Kubernetes

Uber built Makisu, our open source Docker image builder, to enable the quick, reliable generation of Dockerfiles in Mesos and Kubernetes ecosystems.

Observability at Scale: Building Uber’s Alerting Ecosystem

Uber’s Observability team built a robust, scalable metrics and alerting pipeline to detect, mitigate, and notify engineers of issues as they occur.

Peloton: Uber’s Unified Resource Scheduler for Diverse Cluster Workloads

Uber developed Peloton to help us balance resource use, elastically share resources, and plan for future capacity needs.

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Responsible for cleaning, storing, and serving over 100 petabytes of analytical data, Uber's Hadoop platform ensures data reliability, scalability, and ease-of-use with minimal latency.

M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus

M3, Uber's open source metrics platform for Prometheus, facilitates scalable and configurable multi-tenant storage for large-scale metrics.

Databook: Turning Big Data into Knowledge with Metadata at Uber

Databook, Uber's in-house platform for surfacing and exploring contextual metadata, makes dataset discovery and exploration easier for teams across the company.

Open Source at Uber: Meet Shan He, the Architect Behind kepler.gl

Shan He, the technical lead on Uber's kepler.gl framework, discusses her journey to data visualization and why she believes open source is such an important part of her team's work.

Scaling Uber’s Apache Hadoop Distributed File System for Growth

Uber's Data Infrastructure team overhauled our approach to scaling our storage infrastructure by incorporating several new features and functionalities, including ViewFs, NameNode garbage collection tuning, and an HDFS load management service.

Queryparser, an Open Source Tool for Parsing and Analyzing SQL

Written in Haskell, Queryparser is Uber Engineering's open source tool for parsing and analyzing SQL queries that makes it easy to identify foreign-key relationships in large data warehouses.

Code Migration in Production: Rewriting the Sharding Layer of Uber’s Schemaless Datastore

Migrating our Schemaless sharding layer from Python to Go while in production demonstrated that it was possible for us to rewrite the frontend of a massive datastore with zero downtime.

Building Reliable Reprocessing and Dead Letter Queues with Apache Kafka

The Uber Insurance Engineering team extended Kafka’s role in our existing event-driven architecture by using non-blocking request reprocessing and dead letter queues (DLQ) to achieve decoupled, observable error-handling without disrupting real-time traffic.

Harnessing Code Generation to Increase Reliability & Productivity on iOS at Uber

Uber's mobile engineers leverage code generation to make our applications more reliable and boost developer productivity.

Architects of Infrastructure: Meet Uber Aarhus Engineering

Get to know Uber Aarhus Engineering and the work they do behind the scenes to build and maintain our storage and compute platforms.

Year in Review: 2017 Highlights from Uber Open Source

As we approach the New Year, Uber Open Source revisits some of Uber Engineering's most popular projects from 2017.

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering built AthenaX, our open source streaming analytics platform, to bring large-scale event stream processing to everyone.

Meet Michelangelo: Uber’s Machine Learning Platform

Uber Engineering introduces Michelangelo, our machine learning-as-a-service system that enables teams to easily build, deploy, and operate ML solutions at scale.

Engineering Scalable, Isolated Mobile Features with Plugins at Uber

Uber Engineering shares our best practices for working with plugins, a powerful tool that enables us to build and ship features quickly at scale.

Driver Profiles: How Uber Engineering Celebrates Drivers

Uber Engineering built a new microservice to power Driver Profiles, an in-app platform that enhances the Uber experience by celebrating drivers.

The Road to uChat: Building Uber’s Internal Chat Solution

Learn how Uber Engineering’s Employee Productivity Tools team built uChat, an internal chat solution capable of scaling to meet the needs of our growing global company.

Engineering Uber Predictions in Real Time with ELK

Uber Engineering architected a real-time trip features prediction system using an open source RESTful search engine built with Elasticsearch, Logstash, and Kibana (ELK).

Popular Articles