Tag: Kafka

Databook: Turning Big Data into Knowledge with Metadata at Uber

Databook, Uber's in-house platform for surfacing and exploring contextual metadata, makes dataset discovery and exploration easier for teams across the company.

Building Reliable Reprocessing and Dead Letter Queues with Apache Kafka

The Uber Insurance Engineering team extended Kafka’s role in our existing event-driven architecture by using non-blocking request reprocessing and dead letter queues (DLQ) to achieve decoupled, observable error-handling without disrupting real-time traffic.

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering built AthenaX, our open source streaming analytics platform, to bring large-scale event stream processing to everyone.

Engineering Restaurant Manager, our UberEATS Analytics Dashboard

The UberEATS Restaurant Manager gives restaurant partners insight into their business by measuring customer satisfaction, sales, and service quality.

Meet Michelangelo: Uber’s Machine Learning Platform

Uber Engineering introduces Michelangelo, our machine learning-as-a-service system that enables teams to easily build, deploy, and operate ML solutions at scale.

Deploying More Reliable Apps with Uber Engineering’s XP Background Push

Uber Engineering's XP Background Push mitigates bugs safely and efficiently in real time, facilitating more seamless user experiences on our apps.

Engineering Uber Predictions in Real Time with ELK

Uber Engineering architected a real-time trip features prediction system using an open source RESTful search engine built with Elasticsearch, Logstash, and Kibana (ELK).

Engineering Data Analytics with Presto and Apache Parquet at Uber

Snap your fingers and presto! How Uber Engineering built a fast, efficient data analytics system with Presto and Parquet.

Redesigning Uber Engineering’s Mobile Content Delivery Ecosystem

How Uber Engineering re-architected the content delivery feed and backend ecosystem of our new driver app to deliver an enhanced user experience.

Presenting the Engineering Behind Uber at Our Technology Day

A daylong event at Uber’s Palo Alto office, sponsored by our LadyEng group, showcased the technical work across Uber Engineering as well as the people who are leading and building these projects. Here are some of the resulting presentations.

Evolving Distributed Tracing at Uber Engineering

This article is about developing Uber Engineering's open source distributed tracing system, Jaeger.

Introducing Chaperone: How Uber Engineering Audits Apache Kafka End-to-End

Uber Engineering explains why and how we built Chaperone, our in-house auditing system for monitoring Kafka pipeline health.

uReplicator: Uber Engineering’s Robust Apache Kafka Replicator

Take a look into uReplicator, Uber’s open source solution for replicating Apache Kafka data in a robust and reliable manner.

The Uber Engineering Tech Stack, Part II: The Edge and Beyond

The end of a two-part series on the tech stack that Uber Engineering uses to make transportation as reliable as running water, everywhere, for everyone, as of spring 2016.

Streamific, the Ingestion Service for Hadoop Big Data at Uber Engineering

Here we look at Hadoop data ingestion, and how Uber Engineering streams diverse data into a cohesive layer for querying in near real-time using our in-house developed Streamific.

Popular Articles