Real-Time Analytics With Apache Pinot

Length: 60 minutes

Room: Room 6

Abstract

Analytics is arguably the oldest task of digital computers, and has remained an important part of business computing during its 80-year history. What could possibly be new in this space? A better way to serialize data? A better way to run distributed queries over a data lake? An exciting new integration technology? We need all these things urgently, but to be ready for the future, we something even more: we need analytics that can deliver results to users in real time, in the interaction layer, not to internal decision makers seconds or minutes later. We need what Apache Pinot delivers. Pinot is a database optimized to serve analytical queries at extremely high levels of concurrency, at latencies measured in the tens of milliseconds, on data ingested from the streaming pipeline that underlies more and more of the systems we're building. It's an OLAP database, but one engineered from the ground up to power user-facing features, not executive-facing dashboards. In this talk, we'll look at how it's built, how to get data into it, how to query it, and the typical role it plays in a next-generation system exposing analytics-powered features to its users.

Day & time

Thursday, September 07, 11:40 AM – 12:40 PM

Intended audience

Developers, data engineers, architects

• Tim Berglund

  Tim is a teacher, author, and technology leader with StarTree, where he serves as the VP of Developer Relations. He is a regular speaker at conferences and a presence on YouTube explaining complex technology topics in an accessible way. He tweets as @tlberglund, blogs every few years at http://timberglund.com, and lives in Littleton, CO, USA. He has three grown children and two grandchildren, with a third on the way.

  

  tlberglund