Join this two-part session featuring Seattle-based Denny Lee, Apache Spark™ and MLflow contributor, Delta Lake maintainer, and co-author of Learning Spark: 2nd edition and the upcoming Delta Lake: The Definitive Guide and Simon Whiteley, Director of Engineering & Co-Owner of London-area Advancing Analytics!
Welcome to the meetup
Session 1: Building reliable lakehouses with Delta Lake
Data lakehouses combine the best of both worlds for databases and data lakes. Databases provide relative simplicity and ACID transactional protection for your data while data lakes provide flexibility, scalability, and support for non-structured data on cheap object stores.
In this session, we describe Delta Lake, which brings reliability by providing a transactional layer on top of data lakes. We will talk about key features of Delta Lake that enable the Lakehouse Architecture. Finally, we will talk about the work we are doing to build the ecosystem around Delta Lake including supporting multiple languages (Python, Rust, Java, etc.) as well as data processing systems (Apache Flink, Apache Pulsar, Apache Hive, PrestoDB, TrinoDB, Apache Spark™, etc.).
Session 2: Simon & Denny - Ask Us Anything!
Join us in a live session of the monthly series "Simon and Denny - Ask Us Anything!" where we will answer your data engineering questions, from building a data platform, to ingestion, to ETL, to analytics. With our background in SQL Server and BI to Apache Spark and Delta Lake - we want to show you how to build your own lakehouse.
As this session is interactive, come prepared to ask questions all throughout the session! Be prepared for another geeky, trans-Atlantic event from two data nerds … in-person!