linux-foundation

Build Lakehouses with Delta Lake

Delta Lake is an open-source storage framework that enables building a
Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, and Python.

Get Started

Delta Lake Integrations
An overview of Delta Lake

Open

Community driven, rapidly expanding integration ecosystem

Simple

One format to unify your ETL, Data warehouse, ML in your lakehouse

Production Ready

Battle tested in over 10,000+ production environments ​​

Platform Agnostic

Use with any query engine on any cloud, on-prem, or locally

The Latest

Delta Lake 3.1.0

Delta Lake replaceWhere

Delta Lake Performance

Writing a Kafka Stream to Delta Lake with Spark Structured Streaming

Using Delta Lake with AWS Glue

logo

Key Features

ACID Transactions

Protect your data with serializability, the strongest level of isolation

Scalable Metadata

Handle petabyte-scale tables with billions of partitions and files with ease

Time Travel

Access/revert to earlier versions of data for audits, rollbacks, or reproduce

Open Source

Community driven, open standards, open protocol, open discussions

Unified Batch/Streaming

Exactly once semantics ingestion to backfill to interactive queries

Schema Evolution / Enforcement

Prevent bad data from causing data corruption

Audit History

Delta Lake log all change details providing a fill audit trail

DML Operations

SQL, Scala/Java and Python APIs to merge, update and delete datasets

Read the Lakehouse Storage Systems Whitepapers

These whitepapers dive into the features of Lakehouse storage systems and compare Delta Lake, Apache Hudi, and Apache Iceberg. They also explain the benefits of Lakehouse storage systems and show key performance benchmarks.

Read the whitepaper

Organizations that have contributed to Delta Lake

Together we have made Delta Lake the most widely used lakehouse format in the world!

adobe
atlassian
apple
amazon
alibaba
backMarket
byteDance
canva
cockroachdb
comcast
databricks
disney
ebay
grafana
ibm
microsoft
safeGraph
sambaTv
scribd
starburst
td
talend
twilio
ucDavis
kubit

Join the Delta Lake Community

Delta Lake is supported by more than 190 developers from over 70 organizations across multiple repositories.
Chat with fellow Delta Lake users and contributors, ask questions and share tips.

The Linux Foundation
Project Governance

Delta Lake is an independent open-source project and not controlled by any single company. To emphasize this we joined the Delta Lake Project in 2019, which is a sub-project of the Linux Foundation Projects. Within the project, we make decisions based on these rules.