linux-foundation

Delta Lake Newsletter: 2020-03-20 Edition

Upcoming Events

Diving into Delta Lake: Unpacking the Transaction Log

March 26th, 2020

unpacking the transaction log

The transaction log is key to understanding Delta Lake because it is the common thread that runs through many of its most important features, including ACID transactions, scalable metadata handling, time travel, and more. In this session, we'll explore what the Delta Lake transaction log is, how it works at the file level, and how it offers an elegant solution to the problem of multiple concurrent reads and writes.\

Watch the video

Diving into Delta Lake: Enforcing and Evolving the Schema

April 2nd, 2020

schema enforcement and evolution

As business problems and requirements evolve over time, so to does the structure of your data. With Delta Lake, as the data changes, incorporating new dimensions is easy. Users have access to simple semantics to control the schema of their tables. These tools include schema enforcement, which prevents users from accidentally polluting their tables with mistakes or garbage data, as well as schema evolution, which enables them to automatically add new columns of rich data when those columns belong. In this webinar, we'll dive into the use of these tools.\

Register for the webinar

Diving into Delta Lake: DML Internals

April 16th, 2020

dml internals

In the earlier Delta Lake Internals webinar series sessions, we described how the Delta Lake transaction log works. In this session, we will dive deeper into how commits, snapshot isolation, and partition and files change when performing deletes, updates, merges, and structured streaming.

Register for the webinar

Previous Events

Machine Learning Lessons Learned from the Field: Interview with Brooke Wenig

March 18th, 2020

machine learning lessons learned from the field

We had a great interview with Brooke Wenig, Machine Learning Practice Lead, on the best practices and patterns when developing, training, and deploying Machine Learning algorithms in production.
We also had updates to previous tech talks with new live demos and Q&A sessions all available on-demand now.

Watch the video

The Genesis of Delta Lake - An Interview with Burak Yavuz

February 19th, 2020

genesis of delta lake

We interviewed Burak Yavuz to learn about the Delta Lake team's decision making process and why they designed, architected, and implemented the architecture that it is today. Understand technical challenges that the team faced, how those challenges were solved, and learn about the plans for the future.

Watch the video

Tech Talk Session

In light of the times, instead of our usual Delta Lake Thursday Tech Talk sessions, we decided to do a session around the analysis of COVID-19 datasets with Vini Jaiswal, Chengyin Eng, Dhruv Kumar, and Denny Lee. For more information on the session, please refer to the background and the link below to watch the session on-demand.

Analyzing COVID-19: Can the Data Community Help?

March 19th, 2020

covid 19

Watch the video

Thank you

If you have any questions or feedback, please do not hesitate to provide feedback on the #deltalake-oss Slack channel. Join the Delta Lake Channel (Register | Login) and join the Delta Users Email Distribution List today!

Thanks! Denny Lee, Developer Advocate

Follow our authors onLinkedIn