Medallion Architecture & Delta Lake in Microsoft Fabric Lakehouse

Lakehouse Deep Dive, Part 2: Medallion Design, Storage, and Delta Lake

This post is Part 2 of the Lakehouse series and focuses on three areas: Medallion Architecture as the Lakehouse’s natural design pattern, Lakehouse storage using files and Delta tables, and Delta Lake as the engine that powers the Lakehouse.

Medallion Architecture: The Lakehouse’s Natural Design Pattern

This section covers Medallion Architecture and explains why it is a natural design pattern for the Lakehouse.

Bronze, Silver, and Gold Explained

This part of the deep dive focuses on Bronze, Silver, and Gold layers and how they are explained within the Medallion Architecture.

Why Medallion Works Perfectly in Fabric

This part describes why the Medallion Architecture works particularly well in Fabric.

Lakehouse Storage: Files and Delta Tables

This section of the deep dive covers Lakehouse storage, focusing on files and Delta tables.

Two Types of Assets

This part describes two types of assets in Lakehouse storage: files and Delta tables.

When to Use Each

This part explains when to use files and when to use Delta tables in the context of Lakehouse storage.

Delta Lake: The Engine Behind the Lakehouse

This section focuses on Delta Lake as the engine that powers the Lakehouse.

ACID Transactions

This part covers ACID transactions in Delta Lake.

Schema Evolution

This part covers schema evolution in Delta Lake.

Time Travel

This part covers time travel capabilities in Delta Lake.

Partitioning

This part covers partitioning in Delta Lake.

Z-Order

This part covers Z-order in Delta Lake.

File Compaction

This part covers file compaction in Delta Lake.

Open Format

This part covers Delta Lake as an open format.

In the next post in this Lakehouse series, we will move from concepts to implementation and focus on SQL Endpoint, Direct Lake, and building a Lakehouse step by step.

Discover more from My journey from Datum to Data

Subscribe now to keep reading and get access to the full archive.

Continue reading