Microsoft Fabric — The Complete Series
35 posts covering OneLake, Direct Lake, Lakehouses, Medallion Architecture, Pipelines & Dataflows Gen2, Delta Lake Optimization, and end-to-end data engineering on Microsoft Fabric.
01 / Intro
Microsoft Fabric Introduction
Start with the big picture: what Microsoft Fabric is, how the core workloads fit together, and how medallion architecture and end-to-end design come together in a unified analytics platform.
02 / Direct Lake
Direct Lake Deep Dive
Go deep on Direct Lake: why it exists, how it works under the hood, how it compares to Import and DirectQuery, and how to tune it for real-world analytics workloads.
03 / Onelake
OneLake Deep Dive
Understand OneLake as the single, logical data lake for Fabric: core principles, architecture, shortcuts, Delta Lake integration, and how it serves BI, engineering, warehousing, and governance.
04 / Lakehouse
Lakehouse Deep Dive
Explore the Lakehouse pattern in Fabric: what it is, how medallion and Delta Lake fit in, how SQL endpoints and Direct Lake light it up, and how to engineer, secure, and govern it in production.
05 / Medallion Architecture
Medallion Architecture Deep Dive
From theory to production: what medallion architecture is and why it matters, how to design Bronze, Silver, and Gold layers in depth, how pipelines and notebooks power the transformation engine, Direct Lake integration for real-time BI, and Dev/Test/Prod strategy.
- Medallion Architecture in Microsoft Fabric — What It Is & Why It Matters
- Medallion Architecture — Designing Bronze, Silver & Gold in Depth
- Medallion Architecture in Fabric — Pipelines, Notebooks & the Transformation Engine
- Medallion Architecture — Direct Lake Integration & Real-Time BI
- Medallion Architecture — Dev/Test/Prod Strategy & Conclusion
06 / Pipelines & Dataflows
Pipelines & Dataflows Gen2 Deep Dive
Why ingestion is the hardest part of Fabric, pipeline architecture and patterns, Silver transformations and metadata-driven pipelines, error handling, monitoring, and Dev/Test/Prod strategy for production-grade data ingestion.
- Pipelines & Dataflows Gen2 in Fabric — Why Ingestion Is the Hardest Part
- Pipelines & Dataflows Gen2 — Pipeline Architecture & Patterns
- Pipelines & Dataflows Gen2 — Silver Transformations & Metadata-Driven Pipelines
- Pipelines & Dataflows Gen2 — Error Handling, Monitoring & Dev/Test/Prod
- Pipelines & Dataflows Gen2 — Conclusion: The Ingestion Backbone of Fabric
07 / Delta Lake Optimization
Delta Lake Optimization Deep Dive
Why Delta Lake optimization matters in Fabric, Z-Order, file compaction and Vacuum, schema evolution and merge optimization, Star Schema, aggregation tables and Direct Lake tuning, and the final performance conclusions.
- Delta Lake Optimization in Fabric — Why It Matters
- Delta Lake Optimization — Z-Order, File Compaction & Vacuum
- Delta Lake Optimization — Schema Evolution & Merge Optimization
- Delta Lake Optimization — Star Schema, Aggregation Tables & Direct Lake Tuning
- Delta Lake Optimization — Conclusion: The Heart of Fabric Performance