About This Course
Build a production lakehouse & deploy a real capstone project with Unity Catalog, Delta Lake, Lakeflow, DABs & CI/CD
What you'll learn:
- Set up and govern a production Databricks workspace on AWS using Unity Catalog
- Master Delta Lake internals — ACID transactions, time travel, constraints, and performance tuning
- Design Medallion Architecture pipelines, first manually, then declaratively with Lakeflow Declarative Pipelines
- Ingest data at scale with Lakeflow Connect — SaaS connectors, database CDC, and Auto Loader
- Orchestrate production pipelines with Lakeflow Jobs — DAGs, retries, control flow, REST API and CLI
- Build a complete production lakehouse for a real e-commerce business, from ingestion through five gold-layer outputs
- Write unit and integration tests for Databricks pipeline code with pytest
- Package and deploy pipelines using Databricks Asset Bundles (DABs)
- Build a CI/CD pipeline with GitHub Actions that tests, validates, and deploys to a UAT environment