Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
-
Updated
Feb 11, 2026 - Python
Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines
End-to-end Lakehouse data pipeline using Spark Declarative Pipelines with Bronze, Silver, and Gold layers.
A production-ready Clickstream Data Pipeline built with Databricks Lakeflow and Spark 4.1. This project demonstrates Declarative Data Engineering, featuring Auto Liquid Clustering, SCD Type 2 tracking, and automated CI/CD using Databricks Asset Bundles (DABs).
Medallion Architecture for Data Engineering projects
Add a description, image, and links to the lakeflow-declarative-pipelines topic page so that developers can more easily learn about it.
To associate your repository with the lakeflow-declarative-pipelines topic, visit your repo's landing page and select "manage topics."