Skip to content
#

deltalivetable

Star

Here are 2 public repositories matching this topic...

jotstolu / Azure-Data-Engineering-End-to-End-Project-with-CI-CD-using-Azure-DevOps

Star 0

This project demonstrates how to build a modern, scalable data pipeline in the cloud using Azure Data Factory, Azure DevOps, Delta Lake, and Databricks. The pipeline builds silver and gold layers with PySpark and Delta Live Tables, and implements continuous integration using DevOps.

pyspark azuredatafactory azuredatabricks azure-devops delta-lake adlsgen2 deltalivetable
  • Updated Jul 17, 2025

jotstolu / Azure-Data-Engineering-End-to-End-Project---NYC-taxi-dataset

Star 0

An end‑to‑end data engineering pipeline for NYC Green Taxi trip records, built on Microsoft Azure. This project ingests Jan–Dec 2024 Parquet files from the NYC Taxi API into a Bronze Delta Lake layer, cleans and enriches the data in a Silver layer with PySpark on Azure Databricks, then saves the transformed data to the Gold layer in delta format

etl bigdata pyspark sparksql parquet datapipeline azuredatafactory azuredatabricks deltalake adlsgen2 medallionarchitecture deltalivetable
  • Updated Jul 8, 2025

Improve this page

Add a description, image, and links to the deltalivetable topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the deltalivetable topic, visit your repo's landing page and select "manage topics."

Learn more