Databricks framework to validate Data Quality of pySpark DataFrames and Tables
Automated migrations to Unity Catalog
End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL, Delta Lake, and Unity Catalog. Designed for learning, portfolio building, and job interviews.
A cloud-native data pipeline and visualization project analyzing Formula 1 racing data using Azure, Databricks, Delta Lake, Tableau, and Python for insightful EDA and interactive dashboards.
Open, Multi-modal Catalog for Data & AI, written in Rust
A production-ready PySpark project template with medallion architecture, Python packaging, unit tests, integration tests, CI/CD automation, Databricks Asset Bundles, and DQX data quality framework.
Notebooks, terraform, tools to enable setting up Unity Catalog
Production-grade Databricks infrastructure templates for Azure. Deploy in 20 minutes with VNet injection, Unity Catalog, managed identity. Perfect for learning and prototyping. Free and open source.
Unity Catalog Explorer is a TypeScript + Next.js based Web UI for the Unity Catalog OSS.
How to Configure Azure Databricks Unity Catalog using Terraform
SchemaX - Automatic Schema Management
Production-ready support ticket classification using Unity Catalog AI Functions, Vector Search, and RAG. Features 6-phase workflow, knowledge base integration, and Streamlit dashboard.
Real Estate ELT pipeline using Databricks Asset Bundles on GCP. Ingests, transforms, and analyzes property data via Delta Live Tables. Follows medallion architecture (Bronze/Silver/Gold), modular Python design, CI/CD automation with GitHub Actions, and full Unit and Integration tests coverage.
Portfolio Azure (ADF + Databricks SQL + Power BI)
Pulls new data from FRED API, maintained by St. Louis Federal Reserve Bank ,on the 1st Tuesday of every month, performs feature engineering, stores as per medallion architecture on Databricks, and predicts Recession
spark, databricks, kafka, batch and stream-processing
This is a Web API to connect to your Lakehouse with Unity
End-to-end E-Commerce Lakehouse Pipeline built on Azure Databricks using Delta Lake and Delta Live Tables
Add a description, image, and links to the unity-catalog topic page so that developers can more easily learn about it.
To associate your repository with the unity-catalog topic, visit your repo's landing page and select "manage topics."