Data Engineer | Data Pipelines & Lakehouse | Open-Source Contributor
I design and build reliable data pipelines — from ingestion to analytics-ready datasets. My day-to-day work is ETL/ELT in Python and SQL, large-scale processing on Apache Spark and Databricks, and dimensional modeling, with a focus on getting incremental ingestion right: CDC, Delta Lake MERGE, and clean dbt transformations.
- Languages: Python, SQL, Rust
- Data Processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
- Databases: PostgreSQL, MS SQL Server, SSIS, SSAS
- Data Manipulation: Pandas, NumPy
- Architecture: Medallion Architecture, CDC, Delta MERGE, Dimensional Modeling
- Testing & Quality: pytest, Rust tests, SQL validation
- 🔵 Contributing to Apache, Delta Lake, dbt Labs, and other data-engineering open-source projects
- 🔵 Building reliable ETL/ELT pipelines and lakehouse architectures
- 🔵 Working with Delta Lake, Apache Spark, and Databricks at scale
- 🔵 Exploring query optimization, data quality monitoring, and incremental ingestion patterns
I contribute to bug fixes, documentation, tests, and performance improvements across data-engineering projects.
| Organization | Project | Status | Pull Requests | Contributions |
|---|---|---|---|---|
| Delta Lake | delta-rs | 3 merged, 1 open | #4832, #4833, #4866, #4890 | Schema merging nullable fix (Rust), deletedFileRetentionDuration docs, TIMESTAMP UTC offset fix, multiple conditional clauses merge examples |
| Kedro | kedro | 2 merged | #5809, #5808 | CachedDataset docs example, templating concept page rewrite |
| SQLFluff | sqlfluff | 1 merged | #8715 | Removed outdated Snowflake USING note from Rule ST07 |
| Airbyte | airbyte | 1 merged | #88468 | Fixed dead low-code CDK sample connector links |
| ClickHouse | ClickHouse | 1 merged | #125739 | Version note for Replicated engine default_replica_path settings |
| Apache | Iceberg | 1 open | #18468 | Spark branch write precedence docs |
| Apache | DataFusion | 1 open | #26198 | Validate pruning-ratio config at SET time |
| Apache | Airflow | 1 open | #74424 | Missing tests for cncf.kubernetes utilities |
| dbt Labs | dbt | 1 open | #16690 | Log effective thread count at startup |
| OpenMetadata | docs-om | 1 open | #599 | OpenSearch FGAC permissions guide |
| Canonical | craft-cli | 1 open | #504 | TypeError for non-string items in humanize_list |
| Canonical | craft-providers | 1 open | #1026 | Typed error for unsupported Ubuntu version in base checks |
- Languages: Python, SQL, Rust
- Data Processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
- Databases & Warehousing: PostgreSQL, MS SQL Server, SSIS, SSAS
- Data Manipulation: Pandas, NumPy
- Architecture: Medallion Architecture, CDC, Delta MERGE, Dimensional Modeling
- Testing & Quality: pytest, Rust tests, SQL validation
- 8 merged PRs across Delta Lake, Kedro, SQLFluff, Airbyte, and ClickHouse
- 8 open PRs across Delta Lake, Apache, dbt Labs, OpenMetadata, and Canonical
- Contributing to docs, tests, bug fixes, and performance improvements
- Data Engineer — Alphabridge Consulting Ltd, Lahore (Aug 2026)
- Teaching Assistant, DBMS & Data Warehousing / BI — PUCIT, Lahore (Jan 2025 – Jan 2026)
- BS Data Science — University of the Punjab, PUCIT (2022 – 2026)
- Email: shahzebali1218@gmail.com
- GitHub: Shahzeb-DataEngineer
Building reliable data pipelines, one PR at a time. 🚀