Skip to content
View Shahzeb-DataEngineer's full-sized avatar
🇵🇰
Open to Work
🇵🇰
Open to Work

Highlights

  • Pro

Block or report Shahzeb-DataEngineer

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Hi, I'm Shahzeb Ali

Data Engineer based in Lahore | Open-Source Contributor

I build reliable data pipelines, from ingestion to analytics-ready datasets. Day to day, that means ETL/ELT in Python and SQL, large-scale processing on Apache Spark and Databricks, and dimensional modeling, with a focus on getting incremental ingestion right: CDC, Delta Lake MERGE, and clean dbt transformations. I also hunt the bugs that do not crash. They quietly return the wrong answer.

What I'm working on now

  • Building the Jira source connector for Galaxy's Filament (assigned November 2026): YAML manifest and docs page first, following the Asana connector pattern
  • Contributing to delta-rs (Delta Lake, Rust) and maintaining my open pull requests across the data stack
  • Research: fault-injection benchmarking for data quality monitoring, and CDC strategies on Delta Lake under late-arriving updates

Open-source contributions: 21 merged pull requests

Project Merged Pull requests What I contributed
delta-io/delta-rs 7 #4832, #4833, #4866, #4890, #4942, #4966, #5004 Correctness fixes: schema-merge nullability, pre-epoch timestamp statistics, TIMESTAMP UTC offset, validation error naming; docs on retention config, merge examples, and writer env vars
kedro-org/kedro 3 #5808, #5809, #5828 CachedDataset docs example, templating concept page rewrite, OmegaConfigLoader resolver fix
apache/iceberg-python 3 #4135, #4142, #4144 Timestamp parser and predicate evaluation fixes
apache/datafusion 1 #26489 width_bucket bucket-computation dedup
bytewax/bytewax 1 #637 Build info: __version__, __git_revision__, __git_dirty__
open-metadata/docs-om 2 #599, #615 OpenSearch FGAC permissions guide, dev container setup fix
ClickHouse/ClickHouse 1 #125739 Version note for Replicated engine default_replica_path settings
sqlfluff/sqlfluff 1 #8715 Removed outdated Snowflake USING note from Rule ST07
airbytehq/airbyte 1 #88468 Fixed dead low-code CDK sample connector links
canonical/starbase 1 #638 llms.txt description from index.rst

Also in review: Prefect #23819 (type-preserving hash_objects fix), delta-rs #5012 and #5037, dbt #16690, Airflow #74424, and pull requests in Trino, Chroma, Apache Iceberg, lakeFS, and Canonical projects.

Previously validated the Databricks Zerobus sink for Galaxy's Filament, which shipped in Filament v0.24.0.

Technical skills

  • Languages: Python, SQL, Rust, Go
  • Data processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
  • Databases: PostgreSQL, MS SQL Server, SSIS, SSAS
  • Data manipulation: Pandas, NumPy
  • Architecture: Medallion Architecture, CDC, Delta Lake MERGE, Dimensional Modeling
  • Testing and quality: pytest, Rust tests, SQL validation

Experience and education

  • Data Engineer — Alphabridge Consulting, Lahore (Aug – Sep 2026)
  • Teaching Assistant, DBMS & Data Warehousing / BI — PUCIT, Lahore (Jan 2025 – Jan 2026)
  • BS Data Science — University of the Punjab, PUCIT (2022 – 2026)

Connect with me


Building reliable data pipelines, one PR at a time.

Pinned Loading

  1. apache/airflow apache/airflow Public

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    Python 47.5k 18.4k

  2. airbytehq/airbyte airbytehq/airbyte Public

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    Python 22.4k 5.5k

  3. dbt-labs/dbt dbt-labs/dbt Public

    dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

    Rust 14.2k 2.7k

  4. kedro-org/kedro kedro-org/kedro Public

    Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable,…

    Python 11.1k 1.1k

  5. sqlfluff/sqlfluff sqlfluff/sqlfluff Public

    A modular SQL linter and auto-formatter with support for multiple dialects and templated code.

    Python 10k 1.3k

  6. apache/datafusion apache/datafusion Public

    Apache DataFusion SQL Query Engine

    Rust 9.6k 2.6k