Skip to content
View HarshKumarGuptagit's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report HarshKumarGuptagit

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
HarshKumarGuptagit/README.md

👋 Hello, I'm Harsh Kumar Gupta

Data Engineer | Cloud Infrastructure, Event-Driven Pipelines & Scalable Architecture

I design and build scalable, resilient data platforms.

Specializing in cloud-native ETL/ELT systems across AWS and GCP, I build the infrastructure that makes data reliable and actionable. From event-driven serverless architectures to high-frequency sensor data processing, my focus is on crafting Medallion architectures that guarantee 99.99% accuracy while optimizing cloud processing costs.


🌐 Connect With Me


GitHub Analytics

GitHub Contribution Streak

🛠️ The Modern Data Stack

Domain Technologies
Cloud Platforms AWS GCP
Data Processing Python Apache Spark Polars
Orchestration & DevOps Apache Airflow Docker GitHub Actions
Warehousing & Lakehouses Google BigQuery Databricks Elasticsearch
Data Modeling dbt SQL

🔭 What I'm Building Now

  • Event-Driven ETL Engineering: Building serverless telemetry data pipelines using AWS Lambda, EventBridge, and S3 to process IoT/sensor data.
  • Medallion Architectures: Designing highly scalable Bronze, Silver, and Gold data layers to manage everything from staging to analytics-ready marts.
  • High-Frequency Data Processing: Utilizing Polars and PyArrow to process massive streams of sensor data while maintaining 99.99% accuracy across the analytics layer.
  • Cost & Query Optimization: Automating deployments via CI/CD and aggressively tuning data models (partitioning, clustering) to slash cloud processing costs and execution times.

Pinned Loading

  1. Banking-Live-Data-Engineering-Pipeline Banking-Live-Data-Engineering-Pipeline Public

    An end-to-end modern data engineering pipeline for banking analytics. Features real-time CDC via PostgreSQL, Debezium, and Kafka into MinIO; containerized ETL orchestration with Apache Airflow; SCD…

    Python 1 1

  2. ecommerce-databricks-lakehouse ecommerce-databricks-lakehouse Public

    End-to-end Medallion Lakehouse on Databricks (Unity Catalog, Delta Lake, PySpark) featuring incremental MERGE, SCD Type 2, data quality quarantine, and a Gold star schema.

    Python

  3. pubg-analytics-end-to-end-pipeline pubg-analytics-end-to-end-pipeline Public

    End-to-end ELT pipeline for PUBG PC Player analytics using Python, Apache Airflow, Docker, BigQuery, and dbt. Transforms raw match telemetry into an analytics-ready Star Schema with interactive Loo…

    Python

  4. Data-Analytics-Portfolio Data-Analytics-Portfolio Public

    A collection of data analysis projects using Python, SQL, Tableau, Power BI, and Excel.

    Jupyter Notebook 1 1

  5. exambuddy-class10 exambuddy-class10 Public

    A React Native educational mobile app for Class 10 Nagaland Board students, featuring study notes, previous year question papers, exam blueprints, quizzes, and offline learning resources.

    JavaScript 1