Skip to content
View twarangupta's full-sized avatar
😎
Building AI-powered products & MVPs
😎
Building AI-powered products & MVPs
30 followers · 227 following

Achievements

Achievement: QuickdrawAchievement: Pull Sharkx2Achievement: YOLO

Achievements

Achievement: QuickdrawAchievement: Pull Sharkx2Achievement: YOLO

Block or report twarangupta

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
twarangupta/README.md

Namaste 🙏 I'm Twaran Gupta

Data Engineer · SQL · Python · PySpark · Databricks · Airflow · Snowflake · dbt · AWS · Open to Remote (India)

I build reliable batch data pipelines and warehouses: ingestion, ELT, data modelling and data quality.

I'm also a backend engineer at heart: I've shipped production APIs and calculation services in Node.js, TypeScript and FastAPI on SQL databases, so I understand how the data gets used, not just how it moves. And I'm actively growing into AI engineering: LLM enrichment, Text-to-SQL, RAG and agent workflows with LangChain, LangGraph and AWS Bedrock, built on top of clean, well-modelled data.

At ZS Associates I built Informatica IICS ETL pipelines that integrated 4 source systems (~4 GB/day) into a Snowflake warehouse for a Fortune 500 pharma client. Automated validation cut manual effort 35% and stage-to-production time 25%, and pre-load data-quality checks cut data issues 20%. On a contract-analytics platform I cut data retrieval latency 60% (500 ms to 200 ms) with parallel queries and Redis caching, which earned a Client Appreciation Award.

🔨 Building now (public, built in the open)

  • mf-nav-lakehouse: a daily lakehouse for Indian mutual fund NAVs. Airflow lands AMFI files in S3, and PySpark on Databricks builds Bronze, Silver and Gold Delta tables with idempotent loads and a data-quality gate.
  • airbnb-elt: ELT on Inside Airbnb data. S3 to Snowflake via COPY INTO, incremental dbt models, SCD Type 2 snapshots and a tested star schema.

🔗 Links

🧰 Tech

Data: SQL Python PySpark Databricks Delta Lake Airflow Snowflake dbt Informatica IICS Cloud & DevOps: AWS (S3, IAM, RDS, EC2) Docker GitHub Actions Git Databases: PostgreSQL MySQL Redis MongoDB AI: LLM enrichment Text-to-SQL RAG LangChain LangGraph AWS Bedrock Backend: Node.js TypeScript FastAPI

🟢 Open to Data Engineer, Backend and AI Engineer roles · Full-time/Contract · Available immediately · 📧 twarangupta01@gmail.com

Pinned Loading

  1. mf-nav-lakehouse mf-nav-lakehouse Public

    Daily batch lakehouse for Indian mutual fund NAVs: Airflow pulls AMFI data, PySpark on Databricks builds Bronze/Silver/Gold Delta Lake tables with MERGE upserts and a data-quality gate, and compute…

    Python

  2. airbnb-elt airbnb-elt Public

    End-to-end ELT on Inside Airbnb data: S3 to Snowflake via COPY INTO, dbt incremental models, SCD Type 2 snapshots and a tested star schema with marts for price, availability and reviews per neighbo…

    Python

  3. ask-the-ledger ask-the-ledger Public

    Secure multi-tenant, multi-agent Text-to-SQL assistant. Plain-English questions become validated SQL, run under Postgres Row-Level Security, with real evaluation. Free-tier, built in public, phase …

    Just

  4. ground-truth ground-truth Public

    RAG assistant over public Indian financial documents that answers only from sources, cites document and page, and refuses when unsure. Hybrid search (pgvector + full-text), reranking, LangGraph, hu…

    Python

  5. invoiceForge invoiceForge Public

    Backend invoicing system built with Node.js, Express.js and PostgreSQL, featuring authentication, invoice management and RESTful APIs.

    JavaScript 1

  6. J.A.R.V.I.S J.A.R.V.I.S Public

    A Python-based personal AI assistant exploring intelligent automation, LLM integration and personalized AI-powered interactions.

    Python 2