Data Engineering Capstone: Ingestion to Dashboard End to End

<p>Priya Nandakumar joins Northbeam Outfitters as its first dedicated data engineer and inherits a Monday-morning ritual held together by one analyst's spreadsheet: production Postgres orders, a carrier's shipping API, and a manually exported marketing CSV, stitched together by hand and often wrong. This capstone follows her end to end &mdash; architecting the system with real tradeoffs, building an incremental ingestion layer, modeling raw data into tested staging and mart tables, orchestrating the whole pipeline in Airflow with failure alerts, and shipping a metrics layer and dashboard leadership actually trusts &mdash; closing with a retrospective on what breaks at ten times the data volume.</p>

Tools: Python, PostgreSQL, SQL, Apache Airflow, REST APIs, Git