Back to work

MetroPulse NYC

Behavioral Archetypes for NYC Subway Stations · Data Engineering

Segments every NYC subway station into behavioral archetypes using a serverless lakehouse: real ridership, geospatial, and demographic data, no synthetic inputs.

View source on GitHub

Key features

  • Serverless lakehouse pipeline: Dagster orchestration, DuckDB + Polars for transforms
  • FastAPI service layer over the resulting station archetypes
  • Fully geospatial: every station segmented on real MTA and neighborhood data

Impact

Handles the full pipeline from raw transit and geospatial data to station-level behavioral segments.

Tech stack

Python, Dagster, DuckDB, Polars, FastAPI

Interested in something like this?

Get in touch