Local Dev, Cloud Prod with Dagster and MotherDuck

Develop locally and ship to production confidently with Dagster, Evidence, and MotherDuck. Transitioning from local development to production can sometimes be difficult when building data pipelines. Fear not: Dagster and MotherDuck deliver a masterclass and demo on developing locally and shipping to production with confidence!

Alex Monahan, Forward Deployed Engineer at MotherDuck, and Colton Padden, Data Engineer & Developer Advocate at Dagster Labs, show us how to aggregate our data in the cloud with MotherDuck's managed offering of DuckDB and then persist this data to a local, in-memory instance of our DB within Dagster for follow-up processing.

GitHub repo for the demo:
github.com/dagster-io/devrel-project-demos/tree/ma…

‪@dagsterio‬ is the cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. Learn more about how to get started for free at dagster.io/.

‪@motherduckdb‬ is the data warehouse and SQL analytics platform that's bringing DuckDB to the cloud. Start for free at motherduck.com/product/.