Modular Data Stack — Build a Data Platform with Prefect, dbt and Snowflake (Part 2)

DAGs don’t describe what you do. Your teams, projects & systems do. Use blocks to draw a map of your stack and orchestrate it with Prefect.

Modular Data Stack — as colorful and diverse as your teams, projects, and the capabilities of your tools.

Building a data platform is hard. We acknowledged that in the previous post. This is Part 2 in a series of tutorials about how to solve common data platform challenges using Prefect, dbt, and Snowflake. In this post, you’ll learn about the desired outcome and how it can be implemented.

Note: Even though this demo uses Snowflake, it’s also applicable to BigQuery and any other cloud data warehouse, because the building blocks available in Prefect are modular and hot-swappable. You can replace Snowflake with another block that has similar capabilities.

Table of contents
· The desired outcome: Modular Data Stack
· Tell Prefect about your current stack
· Blocks are modular, composable, and easy to change
· Blocks make your data platform adaptable
· Block capabilities
· Use blocks in deployments
· Use blocks to orchestrate dbt
· Hands-on demo
· Realistic dataset and use case
· Prepare your Prefect Cloud workspace
· Prepare your development environment
· CLI profile for the development environment
· Run a…