thank you so much Jarek, I appreciate your commitment to improving Airflow and I'm looking forward to the new features.

However, I'm still a bit sceptical about how can I redeploy and rerun only one child flow if it's logic is defined within this one big DAG. Even if it's based on DRY principle and modularity, those child pipelines (TaskGroups) still live only inside of those "big" DAGs. Can I redeploy and rerun this child (aka subdag) without having to redeploy the entire Master pipeline?

--

Lead Community Engineer at Prefect, Data Professional, Cloud & .py fan. www.annageller.com. Get my articles via email: https://annageller.medium.com/subscribe

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Anna Geller

Anna Geller

Lead Community Engineer at Prefect, Data Professional, Cloud & .py fan. www.annageller.com. Get my articles via email: https://annageller.medium.com/subscribe