Feb 9, 2022
If Dolphin works well for you, there is no need to change. But if, as you say, those pipelines are hard to maintain with Dolphin, then migrating to Prefect can certainly help since Prefect is super user-friendly and easy to use. You are basically writing normal Python scripts and by adding a couple of decorators, you can turn those into a fully-featured Prefect workflow that provides you with observability, alerting, retries, caching, and tons of other features.