Hi Maikel, thanks a lot for your response!!! You encouraged me to try again :) It turned out that my problem was that I was running the flow with FargateTaskEnvironment. This caused plenty of errors and turned out to be not necessary. In the end, I got it running perfectly by just setting the LocalEnvironment with label corresponding to my agent "fargate" as argument to my flow Object:

environment=LocalEnvironment(labels=['fargate'])

This way I was able to connect my flow to the Fargate Agent (which I run by: prefect agent start fargate -t MYRUNNERTOKEN -n fargate -f -l fargate) without having to specify any custom FargateTaskEnvironment.

I'm also curios: how do you start your agent(s)? Do you have an extra EC2 instance where those agents run somewhere as background processes?

--

Lead Community Engineer at Prefect, Data Professional, Cloud & .py fan. www.annageller.com. Get my articles via email: https://annageller.medium.com/subscribe

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store