Hi Maikel, thanks a lot for your response!!! You encouraged me to try again :) It turned out that my problem was that I was running the flow with FargateTaskEnvironment. This caused plenty of errors and turned out to be not necessary. In the end, I got it running perfectly by just setting the LocalEnvironment with label corresponding to my agent "fargate" as argument to my flow Object:

environment=LocalEnvironment(labels=['fargate'])

This way I was able to connect my flow to the Fargate Agent (which I run by: prefect agent start fargate -t MYRUNNERTOKEN -n fargate -f -l fargate) without having to specify any custom FargateTaskEnvironment.

I'm also curios: how do you start your agent(s)? Do you have an extra EC2 instance where those agents run somewhere as background processes?

--

Lead Community Engineer at Prefect, Data Professional, Cloud & .py fan. www.annageller.com. Get my articles via email: https://annageller.medium.com/subscribe

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Anna Geller

Anna Geller

Lead Community Engineer at Prefect, Data Professional, Cloud & .py fan. www.annageller.com. Get my articles via email: https://annageller.medium.com/subscribe