Anna Geller
1 min readAug 28, 2020

--

Hi Brian, thanks for your response. I was referring specifically to parallelizing your Python code with Dask. But it's interesting that you achieved parallelism using SubDags - afaik SubDags are run by SequentialExecutor to prevent from deadlocks.

--

--

Anna Geller
Anna Geller

Written by Anna Geller

Data Engineering, AWS Cloud, Serverless & .py. Get my articles via email https://annageller.medium.com/subscribe YouTube: https://www.youtube.com/@anna__geller

No responses yet