You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@airflow.apache.org by Ananth Durai <va...@gmail.com> on 2017/07/17 06:54:41 UTC

Airflow parallelism

Hi there,
I'm having a hard time to understand airflow parallelism. I'm running
Airflow with the following configuration

Executor: LocalExecutor
parallelism: 156
Airflow version: 1.8.1

I assume the maximum number of "Task Instances" would be 156 at any given
time, but I constantly see the active "Task Instance" around 250 sometimes.
Wonder why I'm seeing this behavior.

Regards,
Ananth.P,