You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "raphaelauv (via GitHub)" <gi...@apache.org> on 2023/07/31 22:18:45 UTC

[GitHub] [airflow] raphaelauv commented on issue #32966: Enable Airflow DAG processor horizontally scalable

raphaelauv commented on issue #32966:
URL: https://github.com/apache/airflow/issues/32966#issuecomment-1659265837

   Uou can manually horizontally scale the DAG processor by using the `subdir` option https://airflow.apache.org/docs/apache-airflow/stable/cli-and-env-variables-ref.html#dag-processor.
   
   I agree that an automatic distribution of the files to parse (pondered by the number of dags present in each file) to every up and running dag processes would be nice


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org