You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/04/01 11:17:52 UTC

[GitHub] [airflow] gferrate opened a new issue #8044: celery worker_autoescale option in configuration file overrided by default value

gferrate opened a new issue #8044: celery worker_autoescale option in configuration file overrided by default value
URL: https://github.com/apache/airflow/issues/8044
 
 
   **Apache Airflow version**: 1.10.9
   
   **Environment**:
   
   - **OS**: Debian GNU/Linux 10
   - **Kernel**: Linux 4.19.0-8-amd64 #1 SMP Debian 4.19.98-1 (2020-01-26) x86_64 GNU/Linux
   
   **What happened**:
   The `worker_autoscale` configuration option in `airflow.cfg` was overridded by the default value in `airflow/config_templates/default_airflow.cfg`  when left commented in the `airflow.cfg` file.
   
   **What you expected to happen**:
   The `worker_autoscale` option not being overridden by the default value.
   
   **How to reproduce it**:
   - Comment the `worker_autoscale` option in the `[celery]` section in `airflow.cfg`.
   - Spawn a worker by running `airflow worker`
   - The celery worker will be spawned with the default autoscale option (16,12)
   
   **Anything else we need to know**:
   - As the `worker_autoscale` option has priority over the `concurrency` option, the last one gets ignored even if autoscale is commented in the config file.
   - The `worker_autoscale` option is commented in  `airflow/config_templates/default_airflow.cfg` in the master branch (which fixes the issue) but not in the 1.10.9 release.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8044: celery worker_autoescale option in configuration file overrided by default value

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #8044: celery worker_autoescale option in configuration file overrided by default value
URL: https://github.com/apache/airflow/issues/8044#issuecomment-607189067
 
 
   Thanks for opening your first issue here! Be sure to follow the issue template!
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] ashb commented on issue #8044: celery worker_autoescale option in configuration file overrided by default value

Posted by GitBox <gi...@apache.org>.
ashb commented on issue #8044: celery worker_autoescale option in configuration file overrided by default value
URL: https://github.com/apache/airflow/issues/8044#issuecomment-611230693
 
 
   When you say "overridden" do you mean it is not possible to disable this autoscaling option? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services