You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/11/24 17:02:17 UTC

[GitHub] [airflow] parisni opened a new issue #19811: Helm scheduler HA : postgresql error on slot_pool lock

parisni opened a new issue #19811:
URL: https://github.com/apache/airflow/issues/19811


   ### Official Helm Chart version
   
   1.3.0 (latest released)
   
   ### Apache Airflow version
   
   2.2.1
   
   ### Kubernetes Version
   
   1.21
   
   ### Helm Chart configuration
   
   ```yaml
   airflow:
   
     env:
       - name: AIRFLOW__SCHEDULER__USE_ROW_LEVEL_LOCKING
         value: "True"
   
   webserver:
     livenessProbe:
       initialDelaySeconds: 100
       timeoutSeconds: 100
       failureThreshold: 20
       periodSeconds: 25
   
     readinessProbe:
       initialDelaySeconds: 100
       timeoutSeconds: 100
       failureThreshold: 20
       periodSeconds: 25
   
   
   scheduler:
     replicas: 2
   
   executor: LocalExecutor
   ```
   
   ### Docker Image customisations
   
   _No response_
   
   ### What happened
   
   THe postgresql logs this errors:
   
   ```
   ERROR:  could not obtain lock on row in relation "slot_pool"                                                              
   STATEMENT:  SELECT slot_pool.pool AS slot_pool_pool, slot_pool.slots AS slot_pool_slots                                   │
   ```
   
   ### What you expected to happen
   
   _No response_
   
   ### How to reproduce
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ephraimbuddy commented on issue #19811: Helm scheduler HA : postgresql error on slot_pool lock

Posted by GitBox <gi...@apache.org>.
ephraimbuddy commented on issue #19811:
URL: https://github.com/apache/airflow/issues/19811#issuecomment-979762022


   This is expected, not an issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ashb commented on issue #19811: Helm scheduler HA : postgresql error on slot_pool lock

Posted by GitBox <gi...@apache.org>.
ashb commented on issue #19811:
URL: https://github.com/apache/airflow/issues/19811#issuecomment-980054155


   I've worked out how I can stop that error from happening, to just remove a source of confusion https://github.com/apache/airflow/pull/19842


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] tanelk commented on issue #19811: Helm scheduler HA : postgresql error on slot_pool lock

Posted by GitBox <gi...@apache.org>.
tanelk commented on issue #19811:
URL: https://github.com/apache/airflow/issues/19811#issuecomment-978078712


   This should be the intended behaviour. There is a so called "critical section" in the scheduler job, where only one scheduler instance can be at a time. The pools database table is used as a mutex.
   
   Don't think that there is anything that can be done on the airflow side to reduce the misleading error loging.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ephraimbuddy closed issue #19811: Helm scheduler HA : postgresql error on slot_pool lock

Posted by GitBox <gi...@apache.org>.
ephraimbuddy closed issue #19811:
URL: https://github.com/apache/airflow/issues/19811


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org