You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/07/11 02:33:25 UTC
[GitHub] [airflow] seongwon77 opened a new issue, #24954: Multiple pgbouncer instances using the helm chart
seongwon77 opened a new issue, #24954:
URL: https://github.com/apache/airflow/issues/24954
### Description
Currently, the helm chart deploys only one pgbouncer instance. (https://github.com/apache/airflow/blob/main/chart/templates/pgbouncer/pgbouncer-deployment.yaml#L40)
However, this could be a single point of failure, since all DB operations would be broken if that instance fails.
Can we have a `replica` option for pgbouncer like the other components(scheduler, worker, ...)?
### Use case/motivation
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #24954: Multiple pgbouncer instances using the helm chart
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24954:
URL: https://github.com/apache/airflow/issues/24954#issuecomment-1180299450
I think you would have to test it thoroughly and make sure it works. From this - (just googled it) - there are some constraints and limits on having multiple pgbouncers and you would also have to make sure to make it in the way that load-balancing happens transparently between the pgbouncer instances: https://www.2ndquadrant.com/en/blog/running-multiple-pgbouncer-instances-with-systemd/#:~:text=Since%20version%201.12%2C%20PgBouncer%20supports,they%20will%20share%20the%20connections.
If you want to work on I think this is a nice feature to add.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #24954: Multiple pgbouncer instances using the helm chart
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #24954:
URL: https://github.com/apache/airflow/issues/24954#issuecomment-1179899089
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Multiple pgbouncer instances using the helm chart [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #24954: Multiple pgbouncer instances using the helm chart
URL: https://github.com/apache/airflow/issues/24954
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #24954: Multiple pgbouncer instances using the helm chart
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24954:
URL: https://github.com/apache/airflow/issues/24954#issuecomment-1180299576
Assigned you @seongwon77
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Multiple pgbouncer instances using the helm chart [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #24954:
URL: https://github.com/apache/airflow/issues/24954#issuecomment-1879998734
https://github.com/apache/airflow/pull/27439 made it configurable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org