You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "dnskr (via GitHub)" <gi...@apache.org> on 2023/10/07 19:15:19 UTC
[I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
dnskr opened a new issue, #34817:
URL: https://github.com/apache/airflow/issues/34817
### Official Helm Chart version
1.11.0 (latest released)
### Apache Airflow version
2.7.1
### Kubernetes Version
1.27
### Helm Chart configuration
_No response_
### Docker Image customizations
_No response_
### What happened
Airflow Helm chart 1.11.0 depends on [bitnami/postgresql:12.10.0](https://github.com/apache/airflow/blob/38e6607cc855f55666b817177103585f080d6173/chart/Chart.yaml#L37) subchart and deploys [PostgreSQL 11](https://github.com/apache/airflow/blob/38e6607cc855f55666b817177103585f080d6173/chart/values.yaml#L2232C14-L2232C14) by default.
Apart from good practice of keeping dependencies up to date, there is an end-of-life for `PostgreSQL 11` coming in November 9, 2023 as described in [PostgreSQL Versioning Policy](https://www.postgresql.org/support/versioning/).
### What you think should happen instead
Next Airflow Helm chart release should use latest `bitnami/postgresql:13.x.x` and `PostgreSQL 16` by default.
### How to reproduce
Deploy Airflow Helm chart 1.11.0 with default configuration.
### Anything else
This issue is created to highlight the problem and discuss how it should be fixed with minimal impact on end users.
PostgreSQL was intentionally downgraded from `15` to `11` after `bitnami/postgresql` upgrade from `10.5.3` to `12.1.9`.
Related PRs:
- https://github.com/apache/airflow/pull/29071
- https://github.com/apache/airflow/pull/29207
The PR https://github.com/apache/airflow/pull/29207 also contains the discussion of future version upgrade.
Also related PRs with minor changes and fixes:
- https://github.com/apache/airflow/pull/29210
- https://github.com/apache/airflow/pull/29478
- https://github.com/apache/airflow/pull/33747
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #34817:
URL: https://github.com/apache/airflow/issues/34817#issuecomment-1751852652
>and PostgreSQL 16 by default.
This would unlikely happen, Airflow CI do not have regular runs on Postgres 16 yet (https://github.com/apache/airflow/pull/34543)
After EOL Postgres 11 I guess default would be Postgres 12, at least this happen for other components: default python is 3.8, default db backend the oldest one.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #34817:
URL: https://github.com/apache/airflow/issues/34817#issuecomment-1751798239
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #34817: Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16
URL: https://github.com/apache/airflow/issues/34817
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #34817:
URL: https://github.com/apache/airflow/issues/34817#issuecomment-1766274125
We added Postgres 16 support to main branch https://github.com/apache/airflow/pull/34543
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "dnskr (via GitHub)" <gi...@apache.org>.
dnskr commented on issue #34817:
URL: https://github.com/apache/airflow/issues/34817#issuecomment-1751994781
Airflow Helm chart has been released recently, so taking it into considiration, there is a good chance that Airflow can support Postgres 16 officially before next Helm chart release.
I'm fine with upgrading PostgreSQL to the newest possible version, either it's 15, 14, 13 or even 12. However, I'm not sure that upgrading to PostgreSQL 12 is a pragmatic solution, because end-of-life for PostgreSQL 12 coming next year (November 14, 2024).
Main challenge with the upgrade is that there is no auto-upgrade options for major versions of PostgreSQL as far as I know, i.e. major version upgrade flow requires users to manage it manually with some database downtime. See https://www.postgresql.org/docs/current/pgupgrade.html for more details.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "dnskr (via GitHub)" <gi...@apache.org>.
dnskr commented on issue #34817:
URL: https://github.com/apache/airflow/issues/34817#issuecomment-1843866659
Looks like there is no automated solution for the problem at the moment.
Related issue https://github.com/bitnami/charts/issues/14926
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Upgrade Helm chart dependency to bitnami/postgresql 13.x.x and PostgreSQL 16 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34817:
URL: https://github.com/apache/airflow/issues/34817#issuecomment-1844595646
We can continue upgrading it manually as we do now. And it's fine to upgrade to postgres 16 immediately. Postgres in our chart is not intended for production use and you **SHOULD** use external postgres. So we do not have to maintain any compatibility or upgrade path.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org