You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "vatsrahul1001 (via GitHub)" <gi...@apache.org> on 2026/03/13 17:23:52 UTC
[I] Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. [airflow]
vatsrahul1001 opened a new issue, #63549:
URL: https://github.com/apache/airflow/issues/63549
### Apache Airflow version
main (development)
### If "Other Airflow 3 version" selected, which one?
_No response_
### What happened?
Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. With 10M deadline rows and 100K serialized_dags, the migration took ~16 minutes.
The UPDATE phase holds row-level locks on all deadline rows for ~7 minutes, and the subsequent ALTER COLUMN ... SET NOT NULL acquires ACCESS EXCLUSIVE lock which blocks all reads and writes to the deadline table.
### What you think should happen instead?
_No response_
### How to reproduce
Steps to reproduce:
1. Start Airflow on 3.1.8 with PostgreSQL backend
2. Accumulate deadline rows and serialized_dag entries (100K+ deadlines to see noticeable impact)
3. Upgrade to 3.2.0 (airflow db migrate)
4. Observe migration 0101 duration scales linearly with deadline row count
### Operating System
MAc
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. [airflow]
Posted by "phanikumv (via GitHub)" <gi...@apache.org>.
phanikumv commented on issue #63549:
URL: https://github.com/apache/airflow/issues/63549#issuecomment-4088136958
Discussed with Jason, targeting to create a PR for this today
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. [airflow]
Posted by "henry3260 (via GitHub)" <gi...@apache.org>.
henry3260 commented on issue #63549:
URL: https://github.com/apache/airflow/issues/63549#issuecomment-4059985872
> [@vatsrahul1001](https://github.com/vatsrahul1001) Can I pick this up? I can do it correctly. I'd like to contribute
Thanks for your interest! You can directly raise a pr. Refer to https://github.com/apache/airflow/blob/main/contributing-docs/04_how_to_contribute.rst#issue-reporting-and-resolution-process
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. [airflow]
Posted by "jason810496 (via GitHub)" <gi...@apache.org>.
jason810496 commented on issue #63549:
URL: https://github.com/apache/airflow/issues/63549#issuecomment-4087554157
Update: I synced up with Rahul yesterday about the setup, I'm able to reproduce the long migration time. Working on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. [airflow]
Posted by "vatsrahul1001 (via GitHub)" <gi...@apache.org>.
vatsrahul1001 closed issue #63549: Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables.
URL: https://github.com/apache/airflow/issues/63549
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migration 0101_3_2_0_ui_improvements_for_deadlines upgrade is slow on deployments with large deadline and serialized_dag tables. [airflow]
Posted by "bittoby (via GitHub)" <gi...@apache.org>.
bittoby commented on issue #63549:
URL: https://github.com/apache/airflow/issues/63549#issuecomment-4056743459
@vatsrahul1001 Can I pick this up? I can do it correctly. I'd like to contribute
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org