You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "AlekseiSaff (via GitHub)" <gi...@apache.org> on 2024/01/26 02:24:30 UTC
[I] Airflow 2.7 to 2.8 upgrade failure [airflow]
AlekseiSaff opened a new issue, #37021:
URL: https://github.com/apache/airflow/issues/37021
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
2.7.3
### What happened?
after succsessfull pip upgrade to 2.8 or 2.8.1 we are running airflow db upgrade and receiving
`[2024-01-26T10:19:46.257+0800] {cli_parser.py:78} WARNING - Authentication manager is not configured and webserver will not be able to start.
/usr/local/lib/python3.9/site-packages/airflow/cli/commands/db_command.py:68 DeprecationWarning: `db upgrade` is deprecated. Use `db migrate` instead.
DB: mysql://airflow:***@localhost/airflow_db
Performing upgrade to the metadata database mysql://airflow:***@localhost/airflow_db
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.9/site-packages/airflow/__main__.py", line 57, in main
args.func(args)
File "/usr/local/lib/python3.9/site-packages/airflow/cli/cli_config.py", line 49, in command
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/airflow/cli/commands/db_command.py", line 69, in upgradedb
migratedb(args)
File "/usr/local/lib/python3.9/site-packages/airflow/utils/cli.py", line 114, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/airflow/utils/providers_configuration_loader.py", line 55, in wrapped_function
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/airflow/cli/commands/db_command.py", line 129, in migratedb
db.upgradedb(
File "/usr/local/lib/python3.9/site-packages/airflow/utils/session.py", line 79, in wrapper
return func(*args, session=session, **kwargs)
File "/usr/local/lib/python3.9/site-packages/airflow/utils/db.py", line 1572, in upgradedb
import_all_models()
File "/usr/local/lib/python3.9/site-packages/airflow/models/__init__.py", line 60, in import_all_models
__getattr__(name)
File "/usr/local/lib/python3.9/site-packages/airflow/models/__init__.py", line 76, in __getattr__
val = import_string(f"{path}.{name}")
File "/usr/local/lib/python3.9/site-packages/airflow/utils/module_loading.py", line 39, in import_string
module = import_module(module_path)
File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 850, in exec_module
File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
File "/usr/local/lib/python3.9/site-packages/airflow/models/dag.py", line 94, in <module>
from airflow.jobs.job import run_job
File "/usr/local/lib/python3.9/site-packages/airflow/jobs/job.py", line 35, in <module>
from airflow.serialization.pydantic.job import JobPydantic
File "/usr/local/lib/python3.9/site-packages/airflow/serialization/pydantic/job.py", line 33, in <module>
class JobPydantic(BaseModelPydantic):
File "pydantic/main.py", line 222, in pydantic.main.ModelMetaclass.__new__
File "pydantic/fields.py", line 506, in pydantic.fields.ModelField.infer
File "pydantic/fields.py", line 436, in pydantic.fields.ModelField.__init__
File "pydantic/fields.py", line 546, in pydantic.fields.ModelField.prepare
File "pydantic/fields.py", line 570, in pydantic.fields.ModelField._set_default_and_type
File "pydantic/fields.py", line 439, in pydantic.fields.ModelField.get_default
File "pydantic/utils.py", line 695, in pydantic.utils.smart_deepcopy
File "/usr/local/lib/python3.9/copy.py", line 172, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/usr/local/lib/python3.9/copy.py", line 270, in _reconstruct
state = deepcopy(state, memo)
File "/usr/local/lib/python3.9/copy.py", line 146, in deepcopy
y = copier(x, memo)
File "/usr/local/lib/python3.9/copy.py", line 230, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/usr/local/lib/python3.9/copy.py", line 161, in deepcopy
rv = reductor(4)
TypeError: cannot pickle '_thread.RLock' object
[lt@lt-hkg1-avm04 experiments]$
`
### What you think should happen instead?
DB should be updated to 2.8.1
### How to reproduce
upgrade 2.7 to 2.8 via PIP and run airflow db upgrade
### Operating System
CentOS 7.9
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Airflow 2.7 to 2.8 upgrade failure [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis closed issue #37021: Airflow 2.7 to 2.8 upgrade failure
URL: https://github.com/apache/airflow/issues/37021
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org