You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "plovegro (via GitHub)" <gi...@apache.org> on 2025/06/18 05:37:52 UTC
[I] Airflow won't work with dbt-core [airflow]
plovegro opened a new issue, #51866:
URL: https://github.com/apache/airflow/issues/51866
### Apache Airflow version
3.0.2
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
I am attempting to install dbt-core in my airflow docker image, but there is a conflict between dbt-core and the new airflow. Pip is attempting to resolve it but it ran for 3 hours and no luck. If i try dbt-core=1.9.6 i get this error -
```
4.725 The conflict is caused by:
4.725 apache-airflow-core 3.0.2 depends on importlib-metadata>=7.0; python_version >= "3.12"
4.725 dbt-semantic-interfaces 0.7.4 depends on importlib-metadata<7 and >=6.0
```
### What you think should happen instead?
dbt-core should install on 3.0.2
### How to reproduce
docker compose build
### Operating System
Ubuntu 24
### Versions of Apache Airflow Providers
_No response_
### Deployment
Docker-Compose
### Deployment details
Dockerfile
```
FROM apache/airflow:3.0.2
ADD requirements.txt .
RUN pip install apache-airflow==${AIRFLOW_VERSION} -r requirements.txt
```
requirements.txt
```
apache-airflow-providers-airbyte
airflow-provider-hightouch
dbt-core
```
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Airflow won't work with dbt-core [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #51866:
URL: https://github.com/apache/airflow/issues/51866#issuecomment-2982866033
I suggest you to open issue to `dbt` or use lower python version of Airflow. There is nothing we can do if a third-party package limits their dependecies in such way.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Airflow won't work with dbt-core [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #51866:
URL: https://github.com/apache/airflow/issues/51866#issuecomment-2982887239
Also feel free to cc: me and this conversation in your issue. I am happy to be involved, but since it's your problem, it's better you lead and show your need as a user to `dbt`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Airflow won't work with dbt-core [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #51866: Airflow won't work with dbt-core
URL: https://github.com/apache/airflow/issues/51866
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Airflow won't work with dbt-core [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #51866:
URL: https://github.com/apache/airflow/issues/51866#issuecomment-2982754061
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Airflow won't work with dbt-core [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #51866:
URL: https://github.com/apache/airflow/issues/51866#issuecomment-2982878206
```
'importlib_metadata>=6.5;python_version<"3.12"',
'importlib_metadata>=7.0;python_version>="3.12"',
```
And just to explain - this is the requirement from airflow and it is **correct**. Importlib_metada adds Python 3.13 features to Python 3.12 importlib (i.e. implements future-compatibility features coming from Python 3.13. So limiting importib_metadata < 7 on Python 3.12 makes completely no sense, because it means you can only install importlib_metada with exactly the same features as Python 3.12 already has. See https://github.com/python/importlib_metadata?tab=readme-ov-file#compatibility
Feel free to explain that to dbt team when you open your issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org