You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "notatallshaw (via GitHub)" <gi...@apache.org> on 2025/06/14 19:33:08 UTC
[PR] Fix protobuf resolution knot for pip 25.1 [airflow]
notatallshaw opened a new pull request, #51742:
URL: https://github.com/apache/airflow/pull/51742
Related to https://github.com/apache/airflow/pull/51702.
There is a resolution "knot" involving `protobuf` when pip 25.1 attempts to resolve dependencies during CI. Many Google dependencies require `protobuf`, but `grpcio-status` and `opentelemetry-proto` often have conflicting version requirements, for example:
* `grpcio-status` 1.73.0 requires `protobuf<7.0.0,>=6.30.0`
* `opentelemetry-proto` 1.27.0 requires `protobuf<5.0,>=3.19`
Because so many packages depend on `protobuf`, pip's heuristics struggle to correctly identify which packages to backtrack on, leading to resolution too deep errors.
This change introduces a workaround by adding `opentelemetry-proto` with an upper bound to the dependency list. This signals to pip that the package should be resolved early, while the use of a very high upper bound ensures that it doesn't meaningfully restrict user environments. I considered using a requirement like `opentelemetry-proto<2!0`, but decided against it, as it felt too magical and might break tools that are not fully PEP 440 compliant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix protobuf resolution knot for pip 25.1 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on PR #51742:
URL: https://github.com/apache/airflow/pull/51742#issuecomment-2973482784
Thanks @notatallshaw -> it helped of course though it's still a bit non-obvious how :). Looking forward to 25.2 !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix protobuf resolution knot for pip 25.1 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on PR #51742:
URL: https://github.com/apache/airflow/pull/51742#issuecomment-2973146108
Let's see if our canary build likes it :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix protobuf resolution knot for pip 25.1 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk merged PR #51742:
URL: https://github.com/apache/airflow/pull/51742
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix protobuf resolution knot for pip 25.1 [airflow]
Posted by "notatallshaw (via GitHub)" <gi...@apache.org>.
notatallshaw commented on PR #51742:
URL: https://github.com/apache/airflow/pull/51742#issuecomment-2973871133
> it helped of course though it's still a bit non-obvious how
Yeah, unfortunately it only becomes obvious when you look into the internal state of resolvelib.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix protobuf resolution knot for pip 25.1 [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on PR #51742:
URL: https://github.com/apache/airflow/pull/51742#issuecomment-2973533503
Thats really nice! Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org