You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "kevinjqliu (via GitHub)" <gi...@apache.org> on 2026/05/13 03:29:20 UTC
[I] Remove `pyiceberg-core` from the `pyarrow` extra [iceberg-python]
kevinjqliu opened a new issue, #3356:
URL: https://github.com/apache/iceberg-python/issues/3356
Context: https://github.com/apache/iceberg-rust/pull/2442#discussion_r3231267052
`pyiceberg[pyarrow]` currently installs both `pyarrow` and `pyiceberg-core`. This is too broad: most Arrow read/write paths only need `pyarrow`, while `pyiceberg-core` is only used in lazy, feature-specific code paths (native transform kernels, DataFusion table provider).
It also creates a packaging cycle for downstream projects: `pyiceberg-core` cannot depend on `pyiceberg[pyarrow]` without re-installing itself through the extra.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Remove `pyiceberg-core` from the `pyarrow` extra [iceberg-python]
Posted by "CalebWeisgerber (via GitHub)" <gi...@apache.org>.
CalebWeisgerber commented on issue #3356:
URL: https://github.com/apache/iceberg-python/issues/3356#issuecomment-4443912390
I can take a look at this. Quick glance it seems like pyiceberg-core can be removed from the pyarrow dependency but I can remake and check test cases.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Remove `pyiceberg-core` from the `pyarrow` extra [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu closed issue #3356: Remove `pyiceberg-core` from the `pyarrow` extra
URL: https://github.com/apache/iceberg-python/issues/3356
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org