You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "XiaoHongbo-Hope (via GitHub)" <gi...@apache.org> on 2026/05/25 12:45:19 UTC
[PR] [python] [daft] Fall back to pypaimon reader for REST catalog [paimon]
XiaoHongbo-Hope opened a new pull request, #7959:
URL: https://github.com/apache/paimon/pull/7959
### Purpose
Daft reads against an Apache Paimon REST catalog fail with OSS 401 once the initial STS token expires. Daft's native parquet reader binds OSS credentials into a static `IOConfig` at `PaimonDataSource` construction, and refreshed STS tokens from pypaimon's
`file_io` cannot be plumbed back into it.
Until Daft exposes a token-refresh callback, route REST catalogs through pypaimon's reader (`_PaimonPKSplitTask`), which shares the catalog's token-aware `file_io`.
Also stops `_read_table` trimming `catalog_options` to `{warehouse: ...}` — `PaimonDataSource` needs the `metastore` field for this decision.
### Tests
`daft_catalog_rest_test.py::DaftRestReadTest::test_read_table_forwards_full_catalog_options_to_datasource`
`daft_catalog_rest_test.py::DaftRestReadTest::test_rest_catalog_disables_native_parquet_reader`
Both fail on master and pass on this branch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] [daft] Inject REST catalog OSS credentials into Daft IOConfig [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #7959:
URL: https://github.com/apache/paimon/pull/7959#issuecomment-4538669059
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] [daft] Inject REST catalog OSS credentials into Daft IOConfig [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #7959:
URL: https://github.com/apache/paimon/pull/7959
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org