You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "kevinjqliu (via GitHub)" <gi...@apache.org> on 2025/09/27 23:06:39 UTC
[I] [epic] address manifest reader feature gaps between rust and python implementations [iceberg-rust]
kevinjqliu opened a new issue, #1714:
URL: https://github.com/apache/iceberg-rust/issues/1714
### What's the feature are you trying to implement?
See https://github.com/apache/iceberg-python/pull/2004 for the integration; pyiceberg using rust-based manifest reader
Heres the error log from `make integration`, grouped by error type:
https://gist.github.com/kevinjqliu/db6352f0b6d0ab8a717af67a1b71355e
- [ ] Convert raw literal (bytes) to binary type
- "pyo3_runtime.PanicException: called `Result::unwrap()` on an `Err` value: DataInvalid => Unable to convert raw literal (bytes) fail convert to type binary for: todo: rust avro doesn't support deserialize any bytes representation now"
- [ ] Convert raw literal (bytes) to decimal(5,2) type
- "pyo3_runtime.PanicException: called `Result::unwrap()` on an `Err` value: DataInvalid => Unable to convert raw literal (bytes) fail convert to type decimal(5,2) for: todo: rust avro doesn't support deserialize any bytes representation now"
- [ ] partition field with special string characters, `special#string+field`
- [ ] partition field with uuid
- [ ] V3 manifests
- `Fail to parse format version in manifest metadata`
- [ ] `files` metadata table `lower_bounds`
- `tests/integration/test_inspect_table.py::test_inspect_files[2] - AssertionError: Difference in column lower_bounds: {} != {2147483546: b's3://warehouse/default/table_metadata_files/data/00000-0-f5c93fd4-42af-481f-bcc0-140fad66f25a.parquet', 2147483545: b'\x00\x00\x00\x00\x00\x00\x00\x00'}`
- [ ] manifest file content after merge
- `tests/integration/test_writes/test_writes.py::test_merge_manifests_file_content[2] - AssertionError: assert [(2, 78), (4,...(8, 118), ...] == [(1, 49), (2,... (6, 94), ...]`
### Willingness to contribute
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] [epic] address manifest reader feature gaps between rust and python implementations [iceberg-rust]
Posted by "rambleraptor (via GitHub)" <gi...@apache.org>.
rambleraptor commented on issue #1714:
URL: https://github.com/apache/iceberg-rust/issues/1714#issuecomment-3657955408
Looks like this can be closed out
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] [epic] address manifest reader feature gaps between rust and python implementations [iceberg-rust]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #1714:
URL: https://github.com/apache/iceberg-rust/issues/1714#issuecomment-3523362530
One left 🥳
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] [epic] address manifest reader feature gaps between rust and python implementations [iceberg-rust]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on issue #1714:
URL: https://github.com/apache/iceberg-rust/issues/1714#issuecomment-3523594861
The last one should be addressed by #1849 🥳
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] [epic] address manifest reader feature gaps between rust and python implementations [iceberg-rust]
Posted by "liurenjie1024 (via GitHub)" <gi...@apache.org>.
liurenjie1024 closed issue #1714: [epic] address manifest reader feature gaps between rust and python implementations
URL: https://github.com/apache/iceberg-rust/issues/1714
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org