You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "kevinjqliu (via GitHub)" <gi...@apache.org> on 2025/02/21 20:00:51 UTC
Re: [PR] [test] Run partition transform tests for all transforms [iceberg-python]
kevinjqliu commented on PR #1592:
URL: https://github.com/apache/iceberg-python/pull/1592#issuecomment-2675433509
CI failed https://github.com/apache/iceberg-python/actions/runs/13464196511/job/37626276454?pr=1592
```
=================================== FAILURES ===================================
_ test_transform_consistency_with_pyarrow_transform[source_type10-\x8e\xd1\x87\x01] _
source_type = BinaryType(), value = b'\x8e\xd1\x87\x01'
@pytest.mark.parametrize(
"source_type, value",
[
(IntegerType(), 22),
(LongType(), 22),
(DecimalType(5, 9), Decimal(19.25)),
(DateType(), datetime.date(1925, 5, 22)),
(TimeType(), datetime.time(19, 25, 00)),
(TimestampType(), datetime.datetime(19, 5, 1, 22, 1, 1)),
(TimestamptzType(), datetime.datetime(19, 5, 1, 22, 1, 1, tzinfo=datetime.timezone.utc)),
(StringType(), "abc"),
(UUIDType(), UUID("12345678-1234-5678-1234-567812345678").bytes),
(FixedType(5), 'b"\x8e\xd1\x87\x01"'),
(BinaryType(), b"\x8e\xd1\x87\x01"),
],
)
def test_transform_consistency_with_pyarrow_transform(source_type: PrimitiveType, value: Any) -> None:
import pyarrow as pa
all_transforms = [ # type: ignore
IdentityTransform(),
BucketTransform(10),
TruncateTransform(10),
YearTransform(),
MonthTransform(),
DayTransform(),
HourTransform(),
]
for t in all_transforms:
if t.can_transform(source_type):
> assert t.transform(source_type)(value) == t.pyarrow_transform(source_type)(pa.array([value])).to_pylist()[0]
tests/table/test_partitioning.py:211:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
array = <pyarrow.lib.BinaryArray object at 0x7ffad121be80>
[
8ED18701
]
def _transform(array: "ArrayLike") -> "ArrayLike":
if isinstance(array, pa.Array):
> return transform_func(array, *args)
E pyo3_runtime.PanicException: range end index 10 out of range for slice of length 4
pyiceberg/transforms.py:209: PanicException
----------------------------- Captured stderr call -----------------------------
thread '<unnamed>' panicked at /home/runner/work/iceberg-rust/iceberg-rust/crates/iceberg/src/transform/truncate.rs:47:11:
range end index 10 out of range for slice of length 4
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
=========================== short test summary info ============================
FAILED tests/table/test_partitioning.py::test_transform_consistency_with_pyarrow_transform[source_type10-\x8e\xd1\x87\x01] - pyo3_runtime.PanicException: range end index 10 out of range for slice of length 4
========== 1 failed, 2771 passed, 1053 deselected in 67.84s (0:01:07) ==========
make: *** [Makefile:78: test-coverage-unit] Error 1
```
cc @Fokko do you think this is a bug on the rust side?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org