You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Michael Smith (Jira)" <ji...@apache.org> on 2024/03/26 04:44:00 UTC
[jira] [Resolved] (IMPALA-12342) Erasure coding build fails on loading iceberg_lineitem_multiblock
[ https://issues.apache.org/jira/browse/IMPALA-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Smith resolved IMPALA-12342.
------------------------------------
Fix Version/s: Impala 4.3.0
Resolution: Fixed
> Erasure coding build fails on loading iceberg_lineitem_multiblock
> -----------------------------------------------------------------
>
> Key: IMPALA-12342
> URL: https://issues.apache.org/jira/browse/IMPALA-12342
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 4.2.0
> Environment: ERASURE_CODING=true
> Reporter: Peter Rozsa
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: test-failure
> Fix For: Impala 4.3.0
>
>
> Erasure coding build fails at statement generation:
>
> {code:java}
> Traceback (most recent call last):
> File "/home/impdev/impala/testdata/bin/generate-schema-statements.py", line 935, in <module>
> convert_orc_to_full_acid)
> File "/home/impdev/impala/testdata/bin/generate-schema-statements.py", line 678, in generate_statements
> insert = eval_section(section['DEPENDENT_LOAD'])
> File "/home/impdev/impala/testdata/bin/generate-schema-statements.py", line 612, in eval_section
> assert p.returncode == 0
> AssertionError{code}
>
> Error message:
>
> {code:java}
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).
> put: Specified block size (524288) is less than the cell size (1048576) of the erasure coding policy (ErasureCodingPolicy=[Name=RS-3-2-1024k, Schema=[ECSchema=[Codec=rs, numDataUnits=3, numParityUnits=2]], CellSize=1048576, Id=2]).{code}
>
> IMPALA-12327 added a specific block size setting for copying files from iceberg_lineitem_multiblock. Without the blocksize setting, the put operation succeeds.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org