[jira] [Commented] (DRILL-7504) Upgrade Parquet library to 1.11.0

["Bohdan Kazydub (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020188#comment-17020188 ] 

Bohdan Kazydub commented on DRILL-7504:
---------------------------------------

[~arina], after upgrading the Parquet versions, each of the tests in `org.apache.drill.metastore.iceberg.write.TestParquetFileWriter` fails with
{code}
java.lang.ExceptionInInitializerError
	at org.apache.iceberg.parquet.Parquet$WriteBuilder.build(Parquet.java:212)
	at org.apache.drill.metastore.iceberg.write.ParquetFileWriter.write(ParquetFileWriter.java:82)
	at org.apache.drill.metastore.iceberg.write.TestParquetFileWriter.testAllTypes(TestParquetFileWriter.java:100)
Caused by: java.lang.RuntimeException: Cannot find constructor for interface org.apache.parquet.column.page.PageWriteStore
	Missing org.apache.parquet.hadoop.ColumnChunkPageWriteStore(org.apache.parquet.hadoop.CodecFactory$BytesCompressor,org.apache.parquet.schema.MessageType,org.apache.parquet.bytes.ByteBufferAllocator) [java.lang.NoSuchMethodException: org.apache.parquet.hadoop.ColumnChunkPageWriteStore.<init>(org.apache.parquet.hadoop.CodecFactory$BytesCompressor, org.apache.parquet.schema.MessageType, org.apache.parquet.bytes.ByteBufferAllocator)]
	at org.apache.iceberg.common.DynConstructors$Builder.build(DynConstructors.java:235)
	at org.apache.iceberg.parquet.ParquetWriter.<clinit>(ParquetWriter.java:57)
	... 3 more
{code}
This happens because constructor for a Parquet's class `org.apache.parquet.hadoop.ColumnChunkPageWriteStore` was expanded with more arguments. Because of this issue, the upgrade is not possible yet, should wait for a new version, the upgrade is already done in the [PR|https://github.com/apache/incubator-iceberg/pull/708].

The tests previously being ignored do pass now, checked other test classes (manually) with Parquet - they seem to pass too, though haven't ran the whole test suit (advanced, functional and full unit tests).

> Upgrade Parquet library to 1.11.0
> ---------------------------------
>
>                 Key: DRILL-7504
>                 URL: https://issues.apache.org/jira/browse/DRILL-7504
>             Project: Apache Drill
>          Issue Type: Task
>    Affects Versions: 1.17.0
>            Reporter: Arina Ielchiieva
>            Assignee: Bohdan Kazydub
>            Priority: Major
>             Fix For: 1.18.0
>
>
> Upgrade Parquet library to 1.11.0
> Apache Parquet Format to 2.7.0 (2.8.0 will be released soon)
> Check ignored tests in:
> org.apache.drill.exec.store.parquet.TestParquetMetadataCache
> org.apache.drill.exec.store.parquet.TestPushDownAndPruningForDecimal
> org.apache.drill.exec.store.parquet.TestPushDownAndPruningForVarchar



--
This message was sent by Atlassian Jira
(v8.3.4#803005)