You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Martin Tzvetanov Grigorov (Jira)" <ji...@apache.org> on 2021/02/09 12:31:00 UTC
[jira] [Comment Edited] (PARQUET-1975) Test failure on ARM64 CPU
architecture
[ https://issues.apache.org/jira/browse/PARQUET-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281756#comment-17281756 ]
Martin Tzvetanov Grigorov edited comment on PARQUET-1975 at 2/9/21, 12:30 PM:
------------------------------------------------------------------------------
The problem starts from org.apache.hadoop.io.compress.CompressionCodecFactory#CODEC_PROVIDERS (hadoop-common:2.10.1). Here it uses ServiceLoader API to load all implementations of org.apache.hadoop.io.compress.CompressionCodec and brotli-codec fails due to the missing binary.
So, the failing test seems to be the first class that instantiates (indirectly) CompressionCodecFactory class.
was (Author: mgrigorov):
The problem starts from org.apache.hadoop.io.compress.CompressionCodecFactory#CODEC_PROVIDERS (hadoop-common:2.10.1). Here it uses ServiceLoader API to load all implementations of org.apache.hadoop.io.compress.CompressionCodec and brotli-codec fails due to the missing binary.
So, the failing test seems to be the first class that loads CompressionCodecFactory class.
> Test failure on ARM64 CPU architecture
> --------------------------------------
>
> Key: PARQUET-1975
> URL: https://issues.apache.org/jira/browse/PARQUET-1975
> Project: Parquet
> Issue Type: Bug
> Affects Versions: 1.12.0
> Reporter: Martin Tzvetanov Grigorov
> Priority: Minor
>
> Trying to build Apache Parquet MR on ARM64 fails with:
>
> {code:java}
> $ mvn clean verify
> ...
> Tests in error:
> testReadWriteWithCountDeprecated(org.apache.parquet.hadoop.DeprecatedInputFormatTest): org.apache.hadoop.io.compress.CompressionCodec: Provider org.apache.hadoop.io.compress.BrotliCodec could not be instantiated
> {code}
>
> The reason is that com.github.rdblue:brotli-codec has no binary for aarch64
--
This message was sent by Atlassian Jira
(v8.3.4#803005)