You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Fokko Driesprong (Jira)" <ji...@apache.org> on 2020/04/30 19:56:00 UTC

[jira] [Commented] (PARQUET-1529) Shade fastutil in all modules where used

    [ https://issues.apache.org/jira/browse/PARQUET-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096937#comment-17096937 ] 

Fokko Driesprong commented on PARQUET-1529:
-------------------------------------------

Turns out that shading Fastutil adds 70MB (uncompressed) to the jar: [https://github.com/apache/incubator-iceberg/pull/708]

> Shade fastutil in all modules where used
> ----------------------------------------
>
>                 Key: PARQUET-1529
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1529
>             Project: Parquet
>          Issue Type: Bug
>    Affects Versions: 1.11.0
>            Reporter: Gabor Szadovszky
>            Assignee: Gabor Szadovszky
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.11.0
>
>
> The dependency {{fastutil}} is shaded in the module {{parquet-column}} while also used in {{parquet-avro}} and {{parquet-hadoop}}. As {{parquet-avro}} and {{parquet-hadoop}} refer to the original packages of {{fastutil}} they won't work if {{fastutil}} is not on the classpath. Let's shade {{fastutil}} in every module it is used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)