You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2024/03/21 10:39:00 UTC

[jira] [Resolved] (HIVE-28140) Remove unnecessary shading of test jars in Kafka module to speedup build

     [ https://issues.apache.org/jira/browse/HIVE-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stamatis Zampetakis resolved HIVE-28140.
----------------------------------------
    Fix Version/s: 4.1.0
       Resolution: Fixed

Fixed in [https://github.com/apache/hive/commit/9a0ce4e15890aa91f05322e845438e1e8830b1c3]

Thanks for the review [~zhangbutao] !

> Remove unnecessary shading of test jars in Kafka module to speedup build
> ------------------------------------------------------------------------
>
>                 Key: HIVE-28140
>                 URL: https://issues.apache.org/jira/browse/HIVE-28140
>             Project: Hive
>          Issue Type: Task
>          Components: kafka integration
>            Reporter: Stamatis Zampetakis
>            Assignee: Stamatis Zampetakis
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.1.0
>
>         Attachments: mvnout.txt
>
>
> When the [shadeTestJar|https://github.com/apache/hive/blob/884981d1788c6966e895e2959ed954a22eb5c5eb/kafka-handler/pom.xml#L179] option is enabled it tries to fetch the test jars from all dependencies and include them in the shaded artifact.
> For every dependency, and every available repository, there is a download attempt that fails most of the time (since most dependencies do not publish the test artifacts).
> {noformat}
> Downloading from confluent: https://packages.confluent.io/maven/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> Downloading from central: https://repo.maven.apache.org/maven2/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> Downloading from repository-release: https://repository.apache.org/content/repositories/releases/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> Downloading from shibboleth: https://build.shibboleth.net/nexus/content/groups/public/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> [WARNING] Could not get tests for com.sun.jersey.contribs:jersey-guice:jar:1.19.4:compile
> {noformat}
> All these download attempts increase build time noticeably, especially on slow internet connections.
> Shading the test jars in Kafka module is not necessary since we are not using the resulting jars (kafka-handler-4.1.0-SNAPSHOT-tests.jar) anywhere inside the project (no occurrence of kafka-handler along with tests).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)