You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2020/09/01 01:18:00 UTC
[jira] [Commented] (IMPALA-10030) Remove unneeded jars from
fe/pom.xml
[ https://issues.apache.org/jira/browse/IMPALA-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188081#comment-17188081 ]
ASF subversion and git services commented on IMPALA-10030:
----------------------------------------------------------
Commit f85dbff97618066d60f37736808c8c24aa0a98e5 in impala's branch refs/heads/master from Sahil Takiar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=f85dbff ]
IMPALA-10030: Remove unnecessary jar dependencies
Remove the dependency on hadoop-hdfs, this jar file contains the core
code for implementing HDFS, and thus pulls in a bunch of unnecessary
transitive dependencies. Impala currently only requires this jar for
some configuration key names. Most of these configuration key names have
been moved to the appropriate HDFS client jars, and some others are
deprecated altogether. Removing this jar required making a few code
changes to move the location of the referenced configuration keys.
Removes all transitive Kafka dependencies from the Apache Ranger
dependency. Previously, Impala only excluded Kafka jars with binary
version kafka_2.11, however, it seems the Ranger recently upgraded the
dependency version to kafka_2.12. Now all Kafka dependencies are
excluded, regardless of artifact name.
Removes all transitive dependencies from the Apache Ozone dependency.
Impala has a dependency on the Ozone client shaded-jar, which already
includes all required transitive dependencies. For some reason, Ozone
still pulls in some transitive dependencies even though they are not
needed.
Made some other minor cleanup / improvements in the fe/pom.xml file.
This saves about 70 MB of space in the Docker images.
Testing:
* Ran exhaustive tests
* Ran on-prem cluster E2E tests
Change-Id: Iadbb6142466f73f067dd7cf9d401ff81145c74cc
Reviewed-on: http://gerrit.cloudera.org:8080/16311
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Remove unneeded jars from fe/pom.xml
> ------------------------------------
>
> Key: IMPALA-10030
> URL: https://issues.apache.org/jira/browse/IMPALA-10030
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
>
> There are several jars dependencies that are (1) not needed, (2) can easily be removed, (3) can be converted to test dependencies, or (4) pull in unnecessary transitive dependencies.
> Removing all these jar dependencies can help decrease the size of Impala Docker images.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org