You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/11/20 00:01:00 UTC
[jira] [Commented] (IMPALA-7871) Don't load Hive builtin jars for
dataload
[ https://issues.apache.org/jira/browse/IMPALA-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692454#comment-16692454 ]
ASF subversion and git services commented on IMPALA-7871:
---------------------------------------------------------
Commit 70fbd1df446f4830b55d684d82c851867b9c1444 in impala's branch refs/heads/master from [~joemcdonnell]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=70fbd1d ]
IMPALA-7871: Don't load Hive builtins
Dataload has a step of "Loading Hive builtins" that
loads a bunch of jars into HDFS/S3/etc. Despite
its name, nothing seems to be using these.
Dataload and core tests succeed without this step.
This removes the Hive builtins step and associated
scripts.
Change-Id: Iaca5ffdaca4b5506e9401b17a7806d37fd7b1844
Reviewed-on: http://gerrit.cloudera.org:8080/11944
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Don't load Hive builtin jars for dataload
> -----------------------------------------
>
> Key: IMPALA-7871
> URL: https://issues.apache.org/jira/browse/IMPALA-7871
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 3.1.0
> Reporter: Joe McDonnell
> Assignee: Joe McDonnell
> Priority: Major
>
> One step in dataload is "Loading Hive Builtins", which copies a large number of jars into HDFS (or whatever storage). This step takes a couple minutes on HDFS dataload and 8 minutes on S3. Despite its name, I can't find any indication that Hive or anything else uses these jars. Dataload and core tests run fine without it. S3 can load data without it. There's no indication that this is needed.
> Unless we find something using these jars, we should remove this step.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org