You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Gopal V (Jira)" <ji...@apache.org> on 2019/09/04 23:16:00 UTC
[jira] [Commented] (HIVE-22169) Tez: SplitGenerator tries to look
for plan files which won't exist for Tez
[ https://issues.apache.org/jira/browse/HIVE-22169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922930#comment-16922930 ]
Gopal V commented on HIVE-22169:
--------------------------------
The only way to test this is to tail the hdfs-audit.log, there's no easy way to write a unit-test for this.
> Tez: SplitGenerator tries to look for plan files which won't exist for Tez
> --------------------------------------------------------------------------
>
> Key: HIVE-22169
> URL: https://issues.apache.org/jira/browse/HIVE-22169
> Project: Hive
> Issue Type: Bug
> Reporter: Gopal V
> Assignee: Gopal V
> Priority: Major
> Attachments: HIVE-22169.1.patch
>
>
> {code}
> at org.apache.hadoop.hive.ql.exec.Utilities.clearWork(Utilities.java:310)
> at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:318)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
> at java.security.AccessController.doPrivileged(Native Method
> {code}
> The split generator tries to clear out the work items from HDFS, which will never exist for Tez plans.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)