You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "hao (Jira)" <ji...@apache.org> on 2021/08/03 14:14:00 UTC

[jira] [Updated] (HIVE-10569) Hive CLI gets stuck when hive.exec.parallel=true; and some exception happens during SessionState.start

     [ https://issues.apache.org/jira/browse/HIVE-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

hao updated HIVE-10569:
-----------------------
    Description: 
_强调文本_The CLI gets stuck in the loop in [DriverContext.pollFinished | https://github.com/apache/hive/blob/release-1.1.0/ql/src/java/org/apache/hadoop/hive/ql/DriverContext.java#L108] when some {{TaskRunner}} which has completed has not been marked as non-running.
This can happen when there is exception in [SessionState.start | https://github.com/apache/hive/blob/release-1.1.0/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskRunner.java#L74] which is called from {{TaskRunner.run}}.

This happened with us when we were running with {{hive.exec.parallel=true}}, {{hive.execution.engine=tez}} and Tez wasn't correctly setup.
In this case the CLI printed the exception and then got hung (No prompt.)

A simple fix is to call {{result.setRunning(false);}} in the {{finally}} block of {{TaskRunner.run}}

  was:
The CLI gets stuck in the loop in [DriverContext.pollFinished | https://github.com/apache/hive/blob/release-1.1.0/ql/src/java/org/apache/hadoop/hive/ql/DriverContext.java#L108] when some {{TaskRunner}} which has completed has not been marked as non-running.
This can happen when there is exception in [SessionState.start | https://github.com/apache/hive/blob/release-1.1.0/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskRunner.java#L74] which is called from {{TaskRunner.run}}.

This happened with us when we were running with {{hive.exec.parallel=true}}, {{hive.execution.engine=tez}} and Tez wasn't correctly setup.
In this case the CLI printed the exception and then got hung (No prompt.)

A simple fix is to call {{result.setRunning(false);}} in the {{finally}} block of {{TaskRunner.run}}


> Hive CLI gets stuck when hive.exec.parallel=true; and some exception happens during SessionState.start
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-10569
>                 URL: https://issues.apache.org/jira/browse/HIVE-10569
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1, 1.1.0, 1.2.0
>            Reporter: Rohit Agarwal
>            Assignee: Rohit Agarwal
>            Priority: Critical
>             Fix For: 1.3.0, 2.0.0
>
>         Attachments: HIVE-10569.patch
>
>
> _强调文本_The CLI gets stuck in the loop in [DriverContext.pollFinished | https://github.com/apache/hive/blob/release-1.1.0/ql/src/java/org/apache/hadoop/hive/ql/DriverContext.java#L108] when some {{TaskRunner}} which has completed has not been marked as non-running.
> This can happen when there is exception in [SessionState.start | https://github.com/apache/hive/blob/release-1.1.0/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskRunner.java#L74] which is called from {{TaskRunner.run}}.
> This happened with us when we were running with {{hive.exec.parallel=true}}, {{hive.execution.engine=tez}} and Tez wasn't correctly setup.
> In this case the CLI printed the exception and then got hung (No prompt.)
> A simple fix is to call {{result.setRunning(false);}} in the {{finally}} block of {{TaskRunner.run}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)