You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Chao Sun (JIRA)" <ji...@apache.org> on 2015/04/24 03:15:38 UTC

[jira] [Created] (HIVE-10476) Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch]

Chao Sun created HIVE-10476:
-------------------------------

             Summary: Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch]
                 Key: HIVE-10476
                 URL: https://issues.apache.org/jira/browse/HIVE-10476
             Project: Hive
          Issue Type: Improvement
          Components: Spark
    Affects Versions: spark-branch
            Reporter: Chao Sun
            Assignee: Chao Sun
            Priority: Minor


Currently, for a Hive query HoS need to get a session
a session twice, once in SparkSetReducerParallelism, and another when submitting the actual job.
The issue is that sometimes there's problem when launching a Yarn application (e.g., don't have permission), then user will have to wait for two timeouts, because both session initializations will fail. This turned out to happen frequently.

This JIRA proposes to fail the query in SparkSetReducerParallelism, when it cannot initialize the session.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)