You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Jaume M (JIRA)" <ji...@apache.org> on 2018/11/01 17:19:01 UTC

[jira] [Created] (HIVE-20853) Expose ShuffleHandler.registerDag in the llap daemon API

Jaume M created HIVE-20853:
------------------------------

             Summary: Expose ShuffleHandler.registerDag in the llap daemon API
                 Key: HIVE-20853
                 URL: https://issues.apache.org/jira/browse/HIVE-20853
             Project: Hive
          Issue Type: Improvement
          Components: llap
    Affects Versions: 3.1.0
            Reporter: Jaume M


Currently DAGs are only registered when a submitWork is called for that DAG. At this point the crendentials are added to the ShuffleHandler and it can start serving.

However Tez might (and will) schedule tasks to fetch from the ShuffleHandler before anything of this happens and all this tasks will fail which may results in the query failing.

This happens in the scenario in which a LlapDaemon just comes up and tez fetchers try to open a connection before a DAG has been registered.

Adding this API will allow to register the DAG against the Daemon when the AM notices that a new Daemon is up.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)