You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Peter Vary (JIRA)" <ji...@apache.org> on 2019/06/07 15:54:02 UTC

[jira] [Created] (HIVE-21847) Reduce the communication rate between TezAM and LlapDaemons for Llap statistics

Peter Vary created HIVE-21847:
---------------------------------

             Summary: Reduce the communication rate between TezAM and LlapDaemons for Llap statistics
                 Key: HIVE-21847
                 URL: https://issues.apache.org/jira/browse/HIVE-21847
             Project: Hive
          Issue Type: Sub-task
            Reporter: Peter Vary


HIVE-21846 is suboptimal if we have big number of TezAMs and LlapDaemons.

We have to find a better way which is scaleable.

Possible solution could be:
 * Elect a TezAM leader for statistics fetching using ZooKeeper for the election
 * TezAM should become a leader and fetch LlapDaemon data from the Daemons if there is no existing leader
 * TezAM should query the data from the leader TezAM if there is an existing leader.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)