You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by chengxiang li <ch...@intel.com> on 2014/10/15 10:49:33 UTC

Review Request 26733: HIVE-8456 Support Hive Counter to collect spark job metric[Spark Branch]

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26733/
-----------------------------------------------------------

Review request for hive, Brock Noland and Szehon Ho.


Bugs: HIVE-8456
    https://issues.apache.org/jira/browse/HIVE-8456


Repository: hive-git


Description
-------

Several Hive query metric in Hive operators is collected by Hive Counter, such as CREATEDFILES and DESERIALIZE_ERRORS, Besides, Hive use Counter as an option to collect table stats info. Spark support Accumulator which is pretty similiar with Hive Counter, we could try to enable Hive Counter based on it.


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/counter/SparkCounter.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/counter/SparkCounterGroup.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/counter/SparkCounters.java PRE-CREATION 

Diff: https://reviews.apache.org/r/26733/diff/


Testing
-------


Thanks,

chengxiang li