You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by cheng xu <ch...@intel.com> on 2016/06/17 05:55:10 UTC

Review Request 48839: HIVE-14029: Update Spark version to 2.0.0

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48839/
-----------------------------------------------------------

Review request for hive, Rui Li, Szehon Ho, and Xuefu Zhang.


Bugs: HIVE-14029
    https://issues.apache.org/jira/browse/HIVE-14029


Repository: hive-git


Description
-------

There are quite some new optimizations in Spark 2.0.0. We need to bump up Spark to 2.0.0 to benefit those performance improvements.


Diffs
-----

  pom.xml 63a5ae1 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveBaseFunctionResultList.java 5b65036 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunction.java 53c5c0e 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunction.java f6595f1 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SortByShuffler.java a6350d3 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/JobMetricsListener.java 09c54c1 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java 4b34ebf 
  ql/src/test/org/apache/hadoop/hive/ql/exec/spark/TestHiveKVResultCache.java ee9f9b7 
  spark-client/src/main/java/org/apache/hive/spark/client/MetricsCollection.java e77aa78 
  spark-client/src/main/java/org/apache/hive/spark/client/RemoteDriver.java e3b88d1 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/InputMetrics.java e46b67d 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/Metrics.java a7305cf 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/ShuffleReadMetrics.java be14c06 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/ShuffleWriteMetrics.java 4420e4d 
  spark-client/src/test/java/org/apache/hive/spark/client/TestMetricsCollection.java 5146e91 

Diff: https://reviews.apache.org/r/48839/diff/


Testing
-------


Thanks,

cheng xu