You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by chengxiang li <ch...@intel.com> on 2014/11/12 07:58:13 UTC

Review Request 27908: HIVE-8780 insert1.q hangs with hadoop-1

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27908/
-----------------------------------------------------------

Review request for hive and Xuefu Zhang.


Bugs: HIVE-8780
    https://issues.apache.org/jira/browse/HIVE-8780


Repository: hive-git


Description
-------

Spark job with empty source data would not be submmited to spark cluster actually, so no JobEnd/JobStart event are posted to Spark listener bus. As Hive monitor spark job state by spark listener, it would never get any job state, we use JavaFutureAction to fetch job state in this patch.


Diffs
-----

  itests/pom.xml a15e04a 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java b33f0e2 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/SimpleSparkJobStatus.java 31a45d0 

Diff: https://reviews.apache.org/r/27908/diff/


Testing
-------


Thanks,

chengxiang li

Re: Review Request 27908: HIVE-8780 insert1.q hangs with hadoop-1

Posted by Xuefu Zhang <xz...@cloudera.com>.

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27908/#review60998
-----------------------------------------------------------

Ship it!


Ship It!

- Xuefu Zhang


On Nov. 12, 2014, 6:58 a.m., chengxiang li wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27908/
> -----------------------------------------------------------
> 
> (Updated Nov. 12, 2014, 6:58 a.m.)
> 
> 
> Review request for hive and Xuefu Zhang.
> 
> 
> Bugs: HIVE-8780
>     https://issues.apache.org/jira/browse/HIVE-8780
> 
> 
> Repository: hive-git
> 
> 
> Description
> -------
> 
> Spark job with empty source data would not be submmited to spark cluster actually, so no JobEnd/JobStart event are posted to Spark listener bus. As Hive monitor spark job state by spark listener, it would never get any job state, we use JavaFutureAction to fetch job state in this patch.
> 
> 
> Diffs
> -----
> 
>   itests/pom.xml a15e04a 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java b33f0e2 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/SimpleSparkJobStatus.java 31a45d0 
> 
> Diff: https://reviews.apache.org/r/27908/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> chengxiang li
> 
>