You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by yuemeng1 <yu...@huawei.com> on 2014/12/18 10:21:13 UTC

foreachAsync at RemoteHiveSparkClient.java

hi,all
i execute a sql on hive on spark,the comand like:
select distinct st.sno,sname from student st join score sc 
on(st.sno=sc.sno) where sc.cno IN(11,12,13) and st.sage > 28;(some days 
ago this sql can work )
  but it give me some Info in hive shell :

Query Hive on Spark job[0] stages:
0

Status: Running (Hive on Spark job[0])
Job Progress Format
CurrentTime StageId_StageAttemptId: 
SucceededTasksCount(+RunningTasksCount-FailedTasksCount)/TotalTasksCount 
[StageCost]
2014-12-19 09:15:57,118 Stage-0_0: 0/1
2014-12-19 09:16:00,210 Stage-0_0: 0/1
2014-12-19 09:16:03,319 Stage-0_0: 0/1
2014-12-19 09:16:06,413 Stage-0_0: 0/1
2014-12-19 09:16:09,505 Stage-0_0: 0/1
2014-12-19 09:16:12,599 Stage-0_0: 0/1
2014-12-19 09:16:15,691 Stage-0_0: 0/1
2014-12-19 09:16:18,772 Stage-0_0: 0/1
2014-12-19 09:16:21,857 Stage-0_0: 0/1
2014-12-19 09:16:24,938 Stage-0_0: 0/1
2014-12-19 09:16:27,995 Stage-0_0: 0/1
2014-12-19 09:16:31,042 Stage-0_0: 0/1
2014-12-19 09:16:34,102 Stage-0_0: 0/1
2014-12-19 09:16:37,172 Stage-0_0: 0/1
2014-12-19 09:16:40,236 Stage-0_0: 0/1
2014-12-19 09:16:43,301 Stage-0_0: 0/1
2014-12-19 09:16:46,349 Stage-0_0: 0/1
2014-12-19 09:16:49,398 Stage-0_0: 0/1
2014-12-19 09:16:52,423 Stage-0_0: 0/1
2014-12-19 09:16:55,458 Stage-0_0: 0/1
and i checkout log in spark webui and found some error like :
foreachAsync at RemoteHiveSparkClient.java:137 
<http://datasight18:4040/stages/stage?id=0&attempt=0>+details

org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45)
org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$1.call(RemoteHiveSparkClient.java:137)
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:221)
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:195)
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
java.util.concurrent.FutureTask.run(FutureTask.java:166)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
java.lang.Thread.run(Thread.java:722)