You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Tan Tim <un...@gmail.com> on 2014/09/18 09:03:30 UTC

how to track the jobs status without the webUI

Hi, all,

I can see the job failed from the web UI, But when I run ps on the
client(which machine I submit the job), I can find the proces is still
exists:
user_tt   5971  2.6  2.2 15030180 3029840 ?    Sl   11:41   4:37 java  -cp
/var/bh/lib/spark-0.9.1-bin-hadoop1/assembly/target/scala-2.10/spark-assembly_2.10-0.9.1-hadoop1.0.4.jar:/home/user_tt/pole_star_2.0/lib/owlqn_2.10-1.0.jar
OWLQN

I run the spark job in the background, so I use the pid to track the job's
status. so My question is  how can I track the job's status when the job is
actually failed.


tim.tan