You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Jins George <ji...@aeris.net> on 2016/01/13 06:10:28 UTC

hiveContext.sql() - Join query fails silently

Hi All,

I have used a  hiveContext.sql() to join a temporary table created from 
Dataframe and parquet tables created in Hive.

The join query runs fine for few hours and then suddenly fails to do the 
Join. Once the issue happens the dataframe returned from 
hiveContext.sql() is empty. If I restart the job, things starts working 
again.

If anyone has faced this type of issue, please suggest

I am using spark 1.5.1, single node in local mode and hive Hive 1.1.0

Thanks,
Jins George