[jira] [Created] (SPARK-14240) PySpark Standalone Application hangs without any Error message

["Sayak Ghosh (JIRA)" <ji...@apache.org>]

Sayak Ghosh created SPARK-14240:
-----------------------------------

             Summary: PySpark Standalone Application hangs without any Error message
                 Key: SPARK-14240
                 URL: https://issues.apache.org/jira/browse/SPARK-14240
             Project: Spark
          Issue Type: Bug
          Components: Deploy, PySpark
    Affects Versions: 1.6.0
            Reporter: Sayak Ghosh


I am relatively new to Spark and wrote a simple script using python and spark SQL. My problem is that it is perfectly allright at the starting phase of the execution but gradually it slowed down and at the end of the last phase the whole application hangs
Here is my code snippet - 
{   hivectx.registerDataFrameAsTable(aggregatedDataV1,"aggregatedDataV1")
q1 = "SELECT *, (Total_Sale/Sale_Weeks) as Average_Sale_Per_SaleWeek, (Total_Weeks/Sale_Weeks) as Velocity FROM aggregatedDataV1"
aggregatedData = hivectx.sql(q1)
aggregatedData.show(100)
}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org