You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2014/07/09 17:12:04 UTC
[jira] [Created] (HIVE-7372) Select query gives unpredictable
incorrect result when parallelism is greater than 1 [Spark Branch]
Xuefu Zhang created HIVE-7372:
---------------------------------
Summary: Select query gives unpredictable incorrect result when parallelism is greater than 1 [Spark Branch]
Key: HIVE-7372
URL: https://issues.apache.org/jira/browse/HIVE-7372
Project: Hive
Issue Type: Bug
Components: Spark
Reporter: Xuefu Zhang
In SparkClient.java, if the following property is set, unpredictable, incorrect result may be observed.
{code}
sparkConf.set("spark.default.parallelism", "1");
{code}
It's suspected that there are some concurrency issues, as Spark may process multiple datasets in a single JVM when parallelism is greater than 1 in order to use multiple cores.
--
This message was sent by Atlassian JIRA
(v6.2#6252)