You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Szehon Ho (JIRA)" <ji...@apache.org> on 2016/03/29 07:06:25 UTC
[jira] [Commented] (HIVE-10365) First job fails with
StackOverflowError [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15215435#comment-15215435 ]
Szehon Ho commented on HIVE-10365:
----------------------------------
I happened to see this in a spark-executor during a query as well. Just leaving a note in case someone else hits this.
The solution is to set spark.executor.extraJavaOptions to a sufficiently high -Xss value.
> First job fails with StackOverflowError [Spark Branch]
> ------------------------------------------------------
>
> Key: HIVE-10365
> URL: https://issues.apache.org/jira/browse/HIVE-10365
> Project: Hive
> Issue Type: Bug
> Affects Versions: spark-branch
> Reporter: Jimmy Xiang
> Assignee: Jimmy Xiang
>
> When running some queries on Yarn with standalone Hadoop, the first query fails with StackOverflowError:
> {noformat}
> java.lang.StackOverflowError
> at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
> at java.util.concurrent.ConcurrentHashMap.putIfAbsent(ConcurrentHashMap.java:1145)
> at java.lang.ClassLoader.getClassLoadingLock(ClassLoader.java:464)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:405)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)