You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Luke Cwik (JIRA)" <ji...@apache.org> on 2016/08/26 20:22:20 UTC
[jira] [Commented] (BEAM-592) StackOverflowError Failed
example/java/WordCount When Using SparkRunner
[ https://issues.apache.org/jira/browse/BEAM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439743#comment-15439743 ]
Luke Cwik commented on BEAM-592:
--------------------------------
Unless runners shade all their dependencies it will be near impossible to maintain having multiple runners included at the same time.
Splitting up the profiles to be per runner for the examples package seems like the right thing to do.
> StackOverflowError Failed example/java/WordCount When Using SparkRunner
> -----------------------------------------------------------------------
>
> Key: BEAM-592
> URL: https://issues.apache.org/jira/browse/BEAM-592
> Project: Beam
> Issue Type: Bug
> Reporter: Mark Liu
>
> WordCount(example/java/WordCount) failed running with sparkRunner in following command:
> {code}
> mvn clean compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/tmp/kinglear.txt --runner=SparkRunner --sparkMaster=local --tempLocation=/tmp/out"
> {code}
> Following is part of stacktrace:
> {code}
> Caused by: java.lang.StackOverflowError
> at java.util.concurrent.CopyOnWriteArrayList.toArray(CopyOnWriteArrayList.java:374)
> at java.util.logging.Logger.accessCheckedHandlers(Logger.java:1782)
> at java.util.logging.LogManager$RootLogger.accessCheckedHandlers(LogManager.java:1668)
> at java.util.logging.Logger.getHandlers(Logger.java:1776)
> at java.util.logging.Logger.log(Logger.java:735)
> at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:580)
> at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:650)
> at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:224)
> at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:301)
> at java.util.logging.Logger.log(Logger.java:738)
> at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:580)
> at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:650)
> at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:224)
> at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:301)
> ...
> {code}
> According to [http://slf4j.org/legacy.html#jul-to-slf4j] and in particular section: "jul-to-slf4j.jar and slf4j-jdk14.jar cannot be present simultaneously".
> Change slf4j-jdk14 dependency scope to test solve the above problem, but WordCountIT still failed in same reason.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)