You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2015/11/24 18:55:11 UTC
[jira] [Commented] (SPARK-11956) Test failures potentially related
to SPARK-11140
[ https://issues.apache.org/jira/browse/SPARK-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024974#comment-15024974 ]
Marcelo Vanzin commented on SPARK-11956:
----------------------------------------
This seems to be an issue I identified as part of working on SPARK-11563; there are fixes as part of that PR, I'll try to pull them out so we can unblock tests without having to push everything.
> Test failures potentially related to SPARK-11140
> ------------------------------------------------
>
> Key: SPARK-11956
> URL: https://issues.apache.org/jira/browse/SPARK-11956
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.7.0
> Reporter: Marcelo Vanzin
>
> [~joshrosen] pointed out that some YARN tests started failing intermittently after that change went in. Here's a suspicious excerpt from one of the logs on Jenkins:
> {noformat}
> 15/11/24 08:58:18 DEBUG TransportClient: Sending stream request for /jars/sparkJar2657865636759819960.tmp to /192.168.10.27:53256
> 15/11/24 08:58:18 INFO Utils: Fetching spark://192.168.10.27:53256/jars/sparkJar2657865636759819960.tmp to /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/spark-466b6740-bbb5-40ed-8abb-b084a6150115/fetchFileTemp4632692089398180695.tmp
> 15/11/24 09:00:00 WARN CoarseGrainedExecutorBackend: An unknown (amp-jenkins-worker-07.amp:53256) driver disconnected.
> 15/11/24 09:00:00 ERROR NettyRpcEnv: Error downloading stream /jars/sparkJar2657865636759819960.tmp.
> java.nio.channels.ClosedChannelException
> at org.apache.spark.network.client.StreamInterceptor.channelInactive(StreamInterceptor.java:61)
> at org.apache.spark.network.util.TransportFrameDecoder.channelInactive(TransportFrameDecoder.java:123)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
> at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
> at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:828)
> at io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:621)
> at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
> at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
> at java.lang.Thread.run(Thread.java:745)
> 15/11/24 09:00:00 INFO Utils: Copying /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/spark-466b6740-bbb5-40ed-8abb-b084a6150115/-4120705061448384283661_cache to /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/container_1448384095183_0006_01_000002/./sparkJar2657865636759819960.tmp
> 15/11/24 09:00:00 INFO Executor: Adding file:/home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/container_1448384095183_0006_01_000002/./sparkJar2657865636759819960.tmp to class loader
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org