[jira] [Resolved] (SPARK-9064) Job fail due to timeout with spark-packages

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-9064.
------------------------------
    Resolution: Cannot Reproduce

This is almost certainly a network problem between you and the Maven repo. It works for me.

> Job fail due to timeout with spark-packages
> -------------------------------------------
>
>                 Key: SPARK-9064
>                 URL: https://issues.apache.org/jira/browse/SPARK-9064
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Shell, Spark Submit
>    Affects Versions: 1.5.0
>            Reporter: Kai Sasaki
>              Labels: package
>         Attachments: error_logs.txt
>
>
> With spark-packages(Any packages), spark job fails due to timeout. Without spark-packages any jobs are working.
> {code}
> $ ./bin/spark-shell --packages com.databricks:spark-csv_2.10:1.0.3
> scala> import org.apache.spark.mllib.util._
> import org.apache.spark.mllib.util._
> scala> sc.textFile("README.md").count
> [Stage 0:>                                                          (0 + 2) / 2]15/07/15 15:58:09 ERROR Executor: Exception in task 1.0 in stage 0.0 (TID 1)
> java.net.SocketTimeoutException: connect timed out
>         at java.net.PlainSocketImpl.socketConnect(Native Method)
>         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>         at java.net.Socket.connect(Socket.java:579)
>         at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
>         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
>         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
>         at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
>         at sun.net.www.http.HttpClient.New(HttpClient.java:308)
>         at sun.net.www.http.HttpClient.New(HttpClient.java:326)
>         at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996)
>         at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932)
>         at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850)
>         at org.apache.spark.util.Utils$.doFetchFile(Utils.scala:652)
>         at org.apache.spark.util.Utils$.fetchFile(Utils.scala:466)
>         at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:398)
>         at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:390)
>         at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
>         at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98)
>         at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98)
>         at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:226)
>         at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
>         at scala.collection.mutable.HashMap.foreach(HashMap.scala:98)
>         at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
>         at org.apache.spark.executor.Executor.org$apache$spark$executor$Executor$$updateDependencies(Executor.scala:390)
>         at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:193)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
> {code}
> All error logs are attached. Environment is MacOSX 10.10.4. Spark was build from master branch and target was hadoop-2.6.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org