You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Srikrishna S <sr...@gmail.com> on 2014/07/15 08:23:06 UTC
ALS on EC2
Using properties file: null
Main class:
RecommendationALS
Arguments:
_train.csv
_validation.csv
_test.csv
System properties:
SPARK_SUBMIT -> true
spark.app.name -> RecommendationALS
spark.jars -> file:/root/projects/spark-recommendation-benchmark/benchmark_mf/target/scala-2.10/recommendation-benchmark_2.10-1.0.jar
spark.master -> local[8]
Classpath elements:
file:/root/projects/spark-recommendation-benchmark/benchmark_mf/target/scala-2.10/recommendation-benchmark_2.10-1.0.jar
14/07/15 05:57:41 INFO Slf4jLogger: Slf4jLogger started
14/07/15 05:57:41 INFO Remoting: Starting remoting
14/07/15 05:57:41 INFO Remoting: Remoting started; listening on
addresses :[akka.tcp://spark@ip-172-31-19-62.us-west-2.compute.internal:57349]
14/07/15 05:57:41 INFO Remoting: Remoting now listens on addresses:
[akka.tcp://spark@ip-172-31-19-62.us-west-2.compute.internal:57349]
14/07/15 05:57:42 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where
applicable
--args is deprecated. Use --arg instead.
14/07/15 05:57:43 INFO RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/07/15 05:57:44 INFO Client: Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1
SECONDS)
14/07/15 05:57:45 INFO Client: Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1
SECONDS)
14
.... and it continues trying and sleeping.
Any help?
Re: ALS on EC2
Posted by Xiangrui Meng <me...@gmail.com>.
Could you share the code of RecommendationALS and the complete
spark-submit command line options? Thanks! -Xiangrui
On Mon, Jul 14, 2014 at 11:23 PM, Srikrishna S <sr...@gmail.com> wrote:
> Using properties file: null
> Main class:
> RecommendationALS
> Arguments:
> _train.csv
> _validation.csv
> _test.csv
> System properties:
> SPARK_SUBMIT -> true
> spark.app.name -> RecommendationALS
> spark.jars -> file:/root/projects/spark-recommendation-benchmark/benchmark_mf/target/scala-2.10/recommendation-benchmark_2.10-1.0.jar
> spark.master -> local[8]
> Classpath elements:
> file:/root/projects/spark-recommendation-benchmark/benchmark_mf/target/scala-2.10/recommendation-benchmark_2.10-1.0.jar
>
>
> 14/07/15 05:57:41 INFO Slf4jLogger: Slf4jLogger started
> 14/07/15 05:57:41 INFO Remoting: Starting remoting
> 14/07/15 05:57:41 INFO Remoting: Remoting started; listening on
> addresses :[akka.tcp://spark@ip-172-31-19-62.us-west-2.compute.internal:57349]
> 14/07/15 05:57:41 INFO Remoting: Remoting now listens on addresses:
> [akka.tcp://spark@ip-172-31-19-62.us-west-2.compute.internal:57349]
> 14/07/15 05:57:42 WARN NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where
> applicable
> --args is deprecated. Use --arg instead.
> 14/07/15 05:57:43 INFO RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/07/15 05:57:44 INFO Client: Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1
> SECONDS)
> 14/07/15 05:57:45 INFO Client: Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1
> SECONDS)
> 14
>
> .... and it continues trying and sleeping.
>
> Any help?