svn commit: r1619175 - /mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext

[dl...@apache.org]

Author: dlyubimov
Date: Wed Aug 20 17:34:24 2014
New Revision: 1619175

URL: http://svn.apache.org/r1619175
Log:
CMS commit to mahout by dlyubimov

Added:
    mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext   (with props)

Added: mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext
URL: http://svn.apache.org/viewvc/mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext?rev=1619175&view=auto
==============================================================================
--- mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext (added)
+++ mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext Wed Aug 20 17:34:24 2014
@@ -0,0 +1,45 @@
+Title:
+Notice:    Licensed to the Apache Software Foundation (ASF) under one
+           or more contributor license agreements.  See the NOTICE file
+           distributed with this work for additional information
+           regarding copyright ownership.  The ASF licenses this file
+           to you under the Apache License, Version 2.0 (the
+           "License"); you may not use this file except in compliance
+           with the License.  You may obtain a copy of the License at
+           .
+             http://www.apache.org/licenses/LICENSE-2.0
+           .
+           Unless required by applicable law or agreed to in writing,
+           software distributed under the License is distributed on an
+           "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+           KIND, either express or implied.  See the License for the
+           specific language governing permissions and limitations
+           under the License.
+
+# Mahout FAQ on scala algebraic optimizer AKA "Spark/Scala bindigns" 
+
+## Q Mahout Spark shell doesn't start; "ClassNotFound" problems or various classpath problems.
+
+A So far at the time of this writing, all reported problems starting the Spark shell in Mahout were revolving 
+around classpath issues one way or the other. 
+
+If you are getting method signature like errors, most probably you have mismatch between Mahout's Spark dependency 
+and actual Spark installed. (At the time of this writing, the head requires Spark 1.0.1).
+
+Troubleshooting general classpath issues is pretty straightforward. Since Mahout is using Spark's installation 
+and its classpath as reported by Spark itself, it is important to make sure the classpath is sane:
+
+(1) Check Spark is of correct version (same as in Mahout's poms), is compiled and SPARK_HOME is set.
+
+(2) Check Mahout is compiled and MAHOUT_HOME is set.
+
+(3) run `$SPARK_HOME/bin/compute-classpath.sh` and make sure it produces sane result with no errors. 
+If it does something something strange, Spark is probably not compiled correctly (later spark versions require 
+`sbt/sbt assembly` to be run, simply runnig `sbt/sbt publish-local` is not enough any longer).
+
+(4) run `$MAHOUT_HOME/bin/mahout -spark classpath` and check that path reported in step (3) is included.
+
+
+
+
+

Propchange: mahout/site/mahout_cms/trunk/content/users/sparkbindings/faq.mdtext
------------------------------------------------------------------------------
    svn:eol-style = native