[jira] [Commented] (MAHOUT-1778) MAhout Spark Shell doesn't work with Spark > 1.3

["Andrew Palumbo (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAHOUT-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969464#comment-14969464 ] 

Andrew Palumbo commented on MAHOUT-1778:
----------------------------------------

The removal of spark-classpath.sh in: https://issues.apache.org/jira/browse/SPARK-4924

Could potentially also affect anything that calls findMahoutContextJars(...) in the o.a.m sparkbindings package object. This is used by anything that creates a MahoutSparkContext.  Currently:

    MahoutSparkILoop (shell)
    MahoutSparkDriver
    DistributedSparkSuite     



> MAhout Spark Shell doesn't work with Spark > 1.3
> ------------------------------------------------
>
>                 Key: MAHOUT-1778
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1778
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Mahout spark shell
>    Affects Versions: 0.11.0
>            Reporter: Suneel Marthi
>             Fix For: 0.11.1
>
>
> Mahout Spark Shell uses compute-classpath.sh from Spark for loading up the shell. The compute-classpath.sh script was removed from Spark 1.4 and above. The Mahout Spark Shell code needs to be fixed to handle the changes in Spark 1.4.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)