[jira] [Commented] (MAHOUT-1569) Create CLI driver that supports Spark jobs

["Pat Ferrel (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAHOUT-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14046433#comment-14046433 ] 

Pat Ferrel commented on MAHOUT-1569:
------------------------------------

this is being merged into MAHOUT-1541. There are abstract MahoutDriver classes and an option parser. 

To further this a set of global options will be made available to the option parser so that, for instance, the schema for an output text delimited file can be specified on the CL with the same options in every driver by mixing in that group of options. Currently they must be reimplemented in each driver.

> Create CLI driver that supports Spark jobs
> ------------------------------------------
>
>                 Key: MAHOUT-1569
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1569
>             Project: Mahout
>          Issue Type: New Feature
>          Components: CLI
>         Environment: Scala, Spark
>            Reporter: Pat Ferrel
>            Assignee: Pat Ferrel
>
> Create a design for CLI drivers, including an option parser, base MahoutDriver for Spark, that uses a text file I/O mechanism MAHOUT-1568
> A version of the proposal is implemented and running for ItemSimilarity on Spark. MAHOUT-1541
> A proposal is running with ItemSimilarity on Spark and is documented on the github wiki here: https://github.com/pferrel/harness/wiki
> Comments are appreciated



--
This message was sent by Atlassian JIRA
(v6.2#6252)