You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jun Zheng (JIRA)" <ji...@apache.org> on 2016/01/03 23:57:39 UTC

[jira] [Commented] (SPARK-12347) Write script to run all MLlib examples for testing

    [ https://issues.apache.org/jira/browse/SPARK-12347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080564#comment-15080564 ] 

Jun Zheng commented on SPARK-12347:
-----------------------------------

1. How to programmatically detect if a test requires input? I can see a ".required()" keyword in OptionParser indicates the test needs input, but not all test that needs input have this keyword.

2. How to set input file names other than hard-coding?

> Write script to run all MLlib examples for testing
> --------------------------------------------------
>
>                 Key: SPARK-12347
>                 URL: https://issues.apache.org/jira/browse/SPARK-12347
>             Project: Spark
>          Issue Type: Test
>          Components: ML, MLlib, PySpark, SparkR, Tests
>            Reporter: Joseph K. Bradley
>
> It would facilitate testing to have a script which runs all MLlib examples for all languages.
> Design sketch to ensure all examples are run:
> * Generate a list of examples to run programmatically (not from a fixed list).
> * Use a list of special examples to handle examples which require command line arguments.
> * Make sure data, etc. used are small to keep the tests quick.
> This could be broken into subtasks for each language, though it would be nice to provide a single script.
> Not sure where the script should live; perhaps in {{bin/}}?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org