[jira] [Resolved] (SYSTEMML-835) Remove read/write validation warnings when use MLContext API

["Deron Eriksson (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SYSTEMML-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Deron Eriksson resolved SYSTEMML-835.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: SystemML 0.11

Fixed by [commit b2f3fd8e...|https://github.com/deroneriksson/incubator-systemml/commit/b2f3fd8e09f2768e468ef5135179156608203fb2].

> Remove read/write validation warnings when use MLContext API
> ------------------------------------------------------------
>
>                 Key: SYSTEMML-835
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-835
>             Project: SystemML
>          Issue Type: Task
>          Components: APIs
>            Reporter: Deron Eriksson
>            Assignee: Deron Eriksson
>             Fix For: SystemML 0.11
>
>
> The following code in the new MLContext API will generate validation warnings:
> {code}
> val habermanUrl = "http://archive.ics.uci.edu/ml/machine-learning-databases/haberman/haberman.data"
> val habermanList = scala.io.Source.fromURL(habermanUrl).mkString.split("\n")
> val habermanRDD = sc.parallelize(habermanList)
> val habermanMetadata = new MatrixMetadata(306, 4)
> val typesRDD = sc.parallelize(Array("1.0,1.0,1.0,2.0"))
> val typesMetadata = new MatrixMetadata(1, 4)
> val scriptUrl = "https://raw.githubusercontent.com/apache/incubator-systemml/master/scripts/algorithms/Univar-Stats.dml"
> val uni = dmlFromUrl(scriptUrl).in("A", habermanRDD, habermanMetadata).in("K", typesRDD, typesMetadata).in("$CONSOLE_OUTPUT", true)
> ml.execute(uni)
> {code}
> This generates the following warnings:
> {code}
> 16/07/30 12:47:19 WARN DMLScript: line 47:9 The parameter $X either needs to be passed through commandline or initialized to default value.
> 16/07/30 12:47:19 WARN DMLScript: line 48:9 The parameter $TYPES either needs to be passed through commandline or initialized to default value.
> 16/07/30 12:47:19 WARN DMLScript: line 186:17 The parameter $STATS either needs to be passed through commandline or initialized to default value.
> 16/07/30 12:47:19 WARN DMLScript: 
> --------------------------------------------------------------
> The following 3 parse issues were encountered:
> #1 [line 47:9] [Validation warning] -> A = read($X); # data file
>    The parameter $X either needs to be passed through commandline or initialized to default value.
> #2 [line 48:9] [Validation warning] -> K = read($TYPES); # attribute kind file
>    The parameter $TYPES either needs to be passed through commandline or initialized to default value.
> #3 [line 186:17] [Validation warning] -> write(baseStats, $STATS);
>    The parameter $STATS either needs to be passed through commandline or initialized to default value.
> --------------------------------------------------------------
> {code}
> Since the user has not done anything wrong, the user should not see warnings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)