[jira] [Created] (SYSTEMML-835) Remove read/write validation warnings when use MLContext API

["Deron Eriksson (JIRA)" <ji...@apache.org>]

Deron Eriksson created SYSTEMML-835:
---------------------------------------

             Summary: Remove read/write validation warnings when use MLContext API
                 Key: SYSTEMML-835
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-835
             Project: SystemML
          Issue Type: Task
          Components: APIs
            Reporter: Deron Eriksson


The following code in the new MLContext API will generate validation warnings:

{code}
val habermanUrl = "http://archive.ics.uci.edu/ml/machine-learning-databases/haberman/haberman.data"
val habermanList = scala.io.Source.fromURL(habermanUrl).mkString.split("\n")
val habermanRDD = sc.parallelize(habermanList)
val habermanMetadata = new MatrixMetadata(306, 4)
val typesRDD = sc.parallelize(Array("1.0,1.0,1.0,2.0"))
val typesMetadata = new MatrixMetadata(1, 4)
val scriptUrl = "https://raw.githubusercontent.com/apache/incubator-systemml/master/scripts/algorithms/Univar-Stats.dml"
val uni = dmlFromUrl(scriptUrl).in("A", habermanRDD, habermanMetadata).in("K", typesRDD, typesMetadata).in("$CONSOLE_OUTPUT", true)
ml.execute(uni)
{code}

This generates the following warnings:
{code}
16/07/30 12:47:19 WARN DMLScript: line 47:9 The parameter $X either needs to be passed through commandline or initialized to default value.
16/07/30 12:47:19 WARN DMLScript: line 48:9 The parameter $TYPES either needs to be passed through commandline or initialized to default value.
16/07/30 12:47:19 WARN DMLScript: line 186:17 The parameter $STATS either needs to be passed through commandline or initialized to default value.
16/07/30 12:47:19 WARN DMLScript: 
--------------------------------------------------------------
The following 3 parse issues were encountered:
#1 [line 47:9] [Validation warning] -> A = read($X); # data file
   The parameter $X either needs to be passed through commandline or initialized to default value.
#2 [line 48:9] [Validation warning] -> K = read($TYPES); # attribute kind file
   The parameter $TYPES either needs to be passed through commandline or initialized to default value.
#3 [line 186:17] [Validation warning] -> write(baseStats, $STATS);
   The parameter $STATS either needs to be passed through commandline or initialized to default value.
--------------------------------------------------------------
{code}

Since the user has not done anything wrong, the user should not see warnings.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)