[jira] [Created] (SPARK-21685) Params isSet in scala Transformer triggered by _setDefault in pyspark

["Ratan Rai Sur (JIRA)" <ji...@apache.org>]

Ratan Rai Sur created SPARK-21685:
-------------------------------------

             Summary: Params isSet in scala Transformer triggered by _setDefault in pyspark
                 Key: SPARK-21685
                 URL: https://issues.apache.org/jira/browse/SPARK-21685
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 2.1.0
            Reporter: Ratan Rai Sur


I'm trying to write a PySpark wrapper for a Transformer whose transform method includes the line

{code:scala}
require(!(isSet(outputNodeName) && isSet(outputNodeIndex)), "Can't set both outputNodeName and outputNodeIndex")
{code}

This should only throw an exception when both of these parameters are explicitly set.

In the PySpark wrapper for the Transformer, there is this line in ___init___

{code:python}
self._setDefault(outputNodeIndex=0)
{code}

Here is the line in the main python script showing how it is being configured
{code:python}
cntkModel = CNTKModel().setInputCol("images").setOutputCol("output").setModelLocation(spark, model.uri).setOutputNodeName("z")
{code}

As you can see, only setOutputNodeName is being explicitly set but the exception is still being thrown.

If you need more context, https://github.com/RatanRSur/mmlspark/tree/default-cntkmodel-output is the branch with the code, the files I'm referring to here are CNTKModel.scala and _CNTKModel.py



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org