[jira] [Created] (SPARK-21511) Unable to load Pipeline or Pipeline model

["Saif Addin (JIRA)" <ji...@apache.org>]

Saif Addin created SPARK-21511:
----------------------------------

             Summary: Unable to load Pipeline or Pipeline model
                 Key: SPARK-21511
                 URL: https://issues.apache.org/jira/browse/SPARK-21511
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 2.1.0
            Reporter: Saif Addin



{code:java}
...
model.transform(self.data).show()
pipe_path = "./tmp_pipeline"
pipeline.write().overwrite().save(pipe_path)
loaded_pipeline = Pipeline.read().load(pipe_path)
{code}

throws 

{code:java}
======================================================================
ERROR: runTest (test.code.PipelineTestSpec)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "code.py", line 207, in runTest
    loaded_pipeline = Pipeline.read().load(pipe_path)
  File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/util.py", line 198, in load
    return self._clazz._from_java(java_obj)
  File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/pipeline.py", line 155, in _from_java
    py_stages = [JavaParams._from_java(s) for s in java_stage.getStages()]
  File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/pipeline.py", line 155, in <listcomp>
    py_stages = [JavaParams._from_java(s) for s in java_stage.getStages()]
  File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/wrapper.py", line 173, in _from_java
    py_type = __get_class(stage_name)
  File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/wrapper.py", line 167, in __get_class
    m = __import__(module)
ModuleNotFoundError: No module named 'com'
{code}




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org