You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/11/18 01:24:18 UTC

[GitHub] [spark] HyukjinKwon commented on pull request #38611: [SPARK-41107][PYTHON][INFRA][TESTS] Install memory-profiler in the CI

HyukjinKwon commented on PR #38611:
URL: https://github.com/apache/spark/pull/38611#issuecomment-1319430302

   The test failure this time seems different:
   
   ```
   
                                                                                   
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 168, in pyspark.pandas.mlflow.load_model
   Failed example:
       run_info = client.list_run_infos(exp_id)[-1]
   Exception raised:
       Traceback (most recent call last):
         File "/usr/lib/python3.9/doctest.py", line 1336, in __run
           exec(compile(example.source, filename, "single",
         File "<doctest pyspark.pandas.mlflow.load_model[14]>", line 1, in <module>
           run_info = client.list_run_infos(exp_id)[-1]
       AttributeError: 'MlflowClient' object has no attribute 'list_run_infos'
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 169, in pyspark.pandas.mlflow.load_model
   Failed example:
       model = load_model("runs:/{run_id}/model".format(run_id=run_info.run_uuid))
   Exception raised:
       Traceback (most recent call last):
         File "/usr/lib/python3.9/doctest.py", line 1336, in __run
           exec(compile(example.source, filename, "single",
         File "<doctest pyspark.pandas.mlflow.load_model[15]>", line 1, in <module>
           model = load_model("runs:/{run_id}/model".format(run_id=run_info.run_uuid))
       NameError: name 'run_info' is not defined
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 171, in pyspark.pandas.mlflow.load_model
   Failed example:
       prediction_df["prediction"] = model.predict(prediction_df)
   Exception raised:
       Traceback (most recent call last):
         File "/usr/lib/python3.9/doctest.py", line 1336, in __run
           exec(compile(example.source, filename, "single",
         File "<doctest pyspark.pandas.mlflow.load_model[17]>", line 1, in <module>
           prediction_df["prediction"] = model.predict(prediction_df)
       NameError: name 'model' is not defined
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 172, in pyspark.pandas.mlflow.load_model
   Failed example:
       prediction_df
   Expected:
           x1   x2  prediction
       0  2.0  4.0    1.355551
   Got:
           x1   x2
       0  2.0  4.0
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 178, in pyspark.pandas.mlflow.load_model
   Failed example:
       model.predict(prediction_df[["x1", "x2"]].to_pandas())
   Exception raised:
       Traceback (most recent call last):
         File "/usr/lib/python3.9/doctest.py", line 1336, in __run
           exec(compile(example.source, filename, "single",
         File "<doctest pyspark.pandas.mlflow.load_model[19]>", line 1, in <module>
           model.predict(prediction_df[["x1", "x2"]].to_pandas())
       NameError: name 'model' is not defined
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 189, in pyspark.pandas.mlflow.load_model
   Failed example:
       y = model.predict(features)
   Exception raised:
       Traceback (most recent call last):
         File "/usr/lib/python3.9/doctest.py", line 1336, in __run
           exec(compile(example.source, filename, "single",
         File "<doctest pyspark.pandas.mlflow.load_model[22]>", line 1, in <module>
           y = model.predict(features)
       NameError: name 'model' is not defined
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 198, in pyspark.pandas.mlflow.load_model
   Failed example:
       features['y'] = y
   Exception raised:
       Traceback (most recent call last):
         File "/usr/lib/python3.9/doctest.py", line 1336, in __run
           exec(compile(example.source, filename, "single",
         File "<doctest pyspark.pandas.mlflow.load_model[25]>", line 1, in <module>
           features['y'] = y
       NameError: name 'y' is not defined
   **********************************************************************
   File "/__w/spark/spark/python/pyspark/pandas/mlflow.py", line 200, in pyspark.pandas.mlflow.load_model
   Failed example:
       everything
   Expected:
           x1   x2  z         y
       0  2.0  3.0 -1  1.376932
   Got:
           x1   x2  z
       0  2.0  3.0 -1
   **********************************************************************
      8 of  26 in pyspark.pandas.mlflow.load_model
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org