[jira] [Created] (SPARK-32673) Pyspark/cloudpickle.py - no module named 'wfdb'

["Sandy Su (Jira)" <ji...@apache.org>]

Sandy Su created SPARK-32673:
--------------------------------

             Summary: Pyspark/cloudpickle.py - no module named 'wfdb'
                 Key: SPARK-32673
                 URL: https://issues.apache.org/jira/browse/SPARK-32673
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 3.0.0
            Reporter: Sandy Su


Running Spark in a Databricks notebook.

 

Ran into this issue when executing a cell:



(1) Spark Jobs

SparkException: Job aborted due to stage failure: Task 0 in stage 17.0 failed 4 times, most recent failure: Lost task 0.3 in stage 17.0 (TID 68, 10.139.64.5, executor 0): org.apache.spark.api.python.PythonException: Traceback (most recent call last): File "/databricks/spark/python/pyspark/serializers.py", line 177, in _read_with_length return self.loads(obj) File "/databricks/spark/python/pyspark/serializers.py", line 466, in loads return pickle.loads(obj, encoding=encoding) File "/databricks/spark/python/pyspark/cloudpickle.py", line 1110, in subimport __import__(name) ModuleNotFoundError: No module named 'wfdb' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/databricks/spark/python/pyspark/worker.py", line 644, in main func, profiler, deserializer, serializer = read_udfs(pickleSer, infile, eval_type) File "/databricks/spark/python/pyspark/worker.py", line 463, in read_udfs udfs.append(read_single_udf(pickleSer, infile, eval_type, runner_conf, udf_index=i)) File "/databricks/spark/python/pyspark/worker.py", line 254, in read_single_udf f, return_type = read_command(pickleSer, infile) File "/databricks/spark/python/pyspark/worker.py", line 74, in read_command command = serializer._read_with_length(file) File "/databricks/spark/python/pyspark/serializers.py", line 180, in _read_with_length raise SerializationError("Caused by " + traceback.format_exc()) pyspark.serializers.SerializationError: Caused by Traceback (most recent call last): File "/databricks/spark/python/pyspark/serializers.py", line 177, in _read_with_length return self.loads(obj) File "/databricks/spark/python/pyspark/serializers.py", line 466, in loads return pickle.loads(obj, encoding=encoding) File "/databricks/spark/python/pyspark/cloudpickle.py", line 1110, in subimport __import__(name) ModuleNotFoundError: No module named 'wfdb'



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org