You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/02/01 07:25:00 UTC

[jira] [Updated] (SPARK-42273) Skip Spark Connect tests if dependencies are not installed

     [ https://issues.apache.org/jira/browse/SPARK-42273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-42273:
---------------------------------
    Description: 
{code}
arget/7411b1a1-5ebc-47a6-b3cb-c73dedc9a3c9/python3.9__pyspark.sql.tests.connect.test_parity_catalog__7iw4wnpb.log)
Traceback (most recent call last):
  File "/usr/local/Cellar/python@3.9/3.9.10/Frameworks/Python.framework/Versions/3.9/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/Cellar/python@3.9/3.9.10/Frameworks/Python.framework/Versions/3.9/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/.../spark/python/pyspark/sql/tests/connect/test_connect_basic.py", line 29, in <module>
    from pyspark.sql.connect.client import Retrying
  File "/.../spark/python/pyspark/sql/connect/__init__.py", line 21, in <module>
    from pyspark.sql.connect.dataframe import DataFrame  # noqa: F401
  File "/.../spark/python/pyspark/sql/connect/dataframe.py", line 50, in <module>
    import pyspark.sql.connect.plan as plan
  File "/.../spark/python/pyspark/sql/connect/plan.py", line 26, in <module>
    import pyspark.sql.connect.proto as proto
  File "/.../spark/python/pyspark/sql/connect/proto/__init__.py", line 18, in <module>
    from pyspark.sql.connect.proto.base_pb2_grpc import *
  File "/.../spark/python/pyspark/sql/connect/proto/base_pb2_grpc.py", line 19, in <module>
    import grpc
ModuleNotFoundError: No module named 'grpc'
{code}

> Skip Spark Connect tests if dependencies are not installed
> ----------------------------------------------------------
>
>                 Key: SPARK-42273
>                 URL: https://issues.apache.org/jira/browse/SPARK-42273
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Connect, Tests
>    Affects Versions: 3.4.0
>            Reporter: Hyukjin Kwon
>            Priority: Major
>
> {code}
> arget/7411b1a1-5ebc-47a6-b3cb-c73dedc9a3c9/python3.9__pyspark.sql.tests.connect.test_parity_catalog__7iw4wnpb.log)
> Traceback (most recent call last):
>   File "/usr/local/Cellar/python@3.9/3.9.10/Frameworks/Python.framework/Versions/3.9/lib/python3.9/runpy.py", line 197, in _run_module_as_main
>     return _run_code(code, main_globals, None,
>   File "/usr/local/Cellar/python@3.9/3.9.10/Frameworks/Python.framework/Versions/3.9/lib/python3.9/runpy.py", line 87, in _run_code
>     exec(code, run_globals)
>   File "/.../spark/python/pyspark/sql/tests/connect/test_connect_basic.py", line 29, in <module>
>     from pyspark.sql.connect.client import Retrying
>   File "/.../spark/python/pyspark/sql/connect/__init__.py", line 21, in <module>
>     from pyspark.sql.connect.dataframe import DataFrame  # noqa: F401
>   File "/.../spark/python/pyspark/sql/connect/dataframe.py", line 50, in <module>
>     import pyspark.sql.connect.plan as plan
>   File "/.../spark/python/pyspark/sql/connect/plan.py", line 26, in <module>
>     import pyspark.sql.connect.proto as proto
>   File "/.../spark/python/pyspark/sql/connect/proto/__init__.py", line 18, in <module>
>     from pyspark.sql.connect.proto.base_pb2_grpc import *
>   File "/.../spark/python/pyspark/sql/connect/proto/base_pb2_grpc.py", line 19, in <module>
>     import grpc
> ModuleNotFoundError: No module named 'grpc'
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org