[jira] [Created] (SPARK-40523) pyspark dataframe methods (i.e. show()) won't run in VSCode debug console

["Eli (Jira)" <ji...@apache.org>]

Eli created SPARK-40523:
---------------------------

             Summary: pyspark dataframe methods (i.e. show()) won't run in VSCode debug console
                 Key: SPARK-40523
                 URL: https://issues.apache.org/jira/browse/SPARK-40523
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 3.1.2
            Reporter: Eli


when debugging pyspark codes in VSCode using the python debugger, when execution is paused on a breakpoint, you can issue statement/expression in VSCode debug console to check dataframe's content, etc.

However, those statement related to df operation always gets stuck and then debugger throws a timeout error in the debug console. 

 

This issue is initially reported in stack overflow: [https://stackoverflow.com/questions/65739467/pyspark-dataframe-methods-i-e-show-can-not-be-printed-in-vs-code-debug-cons]

there are some workaround suggestions as well in that thread.

OS: win 10
VSCode: 1.64.0

Python extension in VScode: v2022.4.1



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org