[GitHub] [spark] viirya commented on pull request #43184: [SPARK-44120][PYTHON] Support Python 3.12

["viirya (via GitHub)" <gi...@apache.org>]

viirya commented on PR #43184:
URL: https://github.com/apache/spark/pull/43184#issuecomment-1741846176

   > Actually, `pyspark` shell fails to start. So, we need to embed `packaging` like Py4J.
   > 
   > >
   
   From the error shown in the description for `distutils`, I guess you mean `pyspark` shell fails to start at same location?
   
   ```
       from pyspark.sql.pandas.conversion import PandasConversionMixin
     File "/Users/dongjoon/APACHE/spark-merge/python/pyspark/sql/pandas/conversion.py", line 29, in <module>
       from distutils.version import LooseVersion
   ModuleNotFoundError: No module named 'distutils'
   ```
   
   This is only triggerd if pandas/pyarrow is installed/enabled. As you can see it is under `sql/pandas`, if you don't have pandas installed, I think it won't run into there.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org