You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "allanf-db (via GitHub)" <gi...@apache.org> on 2023/03/16 15:43:27 UTC

[GitHub] [spark] allanf-db commented on pull request #40458: [SPARK-42824][CONNECT][PYTHON] Provide a clear error message for unsupported JVM attributes.

allanf-db commented on PR #40458:
URL: https://github.com/apache/spark/pull/40458#issuecomment-1472225271

   Instead of proposing that the user uses another PySpark version, I think it's better to suggest that the user creates a Spark Driver session instead of a Spark Connect session.
   
   So instead of:
   [JVM_ATTRIBUTE_NOT_SUPPORTED] Attribute `_jsc` is not supported in Spark Connect as it depends on the JVM. If you need to use this attribute, use the original PySpark instead of Spark Connect.
   
   Perhaps something more like:
   [JVM_ATTRIBUTE_NOT_SUPPORTED] Attribute `_jsc` is not supported in Spark Connect as it depends on the JVM. If you need to use this attribute, do not use Spark Connect when creating your session.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org