[GitHub] squito opened a new pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways

[GitBox <gi...@apache.org>]

squito opened a new pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways
URL: https://github.com/apache/spark/pull/23337
 
 
   Spark always creates secure py4j connections between java and python,
   but it also allows users to pass in their own connection.  This restores
   the ability for users to pass in an _insecure_ connection, though it
   forces them to set 'spark.python.allowInsecurePy4j=true' and still
   issues a warning.
   
   Added test cases verifying the failure without the extra configuration,
   and verifying things still work with an insecure configuration (in
   particular, accumulators, as those were broken with an insecure py4j
   gateway before).
   
   For the tests, I added ways to create insecure gateways, but I tried to put in protections to make sure that wouldn't get used incorrectly.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org