You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by gatorsmile <gi...@git.apache.org> on 2018/01/26 17:55:55 UTC

[GitHub] spark pull request #20409: [SPARK-23233][PYTHON] Reset the cache in asNondet...

Github user gatorsmile commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20409#discussion_r164178516
  
    --- Diff: python/pyspark/sql/udf.py ---
    @@ -188,6 +188,9 @@ def asNondeterministic(self):
     
             .. versionadded:: 2.3
             """
    +        # Here, we explicitly clean the cache to create a JVM UDF instance
    +        # with 'deterministic' updated. See SPARK-23233.
    +        self._judf_placeholder = None
    --- End diff --
    
    Add a test case?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org