[spark] branch branch-3.4 updated: [SPARK-42428][CONNECT][PYTHON] Standardize __repr__ of CommonInlineUserDefinedFunction

[ru...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

ruifengz pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.4 by this push:
     new de31a0f5fee [SPARK-42428][CONNECT][PYTHON] Standardize __repr__ of CommonInlineUserDefinedFunction
de31a0f5fee is described below

commit de31a0f5fee6fdde044fe0584c964833f3556221
Author: Xinrong Meng <xi...@apache.org>
AuthorDate: Tue Feb 14 17:05:13 2023 +0800

    [SPARK-42428][CONNECT][PYTHON] Standardize __repr__ of CommonInlineUserDefinedFunction
    
    ### What changes were proposed in this pull request?
    Standardize __repr__ of CommonInlineUserDefinedFunction.
    
    ### Why are the changes needed?
    To reach parity with vanilla PySpark.
    
    ### Does this PR introduce _any_ user-facing change?
    The column representation reaches parity with the vanilla PySpark's now, as shown below.
    
    Before
    ```
    >>> udf(lambda x : x + 1)(df.id)
    Column<'<lambda>(id), True, "string", 100, b'\x80\x05\x95\xe1\x01\x00\x00\x00\x00\x00\x00\x8c\x1fpyspark.cloudpickle.cloudpickle\x94\x8c\x0e_make_function\x94\x93\x94(h\x00\x8c\r_builtin_type\x94\x93\x94\x8c\x08CodeType\x94\x85\x94R\x94(K\x01K\x00K\x00K\x01K\x02KCC\x08|\x00d\x01\x17\x00S\x00\x94NK\x01\x86\x94)\x8c\x01x\x94\x85\x94\x8c\x07<stdin>\x94\x8c\x08<lambda>\x94K\x01C\x00\x94))t\x94R\x94}\x94(\x8c\x0b__package__\x94N\x8c\x08__name__\x94\x8c\x08__main__\x94uNNNt\x94R\x94\x8c$pys [...]
    ```
    
    Now
    ```
    >>> udf(lambda x : x + 1)(df.id)
    Column<'<lambda>(id)'>
    ```
    
    ### How was this patch tested?
    Existing tests.
    
    Closes #40003 from xinrong-meng/udf_repr.
    
    Authored-by: Xinrong Meng <xi...@apache.org>
    Signed-off-by: Ruifeng Zheng <ru...@apache.org>
    (cherry picked from commit 676332a1f4d6a522f009fa91e593904588cfe9f2)
    Signed-off-by: Ruifeng Zheng <ru...@apache.org>
---
 python/pyspark/sql/connect/expressions.py | 5 +----
 1 file changed, 1 insertion(+), 4 deletions(-)

diff --git a/python/pyspark/sql/connect/expressions.py b/python/pyspark/sql/connect/expressions.py
index 571dd2b2f4b..6e34719042d 100644
--- a/python/pyspark/sql/connect/expressions.py
+++ b/python/pyspark/sql/connect/expressions.py
@@ -555,10 +555,7 @@ class CommonInlineUserDefinedFunction(Expression):
         return expr
 
     def __repr__(self) -> str:
-        return (
-            f"{self._function_name}({', '.join([str(arg) for arg in self._arguments])}), "
-            f"{self._deterministic}, {self._function}"
-        )
+        return f"{self._function_name}({', '.join([str(arg) for arg in self._arguments])})"
 
 
 class WithField(Expression):


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org