You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by ueshin <gi...@git.apache.org> on 2017/11/16 06:54:30 UTC
[GitHub] spark pull request #19630: [SPARK-22409] Introduce function type argument in...
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r151331041
--- Diff: python/pyspark/worker.py ---
@@ -89,6 +90,26 @@ def verify_result_length(*a):
return lambda *a: (verify_result_length(*a), arrow_return_type)
+def wrap_pandas_group_map_udf(f, return_type):
+ def wrapped(*series):
+ import pandas as pd
+
+ result = f(pd.concat(series, axis=1))
--- End diff --
Can we remove `keys=columns`? The original includes it as the 3rd argument.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org