You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/06/26 21:21:10 UTC
[GitHub] [spark] d80tb7 commented on issue #24965:
[WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs
d80tb7 commented on issue #24965: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs
URL: https://github.com/apache/spark/pull/24965#issuecomment-506049891
Hi @BryanCutler
Yes, that seems like a valid approach. Let me see if I can produce another prototype based on that approach and see if we can compare them. I think this solution is probably more flexible in the long run, but there would obviously be a cost to defining and maintaining our own custom streaming format (even if it is largely the same as the arrow format). If we have code examples for both it'll be easier to see.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org