[GitHub] [spark] grundprinzip commented on pull request #38659: [SPARK-41114][CONNECT] Support local data for LocalRelation

[GitBox <gi...@apache.org>]

grundprinzip commented on PR #38659:
URL: https://github.com/apache/spark/pull/38659#issuecomment-1314254660

   The original idea was for the local data to be sent as Arrow IPC batches as well as it follows the same direction as on the return path.
   
   In addition, we have the benefit that the Arrow IPC message actually have a schema embedded so that we can do nice validation on the receive path.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org