You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "FelixYBW (via GitHub)" <gi...@apache.org> on 2024/05/16 21:42:28 UTC

Re: [PR] [GLUTEN-5771][VL] Add metrics for ColumnarArrowEvalPythonExec [incubator-gluten]

FelixYBW commented on PR #5772:
URL: https://github.com/apache/incubator-gluten/pull/5772#issuecomment-2116238446

   @yma11 can you add a UI chart for the pyarrow UDF? Also add some implementation details?
   
   In theory we can convert Velox to Arrow in Velox pipeline, then pass the arrow pointer to Spark where it's send to python process. There is no C2R and R2C in the whole process and no memcpy between Velox and Spark. Can we achieve this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org