You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "usbrandon (via GitHub)" <gi...@apache.org> on 2023/03/12 14:42:16 UTC

[GitHub] [hop] usbrandon opened a new issue, #2556: [Feature Request]: When new transform steps like CPython come over, use Arrow to transfer data.

usbrandon opened a new issue, #2556:
URL: https://github.com/apache/hop/issues/2556

   ### What would you like to happen?
   
   When CPython is rewritten and comes over to Hop, we should use the PyArrow library to shuttle information between the JVM and Python process.  This gives us speed and data integrity bidirectionally.
   https://arrow.apache.org/docs/python/integration/python_java.html
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: Transforms


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: When new transform steps like CPython come over, use Arrow to transfer data. (hop)

Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters commented on issue #2556:
URL: https://github.com/apache/hop/issues/2556#issuecomment-5012883089

   Arrow files and a flight server have arrived along with PyHop


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: When new transform steps like CPython come over, use Arrow to transfer data. (hop)

Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters closed issue #2556: [Feature Request]: When new transform steps like CPython come over, use Arrow to transfer data.
URL: https://github.com/apache/hop/issues/2556


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org