[I] Use IPC streams instead of files [arrow-ballista]

["Dandandan (via GitHub)" <gi...@apache.org>]

Dandandan opened a new issue, #942:
URL: https://github.com/apache/arrow-ballista/issues/942

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   It is redundant to store schema information in the shuffle files, as we already have them as part of the execution plan / query stages.
   
   **Describe the solution you'd like**
   Use IPC streams instead of file format.
   
   **Describe alternatives you've considered**
   
   **Additional context**
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Use StreamWriter instead of FileWriter [arrow-ballista]

["avantgardnerio (via GitHub)" <gi...@apache.org>]

avantgardnerio closed issue #942: Use StreamWriter instead of FileWriter
URL: https://github.com/apache/arrow-ballista/issues/942


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org