You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "erikseulean (via GitHub)" <gi...@apache.org> on 2024/03/04 16:41:28 UTC
[I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
erikseulean opened a new issue, #40353:
URL: https://github.com/apache/arrow/issues/40353
### Describe the usage question you have. Please include as many useful details as possible.
I have some middleware client that wraps the gRPC client library and dispatches an arrow do_get request.
The response is a stream of ArrowFlight objects. How do I decode this into an Arrow table, assuming that the service returns a RecordBatchStream ?
I tried to read the docs but I cannot seem to be able to put this together.
I'm interested in Python/cpp.
Thank you!
### Component(s)
FlightRPC
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on issue #40353:
URL: https://github.com/apache/arrow/issues/40353#issuecomment-1977020117
That said, I would like to expose this directly (see https://github.com/apache/arrow/issues/34607#issuecomment-1959517462) instead of making people jump through hoops. Consider raising some noise so I can justify this to other developers :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on issue #40353:
URL: https://github.com/apache/arrow/issues/40353#issuecomment-1977140018
If you have the byte representation, you can just pass that to FlightInfo.deserialize. If you have the Protobuf on hand then you'll have to get it back into bytes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
Posted by "erikseulean (via GitHub)" <gi...@apache.org>.
erikseulean commented on issue #40353:
URL: https://github.com/apache/arrow/issues/40353#issuecomment-1977033035
Ok. Is this reliable to do ? Is this going to work for any endpoints ? Eg flightInfo ?
It's unlikelt that people will use the Arrowflight client all the time, in my case I have to use a middleware that performs routing based on various things that exposes a different api and I only have access to the FlightData objects.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
Posted by "erikseulean (via GitHub)" <gi...@apache.org>.
erikseulean commented on issue #40353:
URL: https://github.com/apache/arrow/issues/40353#issuecomment-1977115210
Would you mind providing a small snippet , please ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on issue #40353:
URL: https://github.com/apache/arrow/issues/40353#issuecomment-1977017072
https://stackoverflow.com/questions/70629168/how-to-decode-arrow-flight-flightdata-with-a-pure-grpc-client/70629249#70629249
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to decode a pure gRPC response from an ArrowFlight to an arrow table? [arrow]
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on issue #40353:
URL: https://github.com/apache/arrow/issues/40353#issuecomment-1977083661
For FlightInfo, you can use FlightInfo.deserialize or if you generate the Protobuf code you can use it directly as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org