You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "kou (via GitHub)" <gi...@apache.org> on 2023/04/03 08:50:48 UTC
[GitHub] [arrow] kou opened a new issue, #34852: [C++][FlightRPC] Add support for ordered data
kou opened a new issue, #34852:
URL: https://github.com/apache/arrow/issues/34852
### Describe the enhancement requested
Based on the proposal in https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit# .
See also the discussion thread: https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp
Currently, the endpoints within a FlightInfo [explicitly have no ordering](https://github.com/apache/arrow/blob/4a5fadbb7200ae71a151841bac3cbf35dac10258/format/Flight.proto#L269-L270):
* There is no ordering defined on endpoints. Hence, if the returned
* data has an ordering, it should be returned in a single endpoint.
This is unnecessarily limiting. Systems can and do implement distributed sorts, but they can’t reflect this in Flight RPC. And users are asking; see this [Stack Overflow question](https://stackoverflow.com/questions/75180268/apache-arrow-flight-getting-sorted-data-from-multiple-endpoints).
Proposal:
Add a flag to `FlightInfo`:
```protobuf
message FlightInfo {
// FlightEndpoints are in the same order as the data.
bool endpoints_ordered = 6;
}
```
If set, the client may assume that the data is sorted in the same order as the endpoints. Otherwise, the client cannot make any assumptions (as before).
### Component(s)
C++, FlightRPC
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on issue #34852: [C++][FlightRPC] Add support for ordered data
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #34852:
URL: https://github.com/apache/arrow/issues/34852#issuecomment-1522682932
Discussion: https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou closed issue #34852: [C++][Java][FlightRPC] Add support for ordered data
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou closed issue #34852: [C++][Java][FlightRPC] Add support for ordered data
URL: https://github.com/apache/arrow/issues/34852
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org