You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/03/16 16:40:44 UTC
[I] [Python] Create Python examples of HTTP GET Arrow client/server supporting multipart/mixed response [arrow]
ianmcook opened a new issue, #40598:
URL: https://github.com/apache/arrow/issues/40598
### Describe the enhancement requested
Contribute Python client and server examples to the [HTTP GET multipart examples in the `arrow-experiments` repo](https://github.com/apache/arrow-experiments/tree/main/http/get_range). This should demonstrate a server/client pair that sends/receives a multipart response (`Content-Type: multipart/mixed`) containing JSON data (`Content-Type: application/json`) and Arrow IPC stream data (`Content-Type: application/vnd.apache.arrow.stream`).
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Create Python examples of HTTP GET Arrow client/server supporting multipart/mixed response [arrow]
Posted by "ianmcook (via GitHub)" <gi...@apache.org>.
ianmcook commented on issue #40598:
URL: https://github.com/apache/arrow/issues/40598#issuecomment-2002045337
A challenge with this approach is that the part delimiter must not occur in the data, as described here: https://www.w3.org/Protocols/rfc1341/7_2_Multipart.html
So to support all possible sequences of bytes that might occur in Arrow IPC stream data, the server would need to be able to dynamically choose a viable delimiter sequence by checking that it is not contained in the IPC stream bytes to be sent in the response.
On the other hand, maybe it's sufficient for the server to simply use a part delimiter that is highly unlikely to occur in the IPC stream bytes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Create Python examples of HTTP GET Arrow client/server supporting multipart/mixed response [arrow]
Posted by "ianmcook (via GitHub)" <gi...@apache.org>.
ianmcook commented on issue #40598:
URL: https://github.com/apache/arrow/issues/40598#issuecomment-2035422668
Using an dynamically generated, unpredictable, max-allowed-length (70-character) alphanumeric delimiter generated by a cryptographic hash function is perhaps the best way to reduce the risk that the delimiter exists in the IPC stream bytes. Discussion welcome here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org