You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "shatrughnaupadhyay (via GitHub)" <gi...@apache.org> on 2026/10/04 05:34:33 UTC
[PR] GH-34485: [Python][FlightRPC] Add experimental chunked IPC exchange example [arrow]
shatrughnaupadhyay opened a new pull request, #51700:
URL: https://github.com/apache/arrow/pull/51700
A single binary or string value can exceed a gRPC message limit even when its record batch contains one row. This Python example sends IPC bytes through capped metadata-only DoExchange frames, with a private capability probe, sequence checks, a total byte limit and temporary-file reassembly.
This is an experimental application protocol related to #34485 and #41840. It leaves standard FlightData unchanged and requires both peers to opt in. Reassembly uses a capped temporary file. Input batches, IPC copies, decoded output, native transport allocations and OS caching remain outside the frame-size bound; process RSS is not bounded. It does not resolve #34485.
Validation: 41 tests passed with Python 3.12.12 and the PyArrow 25.0.1 wheel, including 4 MiB single-row values under a 128 KiB client gRPC message cap, malformed frames, cancellation and cleanup. Flake8, autopep8 and whitespace checks passed. A benchmark is included. Source-built Arrow and upstream CI have not been verified.
Draft: design agreement and human author review are pending. AI assistance: Codex generated the example, tests, benchmark and documentation and ran the local checks. The author must review, understand and own the changes before marking this ready.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-34485: [Python][FlightRPC] Add experimental chunked IPC exchange example [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #51700:
URL: https://github.com/apache/arrow/pull/51700#issuecomment-5977033178
:warning: GitHub issue #34485 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-34485: [Python][FlightRPC] Add experimental chunked IPC exchange example [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #51700:
URL: https://github.com/apache/arrow/pull/51700#issuecomment-5976972617
:warning: GitHub issue #34485 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-34485: [Python][FlightRPC] Add experimental chunked IPC exchange example [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #51700:
URL: https://github.com/apache/arrow/pull/51700#issuecomment-6407167320
:warning: GitHub issue #34485 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org