You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/08 03:03:54 UTC
[I] Add end-to-end Arrow Flight benchmark with CI dashboard integration [texera]
Yicong-Huang opened a new issue, #5556:
URL: https://github.com/apache/texera/issues/5556
### Task Summary
Add a real end-to-end micro-benchmark of the Arrow Flight data path that spawns a live `PythonWorkflowWorker` actor (real Pekko actor + real Python subprocess via `texera_run_python_worker.py` + real Arrow Flight gRPC transport) wired to an identity Python UDF, sweeps a 36-config grid (batch_size × schema_width × string_len), and reports per-batch send→echo latency percentiles plus throughput. Wire results into the github-action-benchmark dashboard via a bench-agnostic `Benchmarks` workflow + `bin/run-benchmarks.sh` entry point so future bench suites (e.g. JMH for `ArrowUtils.fromTexeraSchema` / `appendTexeraTuple`) can plug in without touching CI.
### Task Type
- [x] DevOps / Deployment / CI
- [x] Performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add end-to-end Arrow Flight benchmark with CI dashboard integration [texera]
Posted by "Yicong-Huang (via GitHub)" <gi...@apache.org>.
Yicong-Huang closed issue #5556: Add end-to-end Arrow Flight benchmark with CI dashboard integration
URL: https://github.com/apache/texera/issues/5556
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org