You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "beliefer (via GitHub)" <gi...@apache.org> on 2025/09/25 03:12:18 UTC
[PR] [FLINK-38429] Improve perf for Elasticsearch 8 connector [flink-connector-elasticsearch]
beliefer opened a new pull request, #134:
URL: https://github.com/apache/flink-connector-elasticsearch/pull/134
This PR proposes to improve perf for Elasticsearch 8 connector.
Currently, Elasticsearch 8 connector create a new `OperationSerializer` for each `Operation`.
A large amount of `OperationSerializer`'s instances brings big overhead.
There is a benchmark cases.
Flink application with single parallelism.
The Kafka Topic consumption rate show below.
| Before this PR | After this PR |
|--------------------|-------------------|
| 1.5 K strips/s(min) | 2.3 K strips/s(min) |
| 2.0 K strips/s(max) | 2.5 K strips/s(max) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-38429] Reuse OperationSerializer in Elasticsearch 8 connector to improve perf [flink-connector-elasticsearch]
Posted by "reswqa (via GitHub)" <gi...@apache.org>.
reswqa merged PR #134:
URL: https://github.com/apache/flink-connector-elasticsearch/pull/134
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-38429] Improve perf for Elasticsearch 8 connector [flink-connector-elasticsearch]
Posted by "beliefer (via GitHub)" <gi...@apache.org>.
beliefer commented on PR #134:
URL: https://github.com/apache/flink-connector-elasticsearch/pull/134#issuecomment-3331899333
ping @mtfelisb cc @reswqa
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org