You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by "PeterZh6 (via GitHub)" <gi...@apache.org> on 2024/12/02 15:04:16 UTC
[I] [Feature][Sort] Add batch end-to-end test for Kafka v1.18 connector [inlong]
PeterZh6 opened a new issue, #11573:
URL: https://github.com/apache/inlong/issues/11573
### Description
**Parent Issue** #11419
**Related Issue** #11494
Flink uses stream mode as default mode of execution. Current end-to-end test introduced by #11494 adopts stream mode. Additional batch-executed end-to-end test need to be enforced to better verify the requirements for #11419, and potentially for all the sub-issues under #11417.
### Use case
_No response_
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][Sort] Add batch end-to-end test for Kafka v1.18 connector [inlong]
Posted by "PeterZh6 (via GitHub)" <gi...@apache.org>.
PeterZh6 commented on issue #11573:
URL: https://github.com/apache/inlong/issues/11573#issuecomment-2517107999
While working on this, I started to wonder about the best approach for conducting such a test:
Should I simply use Flink's batch execution mode with the command-line arguments (i.e., --execution.mode batch) when submitting the Flink job, and test it that way?
Or do I need to tailor the test for each connector (in this case, Kafka) since different connectors can behave differently in batch mode?
I’m uncertain whether a one-size-fits-all approach will work, or if I need to adjust configurations or setup steps specific to Kafka or the InLong Sort connector.
Has anyone faced this scenario or can provide insights on how best to test batch support with Flink connectors?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][Sort] Add batch end-to-end test for Kafka v1.18 connector [inlong]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #11573:
URL: https://github.com/apache/inlong/issues/11573#issuecomment-2629727894
This issue is stale because it has been open for 60 days with no activity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][Sort] Add batch end-to-end test for Kafka v1.18 connector [inlong]
Posted by "vernedeng (via GitHub)" <gi...@apache.org>.
vernedeng commented on issue #11573:
URL: https://github.com/apache/inlong/issues/11573#issuecomment-3413566775
Flink 1.18 related issues will be suspended and enabled later on demand.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][Sort] Add batch end-to-end test for Kafka v1.18 connector [inlong]
Posted by "vernedeng (via GitHub)" <gi...@apache.org>.
vernedeng closed issue #11573: [Feature][Sort] Add batch end-to-end test for Kafka v1.18 connector
URL: https://github.com/apache/inlong/issues/11573
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org