You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/09/20 16:04:58 UTC
[GitHub] [incubator-seatunnel] ashulin opened a new issue, #2824: [Improve][connector-v2] Source Base implementation of One reader multiple splits
ashulin opened a new issue, #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Most readers fall into one of the following categories:
1. One reader single splits. (Some dead simple blocking readers)
2. One reader multiple splits.
- Sequential Single Split (File, database query, most bounded splits)
- Multi-split multiplexed (Kafka, Pulsar, Pravega, ...)
- Multi-split multi-threaded (Kinesis, ...)
For case 1, we already have the base implementation.
For case 2, we don't have a uniform implementation.
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] lhyundeadsoul commented on issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
lhyundeadsoul commented on issue #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824#issuecomment-1259127105
I am curious why there is always `one reader` rather than `multi-reader & multi-split` .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] hailin0 commented on issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
hailin0 commented on issue #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824#issuecomment-1299932635
please assign to me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824#issuecomment-1364762698
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ashulin commented on issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
ashulin commented on issue #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824#issuecomment-1262146227
@lhyundeadsoul Because each degree of parallelism corresponds to one reader, and readers are isolated from each other, we only discuss based on one reader;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ashulin commented on issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
ashulin commented on issue #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824#issuecomment-1298409254
@hailin0 The multi-split multiplexed feature of the CDC reader can be tracked using this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
URL: https://github.com/apache/incubator-seatunnel/issues/2824
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2824: [Improve][connector-v2] SourceReader Base implementation of One reader multiple splits
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2824:
URL: https://github.com/apache/incubator-seatunnel/issues/2824#issuecomment-1356918918
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org