You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/09/16 04:57:01 UTC
[GitHub] [incubator-seatunnel] hailin0 opened a new issue, #2752: [Improve][Connector-V2] Enhance FakeSource connector
hailin0 opened a new issue, #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Thoughts on enhance FakeSource:
- Support define row type
- Supports define the total number of rows of data
- Supports direct definition of data values(row)
Anyone willing to help?
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] liugddx commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
liugddx commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1263665611
> * [ ] Support more than splits and parallelism.
please assign this task to me. I am working for customize parallelism.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] EricJoy2048 closed issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
EricJoy2048 closed issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
URL: https://github.com/apache/incubator-seatunnel/issues/2752
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] laglangyue commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
laglangyue commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1253815011
> 我认为假源需要支持定义关键字段并为关键字段生成唯一值。测试通过幂等写入数据`exactly-once`实现的接收器非常有用。`exactly-once`
good idea, I will do it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
EricJoy2048 commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1260434264
I suggest FakeSource support parallel, I want to use FakeSource and LocalFileSink test the data consistency while some engine node shutdown(For SeaTunnel Engine integration testing). The FakeSource task will run in more than one cluster node only if it support parallel.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
EricJoy2048 commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1251775574
I think fake source need support define the key fields and generate unique value for key fields. It's very useful to test `exactly-once` sink which implement `exactly-once` by Idempotent write data.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1326910062
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] TyrantLucifer commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
TyrantLucifer commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1250028005
Now `SeaTunnelSchema` can not parse row type from config file, so we should upgrade first. I can do this work.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] laglangyue commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
laglangyue commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1250073994
Please assign it to me, I am interested in FakeDatasource and console
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] hk-lrzy commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
hk-lrzy commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1253656700
- Support value's range to avoid exceed in some connectors.
- Support random generate `null` value for validate connector's stability.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] laglangyue commented on issue #2752: [Improve][Connector-V2] Enhance FakeSource connector
Posted by GitBox <gi...@apache.org>.
laglangyue commented on issue #2752:
URL: https://github.com/apache/incubator-seatunnel/issues/2752#issuecomment-1253815825
> * Support value's range to avoid exceed in some connectors.
> * Support random generate `null` value for validating connector's stability.
I will do it but lately
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org