You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/09/16 06:07:02 UTC
[GitHub] [incubator-seatunnel] hailin0 opened a new issue, #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
hailin0 opened a new issue, #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### Describe the proposal
Imporve kafka connector features & bugs
### Task list
Bugs:
- [ ] #2754
Features:
Common
- [ ] Add usage documentation
- [ ] Add e2e testcase
Sink
- [ ] Support extract `topic` from SeaTunnelRow fields
- [ ] Support extract `partition` from SeaTunnelRow fields
- [ ] Support more formats for message(json、csv、...)
- [ ] Support write message metadata(key、timestamp、headers)
Source
- [ ] Support define schema & format
- [ ] Support for dynamic discover `topic` & `partition` in streaming mode
- [ ] Support setting read starting offset or time at startup config
- [ ] Support read message metadata(key、timestamp、headers)
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] Carl-Zhou-CN commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
Carl-Zhou-CN commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1291850571
I want to try the following three tasks：
Add e2e testcase
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] Carl-Zhou-CN commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
Carl-Zhou-CN commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1263296630
I want to try the following three tasks：
Support for dynamic discover topic & partition in streaming mode
Support setting read starting offset or time at startup config
Support read message metadata(key、timestamp、headers)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
EricJoy2048 commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1263309649
> I want to try the following three tasks： Support for dynamic discover topic & partition in streaming mode Support setting read starting offset or time at startup config Support read message metadata(key、timestamp、headers)
Thx for your contribution. Please create issues and link this page.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
URL: https://github.com/apache/incubator-seatunnel/issues/2755
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] TaoZex commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
TaoZex commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1257098663
https://github.com/apache/incubator-seatunnel/issues/2786 What function does this issue want to achieve?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] TaoZex commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
TaoZex commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1278984452
I would like to finish the following two tasks:
Support more formats for message(json、csv、...)
Support write message metadata(key、timestamp、headers)
Please assign it to me? thx.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] TaoZex commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
TaoZex commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1250183555
I would like to try the following two tasks:
1.Support extract topic from SeaTunnelRow fields
2.Support extract partition from SeaTunnelRow fields
The two tasks are relatively similar, so I want to do them together. Could you assign it to me? Plz~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1386279794
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] hailin0 commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
hailin0 commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1283535241
> I would like to finish the following two tasks: Support more formats for message(json、csv、...) Support write message metadata(key、timestamp、headers) Please assign it to me? thx.
Thx for your contribution. Please create issues and link this page.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1327939286
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] hailin0 commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
hailin0 commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1248955210
Anyone willing to help?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2755: [Improve][Connector-V2-kafka] Imporve kafka connector
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2755:
URL: https://github.com/apache/incubator-seatunnel/issues/2755#issuecomment-1376538929
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org