You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/02/24 10:01:51 UTC
[GitHub] [incubator-seatunnel] CalvinKirs opened a new issue #1326: [Test][Plugin]Plugin Test
CalvinKirs opened a new issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326
Hi, everyone, at present we have added many new plugins to the dev branch. We plan to release a version in March. Community contributors are welcome to test it. If you are interested in this, please leave a message in the issue (if you are interested plugin), I will assign it to you, please leave a message in this issue when you are finished, (if you have additional information, you can submit an issue and indicate it in the comment)
Spark | Plugin | Assignees | Status | Comment
---|---|---|---|---
Source| TiDB
Sink | TiDB
Source| Socket
Sink | Redis
Source| Redis
Sink | Phoneix
Source| Phoneix
Source| Neo4J
Sink | MongoDB
Source| MongoDB
Sink | Kudu
Source| Kudu
Sink | Kafka
Source| Kafka
Sink | Jdbc
Source| Jdbc
Sink | Hudi
Source| Hudi
Sink | Hive
Source| Hive
Sink | Hbase
Source| Hbase
Sink | File
Source| File
Source| Fake
Sink | Email
Source| Elasticsearch
Sink | Elasticsearch
Sink | Doris
Sink | Console
Sink | ClickHouse
Transform | Split
Transform | Sql
Transform | Json
Flink | Plugin | Assignees | Status | Comment
---|---|---|---|---
Source| Socket
Sink | Kafka
Source| Kafka
Sink | JDBC
Source| JDBC
Sink | InfluxDB
Source| File
Sink | File
Source| Fake
Sink | Elasticsearch
Source| Druid
Sink | Druid
Sink | Doris
Source| Console
Transform | Split
Transform | Sql
Transform | table2datastream
Transform | datastream2table
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057810287
> > > > @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
> > >
> > >
> > > I functionally tested this and everything works，but I didn't do any performance testing @CalvinKirs
> >
> >
> > the doc has nothing write about spark-kafka source plugin,I'd like to add what I learn while doing the test to the document,could u tell me the step to do it @CalvinKirs
>
> is here https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/spark/configuration/sink-plugins/Kafka.md, You can see if there is anything to add to this, and again, deeply thanks for your contribution. 👍
I found that we are just missing a link in the readme file, need I add and submit a PR ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1059976754
@zixi0825, @PotatoDream, @zhaomin1423, @leo65535, @PotatoDream, @ITzhangqiang, @denglingang, @gaodayu1209, @asdf2014, @kalencaya
hi, everyone, if you finish the test, remember to leave a message in this issue, thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] zixi0825 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
zixi0825 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1054956022
@CalvinKirs I would like to pick up the plugins of spark-tidb source and sink
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 edited a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 edited a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1055048383
@CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 edited a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 edited a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057754741
> > @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
>
> I functionally tested this and everything works，but I didn't do any performance testing @CalvinKirs
the doc has nothing write about spark-kafka source plugin,I'd like to add what I learn while doing the test to the document,could u tell me the step to do it
@CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057751817
> @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
I functionally tested this and everything works，but I didn't do any performance testing
@CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058770482
@zixi0825, @wuchunfu, @PotatoDream, @zhaomin1423, @leo65535, @PotatoDream, @ITzhangqiang, @denglingang, @gaodayu1209, @asdf2014, @kalencaya, @taikongren365
hi, everyone, if you finish the test, remember to leave a message in this issue, thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] PotatoDream commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
PotatoDream commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1054969324
@CalvinKirs I would like to pick up the plugins of spark-hbase/spark-phoenix source and sink.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ITzhangqiang commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ITzhangqiang commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1054964361
@CalvinKirs I would like to pick up Elasticsearch-source and Elasticsearch-sink, for I'm good at them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1056955006
hi，guys,Please update the status of this issue as soon as you finish the test
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057931155
Dear @CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057930879
@CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057932243
> Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
I functionally tested both Spark-Sink-Doris and Flink-Sink-Doris plugin.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] wuchunfu commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058945252
> These Plugins have been done. `spark：file-sink、file-source、transform-split、transform-sql` `flink：file-sink、file-source、transform-split、transform-sql`
well done, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] zhaomin1423 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
zhaomin1423 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1063607389
> > > @CalvinKirs The following modules have been tested and the tests passed
> > > ```shell
> > > spark-connector-source-socket
> > > spark-connector-source-redis
> > > spark-connector-sink-redis
> > > spark-connector-source-mongodb
> > > spark-connector-sink-mongodb
> > > spark-connector-source-jdbc
> > > spark-connector-sink-jdbc
> > > spark-transform-split
> > > ```
> >
> >
> > spark-connector-sink-jdbc has a bug when save mode is update.
>
> I'll merge in later
Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] gaodayu1209 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
gaodayu1209 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050478886
Hello, I would like to pick up the plugins of flink-kafka
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1060299148
Of course I will do.
Actually, I'm resolving flink JdbcSink plugin exception which caused by not implementing FlinkStreamSink<Row, Row> interface and try to pull request recently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057930879
@CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] simon824 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
simon824 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1062745765
hi, I have tested spark-kudu source & sink, spark-hbase source & sink.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] selectbook commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
selectbook commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1078882976
@CalvinKirs Hello, I would like to pick up the plugins of Spark-Neo4J
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1055278229
> @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
I plan to do the test work like this: Sink the data to Kafka from a mysql table, and then sink it back to another mysql table after subscribe it from Kafka by the source plugin，just like the picture below.
@CalvinKirs
the question is: I don't know whether I can test it this way for not knowing weather seatunnel will serialize and deSerialize the data automaticly
<img width="773" alt="image" src="https://user-images.githubusercontent.com/10529123/156150867-856f53d5-67ee-4486-9523-74a78f9eaf9e.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] xsaffable commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
xsaffable commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1054968738
@CalvinKirs I would like to pick up the plugins of ClickHouse-sink.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1055048383
@CalvinKirs I would like to pick up the plugins of spark-kaka source and sink，and I would test it in local mode, if u don't mind
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] simon824 edited a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
simon824 edited a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058889201
These Plugins have been done.
`spark：file-sink、file-source、transform-split、transform-sql`
`flink：file-sink、file-source、transform-split、transform-sql`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058026695
> > Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
>
> I tested both Spark-Sink-Doris and Flink-Sink-Doris plugin. Both of them works functionally well with simple cases in local mode. Laterly, I will update result which is tested on my Company's Cluster Environment.
well done, deeply thanks. 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058017959
> Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
I tested both Spark-Sink-Doris and Flink-Sink-Doris plugin. Both of them works functionally well with simple cases in local mode. Laterly, I will update result which is tested on my Company's Cluster Environment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] JesseAtSZ commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
JesseAtSZ commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1061363509
Do Flink socket and fake source need to be tested? I've been using these two sources for debugging recently. There's no problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057934940
> Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
I tested both Spark-Sink-Doris and Flink-Sink-Doris plugin. Both of them works functionally well with sample cases.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs edited a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs edited a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057757046
> > > @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
> >
> >
> > I functionally tested this and everything works，but I didn't do any performance testing @CalvinKirs
>
> the doc has nothing write about spark-kafka source plugin,I'd like to add what I learn while doing the test to the document,could u tell me the step to do it @CalvinKirs
is here https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/spark/configuration/sink-plugins/Kafka.md,
You can see if there is anything to add to this, and again, deeply thanks for your contribution. 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1055278229
> @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
I plan to do the test work like this: Sink the data to Kafka from a mysql table, and then sink it back to another mysql table after subscribe it from Kafka by the source plugin，just like the picture below.
@CalvinKirs
the question is: I don't know whether I can test it this way for not knowing weather seatunnel will serialize and deSerialize the data automaticly
<img width="773" alt="image" src="https://user-images.githubusercontent.com/10529123/156150867-856f53d5-67ee-4486-9523-74a78f9eaf9e.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] lvshaokang commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
lvshaokang commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1085665422
@CalvinKirs Hello, I will like to test the email plugin sink
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya edited a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya edited a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050430949
Hi, I'm willing to pick up flink jdbc and file plugins, for I'm working on them, which resoling unexpected behavior caused by flink FileSink json format.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050430949
Hi, I'm willing to pick up flink jdbc and file plugins, for I'm working on them
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] asdf2014 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
asdf2014 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1049822003
Hi @CalvinKirs, I would like to pick up the plugins of Druid and InfluxDB since I contributed them. BTW, you have missed the source plugin of InfluxDB I believe, please add it as well, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] zhaomin1423 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
zhaomin1423 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050060725
Hello, I would like to pick up the plugins of spark-jdbc and spark-hive.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] wuchunfu commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058945387
> > > > Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
> > >
> > >
> > > I tested both Spark-Sink-Doris and Flink-Sink-Doris plugin. Both of them works functionally well with simple cases in local mode. Laterly, I will update result which is tested on my Company's Cluster Environment.
>
> [Flink-Sink-Doris.conf.txt](https://github.com/apache/incubator-seatunnel/files/8183955/Flink-Sink-Doris.conf.txt) [Spark-Sink-Doris.conf.txt](https://github.com/apache/incubator-seatunnel/files/8183956/Spark-Sink-Doris.conf.txt)
>
> > well done, deeply thanks. 👍
>
> I've finished tests on Company's Cluster Environment. They all ran quite well. Below is my config file for anyone who is interested in Spark-Sink-Doris and Flink-Sink-Doris plugin. Dear @CalvinKirs I thought tests for Spark-Sink-Doris and Flink-Sink-Doris plugin are done.
well done, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057932243
> Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
I functionally tested both Spark-Sink-Doris and Flink-Sink-Doris plugin.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057931155
Dear @CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1064711213
@CalvinKirs when I tested spark-kafka plugin, I had used spark-console-sink ,it works well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] zhaomin1423 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
zhaomin1423 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1063588714
> @CalvinKirs The following modules have been tested and the tests passed
>
> ```shell
> spark-connector-source-socket
> spark-connector-source-redis
> spark-connector-sink-redis
> spark-connector-source-mongodb
> spark-connector-sink-mongodb
> spark-connector-source-jdbc
> spark-connector-sink-jdbc
> spark-transform-split
> ```
spark-connector-sink-jdbc has a bug when save mode is update.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1086482341
> @CalvinKirs I tested the email sink，i found some enhancement points，like enable ssl/tsl option、support ArrayType data etc. I will submit a pr later.
well.that's good 🤣
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] JesseAtSZ commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
JesseAtSZ commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1054973373
@CalvinKirs No similar tests have been done before. Is this test rigorous? Is there any guidance? If I can, I'd like to try fake source.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ITzhangqiang commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ITzhangqiang commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1078699707
@CalvinKirs
Hi，I tested the components related Elasticsearch
SPARK：Elasticsearch-source and Elasticsearch-sink doesn't support ES 7.x version
FLINK： Elasticsearch-sink doesn't support ES 7.x version
Does the community plan to support multiple versions? Maybe I can give it a try
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1060302581
> @zixi0825, @PotatoDream, @zhaomin1423, @leo65535, @PotatoDream, @ITzhangqiang, @denglingang, @gaodayu1209, @asdf2014, @kalencaya
>
> hi, everyone, if you finish the test, remember to leave a message in this issue, thank you.
of course I will do.
Actually, I'm resolving flink JdbcSink plugin exception which caused by not implementing FlinkStreamSink<Row, Row> interface and pull my request recently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1085668387
> @CalvinKirs Hi，I tested the components related Elasticsearch SPARK：Elasticsearch-source and Elasticsearch-sink doesn't support ES 7.x version FLINK： Elasticsearch-sink doesn't support ES 7.x version Does the community plan to support multiple versions? Maybe I can give it a try
Hi,#1631 is doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] wuchunfu commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1063587395
@CalvinKirs The following modules have been tested and the tests passed
```bash
spark-connector-source-socket
spark-connector-source-redis
spark-connector-sink-redis
spark-connector-source-mongodb
spark-connector-sink-mongodb
spark-connector-source-jdbc
spark-connector-sink-jdbc
spark-transform-split
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] zhaomin1423 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
zhaomin1423 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1063588475
@CalvinKirs spark-connector-source-hive and spark-connector-sink-hive work well. spark-connector-source-jdbc work well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] simon824 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
simon824 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058889201
These Plugins are done.
`spark：file-sink、file-source、transform-split、transform-sql`
`flink：file-sink、file-source、transform-split、transform-sql`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ZhangchengHu0923 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057754741
> > @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
>
> I functionally tested this and everything works，but I didn't do any performance testing @CalvinKirs
the doc has nothing write about spark-kafka source plugin,I'd like to add what I learn while doing the test to the document
@CalvinKirs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057889393
> > @CalvinKirs I would like to pick up the plugins of ClickHouse-sink.
>
> I tested it in local mode and yarn mode, everything works fine.
well done, deeply thanks. 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] lvshaokang commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
lvshaokang commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1086109843
@CalvinKirs
I tested the email sink，i found some enhancement points，like enable ssl/tsl option、support ArrayType data etc. I will submit a pr later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] wuchunfu commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050482845
@CalvinKirs Hi, I will test with `redis` and `mongodb`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050567714
Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1054975829
> @CalvinKirs No similar tests have been done before. Is this test rigorous? Is there any guidance? If I can, I'd like to try fake source.
We need to test whether the corresponding plug-in is working properly, following the plug-in documentation will do. For now, just make sure it works functionally
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya removed a comment on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya removed a comment on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1064050460
@CalvinKirs flink-connector-source-jdbc and flink-connector-sink-jdbc workes well and ready for release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057757046
> > > @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
> >
> >
> > I functionally tested this and everything works，but I didn't do any performance testing @CalvinKirs
>
> the doc has nothing write about spark-kafka source plugin,I'd like to add what I learn while doing the test to the document,could u tell me the step to do it @CalvinKirs
is here https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/spark/configuration/sink-plugins/Kafka.md,
You can see if there is anything to add to this, and again, deeply thanks for your contribution. 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1064050460
@CalvinKirs flink-connector-source-jdbc and flink-connector-sink-jdbc workes well and ready for release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] denglingang commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
denglingang commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1050546422
Hello, I would like to pick up the plugins of Transform-json , Transform-split, and Transform-sql
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] kalencaya commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
kalencaya commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1060299148
Of course I will do.
Actually, I'm resolving flink JdbcSink plugin exception which caused by not implementing FlinkStreamSink<Row, Row> interface and try to pull request recently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057814980
> > > > > @CalvinKirs I would like to pick up the plugins of spark-kafka source and sink，and I would test it in local mode, if u don't mind
> > > >
> > > >
> > > > I functionally tested this and everything works，but I didn't do any performance testing @CalvinKirs
> > >
> > >
> > > the doc has nothing write about spark-kafka source plugin,I'd like to add what I learn while doing the test to the document,could u tell me the step to do it @CalvinKirs
> >
> >
> > is here https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/spark/configuration/sink-plugins/Kafka.md, You can see if there is anything to add to this, and again, deeply thanks for your contribution. 👍
>
> I found that we are just missing a link in the readme file, need I add and submit a PR ?
This is the best 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] xsaffable commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
xsaffable commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057887372
> @CalvinKirs I would like to pick up the plugins of ClickHouse-sink.
I tested it in local mode and yarn mode, everything works fine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1058916849
> > > Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
> >
> >
> > I tested both Spark-Sink-Doris and Flink-Sink-Doris plugin. Both of them works functionally well with simple cases in local mode. Laterly, I will update result which is tested on my Company's Cluster Environment.
>
[Flink-Sink-Doris.conf.txt](https://github.com/apache/incubator-seatunnel/files/8183955/Flink-Sink-Doris.conf.txt)
[Spark-Sink-Doris.conf.txt](https://github.com/apache/incubator-seatunnel/files/8183956/Spark-Sink-Doris.conf.txt)
> well done, deeply thanks. 👍
I've finished tests on Company's Cluster Environment. They all ran quite well.
Below is my config file for anyone who is interested in Spark-Sink-Doris and Flink-Sink-Doris plugin.
Dear @CalvinKirs I thought tests for Spark-Sink-Doris and Flink-Sink-Doris plugin are done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] taikongren365 commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
taikongren365 commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1057934940
> Dear @CalvinKirs, Im willing to pick up Spark-Sink-Doris and Flink-Sink-Doris. For now, im doing jobs with Doris.
I tested both Spark-Sink-Doris and Flink-Sink-Doris plugin. Both of them works functionally well with sample cases.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] wuchunfu commented on issue #1326: [Test][Plugin]Plugin Test
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on issue #1326:
URL: https://github.com/apache/incubator-seatunnel/issues/1326#issuecomment-1063606864
> > @CalvinKirs The following modules have been tested and the tests passed
> > ```shell
> > spark-connector-source-socket
> > spark-connector-source-redis
> > spark-connector-sink-redis
> > spark-connector-source-mongodb
> > spark-connector-sink-mongodb
> > spark-connector-source-jdbc
> > spark-connector-sink-jdbc
> > spark-transform-split
> > ```
>
> spark-connector-sink-jdbc has a bug when save mode is update.
I'll merge in later
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org