You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "sudufly (via GitHub)" <gi...@apache.org> on 2023/04/23 06:53:05 UTC
[GitHub] [incubator-seatunnel] sudufly opened a new issue, #4648: [Bug] [spark] only support one sinkPlugin
sudufly opened a new issue, #4648:
URL: https://github.com/apache/incubator-seatunnel/issues/4648
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
When I set up two sink plugins, only the first one works., spark only support one Action Operator
### SeaTunnel Version
2.31
### SeaTunnel Config
```conf
env {
execution.parallelism = 1
job.mode = "STREAMING"
spark.master = local
}
source {
Kafka {
topic = "telematics-base"
format = json
bootstrap.servers = "172.18.1.200:9092"
consumer.group = "seatunnel_group"
result_table_name = "xxx"
}
}
sink {
Console {
source_table_name="xxx"
}
Kafka {
topic = "test"
format = json
bootstrap.servers = "172.18.1.200:9092"
consumer.group = "seatunnel_group"
source_table_name = "xxx" }
}
```
### Running Command
```shell
idea local
```
### Error Exception
```log
none
```
### Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] closed issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #4648: [Bug] [spark] only support one sinkPlugin
URL: https://github.com/apache/seatunnel/issues/4648
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] sudufly commented on issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "sudufly (via GitHub)" <gi...@apache.org>.
sudufly commented on issue #4648:
URL: https://github.com/apache/incubator-seatunnel/issues/4648#issuecomment-1519011330
read 自定义SeaTunnelSource，自定义kafkareader里面控制了当模式为stream的时候，永远不结束读取数据，因为read模式是批处理模式，readStream才是流处理，所以第一个sinkPlugin 永远不会结束，我试过发送signalNoMoreElement 的时候多个sinkPlugins就可以正常执行，这个是否需要修复一下呢
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] CheneyYin commented on issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "CheneyYin (via GitHub)" <gi...@apache.org>.
CheneyYin commented on issue #4648:
URL: https://github.com/apache/incubator-seatunnel/issues/4648#issuecomment-1519019329
> read 自定义SeaTunnelSource，自定义kafkareader里面控制了当模式为stream的时候，永远不结束读取数据，因为read模式是批处理模式，readStream才是流处理，所以第一个sinkPlugin 永远不会结束，我试过发送signalNoMoreElement 的时候多个sinkPlugins就可以正常执行，这个是否需要修复一下呢
> 
>
> 
>
Similar to #4640
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] laglangyue commented on issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "laglangyue (via GitHub)" <gi...@apache.org>.
laglangyue commented on issue #4648:
URL: https://github.com/apache/seatunnel/issues/4648#issuecomment-1636930359
thx for your email, and I receiver it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] laglangyue commented on issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "laglangyue (via GitHub)" <gi...@apache.org>.
laglangyue commented on issue #4648:
URL: https://github.com/apache/incubator-seatunnel/issues/4648#issuecomment-1537083526
there are some bug for spark structured streaming, can you fix it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4648:
URL: https://github.com/apache/seatunnel/issues/4648#issuecomment-1577724825
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #4648: [Bug] [spark] only support one sinkPlugin
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4648:
URL: https://github.com/apache/seatunnel/issues/4648#issuecomment-1636930260
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org