You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2020/02/12 06:26:48 UTC
[GitHub] [rocketmq-externals] vongosling opened a new issue #512: GSoC topic
Filters
vongosling opened a new issue #512: GSoC topic Filters
URL: https://github.com/apache/rocketmq-externals/issues/512
## Apache RocketMQ connect for Flink
### Context
There are many ways that Apache Flink and Apache RocketMQ can integrate to provide elastic data processing at a large scale. RocketMQ can be used as a streaming source and streaming sink in Flink DataStream applications, which is the main implementation and popular usage in RocketMQ community. Developers can ingest data from RocketMQ into a Flink job that makes computations and processes real-time data, to then send the data back to a RocketMQ topic as a streaming sink. More details you could see from https://github.com/apache/rocketmq-externals/tree/master/rocketmq-flink.
With more and more DW or OLAP engineers using RocketMQ for their data processing work, another potential integration needs arose. Developers can take advantage of as both a streaming source and a streaming table sink for Flink SQL or Table API queries. Also, Flink 1.9.0 makes the Table API a first-class citizen. This is the programming topic for Apache RocketMQ connect for Flink.
### You should learn before applying for this topic:
Apache RocketMQ Flink Connector
Apache Flink Table API
### Mentor
duhenglucky@apache.org, vongosling@apache.org
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [rocketmq-externals] vongosling commented on issue #512: GSoC topic
Filters
Posted by GitBox <gi...@apache.org>.
vongosling commented on issue #512: GSoC topic Filters
URL: https://github.com/apache/rocketmq-externals/issues/512#issuecomment-585086211
I am eagerly looking forward to the startup of the GSoC 2020. This is a preliminary proposal, we could call for discussion in the dev mail list :-)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [rocketmq-externals] vongosling commented on issue #512: GSoC topic
Filters
Posted by GitBox <gi...@apache.org>.
vongosling commented on issue #512: GSoC topic Filters
URL: https://github.com/apache/rocketmq-externals/issues/512#issuecomment-591193201
@qqeasonchen That's' wonderful. would you like to share your topic with the hat of the mentor? you could proposal as the keda example which we have list here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [rocketmq-externals] qqeasonchen commented on issue #512: GSoC
topic Filters
Posted by GitBox <gi...@apache.org>.
qqeasonchen commented on issue #512: GSoC topic Filters
URL: https://github.com/apache/rocketmq-externals/issues/512#issuecomment-589506375
How about RocketMQ Connect Spark、Hbase and Hive？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [rocketmq-externals] qqeasonchen commented on issue #512: GSoC
topic Filters
Posted by GitBox <gi...@apache.org>.
qqeasonchen commented on issue #512: GSoC topic Filters
URL: https://github.com/apache/rocketmq-externals/issues/512#issuecomment-590648439
@vongosling sure, i'd like to try.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [rocketmq-externals] vongosling commented on issue #512: GSoC topic
Filters
Posted by GitBox <gi...@apache.org>.
vongosling commented on issue #512: GSoC topic Filters
URL: https://github.com/apache/rocketmq-externals/issues/512#issuecomment-589694079
@qqeasonchen you could get the spark integration(but not using openconnect spec)in this repo. Would you like to mentor the hbase and hive connect, I would like to help you and co-mentor these topics :-)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services