You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bahir.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/10/24 11:42:58 UTC
[jira] [Commented] (BAHIR-72) support netty: pushed tcp/http
connector
[ https://issues.apache.org/jira/browse/BAHIR-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601725#comment-15601725 ]
ASF GitHub Bot commented on BAHIR-72:
-------------------------------------
GitHub user shijinkui opened a pull request:
https://github.com/apache/bahir-flink/pull/7
[BAHIR-72] support netty: pushed tcp/http connector
When source stream get start, listen a provided tcp port, receive stream data from user data source.
This netty tcp source is keepping alive and end-to-end, that is from business system to flink worker directly.
1. source run as a netty tcp and http server
2. user provide a tcp port, if the port is in used, increace the port number between 1024 to 65535. Source can parallel.
3. callback the provided url to report the real port to listen
4. user push streaming data to netty server, then collect the data to flink
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shijinkui/bahir-flink netty_connector
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/bahir-flink/pull/7.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7
----
commit a189597d11bfabb8af2fc671dd68cf8cc57d3fb2
Author: shijinkui <sh...@huawei.com>
Date: 2016-10-24T11:40:24Z
[BAHIR-72] support netty: pushed tcp/http connector
When source stream get start, listen a provided tcp port, receive stream data from user data source.
This netty tcp source is keepping alive and end-to-end, that is from business system to flink worker directly.
1. source run as a netty tcp and http server
2. user provide a tcp port, if the port is in used, increace the port number between 1024 to 65535. Source can parallel.
3. callback the provided url to report the real port to listen
4. user push streaming data to netty server, then collect the data to flink
----
> support netty: pushed tcp/http connector
> ----------------------------------------
>
> Key: BAHIR-72
> URL: https://issues.apache.org/jira/browse/BAHIR-72
> Project: Bahir
> Issue Type: New Feature
> Components: Flink Streaming Connectors
> Reporter: shijinkui
>
> Also discuss from flink: https://issues.apache.org/jira/browse/FLINK-4630
> When source stream get start, listen a provided tcp port, receive stream data from user data source.
> This netty tcp source is keepping alive and end-to-end, that is from business system to flink worker directly.
> Such source service is needed in produce indeed.
> describe the source in detail below:
> 1. source run as a netty tcp and http server
> 2. user provide a tcp port, if the port is in used, increace the port number between 1024 to 65535. Source can parallel.
> 3. callback the provided url to report the real port to listen
> 4. user push streaming data to netty server, then collect the data to flink
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)