You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by sam mohel <sa...@gmail.com> on 2017/06/28 20:41:07 UTC
Drpc configuration
I need to know configurations of drpc as I read more about it and every
time I read different settings.
Now if I have 2 machines . Machine A and B . In machine A I will run nimbus
and drpc and ui . But in B I will run supervisor .
In the code I made drpc.servers has IP address of A and drpc client has
same IP too. Nimbus.host has same IP and zookeeper.severs too . And in
/etc/hosts I defined IP address with name and IP address of B with it's
name and this copied to /etc/hosts in B too . I didn't receive results
after this configurations . Is something wrong here ?
Re: [EXTERNAL] Drpc configuration
Posted by sam mohel <sa...@gmail.com>.
Is there any help please ?
On Thu, Jun 29, 2017 at 12:42 AM, sam mohel <sa...@gmail.com> wrote:
> I'm beginner in this but here you are
> storm-starter contains some examples of doing DRPC:
>
> https://github.com/nathanmarz/storm-starter/blob/master/src/
> jvm/storm/starter/BasicDRPCTopology.java
> https://github.com/nathanmarz/storm-starter/blob/master/src/
> jvm/storm/starter/ReachTopology.java
>
> and if someone else has a good experience can help us , I hope that
>
>
> On Thu, Jun 29, 2017 at 12:12 AM, Pauley, Jim <Ji...@team.neustar>
> wrote:
>
>> Can I restate your question and ask what is the simplest working example
>> of DRPC out there? Seems like you need a LocalDRPC submitted as a Topology
>> and on that same Storm setup a DRPC server needs to be configured with
>> public IP{. and on a separate JVM a simple jar running DrpcClient trying to
>> connect to that LocalDRPC public IP. I'd like to see a simple working
>> example of LocalDRPC and DRPCClient but have not found one. I would like to
>> extend it to make a REST API to query results from my topology.. Any ideas
>> appreciated.
>>
>> ------------------------------
>> *From:* sam mohel [sammohel5@gmail.com]
>> *Sent:* Wednesday, June 28, 2017 4:41 PM
>> *To:* user@storm.apache.org; dev@storm.apache.org
>> *Subject:* [EXTERNAL] Drpc configuration
>>
>> I need to know configurations of drpc as I read more about it and every
>> time I read different settings.
>> Now if I have 2 machines . Machine A and B . In machine A I will run
>> nimbus and drpc and ui . But in B I will run supervisor .
>> In the code I made drpc.servers has IP address of A and drpc client has
>> same IP too. Nimbus.host has same IP and zookeeper.severs too . And in
>> /etc/hosts I defined IP address with name and IP address of B with it's
>> name and this copied to /etc/hosts in B too . I didn't receive results
>> after this configurations . Is something wrong here ?
>>
>
>
Re: [EXTERNAL] Drpc configuration
Posted by sam mohel <sa...@gmail.com>.
as i got we set drpc.server in code or in storm.yaml and drpc.client in
code that will take host and port and host here means as i got same address
of what we choosed in drpc.server . is that your question or not ? i hope i
can help you . but this point unclear to me too .
On Thu, Jun 29, 2017 at 2:52 AM, Pauley, Jim <Ji...@team.neustar>
wrote:
> Sam, thanks for the info. I have been reading those samples but unclear
> what part is server and what part is client as many examples are part of
> both. I sent direct mail to nathanmarz@gmail since he wrote many of those
> examples. Hoping for a reply
> ------------------------------
> *From:* sam mohel [sammohel5@gmail.com]
> *Sent:* Wednesday, June 28, 2017 6:42 PM
> *To:* user@storm.apache.org
> *Subject:* Re: [EXTERNAL] Drpc configuration
>
> I'm beginner in this but here you are
> storm-starter contains some examples of doing DRPC:
>
> https://github.com/nathanmarz/storm-starter/blob/master/src/
> jvm/storm/starter/BasicDRPCTopology.java
> <http://redir.aspx?REF=H3wnFIsLguY7izsja78Br7W0P_u972lTcgB7GJOQ_6yThP6diL7UCAFodHRwczovL3VybGRlZmVuc2UucHJvb2Zwb2ludC5jb20vdjIvdXJsP3U9aHR0cHMtM0FfX2dpdGh1Yi5jb21fbmF0aGFubWFyel9zdG9ybS0yRHN0YXJ0ZXJfYmxvYl9tYXN0ZXJfc3JjX2p2bV9zdG9ybV9zdGFydGVyX0Jhc2ljRFJQQ1RvcG9sb2d5LmphdmEmZD1Ed01GYVEmYz1NT3B0TmxWdElFVGVEQUxDX2xVTHJ3JnI9WlBULW5vaEJzT2tfdmVCNEV4X1VIRlZhUkxRSXgtTzdxQ0Z5ZGVLXzZZSSZtPWVwNGFVZ3A4WXAzd3FBenZjR1lNbDV3cHB0WmRqUkdYazBxRnRxQXRFaWcmcz1nUkQxMHZsU0tYbURXX3JuUWNoNWFqdTN6bERUeHc4aVlSOEZQS0FYbGxjJmU9>
>
> https://github.com/nathanmarz/storm-starter/blob/master/src/
> jvm/storm/starter/ReachTopology.java
> <http://redir.aspx?REF=rots7Eyo0gELMlwyf_390FXl_VlzlzKf2gf5dPGmn02ThP6diL7UCAFodHRwczovL3VybGRlZmVuc2UucHJvb2Zwb2ludC5jb20vdjIvdXJsP3U9aHR0cHMtM0FfX2dpdGh1Yi5jb21fbmF0aGFubWFyel9zdG9ybS0yRHN0YXJ0ZXJfYmxvYl9tYXN0ZXJfc3JjX2p2bV9zdG9ybV9zdGFydGVyX1JlYWNoVG9wb2xvZ3kuamF2YSZkPUR3TUZhUSZjPU1PcHRObFZ0SUVUZURBTENfbFVMcncmcj1aUFQtbm9oQnNPa192ZUI0RXhfVUhGVmFSTFFJeC1PN3FDRnlkZUtfNllJJm09ZXA0YVVncDhZcDN3cUF6dmNHWU1sNXdwcHRaZGpSR1hrMHFGdHFBdEVpZyZzPURRN2NXMGRJbUhQbzh1UHlzX2Z3WkpnQk9vZ3JwRkp3VzZJb1oxNllod0kmZT0.>
>
>
> and if someone else has a good experience can help us , I hope that
>
>
> On Thu, Jun 29, 2017 at 12:12 AM, Pauley, Jim <Jim.Pauley@team.neustar
> <http://redir.aspx?REF=p4ZgMRpZdG-DFJD43opdrWUfZJu-bXiDB6KKP64cFBiThP6diL7UCAFtYWlsdG86SmltLlBhdWxleUB0ZWFtLm5ldXN0YXI.>
> > wrote:
>
>> Can I restate your question and ask what is the simplest working example
>> of DRPC out there? Seems like you need a LocalDRPC submitted as a Topology
>> and on that same Storm setup a DRPC server needs to be configured with
>> public IP{. and on a separate JVM a simple jar running DrpcClient trying to
>> connect to that LocalDRPC public IP. I'd like to see a simple working
>> example of LocalDRPC and DRPCClient but have not found one. I would like to
>> extend it to make a REST API to query results from my topology.. Any ideas
>> appreciated.
>>
>> ------------------------------
>> *From:* sam mohel [sammohel5@gmail.com
>> <http://redir.aspx?REF=wLLEPqm1iJcLa7UIvg2eOJXkbg-J7kh0M7kPuQALT1OThP6diL7UCAFtYWlsdG86c2FtbW9oZWw1QGdtYWlsLmNvbQ..>
>> ]
>> *Sent:* Wednesday, June 28, 2017 4:41 PM
>> *To:* user@storm.apache.org
>> <http://redir.aspx?REF=ZR1rYWQv3k96IVdteFvJe7m4uNZqjYz4hWuB1va9xW2ThP6diL7UCAFtYWlsdG86dXNlckBzdG9ybS5hcGFjaGUub3Jn>;
>> dev@storm.apache.org
>> <http://redir.aspx?REF=4iwfCC3-aofT1rc6uBugxAfimrB16MqGcAeC7eJxpQiThP6diL7UCAFtYWlsdG86ZGV2QHN0b3JtLmFwYWNoZS5vcmc.>
>> *Subject:* [EXTERNAL] Drpc configuration
>>
>> I need to know configurations of drpc as I read more about it and every
>> time I read different settings.
>> Now if I have 2 machines . Machine A and B . In machine A I will run
>> nimbus and drpc and ui . But in B I will run supervisor .
>> In the code I made drpc.servers has IP address of A and drpc client has
>> same IP too. Nimbus.host has same IP and zookeeper.severs too . And in
>> /etc/hosts I defined IP address with name and IP address of B with it's
>> name and this copied to /etc/hosts in B too . I didn't receive results
>> after this configurations . Is something wrong here ?
>>
>
>
RE: [EXTERNAL] Drpc configuration
Posted by "Pauley, Jim" <Ji...@team.neustar>.
Sam, thanks for the info. I have been reading those samples but unclear what part is server and what part is client as many examples are part of both. I sent direct mail to nathanmarz@gmail since he wrote many of those examples. Hoping for a reply
________________________________
From: sam mohel [sammohel5@gmail.com]
Sent: Wednesday, June 28, 2017 6:42 PM
To: user@storm.apache.org
Subject: Re: [EXTERNAL] Drpc configuration
I'm beginner in this but here you are
storm-starter contains some examples of doing DRPC:
https://github.com/nathanmarz/storm-starter/blob/master/src/jvm/storm/starter/BasicDRPCTopology.java<redir.aspx?REF=H3wnFIsLguY7izsja78Br7W0P_u972lTcgB7GJOQ_6yThP6diL7UCAFodHRwczovL3VybGRlZmVuc2UucHJvb2Zwb2ludC5jb20vdjIvdXJsP3U9aHR0cHMtM0FfX2dpdGh1Yi5jb21fbmF0aGFubWFyel9zdG9ybS0yRHN0YXJ0ZXJfYmxvYl9tYXN0ZXJfc3JjX2p2bV9zdG9ybV9zdGFydGVyX0Jhc2ljRFJQQ1RvcG9sb2d5LmphdmEmZD1Ed01GYVEmYz1NT3B0TmxWdElFVGVEQUxDX2xVTHJ3JnI9WlBULW5vaEJzT2tfdmVCNEV4X1VIRlZhUkxRSXgtTzdxQ0Z5ZGVLXzZZSSZtPWVwNGFVZ3A4WXAzd3FBenZjR1lNbDV3cHB0WmRqUkdYazBxRnRxQXRFaWcmcz1nUkQxMHZsU0tYbURXX3JuUWNoNWFqdTN6bERUeHc4aVlSOEZQS0FYbGxjJmU9>
https://github.com/nathanmarz/storm-starter/blob/master/src/jvm/storm/starter/ReachTopology.java<redir.aspx?REF=rots7Eyo0gELMlwyf_390FXl_VlzlzKf2gf5dPGmn02ThP6diL7UCAFodHRwczovL3VybGRlZmVuc2UucHJvb2Zwb2ludC5jb20vdjIvdXJsP3U9aHR0cHMtM0FfX2dpdGh1Yi5jb21fbmF0aGFubWFyel9zdG9ybS0yRHN0YXJ0ZXJfYmxvYl9tYXN0ZXJfc3JjX2p2bV9zdG9ybV9zdGFydGVyX1JlYWNoVG9wb2xvZ3kuamF2YSZkPUR3TUZhUSZjPU1PcHRObFZ0SUVUZURBTENfbFVMcncmcj1aUFQtbm9oQnNPa192ZUI0RXhfVUhGVmFSTFFJeC1PN3FDRnlkZUtfNllJJm09ZXA0YVVncDhZcDN3cUF6dmNHWU1sNXdwcHRaZGpSR1hrMHFGdHFBdEVpZyZzPURRN2NXMGRJbUhQbzh1UHlzX2Z3WkpnQk9vZ3JwRkp3VzZJb1oxNllod0kmZT0.>
and if someone else has a good experience can help us , I hope that
On Thu, Jun 29, 2017 at 12:12 AM, Pauley, Jim <Jim.Pauley@team.neustar<redir.aspx?REF=p4ZgMRpZdG-DFJD43opdrWUfZJu-bXiDB6KKP64cFBiThP6diL7UCAFtYWlsdG86SmltLlBhdWxleUB0ZWFtLm5ldXN0YXI.>> wrote:
Can I restate your question and ask what is the simplest working example of DRPC out there? Seems like you need a LocalDRPC submitted as a Topology and on that same Storm setup a DRPC server needs to be configured with public IP{. and on a separate JVM a simple jar running DrpcClient trying to connect to that LocalDRPC public IP. I'd like to see a simple working example of LocalDRPC and DRPCClient but have not found one. I would like to extend it to make a REST API to query results from my topology.. Any ideas appreciated.
________________________________
From: sam mohel [sammohel5@gmail.com<redir.aspx?REF=wLLEPqm1iJcLa7UIvg2eOJXkbg-J7kh0M7kPuQALT1OThP6diL7UCAFtYWlsdG86c2FtbW9oZWw1QGdtYWlsLmNvbQ..>]
Sent: Wednesday, June 28, 2017 4:41 PM
To: user@storm.apache.org<redir.aspx?REF=ZR1rYWQv3k96IVdteFvJe7m4uNZqjYz4hWuB1va9xW2ThP6diL7UCAFtYWlsdG86dXNlckBzdG9ybS5hcGFjaGUub3Jn>; dev@storm.apache.org<redir.aspx?REF=4iwfCC3-aofT1rc6uBugxAfimrB16MqGcAeC7eJxpQiThP6diL7UCAFtYWlsdG86ZGV2QHN0b3JtLmFwYWNoZS5vcmc.>
Subject: [EXTERNAL] Drpc configuration
I need to know configurations of drpc as I read more about it and every time I read different settings.
Now if I have 2 machines . Machine A and B . In machine A I will run nimbus and drpc and ui . But in B I will run supervisor .
In the code I made drpc.servers has IP address of A and drpc client has same IP too. Nimbus.host has same IP and zookeeper.severs too . And in /etc/hosts I defined IP address with name and IP address of B with it's name and this copied to /etc/hosts in B too . I didn't receive results after this configurations . Is something wrong here ?
Re: [EXTERNAL] Drpc configuration
Posted by sam mohel <sa...@gmail.com>.
I'm beginner in this but here you are
storm-starter contains some examples of doing DRPC:
https://github.com/nathanmarz/storm-starter/blob/master/src/
jvm/storm/starter/BasicDRPCTopology.java
https://github.com/nathanmarz/storm-starter/blob/master/src/
jvm/storm/starter/ReachTopology.java
and if someone else has a good experience can help us , I hope that
On Thu, Jun 29, 2017 at 12:12 AM, Pauley, Jim <Ji...@team.neustar>
wrote:
> Can I restate your question and ask what is the simplest working example
> of DRPC out there? Seems like you need a LocalDRPC submitted as a Topology
> and on that same Storm setup a DRPC server needs to be configured with
> public IP{. and on a separate JVM a simple jar running DrpcClient trying to
> connect to that LocalDRPC public IP. I'd like to see a simple working
> example of LocalDRPC and DRPCClient but have not found one. I would like to
> extend it to make a REST API to query results from my topology.. Any ideas
> appreciated.
>
> ------------------------------
> *From:* sam mohel [sammohel5@gmail.com]
> *Sent:* Wednesday, June 28, 2017 4:41 PM
> *To:* user@storm.apache.org; dev@storm.apache.org
> *Subject:* [EXTERNAL] Drpc configuration
>
> I need to know configurations of drpc as I read more about it and every
> time I read different settings.
> Now if I have 2 machines . Machine A and B . In machine A I will run
> nimbus and drpc and ui . But in B I will run supervisor .
> In the code I made drpc.servers has IP address of A and drpc client has
> same IP too. Nimbus.host has same IP and zookeeper.severs too . And in
> /etc/hosts I defined IP address with name and IP address of B with it's
> name and this copied to /etc/hosts in B too . I didn't receive results
> after this configurations . Is something wrong here ?
>
RE: [EXTERNAL] Drpc configuration
Posted by "Pauley, Jim" <Ji...@team.neustar>.
Can I restate your question and ask what is the simplest working example of DRPC out there? Seems like you need a LocalDRPC submitted as a Topology and on that same Storm setup a DRPC server needs to be configured with public IP{. and on a separate JVM a simple jar running DrpcClient trying to connect to that LocalDRPC public IP. I'd like to see a simple working example of LocalDRPC and DRPCClient but have not found one. I would like to extend it to make a REST API to query results from my topology.. Any ideas appreciated.
________________________________
From: sam mohel [sammohel5@gmail.com]
Sent: Wednesday, June 28, 2017 4:41 PM
To: user@storm.apache.org; dev@storm.apache.org
Subject: [EXTERNAL] Drpc configuration
I need to know configurations of drpc as I read more about it and every time I read different settings.
Now if I have 2 machines . Machine A and B . In machine A I will run nimbus and drpc and ui . But in B I will run supervisor .
In the code I made drpc.servers has IP address of A and drpc client has same IP too. Nimbus.host has same IP and zookeeper.severs too . And in /etc/hosts I defined IP address with name and IP address of B with it's name and this copied to /etc/hosts in B too . I didn't receive results after this configurations . Is something wrong here ?