You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by ambaricloud <sk...@ambaricloud.com> on 2016/03/15 16:58:01 UTC
Unable Copy data from local NIFI to Cluster in AWS
Hi
I am running NIFI in my MAC and NIFI cluster in AWS. RPG is able to see
port and nodes in AWS cluster. However, when I try to send data from local
NIFI to AWS cluster, I getting below error. Any help appreciated.
RemoteGroupPort[name=FromRemote,target=http://xxxx.compute-1.amazonaws.com:10000/nifi]
failed to communicate with http://xxxx.compute-1.amazonaws.com:10000/nifi
due to java.net.ConnectException: Operation timed out
--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Unable-Copy-data-from-local-NIFI-to-Cluster-in-AWS-tp8099.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: Unable to Copy data from local NIFI to Cluster in AWS
Posted by ambaricloud <sk...@ambaricloud.com>.
Thank you Matt. My configuration is working; now I am able to send data from
Laptop (source NIFI) to AWS NIFI cluster.
Satya
amabriCloud
--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Unable-Copy-data-from-local-NIFI-to-Cluster-in-AWS-tp8099p8623.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: Unable to Copy data from local NIFI to Cluster in AWS
Posted by Matthew Clarke <ma...@gmail.com>.
Not a lot of info to go on here, but you may want to take a look at the
following as a possible cause:
# Site to Site properties
nifi.remote.input.socket.host=<publicly resolvable FQDN or publicly
reachable IP address>
nifi.remote.input.socket.port=<some unused port>
nifi.remote.input.secure=false
If those things are set on every node and the NCM in your AWS NiFi cluster,
verify that your source NiFi can telnet to the configured port on those
FQDNs/IPs.
If that is successful, try changing the log level on your source NiFi for
the RPGs. It shoud provide more detail that may help understand why it is
timing out.
this can be done by adding the following line to your logback.xml file:
<logger name="org.apache.nifi.remote" level="DEBUG"/>
A restart of NiFi is not required for changes to the logback.xml file.
Changes to any other NiFi config file will require a restart to take affect.
Thanks,
Matt
On Tue, Mar 15, 2016 at 12:46 PM, ambaricloud <sk...@ambaricloud.com>
wrote:
> I am attaching log info:
>
> 2016-03-15 12:39:24,699 ERROR [Timer-Driven Process Thread-3]
> o.a.nifi.remote.StandardRemoteGroupPort
> RemoteGroupPort[name=FromRemote,target=
> http://xxxx.compute-1.amazonaws.com:10000/nifi]
> failed to communicate with http://xxx.compute-1.amazonaws.com:10000/nifi
> due
> to java.net.ConnectException: Operation timed out
>
> 2016-03-15 12:39:24,700 INFO [Timer-Driven Process Thread-10]
> o.a.n.r.c.socket.EndpointConnectionPool New Weighted Distribution of Nodes:
> Node[10.xxx.200.yyy:0] will receive 100.0% of data
>
> 2016-03-15 12:39:55,920 INFO [NiFi Site-to-Site Connection Pool
> Maintenance]
> o.a.n.r.c.socket.EndpointConnectionPool EndpointConnectionPool[Cluster
> URL=http://xxxx.compute-1.amazonaws.com:10000/nifi] Successfully refreshed
> Peer Status; remote instance consists of 1 peers
>
>
>
> --
> View this message in context:
> http://apache-nifi-developer-list.39713.n7.nabble.com/Unable-Copy-data-from-local-NIFI-to-Cluster-in-AWS-tp8099p8102.html
> Sent from the Apache NiFi Developer List mailing list archive at
> Nabble.com.
>
Re: Unable to Copy data from local NIFI to Cluster in AWS
Posted by ambaricloud <sk...@ambaricloud.com>.
I am attaching log info:
2016-03-15 12:39:24,699 ERROR [Timer-Driven Process Thread-3]
o.a.nifi.remote.StandardRemoteGroupPort
RemoteGroupPort[name=FromRemote,target=http://xxxx.compute-1.amazonaws.com:10000/nifi]
failed to communicate with http://xxx.compute-1.amazonaws.com:10000/nifi due
to java.net.ConnectException: Operation timed out
2016-03-15 12:39:24,700 INFO [Timer-Driven Process Thread-10]
o.a.n.r.c.socket.EndpointConnectionPool New Weighted Distribution of Nodes:
Node[10.xxx.200.yyy:0] will receive 100.0% of data
2016-03-15 12:39:55,920 INFO [NiFi Site-to-Site Connection Pool Maintenance]
o.a.n.r.c.socket.EndpointConnectionPool EndpointConnectionPool[Cluster
URL=http://xxxx.compute-1.amazonaws.com:10000/nifi] Successfully refreshed
Peer Status; remote instance consists of 1 peers
--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Unable-Copy-data-from-local-NIFI-to-Cluster-in-AWS-tp8099p8102.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.