You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Milan Das <md...@interset.com> on 2018/12/15 02:58:36 UTC
Re: Secured NIFI (clustered) error on ListFile viewstate
Hi Andy,
I have tested it with NIFI 1.8.0
I get the a diferent error.
Unable to get the state for the specified component afc9148c-0167-1000-ffff-ffffa97bf4b6: java.io.IOException: Failed to obtain value from ZooKeeper for component with ID afc9148c-0167-1000-ffff-ffffa97bf4b6 with exception code CONNECTIONLOSS
Thanks,
Milan Das
On 11/8/18, 6:41 PM, "Andy LoPresto" <al...@apache.org> wrote:
There was an issue with malformed replicated requests causing a timeout [1] in previous versions, and this was resolved in 1.8.0. Could you try against 1.8.0? This issue had nothing to do with ZK though, so if the only difference between working/failing is whether ZK is secured, I think the problem is there. Are you sure that your ZK configs are correct?
[1] https://github.com/apache/nifi/commit/748cf745628dab20b7e71f12b5dcfe6ed0bbf134
Andy LoPresto
alopresto@apache.org
alopresto.apache@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
> On Nov 9, 2018, at 10:35 AM, Milan Das <md...@interset.com> wrote:
>
> Hi Andy,
> Thanks for your response.
> I have tested it with 1.4 , 1.6 and 1.7.1 .
> It is external zookeeper .
> It works when zookeeper is not secured.
> Zookeeper is up and running. Otherwise NIFI cluster state will not show running.
>
> Thanks,
> Milan Das
>
>
>
> On 11/8/18, 6:32 PM, "Andy LoPresto" <al...@apache.org> wrote:
>
> Hi Milan,
>
> What version of NiFi are you using? Are you using the internal ZK instance or a standalone instance? Did this work before/without ZK JaaS?
>
> It appears the error is on request replication to another node, and the node is not listening/responding to the request.
>
> Andy LoPresto
> alopresto@apache.org
> alopresto.apache@gmail.com
> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
>
>> On Nov 9, 2018, at 2:07 AM, Milan Das <md...@interset.com> wrote:
>>
>> Hello Nifi team,
>>
>> Wondering if it is something more I need to do.
>>
>> Otherwise I am planning to log a defect in Jira
>>
>>
>>
>> Thanks,
>>
>> Milan
>>
>>
>>
>> From: Milan Das <md...@interset.com>
>> Date: Friday, November 2, 2018 at 10:08 AM
>> To: "dev@nifi.apache.org" <de...@nifi.apache.org>
>> Subject: Secured NIFI (clustered) error on ListFile viewstate
>>
>>
>>
>> I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured zookeeper. Zookeeper-jaas is configured in bootstrap. Cluster starts clean
>>
>> Not sure, if there is something else need to be done.
>>
>>
>>
>> Configuratons are as below:
>>
>>
>>
>> conf/state-management.xml
>>
>> <cluster-provider>
>>
>> <id>zk-provider</id>
>>
>> <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
>>
>> <property name="Connect String"></property>
>>
>> <property name="Root Node">/nifi</property>
>>
>> <property name="Session Timeout">10 seconds</property>
>>
>> <property name="Access Control">Open</property>
>>
>> </cluster-provider>
>>
>>
>>
>>
>>
>> conf/bootstrap.conf
>>
>> java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf
>>
>>
>>
>>
>>
>> Error Message:
>>
>>
>>
>> 2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>>
>> 2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
>>
>> javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>>
>> at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)
>>
>> at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)
>>
>> at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)
>>
>> at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
>>
>> at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
>>
>> at org.glassfish.jersey.internal.Errors.process(Errors.java:229)
>>
>> at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)
>>
>> at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)
>>
>> at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)
>>
>> at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)
>>
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:748)
>>
>> Caused by: java.net.SocketTimeoutException: Read timed out
>>
>> at java.net.SocketInputStream.socketRead0(Native Method)
>>
>> at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
>>
>> at java.net.SocketInputStream.read(SocketInputStream.java:171)
>>
>> at java.net.SocketInputStream.read(SocketInputStream.java:141)
>>
>> at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
>>
>> at sun.security.ssl.InputRecord.read(InputRecord.java:503)
>>
>> at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
>>
>> at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
>>
>> at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
>>
>> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>>
>> at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>>
>> at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>>
>> at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
>>
>> at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
>>
>> at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
>>
>> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
>>
>> at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
>>
>> at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>>
>> at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)
>>
>> at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)
>>
>> ... 14 common frames omitted
>>
>
>
>
>