You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Phil Lord (Jira)" <ji...@apache.org> on 2023/03/21 17:42:00 UTC
[jira] [Updated] (NIFI-11322) ClusterSynchronization errors
[ https://issues.apache.org/jira/browse/NIFI-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phil Lord updated NIFI-11322:
-----------------------------
Description:
Environment: Small 3-node cluster; 4GB Heap/4 Cores per node
See attachments referencing errors in both user.log and corresponding app.log. I'm not sure if these errors might be resolved in some of the tickets being addressed in 1.21.0? The only resolution was a restart of the node... attempts to re-sync the node through a UI level connection request failed. Of note the errors were seen within a Registry versioned ProcessGroup.
2023-03-21 02:43:16,574 INFO [Reconnect to Cluster] o.a.nifi.controller.StandardFlowService Node disconnected due to Failed to properly handle Reconnection request due to org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
2023-03-21 02:43:16,574 ERROR [Reconnect to Cluster] o.a.nifi.controller.StandardFlowService Handling reconnection request failed due to: org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1059)
at org.apache.nifi.controller.StandardFlowService.handleReconnectionRequest(StandardFlowService.java:667)
at org.apache.nifi.controller.StandardFlowService.access$200(StandardFlowService.java:107)
at org.apache.nifi.controller.StandardFlowService$1.run(StandardFlowService.java:396)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.nifi.controller.serialization.FlowSynchronizationException: java.lang.IllegalStateException: Upstream component of Connection (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:447)
at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:205)
at org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:817)
at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1028)
... 4 common frames omitted
Caused by: java.lang.IllegalStateException: Upstream component of Connection (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at org.apache.nifi.connectable.StandardConnection.verifySourceStoppedOrFunnel(StandardConnection.java:529)
at org.apache.nifi.connectable.StandardConnection.verifyCanDelete(StandardConnection.java:510)
at org.apache.nifi.groups.StandardProcessGroup.removeConnection(StandardProcessGroup.java:1375)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.removeMissingConnections(StandardVersionedComponentSynchronizer.java:619)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:383)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronizeChildGroups(StandardVersionedComponentSynchronizer.java:537)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:411)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.lambda$synchronize$0(StandardVersionedComponentSynchronizer.java:255)
at org.apache.nifi.controller.flow.AbstractFlowManager.withParameterContextResolution(AbstractFlowManager.java:550)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:253)
at org.apache.nifi.groups.StandardProcessGroup.synchronizeFlow(StandardProcessGroup.java:3970)
at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:438)
... 10 common frames omitted
was:
Environment: Small 3-node cluster; 4GB Heap/4 Cores per node
See attachments referencing errors in both user.log and corresponding app.log. I'm not sure if these errors might be resolved in some of the tickets being addressed in 1.21.0? The only resolution was a restart of the node... attempts to re-sync the node through a UI level connection request failed.
2023-03-21 02:43:16,574 INFO [Reconnect to Cluster] o.a.nifi.controller.StandardFlowService Node disconnected due to Failed to properly handle Reconnection request due to org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
2023-03-21 02:43:16,574 ERROR [Reconnect to Cluster] o.a.nifi.controller.StandardFlowService Handling reconnection request failed due to: org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1059)
at org.apache.nifi.controller.StandardFlowService.handleReconnectionRequest(StandardFlowService.java:667)
at org.apache.nifi.controller.StandardFlowService.access$200(StandardFlowService.java:107)
at org.apache.nifi.controller.StandardFlowService$1.run(StandardFlowService.java:396)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.nifi.controller.serialization.FlowSynchronizationException: java.lang.IllegalStateException: Upstream component of Connection (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:447)
at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:205)
at org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:817)
at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1028)
... 4 common frames omitted
Caused by: java.lang.IllegalStateException: Upstream component of Connection (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at org.apache.nifi.connectable.StandardConnection.verifySourceStoppedOrFunnel(StandardConnection.java:529)
at org.apache.nifi.connectable.StandardConnection.verifyCanDelete(StandardConnection.java:510)
at org.apache.nifi.groups.StandardProcessGroup.removeConnection(StandardProcessGroup.java:1375)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.removeMissingConnections(StandardVersionedComponentSynchronizer.java:619)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:383)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronizeChildGroups(StandardVersionedComponentSynchronizer.java:537)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:411)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.lambda$synchronize$0(StandardVersionedComponentSynchronizer.java:255)
at org.apache.nifi.controller.flow.AbstractFlowManager.withParameterContextResolution(AbstractFlowManager.java:550)
at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:253)
at org.apache.nifi.groups.StandardProcessGroup.synchronizeFlow(StandardProcessGroup.java:3970)
at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:438)
... 10 common frames omitted
> ClusterSynchronization errors
> -----------------------------
>
> Key: NIFI-11322
> URL: https://issues.apache.org/jira/browse/NIFI-11322
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.19.1
> Reporter: Phil Lord
> Priority: Major
> Attachments: CorrespondingApp.log, StackTraceFromUser.log
>
>
> Environment: Small 3-node cluster; 4GB Heap/4 Cores per node
> See attachments referencing errors in both user.log and corresponding app.log. I'm not sure if these errors might be resolved in some of the tickets being addressed in 1.21.0? The only resolution was a restart of the node... attempts to re-sync the node through a UI level connection request failed. Of note the errors were seen within a Registry versioned ProcessGroup.
> 2023-03-21 02:43:16,574 INFO [Reconnect to Cluster] o.a.nifi.controller.StandardFlowService Node disconnected due to Failed to properly handle Reconnection request due to org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
> 2023-03-21 02:43:16,574 ERROR [Reconnect to Cluster] o.a.nifi.controller.StandardFlowService Handling reconnection request failed due to: org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
> org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed to connect node to cluster because local flow controller partially updated. Administrator should disconnect node and review flow for corruption.
> at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1059)
> at org.apache.nifi.controller.StandardFlowService.handleReconnectionRequest(StandardFlowService.java:667)
> at org.apache.nifi.controller.StandardFlowService.access$200(StandardFlowService.java:107)
> at org.apache.nifi.controller.StandardFlowService$1.run(StandardFlowService.java:396)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: org.apache.nifi.controller.serialization.FlowSynchronizationException: java.lang.IllegalStateException: Upstream component of Connection (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
> at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:447)
> at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:205)
> at org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
> at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
> at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
> at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:817)
> at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1028)
> ... 4 common frames omitted
> Caused by: java.lang.IllegalStateException: Upstream component of Connection (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
> at org.apache.nifi.connectable.StandardConnection.verifySourceStoppedOrFunnel(StandardConnection.java:529)
> at org.apache.nifi.connectable.StandardConnection.verifyCanDelete(StandardConnection.java:510)
> at org.apache.nifi.groups.StandardProcessGroup.removeConnection(StandardProcessGroup.java:1375)
> at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.removeMissingConnections(StandardVersionedComponentSynchronizer.java:619)
> at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:383)
> at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronizeChildGroups(StandardVersionedComponentSynchronizer.java:537)
> at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:411)
> at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.lambda$synchronize$0(StandardVersionedComponentSynchronizer.java:255)
> at org.apache.nifi.controller.flow.AbstractFlowManager.withParameterContextResolution(AbstractFlowManager.java:550)
> at org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:253)
> at org.apache.nifi.groups.StandardProcessGroup.synchronizeFlow(StandardProcessGroup.java:3970)
> at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:438)
> ... 10 common frames omitted
--
This message was sent by Atlassian Jira
(v8.20.10#820010)