You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Lokesh Jain (Jira)" <ji...@apache.org> on 2020/03/16 05:36:00 UTC
[jira] [Updated] (HDDS-3175) Healthy datanodes are marked as stale
[ https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lokesh Jain updated HDDS-3175:
------------------------------
Status: Patch Available (was: Open)
> Healthy datanodes are marked as stale
> -------------------------------------
>
> Key: HDDS-3175
> URL: https://issues.apache.org/jira/browse/HDDS-3175
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Ozone Datanode
> Reporter: Nilotpal Nandi
> Assignee: Lokesh Jain
> Priority: Major
>
> healthy datanodes are marked as stale due to which pipelines are not getting created
>
> scm log snippet:
> {noformat}
> 020-03-08 18:06:03,613 INFO org.apache.hadoop.hdds.scm.node.StaleNodeHandler: Datanode c03617f8-ff70-4cc6-bdf4-33441ca71471\{ip: 172.27.106.64, host: quasar-elfnqw-2.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null} moved to stale state. Finalizing its pipelines [PipelineID=dc0e7e66-c40e-4bac-86d2-3b311db482c7, PipelineID=ac390e8e-3a19-45f4-9b28-d96f1deabfca]
> 2020-03-08 18:06:03,614 INFO org.apache.hadoop.hdds.scm.pipeline.SCMPipelineManager: Destroying pipeline:Pipeline[ Id: dc0e7e66-c40e-4bac-86d2-3b311db482c7, Nodes: c03617f8-ff70-4cc6-bdf4-33441ca71471\{ip: 172.27.106.64, host: quasar-elfnqw-2.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:ONE, State:ALLOCATED, leaderId:null, CreationTimestamp2020-03-08T18:01:02.964455Z]
> 2020-03-08 18:06:03,614 INFO org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager: Pipeline Pipeline[ Id: dc0e7e66-c40e-4bac-86d2-3b311db482c7, Nodes: c03617f8-ff70-4cc6-bdf4-33441ca71471\{ip: 172.27.106.64, host: quasar-elfnqw-2.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:ONE, State:CLOSED, leaderId:null, CreationTimestamp2020-03-08T18:01:02.964455Z] moved to CLOSED state
> 2020-03-08 18:06:03,620 INFO org.apache.hadoop.hdds.scm.pipeline.SCMPipelineManager: Destroying pipeline:Pipeline[ Id: ac390e8e-3a19-45f4-9b28-d96f1deabfca, Nodes: 2ba0ecb0-0739-4da9-9541-5fef23479f28\{ip: 172.27.138.192, host: quasar-elfnqw-7.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}bbc2192c-382e-45c9-979b-912108b7e915\{ip: 172.27.86.128, host: quasar-elfnqw-3.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}c03617f8-ff70-4cc6-bdf4-33441ca71471\{ip: 172.27.106.64, host: quasar-elfnqw-2.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:THREE, State:ALLOCATED, leaderId:bbc2192c-382e-45c9-979b-912108b7e915, CreationTimestamp2020-03-08T18:01:05.580596Z]
> 2020-03-08 18:06:03,620 INFO org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager: Pipeline Pipeline[ Id: ac390e8e-3a19-45f4-9b28-d96f1deabfca, Nodes: 2ba0ecb0-0739-4da9-9541-5fef23479f28\{ip: 172.27.138.192, host: quasar-elfnqw-7.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}bbc2192c-382e-45c9-979b-912108b7e915\{ip: 172.27.86.128, host: quasar-elfnqw-3.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}c03617f8-ff70-4cc6-bdf4-33441ca71471\{ip: 172.27.106.64, host: quasar-elfnqw-2.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:THREE, State:CLOSED, leaderId:bbc2192c-382e-45c9-979b-912108b7e915, CreationTimestamp2020-03-08T18:01:05.580596Z] moved to CLOSED state
> 2020-03-08 18:06:06,613 INFO org.apache.hadoop.hdds.scm.node.StaleNodeHandler: Datanode 2ba0ecb0-0739-4da9-9541-5fef23479f28\{ip: 172.27.138.192, host: quasar-elfnqw-7.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null} moved to stale state. Finalizing its pipelines [PipelineID=0321db64-fa26-4c5a-a45e-59f6ab1d31c4, PipelineID=ac390e8e-3a19-45f4-9b28-d96f1deabfca]
> 2020-03-08 18:06:06,613 INFO org.apache.hadoop.hdds.scm.pipeline.SCMPipelineManager: Destroying pipeline:Pipeline[ Id: 0321db64-fa26-4c5a-a45e-59f6ab1d31c4, Nodes: 2ba0ecb0-0739-4da9-9541-5fef23479f28\{ip: 172.27.138.192, host: quasar-elfnqw-7.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:ONE, State:ALLOCATED, leaderId:null, CreationTimestamp2020-03-08T18:01:05.548579Z]
> 2020-03-08 18:06:06,613 INFO org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager: Pipeline Pipeline[ Id: 0321db64-fa26-4c5a-a45e-59f6ab1d31c4, Nodes: 2ba0ecb0-0739-4da9-9541-5fef23479f28\{ip: 172.27.138.192, host: quasar-elfnqw-7.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:ONE, State:CLOSED, leaderId:null, CreationTimestamp2020-03-08T18:01:05.548579Z] moved to CLOSED state
> 2020-03-08 18:06:06,614 INFO org.apache.hadoop.hdds.scm.pipeline.SCMPipelineManager: Destroying pipeline:Pipeline[ Id: ac390e8e-3a19-45f4-9b28-d96f1deabfca, Nodes: 2ba0ecb0-0739-4da9-9541-5fef23479f28\{ip: 172.27.138.192, host: quasar-elfnqw-7.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}bbc2192c-382e-45c9-979b-912108b7e915\{ip: 172.27.86.128, host: quasar-elfnqw-3.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}c03617f8-ff70-4cc6-bdf4-33441ca71471\{ip: 172.27.106.64, host: quasar-elfnqw-2.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null}, Type:RATIS, Factor:THREE, State:CLOSED, leaderId:bbc2192c-382e-45c9-979b-912108b7e915, CreationTimestamp2020-03-08T18:01:05.580596Z]
> 2020-03-08 18:06:09,613 INFO org.apache.hadoop.hdds.scm.node.StaleNodeHandler: Datanode 9cf2c807-18d9-41bf-8abb-465cba14e26e\{ip: 172.27.82.64, host: quasar-elfnqw-9.quasar-elfnqw.root.hwx.site, networkLocation: /default-rack, certSerialId: null} moved to stale state. Finalizing its pipelines [PipelineID=62a7a71b-8f0a-43ac-8a04-b72fe0c3549d]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org