You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/06/24 11:11:00 UTC

[jira] [Updated] (HDDS-5381) SCM terminated with exit status 1: null

     [ https://issues.apache.org/jira/browse/HDDS-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HDDS-5381:
---------------------------------
    Labels: pull-request-available  (was: )

> SCM terminated with exit status 1: null
> ---------------------------------------
>
>                 Key: HDDS-5381
>                 URL: https://issues.apache.org/jira/browse/HDDS-5381
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: SCM HA
>            Reporter: Nilotpal Nandi
>            Assignee: Shashikant Banerjee
>            Priority: Major
>              Labels: pull-request-available
>
> {code:java}
> steps taken :
> Running ozone fault injection tests which involve activating/deactivating pipelines.
> In one of the tests, while activating pipeline, SCM terminated.SCM log:
> http://logserver.eng.hortonworks.com/s3/quanta/14903496/UNZIPPED_LOGS/QUASAR_DIAG_LOGS/debugging_files_20210623_213812930735/quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site.logs/var/log/hadoop-ozone/ozone-scm.log2021-06-23 23:56:59,922 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for dn/quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site@ROOT.HWX.SITE (auth:KERBEROS) for protocol=interface org.apache.hadoop.ozone.protocol.StorageContainerDatanodeProtocol
> 2021-06-23 23:57:00,868 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for dn/quasar-bcnwtg-6.quasar-bcnwtg.root.hwx.site@ROOT.HWX.SITE (auth:KERBEROS)
> 2021-06-23 23:57:00,874 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for dn/quasar-bcnwtg-6.quasar-bcnwtg.root.hwx.site@ROOT.HWX.SITE (auth:KERBEROS) for protocol=interface org.apache.hadoop.ozone.protocol.StorageContainerDatanodeProtocol
> 2021-06-23 23:57:03,166 WARN org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager: Pipeline PipelineID=661b906a-fd6b-4c14-b6b5-8c0a12c67ff7 is not found in the pipeline Map. Pipeline may have been deleted already.
> 2021-06-23 23:57:03,168 ERROR org.apache.ratis.statemachine.StateMachine: Terminating with exit status 1: null
> java.lang.IllegalMonitorStateException
> 	at java.base/java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(ReentrantReadWriteLock.java:372)
> 	at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1302)
> 	at java.base/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(ReentrantReadWriteLock.java:1147)
> 	at org.apache.hadoop.hdds.scm.pipeline.PipelineStateManagerV2Impl.updatePipelineState(PipelineStateManagerV2Impl.java:270)
> 	at jdk.internal.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
> 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 	at org.apache.hadoop.hdds.scm.ha.SCMStateMachine.process(SCMStateMachine.java:168)
> 	at org.apache.hadoop.hdds.scm.ha.SCMStateMachine.applyTransaction(SCMStateMachine.java:139)
> 	at org.apache.ratis.server.impl.RaftServerImpl.applyLogToStateMachine(RaftServerImpl.java:1690)
> 	at org.apache.ratis.server.impl.StateMachineUpdater.applyLog(StateMachineUpdater.java:234)
> 	at org.apache.ratis.server.impl.StateMachineUpdater.run(StateMachineUpdater.java:179)
> 	at java.base/java.lang.Thread.run(Thread.java:834)
> 2021-06-23 23:57:03,174 INFO org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter: SHUTDOWN_MSG: 
> /************************************************************
> SHUTDOWN_MSG: Shutting down StorageContainerManager at quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site/172.27.106.70
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org