You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Shashikant Banerjee (Jira)" <ji...@apache.org> on 2021/06/24 11:05:00 UTC
[jira] [Created] (HDDS-5381) SCM terminated with exit status 1:
null
Shashikant Banerjee created HDDS-5381:
-----------------------------------------
Summary: SCM terminated with exit status 1: null
Key: HDDS-5381
URL: https://issues.apache.org/jira/browse/HDDS-5381
Project: Apache Ozone
Issue Type: Bug
Components: SCM HA
Reporter: Nilotpal Nandi
Assignee: Shashikant Banerjee
{code:java}
steps taken :
Running ozone fault injection tests which involve activating/deactivating pipelines.
In one of the tests, while activating pipeline, SCM terminated.SCM log:
http://logserver.eng.hortonworks.com/s3/quanta/14903496/UNZIPPED_LOGS/QUASAR_DIAG_LOGS/debugging_files_20210623_213812930735/quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site.logs/var/log/hadoop-ozone/ozone-scm.log2021-06-23 23:56:59,922 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for dn/quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site@ROOT.HWX.SITE (auth:KERBEROS) for protocol=interface org.apache.hadoop.ozone.protocol.StorageContainerDatanodeProtocol
2021-06-23 23:57:00,868 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for dn/quasar-bcnwtg-6.quasar-bcnwtg.root.hwx.site@ROOT.HWX.SITE (auth:KERBEROS)
2021-06-23 23:57:00,874 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for dn/quasar-bcnwtg-6.quasar-bcnwtg.root.hwx.site@ROOT.HWX.SITE (auth:KERBEROS) for protocol=interface org.apache.hadoop.ozone.protocol.StorageContainerDatanodeProtocol
2021-06-23 23:57:03,166 WARN org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager: Pipeline PipelineID=661b906a-fd6b-4c14-b6b5-8c0a12c67ff7 is not found in the pipeline Map. Pipeline may have been deleted already.
2021-06-23 23:57:03,168 ERROR org.apache.ratis.statemachine.StateMachine: Terminating with exit status 1: null
java.lang.IllegalMonitorStateException
at java.base/java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(ReentrantReadWriteLock.java:372)
at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1302)
at java.base/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(ReentrantReadWriteLock.java:1147)
at org.apache.hadoop.hdds.scm.pipeline.PipelineStateManagerV2Impl.updatePipelineState(PipelineStateManagerV2Impl.java:270)
at jdk.internal.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.apache.hadoop.hdds.scm.ha.SCMStateMachine.process(SCMStateMachine.java:168)
at org.apache.hadoop.hdds.scm.ha.SCMStateMachine.applyTransaction(SCMStateMachine.java:139)
at org.apache.ratis.server.impl.RaftServerImpl.applyLogToStateMachine(RaftServerImpl.java:1690)
at org.apache.ratis.server.impl.StateMachineUpdater.applyLog(StateMachineUpdater.java:234)
at org.apache.ratis.server.impl.StateMachineUpdater.run(StateMachineUpdater.java:179)
at java.base/java.lang.Thread.run(Thread.java:834)
2021-06-23 23:57:03,174 INFO org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down StorageContainerManager at quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site/172.27.106.70
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org