You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Arpit Agarwal (Jira)" <ji...@apache.org> on 2023/07/17 18:08:00 UTC

[jira] [Resolved] (HDDS-9020) Datanodes fails to start up when secret key has not yet been initialized in SCM.

     [ https://issues.apache.org/jira/browse/HDDS-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Agarwal resolved HDDS-9020.
---------------------------------
    Fix Version/s: 1.4.0
       Resolution: Fixed

> Datanodes fails to start up when secret key has not yet been initialized in SCM.
> --------------------------------------------------------------------------------
>
>                 Key: HDDS-9020
>                 URL: https://issues.apache.org/jira/browse/HDDS-9020
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: OM, Ozone Datanode
>    Affects Versions: 1.3.0
>            Reporter: Duong
>            Assignee: Duong
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.4.0
>
>
> When a datanode/OM starts up while SCM has not finished initializing secret keys yet, the startup fails because Datanode/OM needs to prefetch the current active secret keys.
> {code:java}
> 2023-07-13 16:06:22,369 [main] ERROR org.apache.hadoop.ozone.HddsDatanodeService: Exception in HddsDatanodeService.
> java.lang.RuntimeException: Can't start the HDDS datanode plugin
> 	at org.apache.hadoop.ozone.HddsDatanodeService.start(HddsDatanodeService.java:361)
> 	at org.apache.hadoop.ozone.HddsDatanodeService.start(HddsDatanodeService.java:235)
> 	at org.apache.hadoop.ozone.HddsDatanodeService.call(HddsDatanodeService.java:203)
> 	at org.apache.hadoop.ozone.HddsDatanodeService.call(HddsDatanodeService.java:93)
> 	at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
> 	at picocli.CommandLine.access$1300(CommandLine.java:145)
> 	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
> 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
> 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
> 	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
> 	at picocli.CommandLine.execute(CommandLine.java:2078)
> 	at org.apache.hadoop.hdds.cli.GenericCli.execute(GenericCli.java:100)
> 	at org.apache.hadoop.hdds.cli.GenericCli.run(GenericCli.java:91)
> 	at org.apache.hadoop.ozone.HddsDatanodeService.main(HddsDatanodeService.java:185)
> Caused by: org.apache.hadoop.hdds.security.exception.SCMSecretKeyException: Secret key initialization is not finished yet.
> 	at org.apache.hadoop.hdds.protocolPB.SecretKeyProtocolClientSideTranslatorPB.handleError(SecretKeyProtocolClientSideTranslatorPB.java:101)
> 	at org.apache.hadoop.hdds.protocolPB.SecretKeyProtocolClientSideTranslatorPB.submitRequest(SecretKeyProtocolClientSideTranslatorPB.java:89)
> 	at org.apache.hadoop.hdds.protocolPB.SecretKeyProtocolClientSideTranslatorPB.getCurrentSecretKey(SecretKeyProtocolClientSideTranslatorPB.java:127)
> 	at org.apache.hadoop.hdds.security.symmetric.DefaultSecretKeySignerClient.start(DefaultSecretKeySignerClient.java:72)
> 	at org.apache.hadoop.hdds.security.symmetric.DefaultSecretKeyClient.start(DefaultSecretKeyClient.java:50)
> 	at org.apache.hadoop.ozone.HddsDatanodeService.start(HddsDatanodeService.java:312)
> 	... 13 more
> 2023-07-13 16:06:22,382 [shutdown-hook-0] INFO org.apache.hadoop.ozone.HddsDatanodeService: SHUTDOWN_MSG: 
> /************************************************************
> SHUTDOWN_MSG: Shutting down HddsDatanodeService at ....
> ************************************************************/  {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org