You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Attila Doroszlai (Jira)" <ji...@apache.org> on 2021/11/30 17:43:00 UTC
[jira] [Comment Edited] (HDDS-6049) Intermittent failure in TestDecommissionAndMaintenance#testNodeWithOpenPipelineCanBeDecommissionedAndRecommissioned
[ https://issues.apache.org/jira/browse/HDDS-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451251#comment-17451251 ]
Attila Doroszlai edited comment on HDDS-6049 at 11/30/21, 5:42 PM:
-------------------------------------------------------------------
BTW, the same can happen in {{TestHDDSUpgrade}}.
{code:title=https://github.com/elek/ozone-build-results/blob/master/2021/11/30/11793/it-filesystem-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade.txt}
testScmFailuresAfterScmCompleteFinalization Time elapsed: 68.074 s <<< FAILURE!
java.lang.AssertionError: Timeout waiting for Upgrade to complete on SCM.
at org.junit.Assert.fail(Assert.java:89)
at org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade.testPostUpgradeConditionsSCM(TestHDDSUpgrade.java:248)
at org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade.testFinalizationWithFailureInjectionHelper(TestHDDSUpgrade.java:1065)
at org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade.testScmFailuresAfterScmCompleteFinalization(TestHDDSUpgrade.java:717)
{code}
but based on the output, the root cause seems to be the same:
{code:title=https://github.com/elek/ozone-build-results/blob/master/2021/11/30/11793/it-filesystem-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade-output.txt}
2021-11-30 01:53:59,851 [Time-limited test] WARN upgrade.InjectedUpgradeFinalizationExecutor (InjectedUpgradeFinalizationExecutor.java:execute(90)) - Upgrade Finalization failed with following Exception.
java.lang.IllegalStateException: zip file closed
at java.util.zip.ZipFile.ensureOpen(ZipFile.java:686)
at java.util.zip.ZipFile.access$200(ZipFile.java:60)
at java.util.zip.ZipFile$ZipEntryIterator.hasNext(ZipFile.java:508)
at java.util.zip.ZipFile$ZipEntryIterator.hasMoreElements(ZipFile.java:503)
at java.util.jar.JarFile$JarEntryIterator.hasNext(JarFile.java:253)
at java.util.jar.JarFile$JarEntryIterator.hasMoreElements(JarFile.java:262)
at org.reflections.vfs.ZipDir$1$1.computeNext(ZipDir.java:30)
at org.reflections.vfs.ZipDir$1$1.computeNext(ZipDir.java:26)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
at org.reflections.Reflections.scan(Reflections.java:243)
at org.reflections.Reflections.scan(Reflections.java:202)
at org.reflections.Reflections.<init>(Reflections.java:123)
at org.reflections.Reflections.<init>(Reflections.java:168)
at org.apache.hadoop.hdds.upgrade.HDDSLayoutVersionManager.registerUpgradeActions(HDDSLayoutVersionManager.java:64)
at org.apache.hadoop.hdds.upgrade.HDDSLayoutVersionManager.<init>(HDDSLayoutVersionManager.java:51)
at org.apache.hadoop.hdds.scm.server.StorageContainerManager.<init>(StorageContainerManager.java:326)
at org.apache.hadoop.hdds.scm.server.StorageContainerManager.createSCM(StorageContainerManager.java:491)
at org.apache.hadoop.hdds.scm.TestUtils.getScmSimple(TestUtils.java:574)
at org.apache.hadoop.ozone.MiniOzoneClusterImpl.restartStorageContainerManager(MiniOzoneClusterImpl.java:364)
at org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade.injectSCMFailureDuringSCMUpgrade(TestHDDSUpgrade.java:505)
at org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade.lambda$testScmFailuresAfterScmCompleteFinalization$6(TestHDDSUpgrade.java:715)
{code}
was (Author: adoroszlai):
BTW, the same can happen in {{TestHDDSUpgrade}}:
https://github.com/elek/ozone-build-results/blob/master/2021/11/30/11793/it-filesystem-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade-output.txt
> Intermittent failure in TestDecommissionAndMaintenance#testNodeWithOpenPipelineCanBeDecommissionedAndRecommissioned
> -------------------------------------------------------------------------------------------------------------------
>
> Key: HDDS-6049
> URL: https://issues.apache.org/jira/browse/HDDS-6049
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Ethan Rose
> Priority: Major
> Attachments: it-ozone (1).zip
>
>
> First seen here. The PR's changed are unrelated.
> [https://github.com/apache/ozone/runs/4355766647]
> {code:java}
> [ERROR] testNodeWithOpenPipelineCanBeDecommissionedAndRecommissioned Time elapsed: 44.016 s <<< ERROR!
> java.lang.IllegalStateException: zip file closed
> at java.util.zip.ZipFile.ensureOpen(ZipFile.java:686)
> ...
> at org.reflections.Reflections.<init>(Reflections.java:168)
> at org.apache.hadoop.hdds.upgrade.HDDSLayoutVersionManager.registerUpgradeActions(HDDSLayoutVersionManager.java:64)
> at org.apache.hadoop.hdds.upgrade.HDDSLayoutVersionManager.<init>(HDDSLayoutVersionManager.java:51)
> at org.apache.hadoop.ozone.container.common.statemachine.DatanodeStateMachine.<init>(DatanodeStateMachine.java:137)
> at org.apache.hadoop.ozone.HddsDatanodeService.start(HddsDatanodeService.java:275)
> at org.apache.hadoop.ozone.HddsDatanodeService.start(HddsDatanodeService.java:207)
> at org.apache.hadoop.ozone.MiniOzoneClusterImpl.restartHddsDatanode(MiniOzoneClusterImpl.java:423)
> at org.apache.hadoop.ozone.scm.node.TestDecommissionAndMaintenance.testNodeWithOpenPipelineCanBeDecommissionedAndRecommissioned(TestDecommissionAndMaintenance.java:197)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org