You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2021/02/22 14:56:00 UTC

[jira] [Commented] (HADOOP-17539) ABFS test setup failing "The specified filesystem already exists"

    [ https://issues.apache.org/jira/browse/HADOOP-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288415#comment-17288415 ] 

Steve Loughran commented on HADOOP-17539:
-----------------------------------------

{code}
[ERROR] testWithNoOptimization(org.apache.hadoop.fs.azurebfs.services.ITestAbfsInputStreamSmallFileReads)  Time elapsed: 6.595 s  <<< ERROR!org.apache.hadoop.fs.FileAlreadyExistsException: Operation failed: "The specified filesystem already exists.", 409, PUT, https://stevelukwest.dfs.core.windows.net/abfs-testcontainer-856a598f-e5f5-492f-9baa-4ba3852f49cc?resource=filesystem, FilesystemAlreadyExists, "The specified filesystem already exists. RequestId:688e1469-601f-0000-1311-095a09000000 Time:2021-02-22T11:57:41.1246401Z"
	at org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.checkException(AzureBlobFileSystem.java:1180)
	at org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.createFileSystem(AzureBlobFileSystem.java:1063)
	at org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.initialize(AzureBlobFileSystem.java:133)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3469)
	at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3574)
	at org.apache.hadoop.fs.FileSystem$Cache.getUnique(FileSystem.java:3527)
	at org.apache.hadoop.fs.FileSystem.newInstance(FileSystem.java:593)
	at org.apache.hadoop.fs.FileSystem.newInstance(FileSystem.java:605)
	at org.apache.hadoop.fs.azurebfs.AbstractAbfsIntegrationTest.createFileSystem(AbstractAbfsIntegrationTest.java:271)
	at org.apache.hadoop.fs.azurebfs.AbstractAbfsIntegrationTest.setup(AbstractAbfsIntegrationTest.java:146)
	at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.lang.Thread.run(Thread.java:748)
Caused by: Operation failed: "The specified filesystem already exists.", 409, PUT, https://stevelukwest.dfs.core.windows.net/abfs-testcontainer-856a598f-e5f5-492f-9baa-4ba3852f49cc?resource=filesystem, FilesystemAlreadyExists, "The specified filesystem already exists. RequestId:688e1469-601f-0000-1311-095a09000000 Time:2021-02-22T11:57:41.1246401Z"
	at org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.execute(AbfsRestOperation.java:199)
	at org.apache.hadoop.fs.azurebfs.services.AbfsClient.createFilesystem(AbfsClient.java:181)
	at org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.createFilesystem(AzureBlobFileSystemStore.java:436)
	at org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.createFileSystem(AzureBlobFileSystem.java:1061)
	... 22 more

{code}

> ABFS test setup failing "The specified filesystem already exists"
> -----------------------------------------------------------------
>
>                 Key: HADOOP-17539
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17539
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure, test
>    Affects Versions: 3.3.1
>            Reporter: Steve Loughran
>            Priority: Major
>
> been hitting this in parallel test runs. Even though FS Creation is meant to catch and swallow exceptions of code {{AzureServiceErrorCode.FILE_SYSTEM_ALREADY_EXISTS}}, this doesn't happen because the exception is translated into FileAlreadyExistsException before that catch/swallow



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org