You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2020/11/06 18:30:00 UTC

[jira] [Commented] (HADOOP-17325) WASB: Test failure in trunk

    [ https://issues.apache.org/jira/browse/HADOOP-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227556#comment-17227556 ] 

Steve Loughran commented on HADOOP-17325:
-----------------------------------------

I don't see an obvious reason for the failure in the changelog. The only recent change which I can see that goes near the code is the guava shading.

But the cause seems to be that lookups in the mock map aren't working because the keys used to add file metadata aren't matching in the subsequent lookups.

{code}
java.lang.NullPointerException
	at org.apache.hadoop.fs.azure.InMemoryBlockBlobStore$Entry.access$000(InMemoryBlockBlobStore.java:177)
	at org.apache.hadoop.fs.azure.InMemoryBlockBlobStore.getMetadata(InMemoryBlockBlobStore.java:166)
	at org.apache.hadoop.fs.azure.TestBlobMetadata.testFolderMetadata(TestBlobMetadata.java:261)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.lang.Thread.run(Thread.java:748)
{code}

{code}
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testNoTempBlobsVisible

Failing for the past 1 build (Since Failed#5 )
Took 0.96 sec.
Error Message
Expected one file listed, instead got: wasb://mockAccount.blob.core.windows.net/null/mockContainer/inProgress,wasb://mockContainer@mockAccount.blob.core.windows.net/mockContainer/_$azuretmpfolder$ expected:<1> but was:<2>
Stacktrace
java.lang.AssertionError: Expected one file listed, instead got: wasb://mockAccount.blob.core.windows.net/null/mockContainer/inProgress,wasb://mockContainer@mockAccount.blob.core.windows.net/mockContainer/_$azuretmpfolder$ expected:<1> but was:<2>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:834)
	at org.junit.Assert.assertEquals(Assert.java:645)
	at org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testNoTempBlobsVisible(TestNativeAzureFileSystemConcurrency.java:98)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.lang.Thread.run(Thread.java:748)
Standard Output
2020-10-22 16:35:34,945 INFO  [JUnit-testNoTempBlobsVisible]: azure.AbstractWasbTestBase (AbstractWasbTestBase.java:describe(172)) - 
{code}



> WASB: Test failure in trunk
> ---------------------------
>
>                 Key: HADOOP-17325
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17325
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure, test
>    Affects Versions: 3.3.0
>            Reporter: Sneha Vijayarajan
>            Assignee: Esfandiar Manii
>            Priority: Major
>
> WASB tests are failing in Apache trunk resulting in Yetus run failures for PRs.
>  
> ||Reason||Tests||
> |Failed junit tests|hadoop.fs.azure.TestNativeAzureFileSystemMocked|
> | |hadoop.fs.azure.TestNativeAzureFileSystemConcurrency|
> | |hadoop.fs.azure.TestWasbFsck|
> | |hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked|
> | |hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck|
> | |hadoop.fs.azure.TestNativeAzureFileSystemContractMocked|
> | |hadoop.fs.azure.TestOutOfBandAzureBlobOperations|
> | |hadoop.fs.azure.TestBlobMetadata|
> Many PRs are hit by this. Test report link from one of the PRs:
> [https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2368/5/testReport/]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org