You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Mehakmeet Singh (Jira)" <ji...@apache.org> on 2020/04/28 11:11:00 UTC
[jira] [Commented] (HADOOP-17018) Intermittent failing of
ITestAbfsStreamStatistics in ABFS
[ https://issues.apache.org/jira/browse/HADOOP-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094399#comment-17094399 ]
Mehakmeet Singh commented on HADOOP-17018:
------------------------------------------
Stack trace
{code:java}
2020-04-28 15:49:04,106 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - GetAcl2020-04-28 15:49:04,106 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - GetAcl2020-04-28 15:49:04,151 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:08,430 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 404,,cid=1a653b2f-8796-4c5d-ab72-f04bb1296d08,rid=8026b894-a01f-005a-6846-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12//?upn=false&action=getAccessControl&timeout=902020-04-28 15:49:08,446 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - CreateFileSystem2020-04-28 15:49:08,446 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:08,752 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 201,,cid=494b1081-ddfc-4f7f-8b58-ff93ef1e1813,rid=8026b896-a01f-005a-6a46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem2020-04-28 15:49:08,774 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - GetAcl2020-04-28 15:49:08,775 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:09,019 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 200,,cid=8b51c94e-53d6-4bf9-95ae-a220452926d3,rid=8026b8a9-a01f-005a-7d46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12//?upn=false&action=getAccessControl&timeout=902020-04-28 15:49:09,020 INFO [JUnit-testAbfsStreamOps]: azurebfs.AbstractAbfsTestWithTimeout (AbstractAbfsTestWithTimeout.java:describe(88)) -
testAbfsStreamOps: Test to see correct population of read and write operations in Abfs
2020-04-28 15:49:09,035 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - CreatePath2020-04-28 15:49:09,035 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:09,300 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 201,,cid=eb705c96-722d-4775-9100-161c64f11145,rid=8026b8be-a01f-005a-1246-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?resource=file&timeout=902020-04-28 15:49:09,319 DEBUG [pool-2-thread-1]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - Append2020-04-28 15:49:09,319 DEBUG [pool-2-thread-1]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:09,565 DEBUG [pool-2-thread-1]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 202,,cid=b7680b95-e3d0-42dd-9a2f-2fe33652d4ba,rid=8026b8c8-a01f-005a-1c46-1d2ad8000000,sent=9,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=append&position=0&timeout=902020-04-28 15:49:09,571 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - Flush2020-04-28 15:49:09,571 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:09,825 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 200,,cid=e8dad7d3-4f4a-4b87-90a4-81ced45fa71b,rid=8026b8d9-a01f-005a-2c46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=flush&retainUncommittedData=false&position=9&close=false&timeout=902020-04-28 15:49:09,826 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - GetPathStatus2020-04-28 15:49:09,827 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:10,573 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 200,,cid=f0b7fda3-ae2a-4a74-811c-4d7647f773a6,rid=8026b8e9-a01f-005a-3c46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?upn=false&timeout=902020-04-28 15:49:10,644 DEBUG [ABFS-prefetch-4]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - ReadFile2020-04-28 15:49:10,646 DEBUG [ABFS-prefetch-4]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:11,389 DEBUG [ABFS-prefetch-4]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 206,,cid=fe0d1b0b-3f46-41fd-8611-5f8fa7c75564,rid=8026b8f0-a01f-005a-4346-1d2ad8000000,sent=0,recv=9,GET,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?timeout=902020-04-28 15:49:11,389 INFO [JUnit-testAbfsStreamOps]: azurebfs.ITestAbfsStreamStatistics (ITestAbfsStreamStatistics.java:testAbfsStreamOps(85)) - Result of Read operation : 92020-04-28 15:49:11,389 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - Flush2020-04-28 15:49:11,390 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:12,132 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 200,,cid=cb07f1b1-6067-4547-8fce-e5b18d8c8ef7,rid=8026b8fc-a01f-005a-4f46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=flush&retainUncommittedData=false&position=9&close=true&timeout=902020-04-28 15:49:12,134 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - DeleteFileSystem2020-04-28 15:49:12,134 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:13,179 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 202,,cid=f8fb143a-f007-4d1e-9fe1-b74ed981bbb8,rid=8026b948-a01f-005a-1b46-1d2ad8000000,sent=0,recv=0,DELETE,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem&timeout=902020-04-28 15:49:13,196 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of REST operation - GetFileSystemProperties2020-04-28 15:49:13,197 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with shared key2020-04-28 15:49:13,439 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest: 404,,cid=0b9689d7-970f-4817-b153-54d906ee5d64,rid=8026b95c-a01f-005a-2f46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem&timeout=90
java.lang.AssertionError: Mismatch in read operations Expected :2Actual :3 <Click to see difference> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:834) at org.junit.Assert.assertEquals(Assert.java:645) at org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics.assertReadWriteOps(ITestAbfsStreamStatistics.java:154) at org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics.testAbfsStreamOps(ITestAbfsStreamStatistics.java:92) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748)
{code}
Http 404 error before the assertion error seems to be the reason for the failure.
> Intermittent failing of ITestAbfsStreamStatistics in ABFS
> ---------------------------------------------------------
>
> Key: HADOOP-17018
> URL: https://issues.apache.org/jira/browse/HADOOP-17018
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 3.2.1
> Reporter: Mehakmeet Singh
> Assignee: Mehakmeet Singh
> Priority: Major
>
> There are intermittent failures of a test inside ITestAbfsStreamStatistics in ABFS.
> Did consecutive runs of the test and failure seemed random. Stack Trace in the comments.
> Propose:
> - Change the assertion of the test for it to be passed, Since the production code seems fine.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org