You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Rushabh S Shah (JIRA)" <ji...@apache.org> on 2017/12/21 16:34:00 UTC

[jira] [Comment Edited] (HDFS-12938) TestErasureCodigCLI testAll failing consistently.

    [ https://issues.apache.org/jira/browse/HDFS-12938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16300205#comment-16300205 ] 

Rushabh S Shah edited comment on HDFS-12938 at 12/21/17 4:33 PM:
-----------------------------------------------------------------

Surprised to know that the test code is so fragile.
We are comparing the whole string including "a or an".
Hopefully we can come up with better test cases in future.


was (Author: shahrs87):
Surprised to know that the code is so fragile.
We are comparing the whole string including "a or an".
Hopefully we can come up with better test cases in future.

> TestErasureCodigCLI testAll failing consistently.
> -------------------------------------------------
>
>                 Key: HDFS-12938
>                 URL: https://issues.apache.org/jira/browse/HDFS-12938
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: erasure-coding, hdfs
>    Affects Versions: 3.1.0
>            Reporter: Rushabh S Shah
>            Assignee: Ajay Kumar
>         Attachments: HDFS-12938.001.patch
>
>
> {{TestErasureCodingCLI#testAll}} is failing consistently.
> It failed in this precommit: https://builds.apache.org/job/PreCommit-HDFS-Build/22435/testReport/org.apache.hadoop.cli/TestErasureCodingCLI/testAll/
> I ran locally on my laptop and it failed too.
> It failed with this stack trace:
> {noformat}
> java.lang.AssertionError: One of the tests failed. See the Detailed results to identify the command that failed
> 	at org.junit.Assert.fail(Assert.java:88)
> 	at org.junit.Assert.assertTrue(Assert.java:41)
> 	at org.apache.hadoop.cli.CLITestHelper.displayResults(CLITestHelper.java:264)
> 	at org.apache.hadoop.cli.CLITestHelper.tearDown(CLITestHelper.java:126)
> 	at org.apache.hadoop.cli.TestErasureCodingCLI.tearDown(TestErasureCodingCLI.java:77)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
> Below is the detailed report from {{org.apache.hadoop.cli.TestErasureCodingCLI-output.txt}}.
> {noformat}
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(156)) - -------------------------------------------
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(157)) -                     Test ID: [15]
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(158)) -            Test Description: [setPolicy : set policy on non-empty directory]
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(159)) - 
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -mkdir /ecdir]
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -touchz /ecdir/file1]
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -setPolicy -policy RS-6-3-1024k -path /ecdir]
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(167)) - 
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(170)) -            Cleanup Commands: [-fs hdfs://localhost:52345 -rm -R /ecdir]
> 2017-12-18 09:25:44,821 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(174)) - 
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(178)) -                  Comparator: [SubstringComparator]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(180)) -          Comparision result:   [fail]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(182)) -             Expected output:   [Warning: setting erasure coding policy on an non-empty directory will not automatically convert existing data to RS-6-3-1024]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(184)) -               Actual output:   [Set erasure coding policy RS-6-3-1024k on /ecdir
> Warning: setting erasure coding policy on a non-empty directory will not automatically convert existing files to RS-6-3-1024k
> ]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(187)) - 
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(156)) - -------------------------------------------
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(157)) -                     Test ID: [17]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(158)) -            Test Description: [unsetPolicy : unset policy on non-empty directory]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(159)) - 
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -mkdir /ecdir]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -setPolicy -policy RS-6-3-1024k -path /ecdir]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -touchz /ecdir/file1]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(163)) -               Test Commands: [-fs hdfs://localhost:52345 -unsetPolicy -path /ecdir]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(167)) - 
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(170)) -            Cleanup Commands: [-fs hdfs://localhost:52345 -rm -R /ecdir]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(174)) - 
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(178)) -                  Comparator: [SubstringComparator]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(180)) -          Comparision result:   [fail]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(182)) -             Expected output:   [Warning: unsetting erasure coding policy on an non-empty directory will not automatically convert existing data to replicated data]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(184)) -               Actual output:   [Unset erasure coding policy from /ecdir
> Warning: unsetting erasure coding policy on a non-empty directory will not automatically convert existing files to replicated data.
> ]
> 2017-12-18 09:25:44,822 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(187)) - 
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(191)) - Summary results:
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(192)) - ----------------------------------
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(212)) -                Testing mode: test
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(213)) - 
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(214)) -              Overall result: --- FAIL ---
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(222)) -                # Tests pass: 51 (96%)
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(224)) -                # Tests fail: 2 (3%)
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(228)) -          # Validations done: 67 (each test may do multiple validations)
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(231)) - 
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(232)) - Failing tests:
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(233)) - --------------
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(239)) - 15: setPolicy : set policy on non-empty directory
> 2017-12-18 09:25:44,823 [Thread-0] INFO  cli.CLITestHelper (CLITestHelper.java:displayResults(239)) - 17: unsetPolicy : unset policy on non-empty directory
> {noformat}
> {{setPolicy}} and {{unsetPolicy}} commands are failing.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org