You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2022/01/19 06:27:55 UTC

[GitHub] [hadoop] anmolanmol1234 opened a new pull request #3903: HADOOP-18084 ABFS: Add testfilePath while verifying test contents are read correctly

anmolanmol1234 opened a new pull request #3903:
URL: https://github.com/apache/hadoop/pull/3903


   Add testfilePath as a param to get the file path for which the contents were not read correctly or the buffer size didn't match the expected one.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


[GitHub] [hadoop] steveloughran merged pull request #3903: HADOOP-18084 ABFS: Add testfilePath while verifying test contents are read correctly

Posted by GitBox <gi...@apache.org>.
steveloughran merged pull request #3903:
URL: https://github.com/apache/hadoop/pull/3903


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


[GitHub] [hadoop] anmolanmol1234 commented on pull request #3903: HADOOP-18084 ABFS: Add testfilePath while verifying test contents are read correctly

Posted by GitBox <gi...@apache.org>.
anmolanmol1234 commented on pull request #3903:
URL: https://github.com/apache/hadoop/pull/3903#issuecomment-1016126610


   
   HNS-OAuth
   ========================
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [ERROR]   ITestAzureBlobFileSystemRandomRead.testSkipBounds:218->Assert.assertTrue:42->Assert.fail:89 There should not be any network I/O (elapsedTimeMs=122).
   [INFO] 
   [ERROR] Tests run: 566, Failures: 2, Errors: 0, Skipped: 54
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
   [INFO] 
   [ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
   
   HNS-SharedKey
   ========================
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [INFO] 
   [ERROR] Tests run: 566, Failures: 1, Errors: 0, Skipped: 54
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
   [INFO] 
   [ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
   
   Time taken: 27 mins 32 secs.
   
   AppendBlob-HNS-OAuth
   ========================
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [ERROR]   ITestAbfsStreamStatistics.testAbfsStreamOps:140->Assert.assertTrue:42->Assert.fail:89 The actual value of 99 was not equal to the expected value
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
   [ERROR]   ITestAzureBlobFileSystemLease.testTwoWritersCreateAppendNoInfiniteLease:177->twoWriters:165 » AbfsRestOperation
   [INFO] 
   [ERROR] Tests run: 566, Failures: 2, Errors: 2, Skipped: 54
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.testListOnFolderWithNoChildren:70 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 64
   
   Time taken: 30 mins 25 secs.
   
   NonHNS-SharedKey
   ========================
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting:171->fuzzyValidate:49 The actual value 12 is not within the expected range: [5.60, 8.40].
   [INFO] 
   [ERROR] Tests run: 106, Failures: 1, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
   [INFO] 
   [ERROR] Tests run: 566, Failures: 1, Errors: 1, Skipped: 276
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsFileSystemContractEtag>AbstractContractEtagTest.testEtagConsistencyAcrossRename:162 [etag of list status (VersionedFileStatus{VersionedFileStatus{path=abfs://testcontainer@anmolasraninonhnstest.dfs.core.windows.net/fork-8/test/testEtagConsistencyAcrossRename/dest; isDirectory=false; length=11; replication=1; blocksize=268435456; modification_time=1642572370000; access_time=0; owner=anmol; group=anmol; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false; isErasureCoded=false}; version='0x8D9DB11CA2C1F33'}) compared to HEAD value of VersionedFileStatus{VersionedFileStatus{path=abfs://testcontainer@anmolasraninonhnstest.dfs.core.windows.net/fork-8/test/testEtagConsistencyAcrossRename/src; isDirectory=false; length=11; replication=1; blocksize=268435456; modification_time=1642572369000; access_time=0; owner=anmol; group=anmol; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false; isErasureCoded=false}; version='0x8D9DB11C9909224'
 }] expected:<"0x8D9DB11C[9909224]"> but was:<"0x8D9DB11C[A2C1F33]">
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
   [INFO] 
   [ERROR] Tests run: 265, Failures: 1, Errors: 1, Skipped: 40
   
   Time taken: 35 mins 42 secs.
   
   Failures tracked in Jiras :-
   https://issues.apache.org/jira/browse/HADOOP-18080
   https://issues.apache.org/jira/browse/HADOOP-18075
   https://issues.apache.org/jira/browse/HADOOP-17826
   https://issues.apache.org/jira/browse/HADOOP-17781
   https://issues.apache.org/jira/browse/HADOOP-17873
   https://issues.apache.org/jira/browse/HADOOP-18084


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


[GitHub] [hadoop] hadoop-yetus commented on pull request #3903: HADOOP-18084 ABFS: Add testfilePath while verifying test contents are read correctly

Posted by GitBox <gi...@apache.org>.
hadoop-yetus commented on pull request #3903:
URL: https://github.com/apache/hadoop/pull/3903#issuecomment-1016171688


   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |   0m 41s |  |  Docker mode activated.  |
   |||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files found.  |
   | +0 :ok: |  codespell  |   0m  0s |  |  codespell was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain any @author tags.  |
   | +1 :green_heart: |  test4tests  |   0m  0s |  |  The patch appears to include 3 new or modified test files.  |
   |||| _ trunk Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |  31m 22s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |   0m 40s |  |  trunk passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04  |
   | +1 :green_heart: |  compile  |   0m 37s |  |  trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07  |
   | +1 :green_heart: |  checkstyle  |   0m 28s |  |  trunk passed  |
   | +1 :green_heart: |  mvnsite  |   0m 42s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   0m 34s |  |  trunk passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04  |
   | +1 :green_heart: |  javadoc  |   0m 33s |  |  trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07  |
   | +1 :green_heart: |  spotbugs  |   1m  2s |  |  trunk passed  |
   | +1 :green_heart: |  shadedclient  |  20m 24s |  |  branch has no errors when building and testing our client artifacts.  |
   |||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   0m 31s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 32s |  |  the patch passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04  |
   | +1 :green_heart: |  javac  |   0m 32s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 28s |  |  the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07  |
   | +1 :green_heart: |  javac  |   0m 28s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks issues.  |
   | +1 :green_heart: |  checkstyle  |   0m 19s |  |  the patch passed  |
   | +1 :green_heart: |  mvnsite  |   0m 32s |  |  the patch passed  |
   | +1 :green_heart: |  javadoc  |   0m 24s |  |  the patch passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04  |
   | +1 :green_heart: |  javadoc  |   0m 23s |  |  the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07  |
   | +1 :green_heart: |  spotbugs  |   1m  3s |  |  the patch passed  |
   | +1 :green_heart: |  shadedclient  |  19m 49s |  |  patch has no errors when building and testing our client artifacts.  |
   |||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   1m 57s |  |  hadoop-azure in the patch passed.  |
   | +1 :green_heart: |  asflicense  |   0m 34s |  |  The patch does not generate ASF License warnings.  |
   |  |   |  84m 36s |  |  |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3903/1/artifact/out/Dockerfile |
   | GITHUB PR | https://github.com/apache/hadoop/pull/3903 |
   | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell |
   | uname | Linux 68785d761647 4.15.0-161-generic #169-Ubuntu SMP Fri Oct 15 13:41:54 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / bf5243eb81e3a495c457c1b2a10361c0e547fbfd |
   | Default Java | Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
   | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
   |  Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3903/1/testReport/ |
   | Max. process+thread count | 722 (vs. ulimit of 5500) |
   | modules | C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3903/1/console |
   | versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
   | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


[GitHub] [hadoop] anmolanmol1234 edited a comment on pull request #3903: HADOOP-18084 ABFS: Add testfilePath while verifying test contents are read correctly

Posted by GitBox <gi...@apache.org>.
anmolanmol1234 edited a comment on pull request #3903:
URL: https://github.com/apache/hadoop/pull/3903#issuecomment-1016126610


   HNS-OAuth
   ========================
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [ERROR]   ITestAzureBlobFileSystemRandomRead.testSkipBounds:218->Assert.assertTrue:42->Assert.fail:89 There should not be any network I/O (elapsedTimeMs=122).
   [INFO] 
   [ERROR] Tests run: 566, Failures: 2, Errors: 0, Skipped: 54
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
   [INFO] 
   [ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
   
   HNS-SharedKey
   ========================
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [INFO] 
   [ERROR] Tests run: 566, Failures: 1, Errors: 0, Skipped: 54
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
   [INFO] 
   [ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
   
   Time taken: 27 mins 32 secs.
   
   AppendBlob-HNS-OAuth
   ========================
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [ERROR]   ITestAbfsStreamStatistics.testAbfsStreamOps:140->Assert.assertTrue:42->Assert.fail:89 The actual value of 99 was not equal to the expected value
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
   [ERROR]   ITestAzureBlobFileSystemLease.testTwoWritersCreateAppendNoInfiniteLease:177->twoWriters:165 » AbfsRestOperation
   [INFO] 
   [ERROR] Tests run: 566, Failures: 2, Errors: 2, Skipped: 54
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.testListOnFolderWithNoChildren:70 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 64
   
   Time taken: 30 mins 25 secs.
   
   NonHNS-SharedKey
   ========================
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting:171->fuzzyValidate:49 The actual value 12 is not within the expected range: [5.60, 8.40].
   [INFO] 
   [ERROR] Tests run: 106, Failures: 1, Errors: 0, Skipped: 2
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
   [INFO] 
   [ERROR] Tests run: 566, Failures: 1, Errors: 1, Skipped: 276
   [INFO] Results:
   [INFO] 
   [ERROR] Failures: 
   [ERROR]   ITestAbfsFileSystemContractEtag>AbstractContractEtagTest.testEtagConsistencyAcrossRename:162 
   [ERROR] Errors: 
   [ERROR]   ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
   [INFO] 
   [ERROR] Tests run: 265, Failures: 1, Errors: 1, Skipped: 40
   
   Time taken: 35 mins 42 secs.
   
   Failures tracked in Jiras :-
   https://issues.apache.org/jira/browse/HADOOP-18080
   https://issues.apache.org/jira/browse/HADOOP-18075
   https://issues.apache.org/jira/browse/HADOOP-17826
   https://issues.apache.org/jira/browse/HADOOP-17781
   https://issues.apache.org/jira/browse/HADOOP-17873
   https://issues.apache.org/jira/browse/HADOOP-18084


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org