You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2022/09/20 05:15:41 UTC
[GitHub] [hadoop] virajjasani commented on pull request #4913: HADOOP-18377. hadoop-aws maven build to add a prefetch profile to run all tests with prefetching
virajjasani commented on PR #4913:
URL: https://github.com/apache/hadoop/pull/4913#issuecomment-1251850569
Tested against `us-west-2`:
With `prefetch`:
```
$ mvn verify -Dparallel-tests -Dprefetch -Dscale -DtestsThreadCount=8
[INFO] --- maven-surefire-plugin:3.0.0-M1:test (default-test) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Results:
[INFO]
[WARNING] Tests run: 436, Failures: 0, Errors: 0, Skipped: 4
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test (default-integration-test) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestS3AContractUnbuffer>AbstractContractUnbufferTest.testMultipleUnbuffers:100->AbstractContractUnbufferTest.validateFullFileContents:132->AbstractContractUnbufferTest.validateFileContents:139->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 failed to read expected number of bytes from stream. This may be transient expected:<1024> but was:<543>
[ERROR] ITestS3AContractVectoredRead.testStopVectoredIoOperationsUnbuffer:143 Expected an exception of type class java.io.InterruptedIOException
[INFO]
[ERROR] Tests run: 1150, Failures: 2, Errors: 0, Skipped: 146
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test (sequential-integration-tests) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[ERROR] Errors:
[ERROR] ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing:267 » TestTimedOut
[INFO]
[ERROR] Tests run: 124, Failures: 0, Errors: 1, Skipped: 10
```
Without `prefetch`:
```
$ mvn verify -Dparallel-tests -Dscale -DtestsThreadCount=8
[INFO] --- maven-surefire-plugin:3.0.0-M1:test (default-test) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Results:
[INFO]
[WARNING] Tests run: 436, Failures: 0, Errors: 0, Skipped: 4
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test (default-integration-test) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Results:
[INFO]
[WARNING] Tests run: 1150, Failures: 0, Errors: 0, Skipped: 146
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test (sequential-integration-tests) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[ERROR] Errors:
[ERROR] ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing:267 » TestTimedOut
[INFO]
[ERROR] Tests run: 124, Failures: 0, Errors: 1, Skipped: 10
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org