You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2020/08/10 09:27:26 UTC
[GitHub] [hadoop] mukund-thakur commented on pull request #2207: HADOOP-17074 Optimise s3a Listing to be fully asynchronous.
mukund-thakur commented on pull request #2207:
URL: https://github.com/apache/hadoop/pull/2207#issuecomment-671252550
Performance result using new test:
`2020-08-10 14:55:31,985 [JUnit-testMultiPagesListingPerformanceAndCorrectness] INFO contract.ContractTestUtils (ContractTestUtils.java:end(1847)) - Duration of listing 500 files using listFiles() api with batch size of 10 including 10ms of processing time for each file: 7,394,348,570 nS
2020-08-10 14:55:42,288 [JUnit-testMultiPagesListingPerformanceAndCorrectness] INFO contract.ContractTestUtils (ContractTestUtils.java:end(1847)) - Duration of listing 500 files using listStatus() api with batch size of 10 including 10ms of processing time for each file: 10,204,574,314 nS`
CC @steveloughran @mehakmeet @bgaborg
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org