You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/08/10 14:54:19 UTC
[GitHub] [hadoop-ozone] elek opened a new pull request #1311: HDDS-4095. Byteman script to debug HCFS performance
elek opened a new pull request #1311:
URL: https://github.com/apache/hadoop-ozone/pull/1311
## What changes were proposed in this pull request
Teragen with Ozone is reported to be slower with Ozone than Hdfs with some specific configuration.
To make it easier to compare different file system, we need an easy measurement on the same point (`FSDataOutputStream`.write) to compare the time spent in that method with Hdfs/Ozone/other file systems.
It can be done with a byteman instrumentation rule
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-4095
## How was this patch tested?
https://elek.github.io/ozone-notes/performance/20_teragen/
https://elek.github.io/ozone-notes/performance/19_hcfs/
Both tests used this btm file. FS usage was reported on the stdout:
For example:
```
Closing file system instance: 1398604678
write.call: 30000
write.allTime: 692
hsync.call: 0
hsync.allTime: 0
hflush.call: 0
hflush.allTime: 0
close.call: 10000
close.allTime: 411171
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1311: HDDS-4095. Byteman script to debug HCFS performance
Posted by GitBox <gi...@apache.org>.
adoroszlai commented on pull request #1311:
URL: https://github.com/apache/hadoop-ozone/pull/1311#issuecomment-672789261
Thanks @elek for the contribution.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] adoroszlai merged pull request #1311: HDDS-4095. Byteman script to debug HCFS performance
Posted by GitBox <gi...@apache.org>.
adoroszlai merged pull request #1311:
URL: https://github.com/apache/hadoop-ozone/pull/1311
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org