You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2007/07/25 00:04:31 UTC

[jira] Updated: (HADOOP-1649) Performance regression with Block CRCs

     [ https://issues.apache.org/jira/browse/HADOOP-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi updated HADOOP-1649:
---------------------------------

    Description: 
Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc). 

With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster. 

There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will be easier to fix. 

  was:

Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc). 

With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster. 

There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will easier to fix. 

        Summary: Performance regression with Block CRCs  (was: Performance degradation with Block CRCs)

> Performance regression with Block CRCs
> --------------------------------------
>
>                 Key: HADOOP-1649
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1649
>             Project: Hadoop
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>            Priority: Blocker
>             Fix For: 0.14.0
>
>
> Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc). 
> With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster. 
> There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will be easier to fix. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.