You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2007/07/25 00:04:31 UTC
[jira] Updated: (HADOOP-1649) Performance regression with Block
CRCs
[ https://issues.apache.org/jira/browse/HADOOP-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghu Angadi updated HADOOP-1649:
---------------------------------
Description:
Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc).
With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster.
There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will be easier to fix.
was:
Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc).
With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster.
There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will easier to fix.
Summary: Performance regression with Block CRCs (was: Performance degradation with Block CRCs)
> Performance regression with Block CRCs
> --------------------------------------
>
> Key: HADOOP-1649
> URL: https://issues.apache.org/jira/browse/HADOOP-1649
> Project: Hadoop
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Raghu Angadi
> Assignee: Raghu Angadi
> Priority: Blocker
> Fix For: 0.14.0
>
>
> Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134). This is more noticeable on writes (randomriter test etc).
> With random writer, it takes 20-25% on small cluster (20 nodes) and many be 10% on larger cluster.
> There are a few differences in how data is written with 1134. As soon as I can reproduce this, I think it will be easier to fix.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.