You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Masatake Iwasaki (JIRA)" <ji...@apache.org> on 2017/05/10 05:08:04 UTC
[jira] [Updated] (HADOOP-14405) Fix performance regression due to
incorrect use of DataChecksum
[ https://issues.apache.org/jira/browse/HADOOP-14405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Masatake Iwasaki updated HADOOP-14405:
--------------------------------------
Summary: Fix performance regression due to incorrect use of DataChecksum (was: Fix:Performance regression due to incorrect use of DataChecksum)
> Fix performance regression due to incorrect use of DataChecksum
> ---------------------------------------------------------------
>
> Key: HADOOP-14405
> URL: https://issues.apache.org/jira/browse/HADOOP-14405
> Project: Hadoop Common
> Issue Type: Bug
> Components: native, performance
> Affects Versions: 2.8.0, 3.0.0-alpha1
> Reporter: LiXin Ge
> Assignee: LiXin Ge
> Attachments: HDFS-11765.patch
>
>
> Recently I have upgraded my Hadoop version from 2.6 to 3.0, and I find that the write performance decreased by 13%. After some days comparative analysis, It's seems introduced by HADOOP-10865.
> Since James Thomas have done the work that native checksum can run against byte[] arrays instead of just against byte buffers, we may use native method preferential because it runs faster than others.
> [~szetszwo] and [~iwasakims] could you take a look at this to see if it make bad effect on your benchmark test? [~tlipcon] could you help to see if I have make mistakes in this patch?
> thanks!
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org