You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "LiXin Ge (JIRA)" <ji...@apache.org> on 2017/05/16 03:23:04 UTC
[jira] [Updated] (HADOOP-14424) Add CRC32C performance test.
[ https://issues.apache.org/jira/browse/HADOOP-14424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
LiXin Ge updated HADOOP-14424:
------------------------------
Description:
The default checksum algorithm of Hadoop is CRC32C, so we'd better add a new test to compare Crc32C chunked verification implementations.
This test is based on Crc32PerformanceTest, what I have done in this test is:
1.CRC32C performance test.
2.CRC32C is not supported by java.util.zip in JAVA JDK, so just remove it from this test.
3.User can choose either direct buffer or non-directly buffer to run this test manually.
4.Take use of verifyChunkedSumsByteArray for native to support non-directly native test.
was:
The default checksum algorithm of Hadoop is CRC32C, so we'd better add a new test to compare Crc32C chunked verification implementations.
This test is based on Crc32PerformanceTest, what I have done in this test is:
1.CRC32C performance test.
2.CRC32C is not supported by java.util.zip in JAVA JDK, so just remove it from this test.
3.User can choose either direct buffer or non-directly buffer to run this test manually.
> Add CRC32C performance test.
> ----------------------------
>
> Key: HADOOP-14424
> URL: https://issues.apache.org/jira/browse/HADOOP-14424
> Project: Hadoop Common
> Issue Type: Improvement
> Components: common
> Affects Versions: 3.0.0-alpha2
> Reporter: LiXin Ge
> Priority: Minor
> Fix For: 3.0.0-alpha2
>
>
> The default checksum algorithm of Hadoop is CRC32C, so we'd better add a new test to compare Crc32C chunked verification implementations.
> This test is based on Crc32PerformanceTest, what I have done in this test is:
> 1.CRC32C performance test.
> 2.CRC32C is not supported by java.util.zip in JAVA JDK, so just remove it from this test.
> 3.User can choose either direct buffer or non-directly buffer to run this test manually.
> 4.Take use of verifyChunkedSumsByteArray for native to support non-directly native test.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org