You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/06/17 15:35:05 UTC

[jira] [Created] (HADOOP-13286) add a scale test to do gunzip and linecount

Steve Loughran created HADOOP-13286:
---------------------------------------

             Summary: add a scale test to do gunzip and linecount
                 Key: HADOOP-13286
                 URL: https://issues.apache.org/jira/browse/HADOOP-13286
             Project: Hadoop Common
          Issue Type: Sub-task
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Assignee: Steve Loughran


the HADOOP-13203 patch proposal showed that there were performance problems downstream which weren't surfacing in the current scale tests.

Trying to decompress the .gz test file and then go through it with LineReader models a basic use case: parse a .csv.gz data source. 

Add this, with metric printing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org