You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by Jiaqi Tan <ta...@gmail.com> on 2009/07/11 01:14:49 UTC
Re: [jira] Commented: (CHUKWA-282) Demux should output detailed
per-operation ClientTrace records
I think commit is fine, I'm working on finishing up the new feature
patches so the unit tests are not coming soon. Thanks.
On Thu, Jul 9, 2009 at 5:56 PM, Ari Rabkin (JIRA)<ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/CHUKWA-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12729476#action_12729476 ]
>
> Ari Rabkin commented on CHUKWA-282:
> -----------------------------------
>
> Jiaqi -- you mentioned a revised version with unit tests. Is that likely to happen? Should I cancel the current patch, or commit it?
>
>> Demux should output detailed per-operation ClientTrace records
>> --------------------------------------------------------------
>>
>> Key: CHUKWA-282
>> URL: https://issues.apache.org/jira/browse/CHUKWA-282
>> Project: Hadoop Chukwa
>> Issue Type: Improvement
>> Components: Data Processors
>> Affects Versions: 0.2.0
>> Reporter: Jiaqi Tan
>> Assignee: Jiaqi Tan
>> Priority: Minor
>> Fix For: 0.2.0
>>
>> Attachments: CHUKWA-282.patch
>>
>>
>> Currently, the ClientTrace reducer in Demux summarizes client trace operations to produce aggregate statistics for each type of operation (e.g. total bytes of local HDFS reads, total bytes of local HDFS writes). However, more sophisticated algorithms and visualization will need more detailed information such as amount of reads/writes to/from every pair of hosts. The ClientTrace reducer should also output the unsummarized, raw ClientTrace data so they can be used for analysis/visualization.
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>