You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2009/04/01 04:16:50 UTC
[jira] Created: (CHUKWA-75) iostat output overflow
iostat output overflow
----------------------
Key: CHUKWA-75
URL: https://issues.apache.org/jira/browse/CHUKWA-75
Project: Hadoop Chukwa
Issue Type: Bug
Components: Data Processors
Environment: Redhat 5.1, Java 6
Reporter: Eric Yang
On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694835#action_12694835 ]
Mac Yang commented on CHUKWA-75:
--------------------------------
When an error condition occurred, it's very important to capture that information. I will create another jira to track it separately.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Attachment: CHUKWA-75.patch
Filter out values that is greater than 1+e10.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Attachment: CHUKWA-75-2.patch
Bump up the number to 1+e12, and skip the key/value pair, if it was a overflow. In today's disk, the highest throughput is ~100MB/second. It's unlike any number should reach 1+e12 in iostat. By skipping the key/value pair, we eliminate null pointer exception problem for the down stream application.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694671#action_12694671 ]
Jerome Boulon commented on CHUKWA-75:
-------------------------------------
Metrics Quality concern:
- Instead of adding a record with a wrong value, shouldn't it be better to just remove this record?
- Also if we have a NumberFormatException exception, shouldn't we do something more tangible?
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Status: Patch Available (was: Open)
Filter out value greater than 1+e10.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Thanks Cheng, I just committed this.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694674#action_12694674 ]
Eric Yang commented on CHUKWA-75:
---------------------------------
Only one of the column contains incorrect value, hence we can't remove the entire record.
If it is a NumberFormatException, this means it is most likely a string. The handling code is correct.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Status: Patch Available (was: Reopened)
Submitted patch for overflow value set to null.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-1.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Attachment: (was: CHUKWA-75-1.patch)
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694723#action_12694723 ]
Mac Yang commented on CHUKWA-75:
--------------------------------
Agree that it does not make sense to remove the whole record, however, instead of setting the value to 0, it might be better to remove the offending value and set it to null. It's probably also a good idea to generate a log entry.
As for the NumberFormatException, sounded like there might be a reason for why it's handled this way. It would be useful to elaborate on this a little so everyone is on the same page.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang reassigned CHUKWA-75:
-------------------------------
Assignee: Eric Yang
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang reopened CHUKWA-75:
-----------------------------
Reopen to change overflow value to null.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-1.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694837#action_12694837 ]
Cheng commented on CHUKWA-75:
-----------------------------
usually i prefer not to use exception to control the flow. in this case, if the data is not a number, a lot of NumberFormatException will be thrown. it could slow down the system.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694790#action_12694790 ]
Mac Yang commented on CHUKWA-75:
--------------------------------
Is there an expectation that this record type will never contain null value? Given the wide range of input sources and the plugable nature of the system, seems to me the generic components like the demux pipeline and the DumpRecord tool should check for null value irregardless of what we decide to do here.
If we use some other value instead of null then all the down stream components will need to check for that, in addition to checking for null. Besides, that value will need to be reserved to signify missing data point, and needs to be followed cross data sources.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-1.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Attachment: CHUKWA-75-1.patch
Use null instead of 0 for overflowed values.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-1.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-75:
----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this, thanks for everyone's feedback.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694731#action_12694731 ]
Eric Yang commented on CHUKWA-75:
---------------------------------
The columns are mapped differently in different linux distro. The parser doesn't employ a strict type check, rather, it attempts to extract information by column separations. Hence, if the column is not a number, it must be a string, and we store the column as a string. This enable us to map columns by column header regardless how the column are rearranged.
Instead of 0, it is better to store as null. Reopen to fix this again.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694786#action_12694786 ]
Jerome Boulon commented on CHUKWA-75:
-------------------------------------
If we don't know the column that we are processing how can we be sure that a value >1000000000L is an overflow?
- Should we or not apply the overflow only on a specific list of headers that we are aware of?
Also, can we have a validation that will not create any exception from Demux, DumpRecord, pig?
Having a null there will force everyone than want to use this recordType to check for NULL (performance impact + check for null at query time),
so in the worse case it should be documented but having a well defined value in place of NULL will be better.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-1.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694840#action_12694840 ]
Mac Yang commented on CHUKWA-75:
--------------------------------
Created CHUKWA-85 to track the general issue of not logging errors.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694655#action_12694655 ]
Cheng commented on CHUKWA-75:
-----------------------------
+1 minor change. looks good.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694754#action_12694754 ]
Cheng commented on CHUKWA-75:
-----------------------------
+1 --- null is better than '0'. please also make sure downstream app can handle null case.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-1.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-75) iostat output overflow
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694838#action_12694838 ]
Cheng commented on CHUKWA-75:
-----------------------------
agree with mac, we should create a new jira to track it and move this jira forward.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75-2.patch, CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the put in a filter to remove the overflow in the demux parser to improve the data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.