You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Ari Rabkin (JIRA)" <ji...@apache.org> on 2009/05/22 20:20:45 UTC
[jira] Created: (CHUKWA-260) unit conversions in Demux
unit conversions in Demux
-------------------------
Key: CHUKWA-260
URL: https://issues.apache.org/jira/browse/CHUKWA-260
Project: Hadoop Chukwa
Issue Type: Improvement
Components: Data Processors
Affects Versions: 0.2.0
Reporter: Ari Rabkin
Fix For: 0.2.0
There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin reassigned CHUKWA-260:
---------------------------------
Assignee: Ari Rabkin
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Assignee: Ari Rabkin
> Fix For: 0.3.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin reassigned CHUKWA-260:
---------------------------------
Assignee: (was: Ari Rabkin)
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.3.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719432#action_12719432 ]
Ari Rabkin commented on CHUKWA-260:
-----------------------------------
I assume this is actually not going to be fixed in 0.2. Can I tag it as 0.3? It seems like it should be a priority.
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.2.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-260:
------------------------------
Fix Version/s: (was: 0.2.0)
0.3.0
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.3.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-260) unit conversions in Demux
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712191#action_12712191 ]
Jiaqi Tan commented on CHUKWA-260:
----------------------------------
Although this is sar-specific (or iostat) the Demux processor should read the column names, parse them for units, and use that information as hints for converting the numerical into the base units for the final information that's written to HDFS.
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.2.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-260:
------------------------------
Fix Version/s: 0.5.0
(was: 0.4.0)
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.5.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-260:
------------------------------
Fix Version/s: (was: 0.3.0)
0.4.0
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.4.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-260) unit conversions in Demux
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712196#action_12712196 ]
Ari Rabkin commented on CHUKWA-260:
-----------------------------------
I actually think we're better off hand-coding the conversions we want. LIke kb/sec *1000--> bytes/sec . I think trying to do it automagically won't work well, since there's not just unit conversions, but also different abbreviations.
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.2.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-260) unit conversions in Demux
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12724727#action_12724727 ]
Eric Yang commented on CHUKWA-260:
----------------------------------
+1 for 0.3.
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Assignee: Ari Rabkin
> Fix For: 0.3.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-260) unit conversions in Demux
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712321#action_12712321 ]
Jiaqi Tan commented on CHUKWA-260:
----------------------------------
Sure, I meant using the column headings' listed units to guide, perhaps, an if-else or switch to do the correct conversions for some degree of automation.
> unit conversions in Demux
> -------------------------
>
> Key: CHUKWA-260
> URL: https://issues.apache.org/jira/browse/CHUKWA-260
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.2.0
> Reporter: Ari Rabkin
> Fix For: 0.2.0
>
>
> There's some code in MetricsDataLoader for doing unit conversions. This should be cleaned up, moved to Demux, and documented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.