You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2009/04/14 19:10:14 UTC
[jira] Created: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
------------------------------------------------------------------------------------
Key: CHUKWA-131
URL: https://issues.apache.org/jira/browse/CHUKWA-131
Project: Hadoop Chukwa
Issue Type: Improvement
Components: Data Processors
Environment: Redhat 5.1, Java 6
Reporter: Eric Yang
Priority: Blocker
The current metrics from map reduce job is missing the following important columns:
finished_maps
finished_reduces
failed_maps
failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this, thanks Cheng.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang reopened CHUKWA-131:
------------------------------
Missing task_type definition in MDL.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Attachment: CHUKWA-131.patch
Added MDL dictionary to collect finished_maps, finished_reduces, failed_maps, failed_reduces.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Priority: Blocker
> Attachments: CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12700639#action_12700639 ]
Mac Yang commented on CHUKWA-131:
---------------------------------
All fields should be loaded. Two that I'm not sure about are http_port and state_string.
Possible fields Map Reduce Fields:
FAILED_MAPS
FAILED_REDUCES
FINISHED_MAPS
FINISHED_REDUCES
FINISH_TIME
JOBCONF
JOBID
JOBNAME
JOB_PRIORITY
JOB_STATUS
LAUNCH_TIME
SUBMIT_TIME
TOTAL_MAPS
TOTAL_REDUCES
USER
Counter:FileSystemCounters:FILE_BYTES_READ
Counter:FileSystemCounters:FILE_BYTES_WRITTEN
Counter:FileSystemCounters:HDFS_BYTES_READ
Counter:FileSystemCounters:HDFS_BYTES_WRITTEN
Counter:org.apache.hadoop.mapred.JobInProgress$Counter:TOTAL_LAUNCHED_MAPS
Counter:org.apache.hadoop.mapred.JobInProgress$Counter:TOTAL_LAUNCHED_REDUCES
Counter:org.apache.hadoop.mapred.Task$Counter:COMBINE_INPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:COMBINE_OUTPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_INPUT_BYTES
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_INPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_OUTPUT_BYTES
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_OUTPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_INPUT_GROUPS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_INPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_OUTPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_SHUFFLE_BYTES
Counter:org.apache.hadoop.mapred.Task$Counter:SPILLED_RECORDS
Possible Task Fields:
Counter:FileSystemCounters:FILE_BYTES_WRITTEN
Counter:FileSystemCounters:HDFS_BYTES_READ
Counter:org.apache.hadoop.mapred.Task$Counter:COMBINE_INPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:COMBINE_OUTPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_INPUT_BYTES
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_INPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_OUTPUT_BYTES
Counter:org.apache.hadoop.mapred.Task$Counter:MAP_OUTPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_INPUT_GROUPS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_INPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_OUTPUT_RECORDS
Counter:org.apache.hadoop.mapred.Task$Counter:REDUCE_SHUFFLE_BYTES
Counter:org.apache.hadoop.mapred.Task$Counter:SPILLED_RECORDS
ERROR
FINISH_TIME
HOSTNAME
HTTP_PORT
JOBID
SHUFFLE_FINISHED
SORT_FINISHED
SPLITS
START_TIME
STATE_STRING
TASKID
TASK_ATTEMPT_ID
TASK_ATTEMPT_TIMES
TASK_STATUS
TASK_TYPE
TRACKER_NAME
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Attachment: CHUKWA-131-2.patch
Update MDL dictionary and database schema to match the new columns.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Attachment: CHUKWA-131-1.patch
MR Job Data:
finished_maps
finished_reduces
failed_maps
failed_reduces
total_maps
total_reduces
reduce_shuffle_bytes
MR Task Data:
type
reduce_shuffle_bytes
hostname
shuffle_finished
sort_finished
spilts
Collect those new metrics.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Fix Version/s: 0.1.2
Assignee: Eric Yang
Affects Version/s: 0.1.2
Status: Patch Available (was: Open)
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Status: Patch Available (was: Reopened)
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131-3.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this, thanks Cheng.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131-3.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716964#action_12716964 ]
Hudson commented on CHUKWA-131:
-------------------------------
Integrated in Chukwa-trunk #45 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/45/])
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131-3.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Attachment: CHUKWA-131-3.patch
Add the missing task_type field.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131-3.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701736#action_12701736 ]
Cheng commented on CHUKWA-131:
------------------------------
+1 good.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this, thanks Cheng.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12698940#action_12698940 ]
Cheng commented on CHUKWA-131:
------------------------------
+1 looks good.
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12702806#action_12702806 ]
Hudson commented on CHUKWA-131:
-------------------------------
Integrated in Chukwa-trunk #8 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/8/])
. Changed from using task id to task attempt id. (Eric Yang)
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131-3.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-131:
-----------------------------
Status: Patch Available (was: Reopened)
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Terence Kwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Terence Kwan reopened CHUKWA-131:
---------------------------------
finished_maps default 0,
finished_reduces default 0,
failed_maps default 0,
failed_reduces default 0,
need to be:
finished_maps bigint default 0,
finished_reduces bigint default 0,
failed_maps bigint default 0,
failed_reduces bigint default 0,
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-131) Collect finished_maps,
finished_reduces, failed_maps, failed_reduces in mr_job table
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12702238#action_12702238 ]
Cheng commented on CHUKWA-131:
------------------------------
+1 good
> Collect finished_maps, finished_reduces, failed_maps, failed_reduces in mr_job table
> ------------------------------------------------------------------------------------
>
> Key: CHUKWA-131
> URL: https://issues.apache.org/jira/browse/CHUKWA-131
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.1.2
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Blocker
> Fix For: 0.1.2
>
> Attachments: CHUKWA-131-1.patch, CHUKWA-131-2.patch, CHUKWA-131-3.patch, CHUKWA-131.patch
>
>
> The current metrics from map reduce job is missing the following important columns:
> finished_maps
> finished_reduces
> failed_maps
> failed_reduces
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.