You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Gummadi (Created) (JIRA)" <ji...@apache.org> on 2012/01/30 11:09:10 UTC
[jira] [Created] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
------------------------------------------------------------------------------------------------
Key: MAPREDUCE-3757
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: tools/rumen
Reporter: Ravi Gummadi
Assignee: Ravi Gummadi
Attachments: 3757.v0.patch
Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210227#comment-13210227 ]
Hudson commented on MAPREDUCE-3757:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #958 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/958/])
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. (Revision 1245303)
Result = SUCCESS
ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1245303
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/rumen.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/tools/data/rumen/small-trace-test/goldFoldedTrace.json.gz
* /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210015#comment-13210015 ]
Hudson commented on MAPREDUCE-3757:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1814/])
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. (Revision 1245303)
Result = SUCCESS
ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1245303
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/rumen.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/tools/data/rumen/small-trace-test/goldFoldedTrace.json.gz
* /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3757:
------------------------------------
Attachment: 3757.v1.1.patch
Attaching new patch by changing the file path of LoggedTaskAttempt.java as it is moved to a new folder.
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204365#comment-13204365 ]
Amar Kamat commented on MAPREDUCE-3757:
---------------------------------------
Looks good to me. +1
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210016#comment-13210016 ]
Hudson commented on MAPREDUCE-3757:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1740 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1740/])
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. (Revision 1245303)
Result = SUCCESS
ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1245303
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/rumen.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/tools/data/rumen/small-trace-test/goldFoldedTrace.json.gz
* /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3757:
------------------------------------
Attachment: (was: 3757.v1.patch)
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210023#comment-13210023 ]
Hudson commented on MAPREDUCE-3757:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1752 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1752/])
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. (Revision 1245303)
Result = FAILURE
ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1245303
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/rumen.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/tools/data/rumen/small-trace-test/goldFoldedTrace.json.gz
* /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3757:
------------------------------------
Release Note: Fixed the sortFinishTime and shuffleFinishTime adjustments in Rumen Folder.
Status: Patch Available (was: Open)
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3757:
------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209271#comment-13209271 ]
Amar Kamat commented on MAPREDUCE-3757:
---------------------------------------
Looks good to me. +1.
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210104#comment-13210104 ]
Ravi Gummadi commented on MAPREDUCE-3757:
-----------------------------------------
Committed the same patch to 0.23.1 also.
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210268#comment-13210268 ]
Hudson commented on MAPREDUCE-3757:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #993 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/993/])
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. (Revision 1245303)
Result = SUCCESS
ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1245303
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/rumen.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/tools/data/rumen/small-trace-test/goldFoldedTrace.json.gz
* /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3757) Rumen Folder is not adjusting
the shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210007#comment-13210007 ]
Ravi Gummadi commented on MAPREDUCE-3757:
-----------------------------------------
Once we bring back the Rumen unit tests, TestRumenFolder should pass based on this fix.
I just committed this patch to trunk.
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3757:
------------------------------------
Attachment: 3757.v0.patch
Attaching patch for trunk.
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3757) Rumen Folder is not adjusting the
shuffleFinished and sortFinished times of reduce task attempts
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3757:
------------------------------------
Attachment: 3757.v1.patch
3757.v1.patch
Attaching new patch with the gold trace expected in a Folder testcase modified to reflect this bug-fix.
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts
> ------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3757
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3757
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: 3757.v0.patch, 3757.v1.patch, 3757.v1.patch
>
>
> Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts when it is adjusting the attempt-start-time and attempt-finish-time. This is leading to wrong values which are greater than the attempt-finish-time in trace file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira