You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Gummadi (Created) (JIRA)" <ji...@apache.org> on 2011/10/10 12:14:29 UTC

[jira] [Created] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Rumen TraceBuilder is skipping analyzing 0.20 history files
-----------------------------------------------------------

                 Key: MAPREDUCE-3157
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tools/rumen
    Affects Versions: 0.23.0
            Reporter: Ravi Gummadi
            Assignee: Ravi Gummadi
             Fix For: 0.23.0


Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125739#comment-13125739 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1081 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1081/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.

ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182293
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravi Gummadi updated MAPREDUCE-3157:
------------------------------------

    Status: Patch Available  (was: Open)
    
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140254#comment-13140254 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #112 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/112/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. (Ravi Gummadi via amarrk)

amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195538
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravi Gummadi updated MAPREDUCE-3157:
------------------------------------

      Resolution: Fixed
    Release Note: Fixes TraceBuilder to handle 0.20 history file names also.
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

I just committed this to trunk.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125731#comment-13125731 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1061 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1061/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.

ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182293
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140286#comment-13140286 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #121 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/121/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. (Ravi Gummadi via amarrk)

amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195538
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140383#comment-13140383 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #57 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/57/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. (Ravi Gummadi via amarrk)

amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195538
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125822#comment-13125822 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #858 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/858/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.

ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182293
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125655#comment-13125655 ] 

Ravi Gummadi commented on MAPREDUCE-3157:
-----------------------------------------

Unit tests of Rumen and Gridmix passed on my local machine except TestCompressionEmulationUtils which is a known issue without this patch also.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125756#comment-13125756 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #828 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/828/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.

ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182293
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140248#comment-13140248 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #112 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/112/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. (Ravi Gummadi via amarrk)

amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195538
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140244#comment-13140244 ] 

Amar Kamat commented on MAPREDUCE-3157:
---------------------------------------

Committed this patch to branch-0.23 too.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124128#comment-13124128 ] 

Hadoop QA commented on MAPREDUCE-3157:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12498427/MR3157.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/977//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/977//console

This message is automatically generated.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140264#comment-13140264 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-3157:
----------------------------------------------------

bq. Committed this patch to branch-0.23 too.
Thanks Amar!
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravi Gummadi updated MAPREDUCE-3157:
------------------------------------

    Attachment: MR3157.patch

Attaching patch fixing the issue by adding 2 regular expressions for Pre21 history file name formats and 2 regular expressions for Pre21 history conf file name formats. Also did some refactoring of code. Updated TestRumenJobTraces to check all the 3 history file name formats and the 3 history conf file name formats.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124694#comment-13124694 ] 

Amar Kamat commented on MAPREDUCE-3157:
---------------------------------------

Ravi,
Instead of parsing the current job-history files using JobHistory.CONF_FILENAME_REGEX or JobHistory.JOBHISTORY_FILENAME_REGEX, should we use the JobHistory's filename parsing APIs like getJobIDFromHistoryFilePath()?
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125725#comment-13125725 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1139 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1139/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.

ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182293
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124695#comment-13124695 ] 

Amar Kamat commented on MAPREDUCE-3157:
---------------------------------------

Other than my previous comment, the patch looks good to me.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140672#comment-13140672 ] 

Hudson commented on MAPREDUCE-3157:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #58 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/58/])
    MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. (Ravi Gummadi via amarrk)

amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195538
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/rumen/TestRumenJobTraces.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobHistoryUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/TraceBuilder.java

                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3157) Rumen TraceBuilder is skipping analyzing 0.20 history files

Posted by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124738#comment-13124738 ] 

Ravi Gummadi commented on MAPREDUCE-3157:
-----------------------------------------

Created a separate JIRA MAPREDUCE-3166 for that.
                
> Rumen TraceBuilder is skipping analyzing 0.20 history files
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-3157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3157
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.23.0
>
>         Attachments: MR3157.patch
>
>
> Rumen TraceBuilder is assuming the Pre21 history file name format to be JTIdentifier_jobId_<something>. But it can be jobId_<something> also as it is now in latest 0.20.x version. This also needs to be understood by TraceBuilder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira