You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Vinay Kumar Thota (JIRA)" <ji...@apache.org> on 2010/09/17 07:59:35 UTC

[jira] Created: (MAPREDUCE-2078) TraceBuilder unable to generate the traces while giving the job history path by globing.

TraceBuilder unable to generate the traces while giving the job history path by globing.
----------------------------------------------------------------------------------------

                 Key: MAPREDUCE-2078
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2078
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tools/rumen
            Reporter: Vinay Kumar Thota
            Assignee: Amar Kamat


I was trying to generate the traces for MR job histories by using TraceBuilder. However, it's unable to generate the traces while giving the job history path by globing. It throws a file not found exception even though the job history path is exists.

I have provide the job history path in the below way.

hdfs://<<clustername>>/dir1/dir2/dir3/*/*/*/*/*/*/

Exception:

java.io.FileNotFoundException: File does not exist:
hdfs://<<clustername>>/dir1/dir2/dir3/*/*/*/*/*/*
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:525)
        at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.<init>(TraceBuilder.java:88)
        at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:183)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:121)

It's truncating the last  slash in the path.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (MAPREDUCE-2078) TraceBuilder unable to generate the traces while giving the job history path by globing.

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sriramadasu resolved MAPREDUCE-2078.
------------------------------------------------

     Hadoop Flags: [Reviewed]
    Fix Version/s: 0.22.0
       Resolution: Fixed

I just committed this. Thanks Amar !

> TraceBuilder unable to generate the traces while giving the job history path by globing.
> ----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2078
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2078
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>            Reporter: Vinay Kumar Thota
>            Assignee: Amar Kamat
>             Fix For: 0.22.0
>
>         Attachments: mapreduce-2078-v1.2.patch, mapreduce-2078-v1.5.patch
>
>
> I was trying to generate the traces for MR job histories by using TraceBuilder. However, it's unable to generate the traces while giving the job history path by globing. It throws a file not found exception even though the job history path is exists.
> I have provide the job history path in the below way.
> hdfs://<<clustername>>/dir1/dir2/dir3/*/*/*/*/*/*/
> Exception:
> java.io.FileNotFoundException: File does not exist:
> hdfs://<<clustername>>/dir1/dir2/dir3/*/*/*/*/*/*
>         at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:525)
>         at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.<init>(TraceBuilder.java:88)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:183)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:121)
> It's truncating the last  slash in the path.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.