You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "XieXianshan (Created) (JIRA)" <ji...@apache.org> on 2011/11/02 03:20:32 UTC

[jira] [Created] (HADOOP-7795) add -n option for FSshell cat

add -n option for FSshell cat
-----------------------------

                 Key: HADOOP-7795
                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
    Affects Versions: 0.24.0
            Reporter: XieXianshan
            Assignee: XieXianshan
             Fix For: 0.24.0


Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7795) add -n option for FSshell cat

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HADOOP-7795:
----------------------------

    Affects Version/s:     (was: 0.24.0)
                       2.0.0-alpha
    
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 2.0.0-alpha
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7795) add -n option for FSshell cat

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461070#comment-13461070 ] 

Harsh J commented on HADOOP-7795:
---------------------------------

P.s. Please merge both the patch and test-case into one patch for trunk today, as thats supported to do now and makes more sense.
                
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.24.0
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7795) add -n option for FSshell cat

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193167#comment-13193167 ] 

Daryn Sharp commented on HADOOP-7795:
-------------------------------------

I think the option would be nice to have to more closely mimic *nix.  However I don't agree with modifying {{IOUtils}}.  {{-cat}} could do a line-by-line read from the stream itself and add line numbers.
                
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.24.0
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7795) add -n option for FSshell cat

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HADOOP-7795:
----------------------------

    Fix Version/s:     (was: 0.24.0)
    
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 2.0.0-alpha
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7795) add -n option for FSshell cat

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461069#comment-13461069 ] 

Harsh J commented on HADOOP-7795:
---------------------------------

Daryn - OK.

Xie - Would you get a chance soon to address Daryn's comments?
                
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.24.0
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7795) add -n option for FSshell cat

Posted by "Harsh J (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190617#comment-13190617 ] 

Harsh J commented on HADOOP-7795:
---------------------------------

Xie,

Have you ever needed this? How often have you come across data files on HDFS that you needed to get line number references of?

Given other tools out there already do this and -cat output can interface with them (well maybe a little inefficient but don't think it'd even matter), I'd not want to rebuild the whole of coreutils' cat featureset inside Hadoop.

I'm inclined to close this as won't fix unless I hear strong reasons on why we ought to be building this in.
                
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.24.0
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7795) add -n option for FSshell cat

Posted by "XieXianshan (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

XieXianshan updated HADOOP-7795:
--------------------------------

    Attachment: HADOOP-7795.patch
    
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.24.0
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7795) add -n option for FSshell cat

Posted by "Harsh J (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153458#comment-13153458 ] 

Harsh J commented on HADOOP-7795:
---------------------------------

I wonder if we really need this. Given the type of data mostly stored on HDFS, how useful is it to provide an internal ability to print line numbers?

It could be done, perhaps a small bit sub-optimally, by external programs using the output of fs-shell's -cat today.
                
> add -n option for FSshell cat
> -----------------------------
>
>                 Key: HADOOP-7795
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7795
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.24.0
>            Reporter: XieXianshan
>            Assignee: XieXianshan
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-7795.patch
>
>
> Add -n option for cat to display the files with line numbers.It's quite useful if you're reading big files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira