You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2007/03/23 00:16:32 UTC

[jira] Created: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

streaming PipeMapRed prints system info to stderr
-------------------------------------------------

                 Key: HADOOP-1151
                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
             Project: Hadoop
          Issue Type: Bug
          Components: contrib/streaming
            Reporter: Koji Noguchi
         Assigned To: Koji Noguchi
            Priority: Trivial


In streaming, user task's stderr is filled with following output from the streaming infrastructure.

R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]

This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-1151:
---------------------------------

    Attachment: 1151.patch

forgot to click on the ASF.

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487060 ] 

Hadoop QA commented on HADOOP-1151:
-----------------------------------

+1, because http://issues.apache.org/jira/secure/attachment/12355024/1151.patch applied and successfully tested against trunk revision http://svn.apache.org/repos/asf/lucene/hadoop/trunk/525596. Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-1151:
---------------------------------

    Attachment:     (was: 1151.patch)

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-1151:
---------------------------------

    Attachment: 1151.patch

deleting one System.err.println line.

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HADOOP-1151:
------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I've just committed this. Thanks Koji!

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-1151:
---------------------------------

    Status: Patch Available  (was: Open)

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487222 ] 

Hadoop QA commented on HADOOP-1151:
-----------------------------------

Integrated in Hadoop-Nightly #49 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/49/)

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1151:
---------------------------------

    Fix Version/s: 0.13.0

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>             Fix For: 0.13.0
>
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1151) streaming PipeMapRed prints system info to stderr

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487059 ] 

Owen O'Malley commented on HADOOP-1151:
---------------------------------------

+1

> streaming PipeMapRed prints system info to stderr
> -------------------------------------------------
>
>                 Key: HADOOP-1151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Assigned To: Koji Noguchi
>            Priority: Trivial
>         Attachments: 1151.patch
>
>
> In streaming, user task's stderr is filled with following output from the streaming infrastructure.
> R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
> R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
> R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
> R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
> R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
> R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
> R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]
> This can hit the size limit and delete users' actual stderr messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.