You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Daniel Udatny (JIRA)" <ji...@apache.org> on 2008/04/17 15:47:21 UTC

[jira] Created: (HADOOP-3267) Counters value of reduce input records do not match map output records

Counters value of  reduce input records do not match map output records
-----------------------------------------------------------------------

                 Key: HADOOP-3267
                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
         Environment: RHEL5, sun java version "1.6.0_04"

            Reporter: Daniel Udatny


Counters value of  reduce input records do not match map output records under certain circumstances. 
somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Status: Patch Available  (was: Open)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment:     (was: WrongCounterValues-TestandPatch.txt)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch-02.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12645879#action_12645879 ] 

Jean-Daniel Cryans commented on HADOOP-3267:
--------------------------------------------

We just had the same problem using 0.18.1 where some counters would return double their value in a unit test. I tried the first part of the patch and it fixed the problem. I was about to refresh it so that it applies to trunk and I ran the test without the fix but it didn't fail as expected. I then tried branch 0.19 with our test and we didn't see the problem so it seem to be fixed for versions > 0.18.

I suggest closing this issue.

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>            Assignee: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment: WrongCounterValues-TestandPatch-02.txt

code changed to force test run locally

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch-02.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12590236#action_12590236 ] 

Hadoop QA commented on HADOOP-3267:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12380436/WrongCounterValues-TestandPatch-02.txt
against trunk revision 645773.

    @author +1.  The patch does not contain any @author tags.

    tests included +1.  The patch appears to include 3 new or modified tests.

    javadoc +1.  The javadoc tool did not generate any warning messages.

    javac +1.  The applied patch does not generate any new javac compiler warnings.

    release audit +1.  The applied patch does not generate any new release audit warnings.

    findbugs +1.  The patch does not introduce any new Findbugs warnings.

    core tests +1.  The patch passed core unit tests.

    contrib tests +1.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2269/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2269/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2269/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2269/console

This message is automatically generated.

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12590059#action_12590059 ] 

Hadoop QA commented on HADOOP-3267:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12380394/patch-TestCounterValues.txt
against trunk revision 645773.

    @author +1.  The patch does not contain any @author tags.

    tests included +1.  The patch appears to include 3 new or modified tests.

    javadoc +1.  The javadoc tool did not generate any warning messages.

    javac +1.  The applied patch does not generate any new javac compiler warnings.

    release audit +1.  The applied patch does not generate any new release audit warnings.

    findbugs +1.  The patch does not introduce any new Findbugs warnings.

    core tests +1.  The patch passed core unit tests.

    contrib tests +1.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2264/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2264/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2264/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2264/console

This message is automatically generated.

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: site
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>             Fix For: site
>
>         Attachments: patch-TestCounterValues.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment: patch-TestCounterValues.txt

a test case to reproduce the bug. the test is running over 100 iterations and should show up within this time.
it is not reproducable straight forward.


> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment:     (was: WrongCounterValues-TestandPatch-02.txt)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Status: Open  (was: Patch Available)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch-02.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny resolved HADOOP-3267.
-----------------------------------

    Resolution: Fixed

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Reopened: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny reopened HADOOP-3267:
-----------------------------------


> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Status: Open  (was: Patch Available)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12590181#action_12590181 ] 

Hadoop QA commented on HADOOP-3267:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12380403/WrongCounterValues-TestandPatch.txt
against trunk revision 645773.

    @author +1.  The patch does not contain any @author tags.

    tests included +1.  The patch appears to include 3 new or modified tests.

    patch -1.  The patch command could not apply the patch.

Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2267/console

This message is automatically generated.

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12590744#action_12590744 ] 

Hadoop QA commented on HADOOP-3267:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12380449/WrongCounterValues-TestandPatch-03.txt
against trunk revision 645773.

    @author +1.  The patch does not contain any @author tags.

    tests included +1.  The patch appears to include 3 new or modified tests.

    patch -1.  The patch command could not apply the patch.

Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2274/console

This message is automatically generated.

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-3267:
----------------------------------

    Assignee: Daniel Udatny
      Status: Open  (was: Patch Available)

Can you please reformat it to follow the Hadoop code conventions. (Sun's http://java.sun.com/docs/codeconv/ but with 2 spaces indentation instead of 4.)

Can you also give a description of the problem that you fixed?

Thanks!

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>            Assignee: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Status: Patch Available  (was: Open)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch-02.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment:     (was: patch-TestCounterValues.txt)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

        Fix Version/s: site
    Affects Version/s: site
         Release Note: - fixed wrong Counters Output in LocalJobRunner
               Status: Patch Available  (was: Open)

the patch containing a TestCase and a possible fix.

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: site
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>             Fix For: site
>
>         Attachments: patch-TestCounterValues.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

        Fix Version/s:     (was: site)
    Affects Version/s:     (was: site)
               Status: In Progress  (was: Patch Available)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment: WrongCounterValues-TestandPatch-03.txt

test and patch

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: WrongCounterValues-TestandPatch-03.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Status: Patch Available  (was: Reopened)

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-3267) Counters value of reduce input records do not match map output records

Posted by "Daniel Udatny (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Udatny updated HADOOP-3267:
----------------------------------

    Attachment: WrongCounterValues-TestandPatch.txt

> Counters value of  reduce input records do not match map output records
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-3267
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3267
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: site
>         Environment: RHEL5, sun java version "1.6.0_04"
>            Reporter: Daniel Udatny
>             Fix For: site
>
>         Attachments: patch-TestCounterValues.txt, WrongCounterValues-TestandPatch.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Counters value of  reduce input records do not match map output records under certain circumstances. 
> somehow reproducable

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.