You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2012/09/21 20:33:09 UTC
[jira] [Created] (PIG-2926) TestPoissonSampleLoader failing on rhel
environment
Koji Noguchi created PIG-2926:
---------------------------------
Summary: TestPoissonSampleLoader failing on rhel environment
Key: PIG-2926
URL: https://issues.apache.org/jira/browse/PIG-2926
Project: Pig
Issue Type: Bug
Reporter: Koji Noguchi
Priority: Minor
Testing on rhel environment, TestPoissonSampleLoader fails with
{noformat}
Testcase: testNumSamples took 22.077 sec
FAILED
expected:<47> but was:<42>
junit.framework.AssertionFailedError: expected:<47> but was:<42>
at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
{noformat}
>From
{noformat}
124 count = testNumSamples("0.0001", "100");
125 assertEquals(count, 42);
{noformat}
This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2926) TestPoissonSampleLoader failing on
rhel environment
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460700#comment-13460700 ]
Koji Noguchi commented on PIG-2926:
-----------------------------------
> On my mac, maxMemory() returns 1037959168 whereas on my rhel environemt, it returns 954466304.
>
Correction: mac: 1069416448 rhel: 954466304
One difference between the two,
on my mac somehow UseConcMarkSweepGC is enabled as default and on rhel it is not. If I add
{noformat}
<jvmarg line="-XX:+UseConcMarkSweepGC"/>
{noformat}
inside the build.xml, then this test passes. But the return value of Runtime.getRuntime().maxMemory() is still a bit different (1060372480).
Is there a better way to test this method without going through this system call?
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Priority: Minor
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2926) TestPoissonSampleLoader failing on rhel
environment
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-2926:
----------------------------------
Assignee: Jonathan Coveney
Status: Patch Available (was: Open)
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Sub-task
> Reporter: Koji Noguchi
> Assignee: Jonathan Coveney
> Priority: Minor
> Attachments: PIG-2926-0.patch
>
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2926) TestPoissonSampleLoader failing on
rhel environment
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460691#comment-13460691 ]
Koji Noguchi commented on PIG-2926:
-----------------------------------
I have no understanding of how this loader works, but the difference is coming at
{noformat}
106 long availRedMem = (long) (Runtime.getRuntime().maxMemory() * heapPerc);
{noformat}
Inside build.xml, test is set up to use -Xmx1024m, however
On my mac, maxMemory() returns 1037959168 whereas on my rhel environemt, it returns 954466304.
Hardcoding this value in the code would make the test pass.
On my macbook.
$ java -version
java version "1.6.0_33"
Java(TM) SE Runtime Environment (build 1.6.0_33-b03-424-10M3720)
Java HotSpot(TM) 64-Bit Server VM (build 20.8-b03-424, mixed mode)
On rhel node.
> java -version
java version "1.6.0_33"
Java(TM) SE Runtime Environment (build 1.6.0_33-b03)
Java HotSpot(TM) Server VM (build 20.8-b03, mixed mode)
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Priority: Minor
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2926) TestPoissonSampleLoader failing on rhel
environment
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-2926:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.11
Status: Resolved (was: Patch Available)
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Sub-task
> Reporter: Koji Noguchi
> Assignee: Jonathan Coveney
> Priority: Minor
> Fix For: 0.11
>
> Attachments: PIG-2926-0.patch
>
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2926) TestPoissonSampleLoader failing on rhel
environment
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-2926:
-------------------------------
Issue Type: Sub-task (was: Bug)
Parent: PIG-2972
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Sub-task
> Reporter: Koji Noguchi
> Priority: Minor
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2926) TestPoissonSampleLoader failing on rhel
environment
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-2926:
----------------------------------
Attachment: PIG-2926-0.patch
I agree with Koji that this should be turned off in the short term. It's not really testing anything meaningful b/c of the platform dependency.
Here is a patch that simply removes it.
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Sub-task
> Reporter: Koji Noguchi
> Priority: Minor
> Attachments: PIG-2926-0.patch
>
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2926) TestPoissonSampleLoader failing on
rhel environment
Posted by "Gianmarco De Francisci Morales (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13479262#comment-13479262 ]
Gianmarco De Francisci Morales commented on PIG-2926:
-----------------------------------------------------
+1
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Sub-task
> Reporter: Koji Noguchi
> Assignee: Jonathan Coveney
> Priority: Minor
> Attachments: PIG-2926-0.patch
>
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2926) TestPoissonSampleLoader failing on
rhel environment
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13476144#comment-13476144 ]
Koji Noguchi commented on PIG-2926:
-----------------------------------
Can I take this test away since the result changes depending on the jvm environment?
124 count = testNumSamples("0.0001", "100");
125 assertEquals(count, 42);
> TestPoissonSampleLoader failing on rhel environment
> ---------------------------------------------------
>
> Key: PIG-2926
> URL: https://issues.apache.org/jira/browse/PIG-2926
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Priority: Minor
>
> Testing on rhel environment, TestPoissonSampleLoader fails with
> {noformat}
> Testcase: testNumSamples took 22.077 sec
> FAILED
> expected:<47> but was:<42>
> junit.framework.AssertionFailedError: expected:<47> but was:<42>
> at org.apache.pig.test.TestPoissonSampleLoader.testNumSamples(TestPoissonSampleLoader.java:125)
> {noformat}
> From
> {noformat}
> 124 count = testNumSamples("0.0001", "100");
> 125 assertEquals(count, 42);
> {noformat}
> This runs fine on my mac environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira