You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2012/10/14 02:44:03 UTC

[jira] [Updated] (PIG-2966) Piggybank test failures in trunk: TestLookupInFiles, TestDBStorage, and TestMultiStorage

     [ https://issues.apache.org/jira/browse/PIG-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cheolsoo Park updated PIG-2966:
-------------------------------

    Attachment: PIG-2966.patch

This is a platform-specific issue. In CentOS 6, any tests that use MiniCluster may fail with the following error if MALLOC_ARENA_MAX is not set. (Please see MAPREDUCE-3933.)

{code}
2012-10-12 18:19:24,262 INFO  [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:transition(659)) - Application application_1350091136828_0001 failed 1 times due to AM Container for appattempt_1350091136828_0001_000001 exited with  exitCode: 143 due to: Container [pid=25526,containerID=container_1350091136828_0001_01_000001] is running beyond virtual memory limits. Current usage: 177.0mb of 1.5gb physical memory used; 3.4gb of 3.1gb virtual memory used. Killing container.
{code}

Attached is a patch that sets MALLOC_ARENA_MAX to 4 in build.xml.

Please find more information regarding what this environment variable does [here|https://www.ibm.com/developerworks/mydeveloperworks/blogs/kevgrig/entry/linux_glibc_2_10_rhel_6_malloc_may_show_excessive_virtual_memory_usage?lang=en].
                
> Piggybank test failures in trunk: TestLookupInFiles, TestDBStorage, and TestMultiStorage
> ----------------------------------------------------------------------------------------
>
>                 Key: PIG-2966
>                 URL: https://issues.apache.org/jira/browse/PIG-2966
>             Project: Pig
>          Issue Type: Bug
>          Components: piggybank
>            Reporter: Cheolsoo Park
>            Assignee: Cheolsoo Park
>              Labels: test
>         Attachments: PIG-2966.patch
>
>
> To reproduce, please run:
> {code}
> ant clean compile-test jar-withouthadoop -Dhadoopversion=23
> cd contrib/piggybank/java
> ant clean test -Dhadoopversion=23
> {code}
> Three tests are failing:
> {code}
> [junit] Test org.apache.pig.piggybank.test.evaluation.string.TestLookupInFiles FAILED
> [junit] Test org.apache.pig.piggybank.test.storage.TestDBStorage FAILED
> [junit] Test org.apache.pig.piggybank.test.storage.TestMultiStorage FAILED
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira