[jira] Updated: (HADOOP-6284) Any hadoop commands crashing jvm (SIGBUS) when /tmp (tmpfs) is full

["Koji Noguchi (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-6284:
---------------------------------

    Attachment: hadoop-6284-patch-v1.txt

It's a silly patch but introduces a new env HADOOP_JAVA_PLATFORM_OPTS .

With this, no option set.
{noformat}
[knoguchi@ ~]$ df /tmp
Filesystem           1K-blocks      Used Available Use% Mounted on
tmpfs                   524288    524288         0 100% /tmp

[knoguchi@ ~]$ hadoop dfs -ls /
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGBUS (0x7) at pc=0x00824077, pid=12811, tid=4160617360
#
# Java VM: Java HotSpot(TM) Server VM (10.0-b22 mixed mode linux-x86)
# Problematic frame:
# C  [libc.so.6+0x6e077]  memset+0x37
#
# An error report file with more information is saved as:
# /homes/knoguchi/hs_err_pid12811.log
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#
Abort
{noformat}

Setting HADOOP_CLIENT_OPTS

{noformat}
[knoguchi@ ~]$ setenv HADOOP_CLIENT_OPTS '-XX:-UsePerfData'
[knoguchi@ ~]$ $HADOOP_HOME/bin/hadoop dfs -ls /
Exception in thread "main" java.lang.NoClassDefFoundError: #_An_unexpected_error_has_been_detected_by_Java_Runtime_Environment:
Caused by: java.lang.ClassNotFoundException: #_An_unexpected_error_has_been_detected_by_Java_Runtime_Environment:
        at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:276)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)

{noformat}

This is because hadoop is executing 
java -Xmx1000m -Djava.library.path=/.../hadoop/bin/../lib/native/# #_An_unexpected_error_has_been_detected_by_Java_Runtime_Environment: #

(basically JAVA_PLATFORM became a long error message)

and then 
{noformat}
[knoguchi@ ~]$ setenv HADOOP_JAVA_PLATFORM_OPTS '-XX:-UsePerfData'
[knoguchi@ ~]$ $HADOOP_HOME/bin/hadoop dfs -ls /   
Found 10 items
drwx------   - ...
{noformat}

works.

I'm reluctant to put -XX:-UsePerfData directly in hadoop script since I don't know when java stops supporting this option.

> Any hadoop commands crashing jvm (SIGBUS)  when /tmp (tmpfs) is full
> --------------------------------------------------------------------
>
>                 Key: HADOOP-6284
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6284
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: scripts
>            Reporter: Koji Noguchi
>            Priority: Minor
>         Attachments: hadoop-6284-patch-v1.txt
>
>
> {noformat}
> [knoguchi@ ~]$ df /tmp
> Filesystem           1K-blocks      Used Available Use% Mounted on
> tmpfs                   524288    524288         0 100% /tmp
> [knoguchi@ ~]$ hadoop dfs -ls 
> #
> # An unexpected error has been detected by Java Runtime Environment:
> #
> #  SIGBUS (0x7) at pc=0x00824077, pid=19185, tid=4160617360
> #
> # Java VM: Java HotSpot(TM) Server VM (10.0-b22 mixed mode linux-x86)
> # Problematic frame:
> # C  [libc.so.6+0x6e077]  memset+0x37
> #
> # An error report file with more information is saved as:
> # /homes/knoguchi/hs_err_pid19185.log
> #
> # If you would like to submit a bug report, please visit:
> #   http://java.sun.com/webapps/bugreport/crash.jsp
> #
> Aborted
> [knoguchi@ ~]$ 
> {noformat}
> This does not happen when /tmp is not in tmpfs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.