You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by "Vincent,Wei" <we...@gmail.com> on 2014/06/18 17:19:37 UTC
libhdfs result in JVM crash issue
Hi Hadoopers
I am using libhdfs in some C/C++ application, but I found some issues may
result in JVM crash .My platform is Ubuntu 12.04 64bit, JDK is 1.7.0
I found that in some simple applications in my platform libhdfs can work
well, but in some complex application when I use
hdfsFile writeFile = hdfsOpenFile(g_hdfs_fs, path_name, O_WRONLY|O_CREAT,
0, 0, 0);
it have return the wrong hdfsfile handle writeFile such as
:0xffffffff9008cc20,
when I try to call the hdfsWrite
s32_Bytes = hdfsWrite(g_hdfs_fs,writeFile ,buf,(tSize)dw_bytes); it will
crash ....
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x0000000000497fbf, pid=23566, tid=139811686958848
#
# JRE version: Java(TM) SE Runtime Environment (7.0_51-b13) (build
1.7.0_51-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode
linux-amd64 compressed oops)
# Problematic frame:
# C [rpc+0x97fbf] umount@@GLIBC_2.2.5+0x97fbf
#
# Core dump written. Default location: /opt/bin/core or core.23566
#
# If you would like to submit a bug report, please visit:
# http://bugreport.sun.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x00007f2790001000): JavaThread "Thread-3"
[_thread_in_native, id=23568, stack(0x00007f2871e03000,0x00007f2871efd000)]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
si_addr=0xffffffff9008cc28
Registers:
RAX=0x00007f27900011e8, RBX=0x00007f27900011e8, RCX=0x0000000000001000,
RDX=0x00007f2871ef7000
RSP=0x00007f2871eb5420, RBP=0x0000000000001000, RSI=0xffffffff9008cc20,
RDI=0x0000000001a6e380
R8 =0x00007f2871f1703f, R9 =0x0000000000000002, R10=0x00007f2871eb51d0,
R11=0x0000000000000202
R12=0xffffffff9008cc20, R13=0x00007f2871efc9c0, R14=0x00007f2871ef7000,
R15=0x0000000000000003
RIP=0x0000000000497fbf, EFLAGS=0x0000000000010282,
CSGSFS=0x0000000000000033, ERR=0x0000000000000005
TRAPNO=0x000000000000000e
I have use the GDB to check it ,of course 0xffffffff9008cc20 can not be
access by my application.., but it is return by hdfsopen api
Is there any other guy hav meet the same issue ? Thansk .Attachment is the
crash log .
--
BR,
Vincent.Wei
Re: libhdfs result in JVM crash issue
Posted by "Vincent,Wei" <we...@gmail.com>.
BTW, my hadoop is 2.2.0
2014-06-18 23:19 GMT+08:00 Vincent,Wei <we...@gmail.com>:
>
> Hi Hadoopers
>
> I am using libhdfs in some C/C++ application, but I found some issues may
> result in JVM crash .My platform is Ubuntu 12.04 64bit, JDK is 1.7.0
>
> I found that in some simple applications in my platform libhdfs can work
> well, but in some complex application when I use
> hdfsFile writeFile = hdfsOpenFile(g_hdfs_fs, path_name,
> O_WRONLY|O_CREAT, 0, 0, 0);
> it have return the wrong hdfsfile handle writeFile such as
> :0xffffffff9008cc20,
> when I try to call the hdfsWrite
> s32_Bytes = hdfsWrite(g_hdfs_fs,writeFile ,buf,(tSize)dw_bytes); it will
> crash ....
>
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x0000000000497fbf, pid=23566, tid=139811686958848
> #
> # JRE version: Java(TM) SE Runtime Environment (7.0_51-b13) (build
> 1.7.0_51-b13)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode
> linux-amd64 compressed oops)
> # Problematic frame:
> # C [rpc+0x97fbf] umount@@GLIBC_2.2.5+0x97fbf
> #
> # Core dump written. Default location: /opt/bin/core or core.23566
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.sun.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> --------------- T H R E A D ---------------
> Current thread (0x00007f2790001000): JavaThread "Thread-3"
> [_thread_in_native, id=23568, stack(0x00007f2871e03000,0x00007f2871efd000)]
> siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
> si_addr=0xffffffff9008cc28
> Registers:
> RAX=0x00007f27900011e8, RBX=0x00007f27900011e8, RCX=0x0000000000001000,
> RDX=0x00007f2871ef7000
> RSP=0x00007f2871eb5420, RBP=0x0000000000001000, RSI=0xffffffff9008cc20,
> RDI=0x0000000001a6e380
> R8 =0x00007f2871f1703f, R9 =0x0000000000000002, R10=0x00007f2871eb51d0,
> R11=0x0000000000000202
> R12=0xffffffff9008cc20, R13=0x00007f2871efc9c0, R14=0x00007f2871ef7000,
> R15=0x0000000000000003
> RIP=0x0000000000497fbf, EFLAGS=0x0000000000010282,
> CSGSFS=0x0000000000000033, ERR=0x0000000000000005
> TRAPNO=0x000000000000000e
>
> I have use the GDB to check it ,of course 0xffffffff9008cc20 can not be
> access by my application.., but it is return by hdfsopen api
>
> Is there any other guy hav meet the same issue ? Thansk .Attachment is the
> crash log .
> --
> BR,
>
> Vincent.Wei
>
--
BR,
Vincent.Wei
Re: libhdfs result in JVM crash issue
Posted by "Vincent,Wei" <we...@gmail.com>.
BTW, my hadoop is 2.2.0
2014-06-18 23:19 GMT+08:00 Vincent,Wei <we...@gmail.com>:
>
> Hi Hadoopers
>
> I am using libhdfs in some C/C++ application, but I found some issues may
> result in JVM crash .My platform is Ubuntu 12.04 64bit, JDK is 1.7.0
>
> I found that in some simple applications in my platform libhdfs can work
> well, but in some complex application when I use
> hdfsFile writeFile = hdfsOpenFile(g_hdfs_fs, path_name,
> O_WRONLY|O_CREAT, 0, 0, 0);
> it have return the wrong hdfsfile handle writeFile such as
> :0xffffffff9008cc20,
> when I try to call the hdfsWrite
> s32_Bytes = hdfsWrite(g_hdfs_fs,writeFile ,buf,(tSize)dw_bytes); it will
> crash ....
>
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x0000000000497fbf, pid=23566, tid=139811686958848
> #
> # JRE version: Java(TM) SE Runtime Environment (7.0_51-b13) (build
> 1.7.0_51-b13)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode
> linux-amd64 compressed oops)
> # Problematic frame:
> # C [rpc+0x97fbf] umount@@GLIBC_2.2.5+0x97fbf
> #
> # Core dump written. Default location: /opt/bin/core or core.23566
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.sun.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> --------------- T H R E A D ---------------
> Current thread (0x00007f2790001000): JavaThread "Thread-3"
> [_thread_in_native, id=23568, stack(0x00007f2871e03000,0x00007f2871efd000)]
> siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
> si_addr=0xffffffff9008cc28
> Registers:
> RAX=0x00007f27900011e8, RBX=0x00007f27900011e8, RCX=0x0000000000001000,
> RDX=0x00007f2871ef7000
> RSP=0x00007f2871eb5420, RBP=0x0000000000001000, RSI=0xffffffff9008cc20,
> RDI=0x0000000001a6e380
> R8 =0x00007f2871f1703f, R9 =0x0000000000000002, R10=0x00007f2871eb51d0,
> R11=0x0000000000000202
> R12=0xffffffff9008cc20, R13=0x00007f2871efc9c0, R14=0x00007f2871ef7000,
> R15=0x0000000000000003
> RIP=0x0000000000497fbf, EFLAGS=0x0000000000010282,
> CSGSFS=0x0000000000000033, ERR=0x0000000000000005
> TRAPNO=0x000000000000000e
>
> I have use the GDB to check it ,of course 0xffffffff9008cc20 can not be
> access by my application.., but it is return by hdfsopen api
>
> Is there any other guy hav meet the same issue ? Thansk .Attachment is the
> crash log .
> --
> BR,
>
> Vincent.Wei
>
--
BR,
Vincent.Wei
Re: libhdfs result in JVM crash issue
Posted by "Vincent,Wei" <we...@gmail.com>.
BTW, my hadoop is 2.2.0
2014-06-18 23:19 GMT+08:00 Vincent,Wei <we...@gmail.com>:
>
> Hi Hadoopers
>
> I am using libhdfs in some C/C++ application, but I found some issues may
> result in JVM crash .My platform is Ubuntu 12.04 64bit, JDK is 1.7.0
>
> I found that in some simple applications in my platform libhdfs can work
> well, but in some complex application when I use
> hdfsFile writeFile = hdfsOpenFile(g_hdfs_fs, path_name,
> O_WRONLY|O_CREAT, 0, 0, 0);
> it have return the wrong hdfsfile handle writeFile such as
> :0xffffffff9008cc20,
> when I try to call the hdfsWrite
> s32_Bytes = hdfsWrite(g_hdfs_fs,writeFile ,buf,(tSize)dw_bytes); it will
> crash ....
>
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x0000000000497fbf, pid=23566, tid=139811686958848
> #
> # JRE version: Java(TM) SE Runtime Environment (7.0_51-b13) (build
> 1.7.0_51-b13)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode
> linux-amd64 compressed oops)
> # Problematic frame:
> # C [rpc+0x97fbf] umount@@GLIBC_2.2.5+0x97fbf
> #
> # Core dump written. Default location: /opt/bin/core or core.23566
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.sun.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> --------------- T H R E A D ---------------
> Current thread (0x00007f2790001000): JavaThread "Thread-3"
> [_thread_in_native, id=23568, stack(0x00007f2871e03000,0x00007f2871efd000)]
> siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
> si_addr=0xffffffff9008cc28
> Registers:
> RAX=0x00007f27900011e8, RBX=0x00007f27900011e8, RCX=0x0000000000001000,
> RDX=0x00007f2871ef7000
> RSP=0x00007f2871eb5420, RBP=0x0000000000001000, RSI=0xffffffff9008cc20,
> RDI=0x0000000001a6e380
> R8 =0x00007f2871f1703f, R9 =0x0000000000000002, R10=0x00007f2871eb51d0,
> R11=0x0000000000000202
> R12=0xffffffff9008cc20, R13=0x00007f2871efc9c0, R14=0x00007f2871ef7000,
> R15=0x0000000000000003
> RIP=0x0000000000497fbf, EFLAGS=0x0000000000010282,
> CSGSFS=0x0000000000000033, ERR=0x0000000000000005
> TRAPNO=0x000000000000000e
>
> I have use the GDB to check it ,of course 0xffffffff9008cc20 can not be
> access by my application.., but it is return by hdfsopen api
>
> Is there any other guy hav meet the same issue ? Thansk .Attachment is the
> crash log .
> --
> BR,
>
> Vincent.Wei
>
--
BR,
Vincent.Wei
Re: libhdfs result in JVM crash issue
Posted by "Vincent,Wei" <we...@gmail.com>.
BTW, my hadoop is 2.2.0
2014-06-18 23:19 GMT+08:00 Vincent,Wei <we...@gmail.com>:
>
> Hi Hadoopers
>
> I am using libhdfs in some C/C++ application, but I found some issues may
> result in JVM crash .My platform is Ubuntu 12.04 64bit, JDK is 1.7.0
>
> I found that in some simple applications in my platform libhdfs can work
> well, but in some complex application when I use
> hdfsFile writeFile = hdfsOpenFile(g_hdfs_fs, path_name,
> O_WRONLY|O_CREAT, 0, 0, 0);
> it have return the wrong hdfsfile handle writeFile such as
> :0xffffffff9008cc20,
> when I try to call the hdfsWrite
> s32_Bytes = hdfsWrite(g_hdfs_fs,writeFile ,buf,(tSize)dw_bytes); it will
> crash ....
>
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x0000000000497fbf, pid=23566, tid=139811686958848
> #
> # JRE version: Java(TM) SE Runtime Environment (7.0_51-b13) (build
> 1.7.0_51-b13)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode
> linux-amd64 compressed oops)
> # Problematic frame:
> # C [rpc+0x97fbf] umount@@GLIBC_2.2.5+0x97fbf
> #
> # Core dump written. Default location: /opt/bin/core or core.23566
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.sun.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> --------------- T H R E A D ---------------
> Current thread (0x00007f2790001000): JavaThread "Thread-3"
> [_thread_in_native, id=23568, stack(0x00007f2871e03000,0x00007f2871efd000)]
> siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
> si_addr=0xffffffff9008cc28
> Registers:
> RAX=0x00007f27900011e8, RBX=0x00007f27900011e8, RCX=0x0000000000001000,
> RDX=0x00007f2871ef7000
> RSP=0x00007f2871eb5420, RBP=0x0000000000001000, RSI=0xffffffff9008cc20,
> RDI=0x0000000001a6e380
> R8 =0x00007f2871f1703f, R9 =0x0000000000000002, R10=0x00007f2871eb51d0,
> R11=0x0000000000000202
> R12=0xffffffff9008cc20, R13=0x00007f2871efc9c0, R14=0x00007f2871ef7000,
> R15=0x0000000000000003
> RIP=0x0000000000497fbf, EFLAGS=0x0000000000010282,
> CSGSFS=0x0000000000000033, ERR=0x0000000000000005
> TRAPNO=0x000000000000000e
>
> I have use the GDB to check it ,of course 0xffffffff9008cc20 can not be
> access by my application.., but it is return by hdfsopen api
>
> Is there any other guy hav meet the same issue ? Thansk .Attachment is the
> crash log .
> --
> BR,
>
> Vincent.Wei
>
--
BR,
Vincent.Wei