You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by forbbs forbbs <bb...@gmail.com> on 2010/03/07 11:40:23 UTC
I got java crash error when writing SequenceFile
*I just ran a simple program, and got the error below:*
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGFPE (0x8) at pc=0x00000030bda07927, pid=22891, tid=1076017504
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode
linux-amd64 )
# Problematic frame:
# C [ld-linux-x86-64.so.2+0x7927]
#
# An error report file with more information is saved as:
# /home1/wwp/amy/SDB/hs_err_pid22891.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Aborted
*The code is CreatePartition.java:*
import java.io.IOException;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.io.SequenceFile.Writer;
import org.apache.hadoop.io.SequenceFile;
public class CreatePartition
{
public static void main(String args[]) throws IOException
{
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(conf);
SequenceFile.Writer wr = SequenceFile.createWriter(fs, conf, new
Path("_sortPartitioning"), IntWritable.class, IntWritable.class);
IntWritable k = new IntWritable(123);
IntWritable v = new IntWritable(123);
wr.append(k, v);
wr.close();
}
}
*
*
*
*
*
--------------- S Y S T E M ---------------
OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 6)
uname:Linux 2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:56:44 EST 2007 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 73728, NOFILE 1024, AS infinity
load average:0.08 0.08 0.04
CPU:total 4 (2 cores per cpu, 1 threads per core) family 15 model 33
stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext
Memory: 4k page, physical 8162896k(1127340k free), swap 16386292k(16386052k
free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64 JRE
(1.6.0_18-b07), built on Dec 17 2009 13:42:22 by "java_re" with gcc 3.2.2
(SuSE Linux)
*
*
*
*Hadoop 0.19.2*
*
*
*The error log /home1/wwp/amy/SDB/hs_err_pid22891.log is attached with this
mail. *
RE: I got java crash error when writing SequenceFile
Posted by Zheng Shao <zs...@facebook.com>.
We had a similar problem and it turns out that hadoop native library built on CentOS 5 cannot run reliably on Fedora Core 4.
You might want to recompile the hadoop native library.
Zheng
________________________________
From: forbbs forbbs [bbsexclusive@gmail.com]
Sent: Sunday, March 07, 2010 6:13 PM
To: general@hadoop.apache.org
Subject: I got java crash error when writing SequenceFile
I just ran a simple program, and got the error below:
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGFPE (0x8) at pc=0x00000030bda07927, pid=22891, tid=1076017504
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode linux-amd64 )
# Problematic frame:
# C [ld-linux-x86-64.so.2+0x7927]
#
# An error report file with more information is saved as:
# /home1/wwp/amy/SDB/hs_err_pid22891.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Aborted
The code is CreatePartition.java:
import java.io.IOException;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.io.SequenceFile.Writer;
import org.apache.hadoop.io.SequenceFile;
public class CreatePartition
{
public static void main(String args[]) throws IOException
{
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(conf);
SequenceFile.Writer wr = SequenceFile.createWriter(fs, conf, new Path("_sortPartitioning"), IntWritable.class, IntWritable.class);
IntWritable k = new IntWritable(123);
IntWritable v = new IntWritable(123);
wr.append(k, v);
wr.close();
}
}
--------------- S Y S T E M ---------------
OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 6)
uname:Linux 2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:56:44 EST 2007 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 73728, NOFILE 1024, AS infinity
load average:0.08 0.08 0.04
CPU:total 4 (2 cores per cpu, 1 threads per core) family 15 model 33 stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext
Memory: 4k page, physical 8162896k(1127340k free), swap 16386292k(16386052k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64 JRE (1.6.0_18-b07), built on Dec 17 2009 13:42:22 by "java_re" with gcc 3.2.2 (SuSE Linux)
Hadoop 0.19.2
The error log /home1/wwp/amy/SDB/hs_err_pid22891.log is attached with this mail.
I got java crash error when writing SequenceFile
Posted by forbbs forbbs <bb...@gmail.com>.
*I just ran a simple program, and got the error below:*
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGFPE (0x8) at pc=0x00000030bda07927, pid=22891, tid=1076017504
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode
linux-amd64 )
# Problematic frame:
# C [ld-linux-x86-64.so.2+0x7927]
#
# An error report file with more information is saved as:
# /home1/wwp/amy/SDB/hs_err_pid22891.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Aborted
*The code is CreatePartition.java:*
import java.io.IOException;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.io.SequenceFile.Writer;
import org.apache.hadoop.io.SequenceFile;
public class CreatePartition
{
public static void main(String args[]) throws IOException
{
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(conf);
SequenceFile.Writer wr = SequenceFile.createWriter(fs, conf, new
Path("_sortPartitioning"), IntWritable.class, IntWritable.class);
IntWritable k = new IntWritable(123);
IntWritable v = new IntWritable(123);
wr.append(k, v);
wr.close();
}
}
*
*
*
*
*
--------------- S Y S T E M ---------------
OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 6)
uname:Linux 2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:56:44 EST 2007 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 73728, NOFILE 1024, AS infinity
load average:0.08 0.08 0.04
CPU:total 4 (2 cores per cpu, 1 threads per core) family 15 model 33
stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext
Memory: 4k page, physical 8162896k(1127340k free), swap 16386292k(16386052k
free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64 JRE
(1.6.0_18-b07), built on Dec 17 2009 13:42:22 by "java_re" with gcc 3.2.2
(SuSE Linux)
*
*
*
*Hadoop 0.19.2*
*
*
*The error log /home1/wwp/amy/SDB/hs_err_pid22891.log is attached with this
mail. *
Re: I got java crash error when writing SequenceFile
Posted by Steve Loughran <st...@apache.org>.
forbbs forbbs wrote:
> *I just ran a simple program, and got the error below:*
>
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGFPE (0x8) at pc=0x00000030bda07927, pid=22891, tid=1076017504
> #
> # JRE version: 6.0_18-b07
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode
> linux-amd64 )
> # Problematic frame:
> # C [ld-linux-x86-64.so.2+0x7927]
> #
> # An error report file with more information is saved as:
> # /home1/wwp/amy/SDB/hs_err_pid22891.log
> #
> # If you would like to submit a bug report, please visit:
> # http://java.sun.com/webapps/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
1. file the bug as sun ask
2. roll back to the 6u15 JVM, it appears to be better than the .18 release