You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by the olele <th...@hotmail.com> on 2011/04/16 00:31:20 UTC
terasort failing with java exception
I have hadoop/hbase/hive/zookeeper up and running. everything has passed basic testing and teragen has run without error.however, when I start up terasort I see the following (both directories exist, data is in in /user/terasort-input)
hadoop jar hadoop-0.20.1-dev-examples.jar terasort /user/terasort-input /user/terasort-output11/04/15 15:08:09 INFO terasort.TeraSort: starting11/04/15 15:08:09 INFO mapred.FileInputFormat: Total input paths to process : 2java.lang.IllegalArgumentException: Offset 2147483648 is outside of file (0..2147483647) at org.apache.hadoop.mapred.FileInputFormat.getBlockIndex(FileInputFormat.java:396) at org.apache.hadoop.mapred.FileInputFormat.getSplitHosts(FileInputFormat.java:552) at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:357) at org.apache.hadoop.examples.terasort.TeraInputFormat.getSplits(TeraInputFormat.java:209) at org.apache.hadoop.examples.terasort.TeraInputFormat.writePartitionFile(TeraInputFormat.java:116) at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:243) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:257) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.hadoop.util.RunJar.main(RunJar.java:156)