You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Keren Ouaknine <ke...@gmail.com> on 2011/10/14 12:11:35 UTC
Error on generation of 10M rows
Hello,
I have been trying to generate 10M rows on 10 nodes and 4G of memory on
each.
Below my stdout and the last error prior shell disconnect (working through
vpn).
Job is successful! It took 2655 seconds.
Skimming users
2011-10-14 05:25:01,377 [main] INFO org.apache.pig.Main - Logging error
message
s to:
/mnt/disk1/home/kouaknine/hapache/pig/test/utils/pigmix/scripts/pig_131858
4301370.log
*Write failed: Software caused connection abort*
There is no log file to look into (pig_1318584301370.log non existent)
Looking into stdout of 1M rows, the next expected step should be:
2011-10-13 18:33:52,105 [main] INFO
org.apache.pig.backend.hadoop.executionengi
ne.HExecutionEngine - Connecting to hadoop file system at: hdfs://
10.239.24.12:5
4310
I cant connect to 54310, but my namenode is alive.
What do you reckon?
Thanks,
Keren
--
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com