You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Egor Chernodarov <eg...@zarinsk.com> on 2005/08/30 11:01:51 UTC
Re: NDFS troubles
Hello, Jay!
I have such troubles as you with ndfs. I can to create directories,
bat can't put any file to ndfs. ;-/
I wonder if you finally got the answer for it?
Thank you. I would be very appreciate it if you answer me this email.
Thursday, July 7, 2005, 11:06:47 PM, you wrote:
Jay Pound> ok I'm running suse 9.3 on 3 computers, a amd
Jay Pound> athlon 64 3500+ the x86_64
Jay Pound> edition of course, and on a pentium 4 3.0ghz
Jay Pound> suse x86, and a athlon 1900+
Jay Pound> x86 version. I am trying to setup ndfs across
Jay Pound> all the nodes, the athlon
Jay Pound> 1900+ is the namenode and a datanode, the
Jay Pound> athlon 64 and pentium 4 are
Jay Pound> datanodes, I ssh from my amd64 to the namenode
Jay Pound> and start the namenode first,
Jay Pound> then I start a datanode on it in another ssh
Jay Pound> shell, then I startup the amd64
Jay Pound> and pentium 4 as datanodes, they all connect and I can run the basic
Jay Pound> commands mkdir ls rm report du, but when I do a "put" which is also
Jay Pound> copyFromLocal moveFromLocal. here is the stuff
Jay Pound> i did on my a64 testing it:
Jay Pound> 64bit:/ # cd nutch/
Jay Pound> 64bit:/nutch # cd nutch-nightly/
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -report
Jay Pound> Error: JAVA_HOME is not set.
Jay Pound> 64bit:/nutch/nutch-nightly # export JAVA_HOME="/usr"
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -report
Jay Pound> 050707 040223 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040223 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040223 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040223 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> Total raw bytes: 137920811008 (128.44 Gb)
Jay Pound> Used raw bytes: 22408891270 (20.86 Gb)
Jay Pound> % used: 16.24%
Jay Pound> Total effective bytes: 0 (0.0 k)
Jay Pound> Effective replication multiplier: Infinity
Jay Pound> -------------------------------------------------
Jay Pound> Datanodes available: 2
Jay Pound> Name: 64bit:7000
Jay Pound> Total raw bytes: 78955618304 (73.53 Gb)
Jay Pound> Used raw bytes: 12090358170 (11.26 Gb)
Jay Pound> % used: 15.31%
Jay Pound> Last contact with namenode: Thu Jul 07 03:11:15 MDT 2005
Jay Pound> Name: linux:7000
Jay Pound> Total raw bytes: 58965192704 (54.91 Gb)
Jay Pound> Used raw bytes: 10318533100 (9.60 Gb)
Jay Pound> % used: 17.49%
Jay Pound> Last contact with namenode: Thu Jul 07 03:11:14 MDT 2005
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -report\
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -report
Jay Pound> 050707 040243 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040243 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040243 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040243 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> Total raw bytes: 254930059264 (237.42 Gb)
Jay Pound> Used raw bytes: 32569607947 (30.33 Gb)
Jay Pound> % used: 12.77%
Jay Pound> Total effective bytes: 0 (0.0 k)
Jay Pound> Effective replication multiplier: Infinity
Jay Pound> -------------------------------------------------
Jay Pound> Datanodes available: 3
Jay Pound> Name: 64bit:7000
Jay Pound> Total raw bytes: 78955618304 (73.53 Gb)
Jay Pound> Used raw bytes: 12090358170 (11.26 Gb)
Jay Pound> % used: 15.31%
Jay Pound> Last contact with namenode: Thu Jul 07 03:11:36 MDT 2005
Jay Pound> Name: linux:7000
Jay Pound> Total raw bytes: 58965192704 (54.91 Gb)
Jay Pound> Used raw bytes: 10318533100 (9.60 Gb)
Jay Pound> % used: 17.49%
Jay Pound> Last contact with namenode: Thu Jul 07 03:11:35 MDT 2005
Jay Pound> Name: mikes:7000
Jay Pound> Total raw bytes: 117009248256 (108.97 Gb)
Jay Pound> Used raw bytes: 10160716677 (9.46 Gb)
Jay Pound> % used: 8.68%
Jay Pound> Last contact with namenode: Thu Jul 07 03:11:36 MDT 2005
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -ls /
Jay Pound> 050707 040406 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040406 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040406 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040406 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> Found 0 items
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -mkdir /content
Jay Pound> 050707 040413 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040413 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040414 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040414 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> -ls /
Jay Pound> 050707 040424 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040424 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040424 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040424 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> Found 1 items
Jay Pound> /content <dir>
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient -put
Jay Pound> con
Jay Pound> conf/ content.rdf.u8
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient -put
Jay Pound> content.rdf.u8 /content
Jay Pound> 050707 040504 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040504 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040504 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040504 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> Exception in thread "main" java.lang.NullPointerException
Jay Pound> at java.net.Socket.<init>(Socket.java:357)
Jay Pound> at java.net.Socket.<init>(Socket.java:207)
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.nextBlockOutputStream
Jay Pound> (NDFSClient.java:627)
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>
Jay Pound> (NDFSClient.java:597)
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:85)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.create(NDFSFileSystem.java:74)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.create(NDFSFileSystem.java:69)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile(NDFSFileSystem.java:181)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile
Jay Pound> (NDFSFileSystem.java:156)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.TestClient.copyFromLocal(TestClient.java:46)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.TestClient.main(TestClient.java:234)
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient -put
Jay Pound> content.rdf.u8 /content/content.rdf.u8
Jay Pound> 050707 040521 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040521 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040521 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040521 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> Exception in thread "main" java.io.IOException:
Jay Pound> Could not obtain new output
Jay Pound> block for file /content/content.rdf.u8
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient$NameNodeCaller.getNewOutputBlock
Jay Pound> (NDFSClient.java:921)
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.nextBlockOutputStream
Jay Pound> (NDFSClient.java:616)
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>
Jay Pound> (NDFSClient.java:597)
Jay Pound> at
Jay Pound> org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:85)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.create(NDFSFileSystem.java:74)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.create(NDFSFileSystem.java:69)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile(NDFSFileSystem.java:181)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile
Jay Pound> (NDFSFileSystem.java:156)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.TestClient.copyFromLocal(TestClient.java:46)
Jay Pound> at
Jay Pound> org.apache.nutch.fs.TestClient.main(TestClient.java:234)
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient -put
Jay Pound> content.rdf.u8 content.rdf.u8
Jay Pound> 050707 040534 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 040534 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 040534 No FS indicated, using default:10.0.0.222:9000
Jay Pound> 050707 040535 Client connection to
Jay Pound> 10.0.0.222:9000: starting
Jay Pound> 050707 040540 Waiting to find new output block node for 5007ms
Jay Pound> 050707 040541 Waiting to find new output block node for 5463ms
Jay Pound> 050707 040541 Waiting to find new output block node for 5918ms
Jay Pound> 050707 040542 Waiting to find new output block node for 6372ms
Jay Pound> 050707 040542 Waiting to find new output block node for 6827ms
Jay Pound> 050707 040543 Waiting to find new output block node for 7282ms
Jay Pound> 050707 040543 Waiting to find new output block node for 7737ms
Jay Pound> 050707 040544 Waiting to find new output block node for 8192ms
Jay Pound> 050707 040544 Waiting to find new output block node for 8647ms
Jay Pound> 050707 040545 Waiting to find new output block node for 9102ms
Jay Pound> 050707 040545 Waiting to find new output block node for 9557ms
Jay Pound> 050707 040545 Waiting to find new output block node for 10012ms
Jay Pound> 050707 040546 Waiting to find new output block node for 10467ms
Jay Pound> 050707 040546 Waiting to find new output block node for 10922ms
Jay Pound> 050707 040547 Waiting to find new output block node for 11377ms
Jay Pound> 050707 040547 Waiting to find new output block node for 11832ms
Jay Pound> 050707 040548 Waiting to find new output block node for 12287ms
Jay Pound> 050707 040548 Waiting to find new output block node for 12741ms
Jay Pound> 050707 040549 Waiting to find new output block node for 13196ms
Jay Pound> 050707 040549 Waiting to find new output block node for 13651ms
Jay Pound> 050707 040550 Waiting to find new output block node for 14108ms
Jay Pound> 050707 040550 Waiting to find new output block node for 14563ms
Jay Pound> 050707 040550 Waiting to find new output block node for 15018ms
Jay Pound> 050707 040551 Waiting to find new output block node for 15473ms
Jay Pound> 64bit:/nutch/nutch-nightly # ./bin/nutch
Jay Pound> org.apache.nutch.fs.TestClient
Jay Pound> Usage: java NDFSClient [-local | -ndfs
Jay Pound> <namenode:port>] [-ls <path>] [-du
Jay Pound> <path>] [-mv <src> <dst>] [-cp <src> <dst>]
Jay Pound> [-rm <src>] [-put <localsrc>
Jay Pound> <dst>] [-copyFromLocal <localsrc> <dst>]
Jay Pound> [-moveFromLocal <localsrc> <dst>]
Jay Pound> [-get <src> <localdst>] [-copyToLocal <src>
Jay Pound> <localdst>] [-moveToLocal <src>
Jay Pound> <localdst>] [-mkdir <path>] [-report]
Jay Pound> 64bit:/nutch/nutch-nightly #
Jay Pound> here is what the namenode said while my a64 was doing those commands
Jay Pound> linux:~ # cd /
Jay Pound> linux:/ # cd tmp/
Jay Pound> linux:/tmp # cd nutch/
Jay Pound> linux:/tmp/nutch # cd ndfs/
Jay Pound> linux:/tmp/nutch/ndfs # ls
Jay Pound> . .. data name
Jay Pound> linux:/tmp/nutch/ndfs # cd name
Jay Pound> linux:/tmp/nutch/ndfs/name # ls
Jay Pound> . .. edits image
Jay Pound> linux:/tmp/nutch/ndfs/name # del edits
Jay Pound> -bash: del: command not found
Jay Pound> linux:/tmp/nutch/ndfs/name # rm edits
Jay Pound> linux:/tmp/nutch/ndfs/name # ls
Jay Pound> . .. image
Jay Pound> linux:/tmp/nutch/ndfs/name # rm image
Jay Pound> rm: cannot remove `image': Is a directory
Jay Pound> linux:/tmp/nutch/ndfs/name # rd image/
Jay Pound> rmdir: `image/': Directory not empty
Jay Pound> linux:/tmp/nutch/ndfs/name # cd image/
Jay Pound> linux:/tmp/nutch/ndfs/name/image # ls
Jay Pound> . .. fsimage
Jay Pound> linux:/tmp/nutch/ndfs/name/image # rm fsimage
Jay Pound> linux:/tmp/nutch/ndfs/name/image # cd ..
Jay Pound> linux:/tmp/nutch/ndfs/name # rd image/
Jay Pound> linux:/tmp/nutch/ndfs/name # ls
Jay Pound> . ..
Jay Pound> linux:/tmp/nutch/ndfs/name # cd /
Jay Pound> linux:/ # cd nutch/
Jay Pound> linux:/nutch # cd nutch-nightly/
Jay Pound> linux:/nutch/nutch-nightly # ./bin/nutch namenode
Jay Pound> 050707 030736 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-default.xml
Jay Pound> 050707 030736 parsing
Jay Pound> file:/nutch/nutch-nightly/conf/nutch-site.xml
Jay Pound> 050707 030736 Server listener on port 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030736 Server handler on 9000: starting
Jay Pound> 050707 030759 Server connection on port 9000
Jay Pound> from 10.0.0.222: starting
Jay Pound> 050707 030943 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031004 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031015 Lost heartbeat for 64bit:7000
Jay Pound> 050707 031018 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031116 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031117 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031124 Server connection on port 9000
Jay Pound> from 10.0.0.112: starting
Jay Pound> 050707 031136 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031137 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031259 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031259 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031307 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031307 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031317 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031317 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031357 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031357 New lease, holder NDFSClient_-1418582750
Jay Pound> 050707 031400 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031414 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031414 Removing lease [Lease. Holder: NDFSClient_-1418582750,
Jay Pound> heldlocks: 0, pendingcreates: 0], leases remaining: 1
Jay Pound> 050707 031416 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031427 Server connection on port 9000
Jay Pound> from 10.0.0.69: starting
Jay Pound> 050707 031427 New lease, holder NDFSClient_1090559415
Jay Pound> 050707 031428 Renewed lease [Lease. Holder: NDFSClient_1090559415,
Jay Pound> heldlocks: 0, pendingcreates: 1]
Jay Pound> 050707 031428 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031428 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031428 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031428 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031429 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031429 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031429 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031429 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031429 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031429 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031429 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031429 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031430 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031430 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031430 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031430 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031430 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031430 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031430 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031430 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031431 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031431 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031431 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031431 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031431 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031431 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031431 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031431 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031432 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031432 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031432 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031432 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031432 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031432 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031432 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031432 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031433 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031433 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031433 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031433 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031433 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031433 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031433 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031433 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031433 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031433 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031433 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031433 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031434 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031434 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031434 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031434 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031434 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031434 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031434 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031434 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031435 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031435 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031435 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031435 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031435 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031435 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031435 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031435 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031436 Renewed lease [Lease. Holder: NDFSClient_1090559415,
Jay Pound> heldlocks: 0, pendingcreates: 1]
Jay Pound> 050707 031436 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031436 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031436 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031436 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031436 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031436 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031436 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031436 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031437 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031437 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031437 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031437 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031437 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031437 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031437 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031437 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031438 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031438 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031438 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031438 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031438 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031438 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031438 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031438 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031438 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031438 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031438 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031438 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031439 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031439 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031439 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031439 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031439 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031439 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031439 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031439 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031440 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031440 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031440 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031440 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031440 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031440 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031440 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031440 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031441 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031441 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031441 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031441 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031441 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031441 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031441 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031441 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031442 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031442 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031442 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031442 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031442 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031442 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031442 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031442 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031443 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031443 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031443 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031443 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031443 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031443 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031443 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031443 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031443 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031443 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031443 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031443 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031444 Renewed lease [Lease. Holder: NDFSClient_1090559415,
Jay Pound> heldlocks: 0, pendingcreates: 1]
Jay Pound> 050707 031444 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031444 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031444 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031444 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031444 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031444 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031444 File progress failure for
Jay Pound> /user/root/content.rdf.u8
Jay Pound> 050707 031444 Problem with block
Jay Pound> blk_-686619750383293943, with 0 nodes
Jay Pound> reporting in.
Jay Pound> 050707 031444 Server connection on port 9000 from 10.0.0.69: exiting
Jay Pound> 050707 031500 Removing lease [Lease. Holder: NDFSClient_1090559415,
Jay Pound> heldlocks: 0, pendingcreates: 0], leases remaining: 1
Jay Pound> any ideas??? also before I ran it this time I
Jay Pound> trashed all the data and
Jay Pound> folders out of my /tmp/nutch/ndfs/data and name directories!!!
Jay Pound> Does anyone also know what the limitations of
Jay Pound> ndfs are, max size and max
Jay Pound> datanodes etc...
Jay Pound> thanks for your help
Jay Pound> -Jay Pound
--
Best regards,
Chernodarov Egor
egor@zarinsk.com
http://zarinsk.com