You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Anton Potehin <an...@orbita1.ru> on 2005/11/24 16:04:19 UTC
problem with ndfs
When we start namenode and datenode on one host and then try get file from ndfs from another host we get error:
Exception in thread "main" java.lang.NullPointerException
at java.net.Socket.<init>(Socket.java:301)
at java.net.Socket.<init>(Socket.java:153)
at org.apache.nutch.ndfs.NDFSClient$NDFSInputStream.blockSeekTo(NDFSClient.java:339)
at org.apache.nutch.ndfs.NDFSClient$NDFSInputStream.read(NDFSClient.java:429)
at org.apache.nutch.fs.NFSDataInputStream$PositionCache.read(NFSDataInputStream.java:152)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
at java.io.DataInputStream.readFully(DataInputStream.java:266)
at java.io.DataInputStream.readFully(DataInputStream.java:242)
at org.apache.nutch.fs.NFSDataInputStream$Checker.<init>(NFSDataInputStream.java:53)
at org.apache.nutch.fs.NFSDataInputStream.<init>(NFSDataInputStream.java:217)
at org.apache.nutch.fs.NutchFileSystem.open(NutchFileSystem.java:143)
at org.apache.nutch.fs.NutchFileSystem.open(NutchFileSystem.java:132)
at org.apache.nutch.fs.NDFSFileSystem.copyToLocalFile(NDFSFileSystem.java:216)
at org.apache.nutch.fs.NDFSFileSystem.copyToLocalFile(NDFSFileSystem.java:212)
at org.apache.nutch.fs.TestClient.copyToLocal(TestClient.java:61)
at org.apache.nutch.fs.TestClient.main(TestClient.java:238)
If we get file from first host everything is fine.
How work out this problem ?
We try use jdk 1.4. and jdk1.5 results the same.
Re: problem with ndfs
Posted by Stefan Groschupf <sg...@media-style.com>.
Sounds like a problem with the hostnames of your datanodes.
Check that your are able to ping all the datanodes with the hostnames
they had send to the namenode.
check:
bin/nutch ndfs -report to see the hostnames.
Stefan
Am 24.11.2005 um 16:04 schrieb Anton Potehin:
> When we start namenode and datenode on one host and then try get
> file from ndfs from another host we get error:
>
>
>
> Exception in thread "main" java.lang.NullPointerException
>
> at java.net.Socket.<init>(Socket.java:301)
>
> at java.net.Socket.<init>(Socket.java:153)
>
> at org.apache.nutch.ndfs.NDFSClient
> $NDFSInputStream.blockSeekTo(NDFSClient.java:339)
>
> at org.apache.nutch.ndfs.NDFSClient$NDFSInputStream.read
> (NDFSClient.java:429)
>
> at org.apache.nutch.fs.NFSDataInputStream$PositionCache.read
> (NFSDataInputStream.java:152)
>
> at java.io.BufferedInputStream.fill
> (BufferedInputStream.java:183)
>
> at java.io.BufferedInputStream.read1
> (BufferedInputStream.java:222)
>
> at java.io.BufferedInputStream.read
> (BufferedInputStream.java:277)
>
> at java.io.DataInputStream.readFully(DataInputStream.java:266)
>
> at java.io.DataInputStream.readFully(DataInputStream.java:242)
>
> at org.apache.nutch.fs.NFSDataInputStream$Checker.<init>
> (NFSDataInputStream.java:53)
>
> at org.apache.nutch.fs.NFSDataInputStream.<init>
> (NFSDataInputStream.java:217)
>
> at org.apache.nutch.fs.NutchFileSystem.open
> (NutchFileSystem.java:143)
>
> at org.apache.nutch.fs.NutchFileSystem.open
> (NutchFileSystem.java:132)
>
> at org.apache.nutch.fs.NDFSFileSystem.copyToLocalFile
> (NDFSFileSystem.java:216)
>
> at org.apache.nutch.fs.NDFSFileSystem.copyToLocalFile
> (NDFSFileSystem.java:212)
>
> at org.apache.nutch.fs.TestClient.copyToLocal
> (TestClient.java:61)
>
> at org.apache.nutch.fs.TestClient.main(TestClient.java:238)
>
>
>
> If we get file from first host everything is fine.
>
>
>
> How work out this problem ?
>
>
>
> We try use jdk 1.4. and jdk1.5 results the same.
>