You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Mike Smith <mi...@gmail.com> on 2006/02/28 01:15:01 UTC

copyFromLocal Exception!

When I try to copy a local crawled data from the local file system into DFS
I get this exception after a while (copying 500MB of data)

Exception in thread "main" java.io.IOException: Target
c81/crawldb/current/part-00000/.data.crc already exists
        at org.apache.hadoop.dfs.DistributedFileSystem.doFromLocalFile(
DistributedFileSystem.java:137)
        at org.apache.hadoop.dfs.DistributedFileSystem.doFromLocalFile(
DistributedFileSystem.java:150)
        at org.apache.hadoop.dfs.DistributedFileSystem.doFromLocalFile(
DistributedFileSystem.java:150)
        at org.apache.hadoop.dfs.DistributedFileSystem.doFromLocalFile(
DistributedFileSystem.java:150)
        at org.apache.hadoop.dfs.DistributedFileSystem.doFromLocalFile(
DistributedFileSystem.java:150)
        at org.apache.hadoop.dfs.DistributedFileSystem.copyFromLocalFile(
DistributedFileSystem.java:131)
        at org.apache.hadoop.dfs.DFSShell.copyFromLocal(DFSShell.java:42)
        at org.apache.hadoop.dfs.DFSShell.main(DFSShell.java:250)

Thanks, Mike