You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Florian Hartl <fl...@hartl.info> on 2012/05/16 22:34:42 UTC

problem - Failed to set permissions of path: \tmp\hadoop

Hi there,

 

whenever I try to crawl something, I get the error message below.

More info: The command "bin/nutch" triggers the desired return, so Nutch
should be installed correctly. I already tried to start the crawl via Cygwin
as well as via Eclipse. Building Nutch works successfully. I am using Nutch
1.4 and downloaded the newest version of Nutch 3 days ago, Windows 7.

I tried to debug the issue for roughly 2 days now.

The crawl command is: urls_test -dir test_crawl -depth 3 -topN 50 -solr
http://localhost:8983/solr/ -threads 100

 

Did anyone face the same problem already and solved it? How? J Any help
would be appreciated.

 

 

 

crawl started in: test_crawl

rootUrlDir = urls_test

threads = 100

depth = 3

solrUrl=http://localhost:8983/solr/

topN = 50

Injector: starting at 2012-05-16 21:59:22

Injector: crawlDb: test_crawl/crawldb

Injector: urlDir: urls_test

Injector: Converting injected urls to crawl db entries.

Exception in thread "main" java.io.IOException: Failed to set permissions of
path: \tmp\hadoop-.(my name here)\mapred\staging\(my name
here)1502171059\.staging to 0700

       at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)

       at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)

       at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.jav
a:509)

       at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)

       at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)

       at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFi
les.java:116)

       at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)

       at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)

       at java.security.AccessController.doPrivileged(Native Method)

       at javax.security.auth.Subject.doAs(Subject.java:415)

       at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1083)

       at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)

       at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)

       at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)

       at org.apache.nutch.crawl.Injector.inject(Injector.java:217)

       at org.apache.nutch.crawl.Crawl.run(Crawl.java:127)

       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

       at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)


Re: problem - Failed to set permissions of path: \tmp\hadoop

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Florian,

http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/25837

On Wed, May 16, 2012 at 9:34 PM, Florian Hartl <fl...@hartl.info> wrote:
> Hi there,
>
>
>
> whenever I try to crawl something, I get the error message below.
>
> More info: The command "bin/nutch" triggers the desired return, so Nutch
> should be installed correctly. I already tried to start the crawl via Cygwin
> as well as via Eclipse. Building Nutch works successfully. I am using Nutch
> 1.4 and downloaded the newest version of Nutch 3 days ago, Windows 7.
>
> I tried to debug the issue for roughly 2 days now.
>
> The crawl command is: urls_test -dir test_crawl -depth 3 -topN 50 -solr
> http://localhost:8983/solr/ -threads 100
>
>
>
> Did anyone face the same problem already and solved it? How? J Any help
> would be appreciated.
>
>
>
>
>
>
>
> crawl started in: test_crawl
>
> rootUrlDir = urls_test
>
> threads = 100
>
> depth = 3
>
> solrUrl=http://localhost:8983/solr/
>
> topN = 50
>
> Injector: starting at 2012-05-16 21:59:22
>
> Injector: crawlDb: test_crawl/crawldb
>
> Injector: urlDir: urls_test
>
> Injector: Converting injected urls to crawl db entries.
>
> Exception in thread "main" java.io.IOException: Failed to set permissions of
> path: \tmp\hadoop-.(my name here)\mapred\staging\(my name
> here)1502171059\.staging to 0700
>
>       at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
>
>       at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
>
>       at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.jav
> a:509)
>
>       at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>
>       at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
>
>       at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFi
> les.java:116)
>
>       at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
>
>       at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
>
>       at java.security.AccessController.doPrivileged(Native Method)
>
>       at javax.security.auth.Subject.doAs(Subject.java:415)
>
>       at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
> va:1083)
>
>       at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
>
>       at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
>
>       at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
>
>       at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
>
>       at org.apache.nutch.crawl.Crawl.run(Crawl.java:127)
>
>       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>
>       at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)
>



-- 
Lewis