You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Florian Hartl <fl...@hartl.info> on 2012/05/16 22:34:42 UTC
problem - Failed to set permissions of path: \tmp\hadoop
Hi there,
whenever I try to crawl something, I get the error message below.
More info: The command "bin/nutch" triggers the desired return, so Nutch
should be installed correctly. I already tried to start the crawl via Cygwin
as well as via Eclipse. Building Nutch works successfully. I am using Nutch
1.4 and downloaded the newest version of Nutch 3 days ago, Windows 7.
I tried to debug the issue for roughly 2 days now.
The crawl command is: urls_test -dir test_crawl -depth 3 -topN 50 -solr
http://localhost:8983/solr/ -threads 100
Did anyone face the same problem already and solved it? How? J Any help
would be appreciated.
crawl started in: test_crawl
rootUrlDir = urls_test
threads = 100
depth = 3
solrUrl=http://localhost:8983/solr/
topN = 50
Injector: starting at 2012-05-16 21:59:22
Injector: crawlDb: test_crawl/crawldb
Injector: urlDir: urls_test
Injector: Converting injected urls to crawl db entries.
Exception in thread "main" java.io.IOException: Failed to set permissions of
path: \tmp\hadoop-.(my name here)\mapred\staging\(my name
here)1502171059\.staging to 0700
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.jav
a:509)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFi
les.java:116)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1083)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
at org.apache.nutch.crawl.Crawl.run(Crawl.java:127)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)
Re: problem - Failed to set permissions of path: \tmp\hadoop
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Florian,
http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/25837
On Wed, May 16, 2012 at 9:34 PM, Florian Hartl <fl...@hartl.info> wrote:
> Hi there,
>
>
>
> whenever I try to crawl something, I get the error message below.
>
> More info: The command "bin/nutch" triggers the desired return, so Nutch
> should be installed correctly. I already tried to start the crawl via Cygwin
> as well as via Eclipse. Building Nutch works successfully. I am using Nutch
> 1.4 and downloaded the newest version of Nutch 3 days ago, Windows 7.
>
> I tried to debug the issue for roughly 2 days now.
>
> The crawl command is: urls_test -dir test_crawl -depth 3 -topN 50 -solr
> http://localhost:8983/solr/ -threads 100
>
>
>
> Did anyone face the same problem already and solved it? How? J Any help
> would be appreciated.
>
>
>
>
>
>
>
> crawl started in: test_crawl
>
> rootUrlDir = urls_test
>
> threads = 100
>
> depth = 3
>
> solrUrl=http://localhost:8983/solr/
>
> topN = 50
>
> Injector: starting at 2012-05-16 21:59:22
>
> Injector: crawlDb: test_crawl/crawldb
>
> Injector: urlDir: urls_test
>
> Injector: Converting injected urls to crawl db entries.
>
> Exception in thread "main" java.io.IOException: Failed to set permissions of
> path: \tmp\hadoop-.(my name here)\mapred\staging\(my name
> here)1502171059\.staging to 0700
>
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
>
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
>
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.jav
> a:509)
>
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
>
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFi
> les.java:116)
>
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
>
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:415)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
> va:1083)
>
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
>
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
>
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
>
> at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
>
> at org.apache.nutch.crawl.Crawl.run(Crawl.java:127)
>
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>
> at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)
>
--
Lewis