You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/09/04 11:09:00 UTC
[jira] [Commented] (NUTCH-2639) java.lang.UnsatisfiedLinkError:
org.apache.hadoop.io.nativeio.NativeIO$Windows.access0
[ https://issues.apache.org/jira/browse/NUTCH-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602912#comment-16602912 ]
ASF GitHub Bot commented on NUTCH-2639:
---------------------------------------
rustyx opened a new pull request #378: Fix for NUTCH-2639 contributed by rustyx
URL: https://github.com/apache/nutch/pull/378
This fixes the issue [NUTCH-2639](https://issues.apache.org/jira/browse/NUTCH-2639).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0
> --------------------------------------------------------------------------------------
>
> Key: NUTCH-2639
> URL: https://issues.apache.org/jira/browse/NUTCH-2639
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Windows 10 x64 Cygwin
> Reporter: Rustam Abdullaev
> Priority: Major
>
> It is impossible to run nutch under Cygwin, even when hadoop.dll is properly available in the PATH.
> The issue is two-fold:
> 1. JAVA_PLATFORM detects as "{{Windows_NT-amd64-64\r}}" (notice the trailing \r)
> 2. A non-existent directory {{lib/native/Windows_NT-amd64-64\r}} is being set as {{java.library.path}}, making Java ignore the system PATH when looking for hadoop.dll.
>
> As a result, the following exception is thrown on any Gora backend access:
> {noformat}
> java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
> at org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)
> at org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:570)
> at org.apache.hadoop.fs.FileUtil.canRead(FileUtil.java:977)
> at org.apache.hadoop.util.DiskChecker.checkAccessByFileMethods(DiskChecker.java:173)
> at org.apache.hadoop.util.DiskChecker.checkDirAccess(DiskChecker.java:160)
> at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:94)
> at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:285)
> at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:344)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
> at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:131)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)
> at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
> at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:115)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:249)
> at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:270)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:293)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:302)
> {noformat}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)