You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Ralf (JIRA)" <ji...@apache.org> on 2018/06/06 13:46:00 UTC
[jira] [Comment Edited] (NUTCH-2512) Nutch does not build under
JDK9
[ https://issues.apache.org/jira/browse/NUTCH-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503269#comment-16503269 ]
Ralf edited comment on NUTCH-2512 at 6/6/18 1:45 PM:
-----------------------------------------------------
I just compiled master/trunk on a VM-Box with Ubuntu Bionic and Oracle Java 10.1 - It trows a couple of warnings, but compiles and I have it doing a small crawl right now and so far so good. Nutch now no longer takes the Solr url from the commandline, this should be reflected in the tutorials and docs by the time 1.15 gets released. (I still can't compile Nutch with Tika 1.18 on my Java 8 set-up, it works when I revert to Tika 1.17, I wonder what could be wrong with my Java set-up)...
Correction - actually it doesn't index to Solr and fails with:
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://192.168.178.20:8983/solr/#/nutch: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 405 HTTP method POST is not supported by this URL</title>
</head>
<body><h2>HTTP ERROR 405</h2>
<p>Problem accessing /solr/index.html. Reason:
<pre> HTTP method POST is not supported by this URL</pre></p>
</body>
</html>
was (Author: bl4ck1c3):
I just compiled master/trunk on a VM-Box with Ubuntu Bionic and Oracle Java 10.1 - It trows a couple of warnings, but compiles and I have it doing a small crawl right now and so far so good. Nutch now no longer takes the Solr url from the commandline, this should be reflected in the tutorials and docs by the time 1.15 gets released. (I still can't compile Nutch with Tika 1.18 on my Java 8 set-up, it works when I revert to Tika 1.17, I wonder what could be wrong with my Java set-up)
> Nutch does not build under JDK9
> -------------------------------
>
> Key: NUTCH-2512
> URL: https://issues.apache.org/jira/browse/NUTCH-2512
> Project: Nutch
> Issue Type: Bug
> Components: build, injector
> Affects Versions: 1.14
> Environment: Ubuntu 16.04 (All patches up to 02/20/2018)
> Oracle Java 9 - Oracle JDK 9 (Latest as off 02/22/2018)
> Reporter: Ralf
> Priority: Major
> Fix For: 1.15
>
>
> Nutch 1.14 (Source) does not compile properly under JDK 9
> Nutch 1.14 (Binary) does not function under Java 9
>
> When trying to Nuild Nutch, Ant complains about missing Sonar files then exits with:
> "BUILD FAILED
> /home/nutch/nutch/build.xml:79: Unparseable date: "01/25/1971 2:00 pm" "
>
> Once having commented out the "offending code" the Build finishes but the resulting Binary fails to function (as well as the Apache Compiled Binary distribution), Both exit with:
>
> Injecting seed URLs
> /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/
> Injector: starting at 2018-02-21 02:02:16
> Injector: crawlDb: searchcrawl/crawldb
> Injector: urlDir: urls
> Injector: Converting injected urls to crawl db entries.
> WARNING: An illegal reflective access operation has occurred
> WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/home/nutch/nutch2/lib/hadoop-auth-2.7.4.jar) to method sun.security.krb5.Config.getInstance()
> WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
> WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
> WARNING: All illegal access operations will be denied in a future release
> Injector: java.lang.NullPointerException
> at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getBlockIndex(FileInputFormat.java:444)
> at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:413)
> at org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat.getSplits(DelegatingInputFormat.java:115)
> at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
> at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
> at org.apache.nutch.crawl.Injector.inject(Injector.java:417)
> at org.apache.nutch.crawl.Injector.run(Injector.java:563)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.nutch.crawl.Injector.main(Injector.java:528)
>
> Error running:
> /home/nutch/nutch2/bin/nutch inject searchcrawl//crawldb urls/
> Failed with exit value 255.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)