You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2011/08/12 12:26:27 UTC
[jira] [Updated] (NUTCH-987) Support HTTP auth for Solr
communication
[ https://issues.apache.org/jira/browse/NUTCH-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney updated NUTCH-987:
---------------------------------------
Attachment: NUTCH-987-2.0-2.patch
Hi Markus, the patch for 2.0 does not apply cleanly for me I get the following output
{code}
lewis@lewis-01:~/ASF/trunk$ patch -p0 -i NUTCH-987-2.0-1.patch
patching file src/java/org/apache/nutch/indexer/solr/SolrUtils.java
patching file src/java/org/apache/nutch/indexer/solr/SolrDeleteDuplicates.java
patching file src/java/org/apache/nutch/indexer/solr/SolrIndexerJob.java
patching file src/java/org/apache/nutch/indexer/solr/SolrConstants.java
patching file src/java/org/apache/nutch/indexer/solr/SolrWriter.java
patching file src/java/org/apache/nutch/indexer/IndexerReducer.java
patching file conf/nutch-default.xml
Hunk #1 FAILED at 728.
Hunk #2 succeeded at 1060 (offset 13 lines).
1 out of 2 hunks FAILED -- saving rejects to file conf/nutch-default.xml.rej
{code}
I therefore I attach an updated patch which applies cleanly, however it breaks runtime builds and (already broken) tests with the following output
{code}
[javac] Compiling 5 source files to /home/lewis/ASF/trunk/build/classes
[javac] /home/lewis/ASF/trunk/src/java/org/apache/nutch/indexer/solr/SolrDeleteDuplicates.java:231: cannot find symbol
[javac] symbol : variable SolrUtils
[javac] location: class org.apache.nutch.indexer.solr.SolrDeleteDuplicates.SolrInputFormat
[javac] SolrServer solr = SolrUtils.getCommonsHttpSolrServer(conf);
[javac] ^
[javac] /home/lewis/ASF/trunk/src/java/org/apache/nutch/indexer/solr/SolrDeleteDuplicates.java:261: cannot find symbol
[javac] symbol : variable SolrUtils
[javac] location: class org.apache.nutch.indexer.solr.SolrDeleteDuplicates.SolrInputFormat
[javac] SolrServer solr = SolrUtils.getCommonsHttpSolrServer(conf);
[javac] ^
[javac] /home/lewis/ASF/trunk/src/java/org/apache/nutch/indexer/solr/SolrDeleteDuplicates.java:306: cannot find symbol
[javac] symbol : variable SolrUtils
[javac] location: class org.apache.nutch.indexer.solr.SolrDeleteDuplicates
[javac] solr = SolrUtils.getCommonsHttpSolrServer(conf);
[javac] ^
[javac] /home/lewis/ASF/trunk/src/java/org/apache/nutch/indexer/solr/SolrIndexerJob.java:70: cannot find symbol
[javac] symbol : variable SolrUtils
[javac] location: class org.apache.nutch.indexer.solr.SolrIndexerJob
[javac] SolrServer solr = SolrUtils.getCommonsHttpSolrServer(getConf());
[javac] ^
[javac] /home/lewis/ASF/trunk/src/java/org/apache/nutch/indexer/solr/SolrWriter.java:51: cannot find symbol
[javac] symbol : variable SolrUtils
[javac] location: class org.apache.nutch.indexer.solr.SolrWriter
[javac] solr = SolrUtils.getCommonsHttpSolrServer(conf);
[javac] ^
[javac] /home/lewis/ASF/trunk/src/java/org/apache/nutch/indexer/solr/SolrWriter.java:64: cannot find symbol
[javac] symbol : variable SolrUtils
[javac] location: class org.apache.nutch.indexer.solr.SolrWriter
[javac] val2 = SolrUtils.stripNonCharCodepoints((String)val);
[javac] ^
[javac] 6 errors
BUILD FAILED
/home/lewis/ASF/trunk/build.xml:96: Compile failed; see the compiler error output for details.
{code}
> Support HTTP auth for Solr communication
> ----------------------------------------
>
> Key: NUTCH-987
> URL: https://issues.apache.org/jira/browse/NUTCH-987
> Project: Nutch
> Issue Type: Improvement
> Components: indexer
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 1.4, 2.0
>
> Attachments: NUTCH-987-1.3-hack.patch, NUTCH-987-1.4-3.patch, NUTCH-987-1.4.1-2.patch, NUTCH-987-2.0-1.patch, NUTCH-987-2.0-2.patch, SolrUtils.java
>
>
> At the moment we cannot send data directly to a public HTTP auth protected Solr instance. I've a WIP that passes a configured HTTPClient object to CommonsHttpSolrServer, it works. This issue should add this ability to indexing, dedup and clean and be configured from some configuration file.
> Enable Solr HTTP auth communication by setting the following parameters in your nutch-site config:
> * solr.auth=true
> * solr.auth.username=USERNAME
> * solr.auth.password=PASSWORD
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira