You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2015/07/01 06:39:04 UTC

[jira] [Commented] (NUTCH-2052) Enhance index-static to allow configurable delimiters

    [ https://issues.apache.org/jira/browse/NUTCH-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609546#comment-14609546 ] 

Chris A. Mattmann commented on NUTCH-2052:
------------------------------------------

I see the following failures with this PR:

{noformat}
[mattmann-0420740:~/tmp/nutch-trunk] mattmann% more build/index-static/test/TEST-org.apache.nutch.indexer.staticfield.TestStaticFieldIndexerTest.txt 
Testsuite: org.apache.nutch.indexer.staticfield.TestStaticFieldIndexerTest
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.085 sec

Testcase: testNormalScenario took 0.444 sec
Testcase: testCustomDelimiters took 0.364 sec
        FAILED
test if doc has field1
junit.framework.AssertionFailedError: test if doc has field1
        at org.apache.nutch.indexer.staticfield.TestStaticFieldIndexerTest.testCustomDelimiters(TestStaticFieldIndexerTest.java:149)

Testcase: testEmptyIndexStatic took 0.126 sec
[mattmann-0420740:~/tmp/nutch-trunk] mattmann% 
{noformat}

Also to apply it I had to do the following (due to extraneous commits included from lewismc) - please git reset --hard HEAD before updating and pushing your PR.

{noformat}
git apply --exclude="*CHANGES.txt" --exclude="*NOTICE.txt" --exclude="*nutch-default.xml" --exclude="*default.properties" < 43.patch
{noformat}


> Enhance index-static to allow configurable delimiters
> -----------------------------------------------------
>
>                 Key: NUTCH-2052
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2052
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.10
>            Reporter: Peter Ciuffetti
>            Assignee: Chris A. Mattmann
>             Fix For: 1.11
>
>
> The index-static plugin has a set of fixed-value delimiters that control the parsing of the property index.static.
> comma is used to separate fields
> colon is used to separate field name from field value
> space is used to separate multiple values in the field
> This set of choices makes it impossible to have a fixed field value containing a space, comma or colon.
> The proposed enhancement is to allow configuration properties to override any of these defaults.
> index.static.fieldsep (default comma)
> index.static.keysep (default colon)
> index.static.valuesep (default space)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)