You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Julien Nioche (JIRA)" <ji...@apache.org> on 2011/05/17 15:40:47 UTC

[jira] [Created] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

IndexingFitlers to store Date objects instead of Strings
--------------------------------------------------------

                 Key: NUTCH-997
                 URL: https://issues.apache.org/jira/browse/NUTCH-997
             Project: Nutch
          Issue Type: Improvement
          Components: indexer
    Affects Versions: 1.3, 2.0
            Reporter: Julien Nioche
            Assignee: Julien Nioche
             Fix For: 1.3, 2.0


See Nutch-985.

Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Nioche updated NUTCH-997:
--------------------------------

    Attachment: NUTCH-997.branch-1.3.patch

Patch which : 
- modifies the schema for SOLR
- BasicIndexingFilter, FeedIndexingFilter and MoreIndexingFilter generate fields with Date objects as value
- SolrWriter normalises the String representation of Date objects 

> IndexingFitlers to store Date objects instead of Strings
> --------------------------------------------------------
>
>                 Key: NUTCH-997
>                 URL: https://issues.apache.org/jira/browse/NUTCH-997
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.3, 2.0
>            Reporter: Julien Nioche
>            Assignee: Julien Nioche
>             Fix For: 1.3, 2.0
>
>         Attachments: NUTCH-997.branch-1.3.patch
>
>
> See Nutch-985.
> Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

Posted by "Markus Jelsma (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035297#comment-13035297 ] 

Markus Jelsma commented on NUTCH-997:
-------------------------------------

Good work, especially that it supercedes the other ticket. I'll try and test the patch this week.

> IndexingFitlers to store Date objects instead of Strings
> --------------------------------------------------------
>
>                 Key: NUTCH-997
>                 URL: https://issues.apache.org/jira/browse/NUTCH-997
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.3, 2.0
>            Reporter: Julien Nioche
>            Assignee: Julien Nioche
>             Fix For: 1.3, 2.0
>
>         Attachments: NUTCH-997.branch-1.3.patch
>
>
> See Nutch-985.
> Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Nioche resolved NUTCH-997.
---------------------------------

       Resolution: Fixed
    Fix Version/s:     (was: 2.0)

1.3 : Committed revision 1124202

Can't apply to trunk as NutchDocuments can have only String values there. Will open a separate issue for it 

> IndexingFitlers to store Date objects instead of Strings
> --------------------------------------------------------
>
>                 Key: NUTCH-997
>                 URL: https://issues.apache.org/jira/browse/NUTCH-997
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.3, 2.0
>            Reporter: Julien Nioche
>            Assignee: Julien Nioche
>             Fix For: 1.3
>
>         Attachments: NUTCH-997.branch-1.3.patch
>
>
> See Nutch-985.
> Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

Posted by "Markus Jelsma (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035315#comment-13035315 ] 

Markus Jelsma commented on NUTCH-997:
-------------------------------------

Well, it seems this afternoon is this week as well. Anyway, it runs and works like a charm in 1.3. +1 for committing this. We can then resolve NUTCH-985 as won't fix. If desirable i can then also commit NUTCH-994. The issue with the pom NUTCH-995 is then the last.

> IndexingFitlers to store Date objects instead of Strings
> --------------------------------------------------------
>
>                 Key: NUTCH-997
>                 URL: https://issues.apache.org/jira/browse/NUTCH-997
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.3, 2.0
>            Reporter: Julien Nioche
>            Assignee: Julien Nioche
>             Fix For: 1.3, 2.0
>
>         Attachments: NUTCH-997.branch-1.3.patch
>
>
> See Nutch-985.
> Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035319#comment-13035319 ] 

Julien Nioche commented on NUTCH-997:
-------------------------------------

Thanks for reviewing it. I had tested this yesterday as well so now that there is 2 of us I will commit it in 1.3 and trunk. We can then resolve 985 as fixed. 
I'll have a look at NUTCH-994 later this week


> IndexingFitlers to store Date objects instead of Strings
> --------------------------------------------------------
>
>                 Key: NUTCH-997
>                 URL: https://issues.apache.org/jira/browse/NUTCH-997
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.3, 2.0
>            Reporter: Julien Nioche
>            Assignee: Julien Nioche
>             Fix For: 1.3, 2.0
>
>         Attachments: NUTCH-997.branch-1.3.patch
>
>
> See Nutch-985.
> Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Closed] (NUTCH-997) IndexingFitlers to store Date objects instead of Strings

Posted by "Markus Jelsma (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Markus Jelsma closed NUTCH-997.
-------------------------------


Bulk close of resolved issues for 1.3.

> IndexingFitlers to store Date objects instead of Strings
> --------------------------------------------------------
>
>                 Key: NUTCH-997
>                 URL: https://issues.apache.org/jira/browse/NUTCH-997
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.3, 2.0
>            Reporter: Julien Nioche
>            Assignee: Julien Nioche
>             Fix For: 1.3
>
>         Attachments: NUTCH-997.branch-1.3.patch
>
>
> See Nutch-985.
> Several IndexingFilters generate fields containing Dates with String values. This patch changes this so that Date objects are stored then converted into whatever type and format are required during the indexing.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira