[jira] [Comment Edited] (NUTCH-1467) nutch 1.5.1 not able to parse mutliValued metatags

["kiran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454296#comment-13454296 ] 

kiran edited comment on NUTCH-1467 at 9/13/12 6:59 AM:
-------------------------------------------------------

Yes, it would be great to store the multiValues as array instead of concatenation. I just made a quick workaround but  the implementation of HTMLMetaTags.generalTags should be changed from the implementation of properties so that it can accept array of values. That would be the next step. 

I will work on it soon but i am thinking of working on tika parser so that it can get all the attributes by default, index them and send it to solr 'attr_*' dynamic field, so that instead of specifying manually any attributes will be accepted. That would be helpful i think than the parse-metatags.

I am not sure if this feature is already present in Nutch.

Any suggestions are appreciated.

Thank you,
Kiran.
                
      was (Author: kiranch):
    Yes, it would be great to store the multiValues as array instead of concatenation. I just made a quick workaround but  the implementation of HTMLMetaTags.generalTags should be changed from the implementation of properties so that it can accept array of values. That would be the next step. 

I will work on it soon but i am thinking of working on tika parser so that it can get all the attributes by default, index them and send it to solr 'attr_*' dynamic field, so that instead of specifying manually, any attributes will be accepted. That would be helpful i think than the parse-metatags.

I am not sure if this feature is already present in Nutch.

Any suggestions are appreciated.

Thank you,
Kiran.
                  
> nutch 1.5.1 not able to parse mutliValued metatags
> --------------------------------------------------
>
>                 Key: NUTCH-1467
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1467
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: 1.5.1
>            Reporter: kiran
>            Priority: Minor
>             Fix For: 1.6
>
>         Attachments: patch.txt
>
>
> Hi,
> I have been able to parse metatags in an html page using http://wiki.apache.org/nutch/IndexMetatags. It does not work quite well when there are two metatags with same name but two different contents. 
> Does anyone encounter this kind of issue ?  
> Are there any changes that need to be made to the config files to make it work ?
> When there are two tags with same name and different content, it takes the value of the later tag and saves it rather than creating a multiValue field.
> Edit: I have attached the patch for the file and it is provided by DLA (Digital Library and Archives) http://scholar.lib.vt.edu/ of Virginia Tech. 
> Many Thanks,

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira