You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@opennlp.apache.org by Ajay Bhat <a....@gmail.com> on 2014/05/02 17:03:18 UTC

Test for Snowball Stemmer?

Hi,

Is there any test for the Snowball Stemmer in the Opennlp? I have seen only
the Porter Stemmer test. I'd be happy to code a test if needed. Also,
please tell if there are any other test for classes needed.

-- 
Regards,
Ajay Bhat

Re: Test for Snowball Stemmer?

Posted by Rodrigo Agerri <ro...@ehu.es>.
Hi,

For what is worth, I also think that implementing tests for every
stemmer is not needed. But a smoke test will be great.

Cheers,

Rodrigo

On Fri, May 2, 2014 at 5:03 PM, Ajay Bhat <a....@gmail.com> wrote:
> Hi,
>
> Is there any test for the Snowball Stemmer in the Opennlp? I have seen only
> the Porter Stemmer test. I'd be happy to code a test if needed. Also,
> please tell if there are any other test for classes needed.
>
> --
> Regards,
> Ajay Bhat

Re: Test for Snowball Stemmer?

Posted by Ajay Bhat <a....@gmail.com>.
Hi,

I'm not sure if this patch has been reviewed yet.


On Fri, May 16, 2014 at 7:15 AM, Ajay Bhat <a....@gmail.com> wrote:

> Please review : https://issues.apache.org/jira/browse/OPENNLP-696
>
>
> On Wed, May 14, 2014 at 1:18 PM, Jörn Kottmann <ko...@gmail.com> wrote:
>
>> On 05/13/2014 05:36 PM, Ajay Bhat wrote:
>>
>>> I've found test data for snowball stemmers from the Xapian project
>>> https://github.com/xapian/xapian/tree/master/xapian-data/stemming
>>>
>>> However its licensed under the GPL which could cause conflict with the
>>> Apache license which we use, AFAIK
>>>
>>
>> Yes, that will likely cause issues. We can't distribute any GPL artifacts
>> here from Apache.
>>
>> Jörn
>>
>
>
>
> --
> Regards,
> Ajay Bhat
>



-- 
Regards,
Ajay Bhat

Re: Test for Snowball Stemmer?

Posted by Ajay Bhat <a....@gmail.com>.
Please review : https://issues.apache.org/jira/browse/OPENNLP-696


On Wed, May 14, 2014 at 1:18 PM, Jörn Kottmann <ko...@gmail.com> wrote:

> On 05/13/2014 05:36 PM, Ajay Bhat wrote:
>
>> I've found test data for snowball stemmers from the Xapian project
>> https://github.com/xapian/xapian/tree/master/xapian-data/stemming
>>
>> However its licensed under the GPL which could cause conflict with the
>> Apache license which we use, AFAIK
>>
>
> Yes, that will likely cause issues. We can't distribute any GPL artifacts
> here from Apache.
>
> Jörn
>



-- 
Regards,
Ajay Bhat

Re: Test for Snowball Stemmer?

Posted by Jörn Kottmann <ko...@gmail.com>.
On 05/13/2014 05:36 PM, Ajay Bhat wrote:
> I've found test data for snowball stemmers from the Xapian project
> https://github.com/xapian/xapian/tree/master/xapian-data/stemming
>
> However its licensed under the GPL which could cause conflict with the
> Apache license which we use, AFAIK

Yes, that will likely cause issues. We can't distribute any GPL 
artifacts here from Apache.

Jörn

Re: Test for Snowball Stemmer?

Posted by Ajay Bhat <a....@gmail.com>.
I've found test data for snowball stemmers from the Xapian project
https://github.com/xapian/xapian/tree/master/xapian-data/stemming

However its licensed under the GPL which could cause conflict with the
Apache license which we use, AFAIK

This could be used for extensive test, but as you say, a simple test should
be enough for all the stemmers.


On Wed, May 7, 2014 at 12:16 AM, Jörn Kottmann <ko...@gmail.com> wrote:

> Hello,
>
> yes would be nice to have a test for it. We redistribute the code
> from the snowball stemmer project.
>
> How do you think it should be done?
>
> The factory class is our code wich can load the correct snowball
> stemmer, it is worth testing if that works. Not sure if we should
> implement extensive tests for each of these stemmers here.
>
> Any opinions?
>
> A simple smoke test to see if they all work is nice to have IMO.
>
> Jörn
>
> On Fri, 2014-05-02 at 20:33 +0530, Ajay Bhat wrote:
> > Hi,
> >
> > Is there any test for the Snowball Stemmer in the Opennlp? I have seen
> only
> > the Porter Stemmer test. I'd be happy to code a test if needed. Also,
> > please tell if there are any other test for classes needed.
> >
>
>
>


-- 
Regards,
Ajay Bhat

Re: Test for Snowball Stemmer?

Posted by Jörn Kottmann <ko...@gmail.com>.
Hello,

yes would be nice to have a test for it. We redistribute the code
from the snowball stemmer project. 

How do you think it should be done?

The factory class is our code wich can load the correct snowball
stemmer, it is worth testing if that works. Not sure if we should
implement extensive tests for each of these stemmers here.

Any opinions? 

A simple smoke test to see if they all work is nice to have IMO.

Jörn

On Fri, 2014-05-02 at 20:33 +0530, Ajay Bhat wrote:
> Hi,
> 
> Is there any test for the Snowball Stemmer in the Opennlp? I have seen only
> the Porter Stemmer test. I'd be happy to code a test if needed. Also,
> please tell if there are any other test for classes needed.
>