You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@opennlp.apache.org by Jörn Kottmann <ko...@gmail.com> on 2012/04/03 18:05:02 UTC
Tokenizer broken?
Hi all,
I noticed that our Tokenizer fails when it is run with the english model
from the SourceForge page. The handling for the alphanumeric optimization
was changed. The pattern for it is now retrieved from a factory, but this
does not seem to work with our old model and we get a NullPointerException,
when the alpha-num-pattern is accessed.
Jörn
Re: Tokenizer broken?
Posted by Jörn Kottmann <ko...@gmail.com>.
Its fixed, I didn't get the exception anymore.
Thanks for quick response.
Jörn
On 04/03/2012 07:09 PM, william.colen@gmail.com wrote:
> Can you please try it again?
>
> Thank you
>
> On Tue, Apr 3, 2012 at 1:35 PM, william.colen@gmail.com<
> william.colen@gmail.com> wrote:
>
>> Hi Jörn
>>
>> It is probably my fault. I will verify it right now.
>>
>> Thanks
>> William
>>
>>
>> On Tue, Apr 3, 2012 at 1:05 PM, Jörn Kottmann<ko...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I noticed that our Tokenizer fails when it is run with the english model
>>> from the SourceForge page. The handling for the alphanumeric optimization
>>> was changed. The pattern for it is now retrieved from a factory, but this
>>> does not seem to work with our old model and we get a
>>> NullPointerException,
>>> when the alpha-num-pattern is accessed.
>>>
>>> Jörn
>>>
>>>
>>>
Re: Tokenizer broken?
Posted by "william.colen@gmail.com" <wi...@gmail.com>.
Can you please try it again?
Thank you
On Tue, Apr 3, 2012 at 1:35 PM, william.colen@gmail.com <
william.colen@gmail.com> wrote:
> Hi Jörn
>
> It is probably my fault. I will verify it right now.
>
> Thanks
> William
>
>
> On Tue, Apr 3, 2012 at 1:05 PM, Jörn Kottmann <ko...@gmail.com> wrote:
>
>> Hi all,
>>
>> I noticed that our Tokenizer fails when it is run with the english model
>> from the SourceForge page. The handling for the alphanumeric optimization
>> was changed. The pattern for it is now retrieved from a factory, but this
>> does not seem to work with our old model and we get a
>> NullPointerException,
>> when the alpha-num-pattern is accessed.
>>
>> Jörn
>>
>>
>>
>
Re: Tokenizer broken?
Posted by "william.colen@gmail.com" <wi...@gmail.com>.
Hi Jörn
It is probably my fault. I will verify it right now.
Thanks
William
On Tue, Apr 3, 2012 at 1:05 PM, Jörn Kottmann <ko...@gmail.com> wrote:
> Hi all,
>
> I noticed that our Tokenizer fails when it is run with the english model
> from the SourceForge page. The handling for the alphanumeric optimization
> was changed. The pattern for it is now retrieved from a factory, but this
> does not seem to work with our old model and we get a NullPointerException,
> when the alpha-num-pattern is accessed.
>
> Jörn
>
>
>