You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Joseph Vychtrle (JIRA)" <ji...@apache.org> on 2011/04/11 01:47:05 UTC

[jira] [Created] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------

                 Key: TIKA-638
                 URL: https://issues.apache.org/jira/browse/TIKA-638
             Project: Tika
          Issue Type: Bug
          Components: languageidentifier
    Affects Versions: 0.9
         Environment: java version "1.6.0_16"
            Reporter: Joseph Vychtrle


Hey, I get this error when simply doing:
{code}
return new LanguageIdentifier(text).getLanguage();
{code}

It happens in LanguageIdentifier.addProfile(String language);

The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"

The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
{code}
2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
        at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
        at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
        at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
        at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
        at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
        at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
        at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
        at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
        at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
        at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
{code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Posted by "Joseph Vychtrle (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TIKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13078702#comment-13078702 ] 

Joseph Vychtrle commented on TIKA-638:
--------------------------------------

I didn't do anything else than using LanguageIdentifier in my own application. I was testing it on what I pasted in the issue description (the log messages, exception message and stack trace). It is the actual "text" that I was testing language recognition on.

> Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: TIKA-638
>                 URL: https://issues.apache.org/jira/browse/TIKA-638
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>    Affects Versions: 0.9
>         Environment: java version "1.6.0_16"
>            Reporter: Joseph Vychtrle
>
> Hey, I get this error when simply doing:
> {code}
> return new LanguageIdentifier(text).getLanguage();
> {code}
> It happens in LanguageIdentifier.addProfile(String language);
> The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"
> The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
> {code}
> 2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
> 2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
> 2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
> 2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
> javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
>         at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
>         at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
>         at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
>         at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
>         at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
>         at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
>         at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
>         at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
>         at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
>         at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Resolved] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Posted by "Ken Krugler (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TIKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ken Krugler resolved TIKA-638.
------------------------------

    Resolution: Not A Problem
      Assignee: Ken Krugler
    
> Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: TIKA-638
>                 URL: https://issues.apache.org/jira/browse/TIKA-638
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>    Affects Versions: 0.9
>         Environment: java version "1.6.0_16"
>            Reporter: Joseph Vychtrle
>            Assignee: Ken Krugler
>
> Hey, I get this error when simply doing:
> {code}
> return new LanguageIdentifier(text).getLanguage();
> {code}
> It happens in LanguageIdentifier.addProfile(String language);
> The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"
> The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
> {code}
> 2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
> 2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
> 2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
> 2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
> javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
>         at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
>         at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
>         at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
>         at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
>         at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
>         at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
>         at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
>         at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
>         at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
>         at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Posted by "Joseph Vychtrle (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TIKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086068#comment-13086068 ] 

Joseph Vychtrle commented on TIKA-638:
--------------------------------------

Simply put, please ignore everything I said, the  Lithuanian ngram is not valid...that's all

> Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: TIKA-638
>                 URL: https://issues.apache.org/jira/browse/TIKA-638
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>    Affects Versions: 0.9
>         Environment: java version "1.6.0_16"
>            Reporter: Joseph Vychtrle
>
> Hey, I get this error when simply doing:
> {code}
> return new LanguageIdentifier(text).getLanguage();
> {code}
> It happens in LanguageIdentifier.addProfile(String language);
> The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"
> The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
> {code}
> 2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
> 2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
> 2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
> 2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
> javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
>         at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
>         at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
>         at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
>         at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
>         at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
>         at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
>         at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
>         at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
>         at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
>         at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Posted by "Jan Høydahl (Commented JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TIKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188452#comment-13188452 ] 

Jan Høydahl commented on TIKA-638:
----------------------------------

Ok, will someone close this bug as "not a problem"?
                
> Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: TIKA-638
>                 URL: https://issues.apache.org/jira/browse/TIKA-638
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>    Affects Versions: 0.9
>         Environment: java version "1.6.0_16"
>            Reporter: Joseph Vychtrle
>
> Hey, I get this error when simply doing:
> {code}
> return new LanguageIdentifier(text).getLanguage();
> {code}
> It happens in LanguageIdentifier.addProfile(String language);
> The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"
> The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
> {code}
> 2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
> 2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
> 2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
> 2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
> javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
>         at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
>         at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
>         at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
>         at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
>         at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
>         at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
>         at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
>         at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
>         at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
>         at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Posted by "Jan Høydahl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TIKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076241#comment-13076241 ] 

Jan Høydahl commented on TIKA-638:
----------------------------------

Hi,

Have you somehow added your own language profile?
Can you reproduce this error from tika-cmd commandline or is it only from your own program?

Please provide some more context on what you're trying to do, more of your code and a which text it fails at identifying.

> Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: TIKA-638
>                 URL: https://issues.apache.org/jira/browse/TIKA-638
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>    Affects Versions: 0.9
>         Environment: java version "1.6.0_16"
>            Reporter: Joseph Vychtrle
>
> Hey, I get this error when simply doing:
> {code}
> return new LanguageIdentifier(text).getLanguage();
> {code}
> It happens in LanguageIdentifier.addProfile(String language);
> The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"
> The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
> {code}
> 2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
> 2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
> 2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
> 2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
> javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
>         at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
>         at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
>         at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
>         at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
>         at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
>         at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
>         at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
>         at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
>         at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
>         at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (TIKA-638) Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

Posted by "Joseph Vychtrle (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TIKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086063#comment-13086063 ] 

Joseph Vychtrle commented on TIKA-638:
--------------------------------------

Sorry I didn't recall what was going on back then. Now I'm looking at it and it doesn't happen when parsing, but loading profile lt = Lithuanian ... The default one.

It fails with "Unable to add an ngram of incorrect length: 5 != 3"

> Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: TIKA-638
>                 URL: https://issues.apache.org/jira/browse/TIKA-638
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>    Affects Versions: 0.9
>         Environment: java version "1.6.0_16"
>            Reporter: Joseph Vychtrle
>
> Hey, I get this error when simply doing:
> {code}
> return new LanguageIdentifier(text).getLanguage();
> {code}
> It happens in LanguageIdentifier.addProfile(String language);
> The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"
> The "text" I'm using as input is this : (note that it is not the log, it's just an input text)
> {code}
> 2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
> 2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
> 2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
> 2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
> 2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
> javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
>         at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
>         at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
>         at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
>         at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
>         at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
>         at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
>         at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
>         at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
>         at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
>         at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
>         at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira