You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@tika.apache.org by Peter Kronenberg <pe...@torch.ai> on 2021/01/07 23:28:04 UTC

Language detection

In my previous 1.25 code, I had


LanguageDetector detector = new OptimaizeLangDetector();
detector.loadModels();


I had a Maven dependency on
<dependency>
    <groupId>com.optimaize.languagedetector</groupId>
    <artifactId>language-detector</artifactId>
    <version>0.6</version>
</dependency>

This doesn't seem to work anymore, but I see that Tika now has

<dependency>
    <groupId>org.apache.tika</groupId>
    <artifactId>tika-langdetect-optimaize</artifactId>
    <version>2.0.0-SNAPSHOT</version>
</dependency>


But OptimazieLangDetector no longer extends LanaguageDetector.  How is this supposed to work?

RE: Language detection

Posted by Peter Kronenberg <pe...@torch.ai>.

Hmm, that’s definitely not the same class I’m picking up.  I’m getting mine from tika-langdetect-optimaize.jar

Ok, now it looks good.  Somehow maven refreshed something. But I was definitely getting a different class

From: Tim Allison <ta...@apache.org>
Sent: Friday, January 8, 2021 1:04 PM
To: Peter Kronenberg <pe...@torch.ai>
Cc: user@tika.apache.org
Subject: Re: Language detection

I just added an example: https://github.com/tballison/tika-2_0-client-examples/blob/master/optimaize/src/test/java/TestOptimaizeBasic.java

Take a look at the pom there.

I'm not sure I understand what you mean by OptimaizeLanguageDetector no longer extending LanguageDetector?

https://github.com/apache/tika/blob/main/tika-langdetect/tika-langdetect-optimaize/src/main/java/org/apache/tika/langdetect/optimaize/OptimaizeLangDetector.java#L47

I can't think of a time when it didn't... help!

On Thu, Jan 7, 2021 at 6:28 PM Peter Kronenberg <pe...@torch.ai>> wrote:
In my previous 1.25 code, I had

LanguageDetector detector = new OptimaizeLangDetector();
detector.loadModels();

I had a Maven dependency on
<dependency>
    <groupId>com.optimaize.languagedetector</groupId>
    <artifactId>language-detector</artifactId>
    <version>0.6</version>
</dependency>

This doesn’t seem to work anymore, but I see that Tika now has

<dependency>
    <groupId>org.apache.tika</groupId>
    <artifactId>tika-langdetect-optimaize</artifactId>
    <version>2.0.0-SNAPSHOT</version>
</dependency>

But OptimazieLangDetector no longer extends LanaguageDetector.  How is this supposed to work?

Re: Language detection

Posted by Tim Allison <ta...@apache.org>.

I just added an example:
https://github.com/tballison/tika-2_0-client-examples/blob/master/optimaize/src/test/java/TestOptimaizeBasic.java

Take a look at the pom there.

I'm not sure I understand what you mean by OptimaizeLanguageDetector no
longer extending LanguageDetector?

https://github.com/apache/tika/blob/main/tika-langdetect/tika-langdetect-optimaize/src/main/java/org/apache/tika/langdetect/optimaize/OptimaizeLangDetector.java#L47

I can't think of a time when it didn't... help!

On Thu, Jan 7, 2021 at 6:28 PM Peter Kronenberg <pe...@torch.ai>
wrote:

> In my previous 1.25 code, I had
>
>
>
> LanguageDetector detector = *new *OptimaizeLangDetector();
> detector.loadModels();
>
>
>
>
>
> I had a Maven dependency on
>
> <*dependency*>
>     <*groupId*>com.optimaize.languagedetector</*groupId*>
>     <*artifactId*>language-detector</*artifactId*>
>     <*version*>0.6</*version*>
> </*dependency*>
>
>
>
> This doesn’t seem to work anymore, but I see that Tika now has
>
> <*dependency*>
>     <*groupId*>org.apache.tika</*groupId*>
>     <*artifactId*>tika-langdetect-optimaize</*artifactId*>
>     <*version*>2.0.0-SNAPSHOT</*version*>
> </*dependency*>
>
>
>
>
>
> But *OptimazieLangDetector* no longer extends *LanaguageDetector*.  How
> is this supposed to work?
>