You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@joshua.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2016/07/01 21:45:11 UTC

[jira] [Commented] (JOSHUA-280) Existing Language packs not compatible with Joshua master

    [ https://issues.apache.org/jira/browse/JOSHUA-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359691#comment-15359691 ] 

Lewis John McGibbney commented on JOSHUA-280:
---------------------------------------------

Same goes for the Arabic language pack
{code}
lmcgibbn@LMC-032857 /usr/local/Cellar/joshua/HEAD/libexec/language-pack-ar-en-phrase-2015-03-18(NUTCH-2089) $ ./run-joshua-server.sh
INFO - Parameters read from configuration file: joshua.config
INFO -     tm = 'moses -owner pt -maxspan 0 -max-source-len 5 -path phrase-table.packed'
INFO -     defaultnonterminal = 'X'
INFO -     goalsymbol = 'GOAL'
INFO -     featurefunction = 'StateMinimizingLanguageModel -lm_type kenlm -lm_order 5 -lm_file gigaword.kenlm.v5'
INFO -     featurefunction = 'StateMinimizingLanguageModel -lm_type kenlm -lm_order 5 -lm_file lm.kenlm'
INFO -     markoovs = 'false'
INFO -     search = 'stack'
INFO - pop-limit: 100
INFO -     poplimit = '100'
INFO -     topn = '0'
INFO -     useuniquenbest = 'true'
INFO -     outputformat = '%s'
INFO -     includealignindex = 'false'
INFO -     featurefunction = 'OOVPenalty'
INFO -     featurefunction = 'WordPenalty'
INFO -     featurefunction = 'Distortion'
INFO -     featurefunction = 'PhrasePenalty'
INFO -     c = 'joshua.config'
INFO -     server-port: 5674
INFO -     serverport = '5674'
INFO - Read 10 weights (0 of them dense)
INFO - Reading vocabulary: phrase-table.packed/vocabulary
INFO - Read 297133 entries from the vocabulary
INFO - Reading packed config: phrase-table.packed/config
........10........20........30........40........50........60........70........80........90.....100%
Exception in thread "main" java.lang.RuntimeException: The grammar at phrase-table.packed was packed with packer version 0, but the earliest supported version is 3
	at org.apache.joshua.decoder.ff.tm.packed.PackedGrammar.readConfig(PackedGrammar.java:1061)
	at org.apache.joshua.decoder.ff.tm.packed.PackedGrammar.<init>(PackedGrammar.java:143)
	at org.apache.joshua.decoder.phrase.PhraseTable.<init>(PhraseTable.java:65)
	at org.apache.joshua.decoder.Decoder.initializeTranslationGrammars(Decoder.java:603)
	at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
	at org.apache.joshua.decoder.Decoder.<init>(Decoder.java:126)
	at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
{code}

> Existing Language packs not compatible with Joshua master
> ---------------------------------------------------------
>
>                 Key: JOSHUA-280
>                 URL: https://issues.apache.org/jira/browse/JOSHUA-280
>             Project: Joshua
>          Issue Type: Bug
>          Components: language packs
>    Affects Versions: 6.0.5
>            Reporter: Lewis John McGibbney
>            Priority: Critical
>             Fix For: 6.1
>
>
> When I work with the existing Spanish --> English language pack at http://cs.jhu.edu/~post/language-packs/language-pack-es-en-phrase-2015-03-06.tgz, I get the following error
> {code}
> lmcgibbn@LMC-032857 /usr/local/Cellar/joshua/HEAD/libexec/language-pack-es-en-phrase-2015-03-06(NUTCH-2089) $ ./run-joshua-server.sh
> INFO - Parameters read from configuration file: joshua.config
> INFO -     tm = 'moses -owner pt -maxspan 0 -path phrase-table.packed -max-source-len 5'
> INFO -     defaultnonterminal = 'X'
> INFO -     goalsymbol = 'GOAL'
> INFO -     featurefunction = 'StateMinimizingLanguageModel -lm_type kenlm -lm_order 5 -lm_file lm.kenlm'
> INFO -     markoovs = 'false'
> INFO -     search = 'stack'
> INFO - pop-limit: 100
> INFO -     poplimit = '100'
> INFO -     topn = '0'
> INFO -     useuniquenbest = 'true'
> INFO -     outputformat = '%s'
> INFO -     includealignindex = 'false'
> INFO -     featurefunction = 'OOVPenalty'
> INFO -     featurefunction = 'WordPenalty'
> INFO -     featurefunction = 'Distortion'
> INFO -     featurefunction = 'PhrasePenalty'
> INFO -     c = 'joshua.config'
> INFO -     server-port: 5674
> INFO -     serverport = '5674'
> INFO - Read 9 weights (0 of them dense)
> INFO - Reading vocabulary: phrase-table.packed/vocabulary
> INFO - Read 191983 entries from the vocabulary
> INFO - Reading packed config: phrase-table.packed/config
> ........10........20........30........40........50........60........70........80........90.....100%
> Exception in thread "main" java.lang.RuntimeException: The grammar at phrase-table.packed was packed with packer version 0, but the earliest supported version is 3
> 	at org.apache.joshua.decoder.ff.tm.packed.PackedGrammar.readConfig(PackedGrammar.java:1061)
> 	at org.apache.joshua.decoder.ff.tm.packed.PackedGrammar.<init>(PackedGrammar.java:143)
> 	at org.apache.joshua.decoder.phrase.PhraseTable.<init>(PhraseTable.java:65)
> 	at org.apache.joshua.decoder.Decoder.initializeTranslationGrammars(Decoder.java:603)
> 	at org.apache.joshua.decoder.Decoder.initialize(Decoder.java:514)
> 	at org.apache.joshua.decoder.Decoder.<init>(Decoder.java:126)
> 	at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:69)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)