You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@joshua.apache.org by Nicoara Talpes <ni...@gmail.com> on 2017/07/03 21:30:08 UTC

joshua prints hyphens instead of translation

Hello Joshua Community,

I am running "cat example.SRC | ./prepare.sh | ./joshua" in a terminal on a
Ubuntu machine, but for every line in the example.SRC, there is a hyphen
shown on the terminal. No translation seems to be happening. I am using the
English-German pack.

How to fix this?

Is there a FAQ that I missed where this is addressed?

Apologies for asking this question again in a matter of a few days, but I
am in need of a response to move forward.

Thank you,

Nicoara

Re: joshua prints hyphens instead of translation

Posted by Nicoara Talpes <ni...@gmail.com>.
Hello,

Here it is:

nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
example.SRC | ./prepare.sh | ./joshua -v 1
INFO - Parameters read from configuration file: joshua.config
INFO -     tm = 'moses -path model/grammar.gz.packed -maxspan 0 -owner pt'
INFO -     defaultnonterminal = 'X'
INFO -     goalsymbol = 'GOAL'
INFO -     markoovs = 'false'
INFO -     search = 'stack'
INFO - pop-limit: 100
INFO -     poplimit = '100'
INFO -     topn = '1'
INFO -     useuniquenbest = 'true'
INFO -     outputformat = '%S'
INFO -     includealignindex = 'false'
INFO -     featurefunction = 'OOVPenalty'
INFO -     featurefunction = 'WordPenalty'
INFO -     featurefunction = 'PhrasePenalty'
INFO -     featurefunction = 'Distortion'
INFO -     featurefunction = 'LanguageModel -lm_type berkeleylm -lm_order 4
-lm_file model/lm.berkeleylm'
INFO -     lowercase = 'true'
INFO -     projectcase = 'true'
INFO -     c = 'joshua.config'
INFO -     v = '0'
INFO -     v = '1'
INFO - Read 9 weights (0 of them dense)
INFO - Reading vocabulary: model/grammar.gz.packed/vocabulary
INFO - Read 1404929 entries from the vocabulary
INFO - Reading packed config: model/grammar.gz.packed/config
........10........20........30........40........50........60........70........80........90.....100%
INFO - Reading encoder configuration: model/grammar.gz.packed/encoding
INFO - Loaded 64487199 rules
INFO - Memory used 2360.054904 MB
INFO - Grammar loading took: 151 seconds.
INFO - Stateful object with state index 0
INFO - Loading Berkeley LM from binary model/lm.berkeleylm
INFO - FEATURE: tm_pt (weight 0.000)
INFO - FEATURE: OOVPenalty (weight 0.016)
INFO - FEATURE: WordPenalty (weight -0.279)
INFO - FEATURE: PhrasePenalty (weight 0.001)
INFO - FEATURE: Distortion (weight 0.123)
INFO - FEATURE: lm_0, order 4 (weight 0.314), classLm=false
INFO - Grammar sorting happening lazily on-demand.
INFO - Model loading took 176 seconds
INFO - Memory used 2823.330152 MB
INFO - Input 0: <s> hello </s>
INFO - Input 0: Collecting options took 0.0 seconds
INFO - Input 0: Search took 0.073 seconds
INFO - Input 0: Translation took 0.824 seconds
INFO - Input 0: Memory used is 2828.316456 MB
INFO - Input 0: 1-best extraction took 0.172 seconds
-
INFO - Input 1: <s> how are you </s>
INFO - Input 1: Collecting options took 0.0 seconds
INFO - Input 1: Search took 0.94 seconds
INFO - Input 1: Translation took 5.397 seconds
INFO - Input 1: Memory used is 2858.289328 MB
INFO - Input 1: 1-best extraction took 0.468 seconds
-
INFO - Decoding completed.
INFO - Memory used 2858.289328 MB
INFO - Total running time: 183 seconds

Did this output the translation anywhere?

Also , can you tell me what is the command corresponding to this on
Windows, I could try there.

Thank you,

Nicoara


On Tue, Jul 4, 2017 at 7:33 PM, Matt Post <po...@cs.jhu.edu> wrote:

> Sorry, that should be "joshua -v 1", can you show that, please?
>
>
> On Jul 4, 2017, at 12:25 PM, Nicoara Talpes <ni...@gmail.com>
> wrote:
>
> Hello,
>
> Thanks for responding .
>
> Here it is the output, I hope it clarifies a little:
>
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
> example.SRC
> hello
> how are you
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
> example.SRC | ./prepare.sh
> hello
> how are you
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
> example.SRC | ./prepare.sh | ./joshua -v
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 5
>     at org.apache.joshua.decoder.ArgsParser.<init>(ArgsParser.java:60)
>     at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:61)
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ cat
> example.SRC | ./prepare.sh | ./joshua
> -
> -
>
> How to proceed?
>
> Thank you
>
> On Tue, Jul 4, 2017 at 4:31 PM, Matt Post <po...@cs.jhu.edu> wrote:
>
>> Hi Nicoara,
>>
>> Sorry, I seem to have missed your followup question.
>>
>> Can you please debug this a little? What do you get from the following
>> commands?
>>
>> head example.SRC
>> head example.SRC | ./prepare.sh
>> head example.SRC | ./prepare.sh | ./joshua -v
>>
>> matt
>>
>>
>> On Jul 3, 2017, at 5:30 PM, Nicoara Talpes <ni...@gmail.com>
>> wrote:
>>
>> Hello Joshua Community,
>>
>> I am running "cat example.SRC | ./prepare.sh | ./joshua" in a terminal on
>> a Ubuntu machine, but for every line in the example.SRC, there is a
>> hyphen shown on the terminal. No translation seems to be happening. I am
>> using the English-German pack.
>>
>> How to fix this?
>>
>> Is there a FAQ that I missed where this is addressed?
>>
>> Apologies for asking this question again in a matter of a few days, but I
>> am in need of a response to move forward.
>>
>> Thank you,
>>
>> Nicoara
>>
>>
>>
>
>

Re: joshua prints hyphens instead of translation

Posted by Matt Post <po...@cs.jhu.edu>.
Sorry, that should be "joshua -v 1", can you show that, please?


> On Jul 4, 2017, at 12:25 PM, Nicoara Talpes <nicoaratalpes@gmail.com <ma...@gmail.com>> wrote:
> 
> Hello,
> 
> Thanks for responding .
> 
> Here it is the output, I hope it clarifies a little:
> 
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head example.SRC
> hello 
> how are you
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head example.SRC | ./prepare.sh 
> hello
> how are you
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head example.SRC | ./prepare.sh | ./joshua -v
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 5
>     at org.apache.joshua.decoder.ArgsParser.<init>(ArgsParser.java:60)
>     at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:61)
> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ cat example.SRC | ./prepare.sh | ./joshua
> -
> -
> 
> How to proceed? 
> 
> Thank you
> 
> On Tue, Jul 4, 2017 at 4:31 PM, Matt Post <post@cs.jhu.edu <ma...@cs.jhu.edu>> wrote:
> Hi Nicoara,
> 
> Sorry, I seem to have missed your followup question. 
> 
> Can you please debug this a little? What do you get from the following commands?
> 
> 	head example.SRC
> 	head example.SRC | ./prepare.sh
> 	head example.SRC | ./prepare.sh | ./joshua -v
> 
> matt
> 
> 
>> On Jul 3, 2017, at 5:30 PM, Nicoara Talpes <nicoaratalpes@gmail.com <ma...@gmail.com>> wrote:
>> 
>> Hello Joshua Community,
>> 
>> I am running "cat example.SRC | ./prepare.sh | ./joshua" in a terminal on a Ubuntu machine, but for every line in the example.SRC, there is a hyphen shown on the terminal. No translation seems to be happening. I am using the English-German pack.
>> 
>> How to fix this?
>> 
>> Is there a FAQ that I missed where this is addressed?
>> 
>> Apologies for asking this question again in a matter of a few days, but I am in need of a response to move forward.
>> 
>> Thank you,
>> 
>> Nicoara
> 
> 


Re: joshua prints hyphens instead of translation

Posted by Nicoara Talpes <ni...@gmail.com>.
Hello,

Thanks for responding .

Here it is the output, I hope it clarifies a little:

nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
example.SRC
hello
how are you
nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
example.SRC | ./prepare.sh
hello
how are you
nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ head
example.SRC | ./prepare.sh | ./joshua -v
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 5
    at org.apache.joshua.decoder.ArgsParser.<init>(ArgsParser.java:60)
    at org.apache.joshua.decoder.JoshuaDecoder.main(JoshuaDecoder.java:61)
nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ cat
example.SRC | ./prepare.sh | ./joshua
-
-

How to proceed?

Thank you

On Tue, Jul 4, 2017 at 4:31 PM, Matt Post <po...@cs.jhu.edu> wrote:

> Hi Nicoara,
>
> Sorry, I seem to have missed your followup question.
>
> Can you please debug this a little? What do you get from the following
> commands?
>
> head example.SRC
> head example.SRC | ./prepare.sh
> head example.SRC | ./prepare.sh | ./joshua -v
>
> matt
>
>
> On Jul 3, 2017, at 5:30 PM, Nicoara Talpes <ni...@gmail.com>
> wrote:
>
> Hello Joshua Community,
>
> I am running "cat example.SRC | ./prepare.sh | ./joshua" in a terminal on
> a Ubuntu machine, but for every line in the example.SRC, there is a
> hyphen shown on the terminal. No translation seems to be happening. I am
> using the English-German pack.
>
> How to fix this?
>
> Is there a FAQ that I missed where this is addressed?
>
> Apologies for asking this question again in a matter of a few days, but I
> am in need of a response to move forward.
>
> Thank you,
>
> Nicoara
>
>
>

Re: joshua prints hyphens instead of translation

Posted by Matt Post <po...@cs.jhu.edu>.
Hi Nicoara,

Sorry, I seem to have missed your followup question. 

Can you please debug this a little? What do you get from the following commands?

	head example.SRC
	head example.SRC | ./prepare.sh
	head example.SRC | ./prepare.sh | ./joshua -v

matt


> On Jul 3, 2017, at 5:30 PM, Nicoara Talpes <nicoaratalpes@gmail.com <ma...@gmail.com>> wrote:
> 
> Hello Joshua Community,
> 
> I am running "cat example.SRC | ./prepare.sh | ./joshua" in a terminal on a Ubuntu machine, but for every line in the example.SRC, there is a hyphen shown on the terminal. No translation seems to be happening. I am using the English-German pack.
> 
> How to fix this?
> 
> Is there a FAQ that I missed where this is addressed?
> 
> Apologies for asking this question again in a matter of a few days, but I am in need of a response to move forward.
> 
> Thank you,
> 
> Nicoara