Re: cannot allocate memory

[Nicoara Talpes <ni...@gmail.com>]

Hello ,

Thank you both for answering so fast !

I managed to increase the allocated memory and now it does not crash
because of this.

But still there is no output for "cat example.SRC | ./prepare.sh |
./joshua"; for every line in the example.SRC, there is a hyphen shown on
the terminal.

What am I misconfiguring?

Thank you






On Wed, Jun 28, 2017 at 12:30 AM, Matt Post <po...@cs.jhu.edu> wrote:

> Yes, the default memory is not set very well on many of these language
> packs. John's suggestions here should solve the problem. Please do let us
> know!
>
> matt
>
>
> On Jun 26, 2017, at 2:09 PM, John Hewitt <jo...@seas.upenn.edu> wrote:
>
> Hi Nicoara,
>
> Machine translation is a memory-intensive task, with large amounts of
> memory used for storing translation information and language modeling
> information.
>
> From the language packs page
> <https://cwiki.apache.org/confluence/display/JOSHUA/Language+Packs>: add
> an option to the decoder (e.g. in this case the ./joshua command)
>
>
>    - "-m XXg" — increase the amount of memory provided to Joshua. The
>    default is 8g, but for the larger language packs, you will want 16 or 24.
>    In general, 50% more memory than the raw model size should be more than
>    sufficient.
>
>
> Since you're using the English-German pack, which is 4.5GB, I'd suggest
> about 8GB of RAM. Also make sure your VM has been allocated that much RAM
> from the host system.
>
> Best,
> John
>
>
>
> On Mon, Jun 26, 2017 at 12:00 PM, Nicoara Talpes <ni...@gmail.com>
> wrote:
>
>> Hello Joshua Community,
>>
>> When running in an Ubuntu VM "cat example.SRC | ./prepare.sh | ./joshua"
>> as per instructions here https://cwiki.apache.org/
>> confluence/display/JOSHUA/Language+Packs  the jvm goes quickly to 4 gb
>> and the process crashes.
>>
>> The input is a file with one line to translate: "Hello".
>>
>> What is the amount of RAM required by Joshua? How to limit the amount of
>> RAM required?
>>
>> The error is this:
>> nicoara@ubuntu:~/Desktop/joshua/apache-joshua-en-de-2017-01-31$ cat
>> example.SRC | ./prepare.sh | ./joshua
>> Java HotSpot(TM) 64-Bit Server VM warning: INFO:
>> os::commit_memory(0x00000005cbf00000, 76021760, 0) failed; error='Cannot
>> allocate memory' (errno=12)
>> #
>> # There is insufficient memory for the Java Runtime Environment to
>> continue.
>> # Native memory allocation (mmap) failed to map 76xxxxxxxxx021760 bytes
>> for committing reserved memory.
>> # An error report file with more information is saved as:
>> # /home/nicoara/Desktop/joshua/apache-joshua-en-de-2017-01-31/
>> hs_err_pid10488.log
>>
>> Thank you,
>> Nicoara
>>
>
>
>