You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@joshua.apache.org by Arezoo Arjomand <ar...@yahoo.com> on 2017/08/06 13:01:26 UTC
I download Apache Joshua (Incubating) and compile it successfully. but when i run it as the instruction https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial the following error is appeared.I'm really appreciate if you tell me how can i fix it.
arezoo1@arezoo1-X450CC:~/joshua-tutorial/runs$ $JOSHUA/bin/pipeline.pl \ --rundir tessttt \
> --readme "Baseline Hiero run" \
> --source es \
> --target en \
> --type hiero \
> --corpus $FISHER/corpus/asr/fisher_train \
> --tune $FISHER/corpus/asr/fisher_dev \
> --test $FISHER/corpus/asr/fisher_dev2 \
> --maxlen 11 \
> --maxlen-tune 11 \
> --maxlen-test 11 \
> --tuner-iterations 1 \
> --lm-order 3
[train-copy-and-filter] rebuilding...
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [NOT FOUND]
cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en) | /joshua/scripts/training/filter-empty-lines.pl | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/train/train.es /home/arezoo1/joshua-tutorial/runs/data/train/train.en
took 1 seconds (1s)
[train-tokenize-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/train/train.es | /joshua/scripts/preparation/normalize.pl es | /joshua/scripts/preparation/tokenize.pl -l es 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es
took 7 seconds (7s)
[train-tokenize-en] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/train/train.en | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en
took 9 seconds (9s)
[train-trim] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [NOT FOUND]
cmd=/joshua/scripts/training/paste /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en | /joshua/scripts/training/trim_parallel_corpus.pl 11 | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en
took 1 seconds (1s)
[train-lowercase-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es
took 0 seconds (0s)
[train-lowercase-en] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en
took 0 seconds (0s)
[train-vocab-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.es | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/train/vocab.es
took 1 seconds (1s)
[train-vocab-en] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.en [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.en | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/train/vocab.en
took 0 seconds (0s)
[tune-copy-and-filter] rebuilding...
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.0) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.1) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.2) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.3) | /joshua/scripts/training/filter-empty-lines.pl | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/tune/tune.es /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3
took 0 seconds (0s)
[tune-tokenize-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.es | /joshua/scripts/preparation/normalize.pl es | /joshua/scripts/preparation/tokenize.pl -l es 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es
took 0 seconds (0s)
[tune-tokenize-en.0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0
took 1 seconds (1s)
[tune-tokenize-en.1] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1
took 0 seconds (0s)
[tune-tokenize-en.2] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2
took 0 seconds (0s)
[tune-tokenize-en.3] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3
took 1 seconds (1s)
[tune-trim] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/paste /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3 | /joshua/scripts/training/trim_parallel_corpus.pl 11 | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2 /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3
took 0 seconds (0s)
[tune-lowercase-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.es
took 0 seconds (0s)
[tune-lowercase-en.0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.0 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.0
took 0 seconds (0s)
[tune-lowercase-en.1] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.1 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.1
took 0 seconds (0s)
[tune-lowercase-en.2] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.2 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.2
took 0 seconds (0s)
[tune-lowercase-en.3] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.3 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.3
took 0 seconds (0s)
[tune-vocab-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.es | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.es
took 0 seconds (0s)
[tune-vocab-en.0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.0 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.0 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.0
took 0 seconds (0s)
[tune-vocab-en.1] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.1 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.1 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.1
took 0 seconds (0s)
[tune-vocab-en.2] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.2 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.2 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.2
took 0 seconds (0s)
[tune-vocab-en.3] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.3 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.3 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.3
took 0 seconds (0s)
[test-copy-and-filter] rebuilding...
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.0 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.es) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.0) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.1) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.2) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.3) | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/test/test.es /home/arezoo1/joshua-tutorial/runs/data/test/test.en.0 /home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 /home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 /home/arezoo1/joshua-tutorial/runs/data/test/test.en.3
took 0 seconds (0s)
[test-tokenize-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/test/test.es | /joshua/scripts/preparation/normalize.pl es | /joshua/scripts/preparation/tokenize.pl -l es 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es
took 1 seconds (1s)
[test-tokenize-en.0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/test/test.en.0 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0
took 0 seconds (0s)
[test-tokenize-en.1] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1
took 0 seconds (0s)
[test-tokenize-en.2] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2
took 1 seconds (1s)
[test-tokenize-en.3] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3
took 0 seconds (0s)
[test-trim] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/paste /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0 /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1 /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2 /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3 | /joshua/scripts/training/trim_parallel_corpus.pl 11 | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0 /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1 /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2 /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3
took 0 seconds (0s)
[test-lowercase-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.es
took 0 seconds (0s)
[test-lowercase-en.0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.0 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.0
took 0 seconds (0s)
[test-lowercase-en.1] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.1 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.1
took 0 seconds (0s)
[test-lowercase-en.2] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.2 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.2
took 0 seconds (0s)
[test-lowercase-en.3] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.3 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3 | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.3
took 0 seconds (0s)
[test-vocab-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.es | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/test/vocab.es
took 0 seconds (0s)
[test-vocab-en.0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.0 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.0 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.0
took 0 seconds (0s)
[test-vocab-en.1] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.1 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.1 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.1
took 1 seconds (1s)
[test-vocab-en.2] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.2 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.2 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.2
took 0 seconds (0s)
[test-vocab-en.3] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.3 [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.3 | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.3
took 0 seconds (0s)
[source-numlines] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.es [CHANGED]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.es | wc -l
took 0 seconds (0s)
[source-numlines] retrieved cached result => 77457
[giza-0] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus.en [CHANGED]
dep=alignments/0/model/aligned.grow-diag-final [NOT FOUND]
cmd=rm -f alignments/0/corpus.0-0.*; /joshua/scripts/training/run-giza.pl --root-dir alignments/0 -e en -f es -corpus /home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus -merge grow-diag-final > alignments/0/giza.log 2>&1
JOB FAILED (return code 127)
[aligner-combine] rebuilding...
dep=alignments/0/model/aligned.grow-diag-final [NOT FOUND]
dep=alignments/training.align [NOT FOUND]
cmd=cat alignments/0/model/aligned.grow-diag-final > alignments/training.align
JOB FAILED (return code 1)
cat: alignments/0/model/aligned.grow-diag-final: No such file or directory
Sincerely,
Arezoo Arjomand Zadeh
Re:
Posted by Matt Post <po...@cs.jhu.edu>.
It looks like the alignments didn't combine, which probably means alignment failed, which probably means the binaries didn't build and aren't in $JOSHUA/bin. These are built as one of the preprocessing steps. Did you run download-deps.sh?
matt
> On Aug 6, 2017, at 9:19 PM, Arezoo Arj <arezooarjomand@yahoo.com <ma...@yahoo.com>> wrote:
>
> Hi
> Thank you for your reply. I'll be really greatfull if you send me Matt's email address?
> From: John Hewitt <ma...@seas.upenn.edu>
> Sent: 8/6/2017 11:21 PM
> To: user@joshua.incubator.apache.org <ma...@joshua.incubator.apache.org>; Arezoo Arjomand <ma...@yahoo.com>
> Subject: Re:
>
> Hi Azeroo,
>
> I'm replying to you and to the user@joshua mailing list. Matt is on this list, the old Google Group isn't used any more, and Hieu is not involved in Joshua development.
>
> Looks like the job died at
>
> cmd=rm -f alignments/0/corpus.0-0.*; /joshua/scripts/training/run-giza.pl <http://run-giza.pl/> --root-dir alignments/0 -e en -f es -corpus /home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus -merge grow-diag-final > alignments/0/giza.log 2>&1
> JOB FAILED (return code 127)
>
> You'll note that stdout and stderr have both been piped to alignments/0/giza.log.
> I'd suggest looking there first; you might be able to figure out the issue based on the error log there. If not, please post its contents in a reply.
>
> Could you let us know if you're using the 6.1 release?
>
> -John
>
>
>
> On Sun, Aug 6, 2017 at 7:01 AM, Arezoo Arjomand <arezooarjomand@yahoo.com <ma...@yahoo.com>> wrote:
> I download Apache Joshua (Incubating) and compile it successfully. but when i run it as the instruction https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial <https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial> the following error is appeared.
> I'm really appreciate if you tell me how can i fix it.
>
>
>
> arezoo1@arezoo1-X450CC:~/joshua-tutorial/runs$ $JOSHUA/bin/pipeline.pl <http://pipeline.pl/> \ --rundir tessttt \
> > --readme "Baseline Hiero run" \
> > --source es \
> > --target en \
> > --type hiero \
> > --corpus $FISHER/corpus/asr/fisher_train \
> > --tune $FISHER/corpus/asr/fisher_dev \
> > --test $FISHER/corpus/asr/fisher_dev2 \
> > --maxlen 11 \
> > --maxlen-tune 11 \
> > --maxlen-test 11 \
> > --tuner-iterations 1 \
> > --lm-order 3
> [train-copy-and-filter] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es <http://fisher_train.es/> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es <http://train.es/> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [NOT FOUND]
> cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es <http://fisher_train.es/>) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en) | /joshua/scripts/training/filter-empty-lines.pl <http://filter-empty-lines.pl/> | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/train/train.es <http://train.es/>/home/arezoo1/joshua-tutorial/runs/data/train/train.en
> took 1 seconds (1s)
> [train-tokenize-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es <http://train.es/> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es <http://train.tok.es/> [NOT FOUND]
> cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/train/train.es <http://train.es/> | /joshua/scripts/preparation/normalize.pl <http://normalize.pl/> es | /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl/> -l es 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es <http://train.tok.es/>
> took 7 seconds (7s)
> [train-tokenize-en] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [NOT FOUND]
> cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/train/train.en | /joshua/scripts/preparation/normalize.pl <http://normalize.pl/> en | /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl/> -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en
> took 9 seconds (9s)
> [train-trim] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es <http://train.tok.es/> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es <http://train.tok.11.es/> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [NOT FOUND]
> cmd=/joshua/scripts/training/paste /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es <http://train.tok.es/> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en | /joshua/scripts/training/trim_parallel_corpus.pl <http://trim_parallel_corpus.pl/> 11 | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es <http://train.tok.11.es/> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en
> took 1 seconds (1s)
> [train-lowercase-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es <http://train.tok.11.es/> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es <http://train.tok.11.lc.es/> [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es <http://train.tok.11.es/> | /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl/> > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es <http://train.tok.11.lc.es/>
> took 0 seconds (0s)
> [train-lowercase-en] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en | /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl/> > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en
> took 0 seconds (0s)
> [train-vocab-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.es <http://corpus.es/> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.es <http://vocab.es/> [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.es <http://corpus.es/> | /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl/> > /home/arezoo1/joshua-tutorial/runs/data/train/vocab.es <http://vocab.es/>
> took 1 seconds (1s)
> [train-vocab-en] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.en [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.en | /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl/> > /home/arezoo1/joshua-tutorial/runs/data/train/vocab.en
> took 0 seconds (0s)
> [tune-copy-and-filter] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es <http://fisher_dev.es/> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.0 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.es <http://tune.es/> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 [NOT FOUND]
> cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es <http://fisher_dev.es/>) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-
>
> [The entire original message is not included.]
RE:
Posted by Arezoo Arj <ar...@yahoo.com>.
Hi
Thank you for your reply. I'll be really greatfull if you send me Matt's email address?
-----Original Message-----
From: "John Hewitt" <jo...@seas.upenn.edu>
Sent: 8/6/2017 11:21 PM
To: "user@joshua.incubator.apache.org" <us...@joshua.incubator.apache.org>; "Arezoo Arjomand" <ar...@yahoo.com>
Subject: Re:
Hi Azeroo,
I'm replying to you and to the user@joshua mailing list. Matt is on this list, the old Google Group isn't used any more, and Hieu is not involved in Joshua development.
Looks like the job died at
cmd=rm -f alignments/0/corpus.0-0.*; /joshua/scripts/training/run-giza.pl --root-dir alignments/0 -e en -f es -corpus /home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus -merge grow-diag-final > alignments/0/giza.log 2>&1
JOB FAILED (return code 127)
You'll note that stdout and stderr have both been piped to alignments/0/giza.log.
I'd suggest looking there first; you might be able to figure out the issue based on the error log there. If not, please post its contents in a reply.
Could you let us know if you're using the 6.1 release?
-John
On Sun, Aug 6, 2017 at 7:01 AM, Arezoo Arjomand <ar...@yahoo.com> wrote:
I download Apache Joshua (Incubating) and compile it successfully. but when i run it as the instruction https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial the following error is appeared.
I'm really appreciate if you tell me how can i fix it.
arezoo1@arezoo1-X450CC:~/joshua-tutorial/runs$ $JOSHUA/bin/pipeline.pl \ --rundir tessttt \
> --readme "Baseline Hiero run" \
> --source es \
> --target en \
> --type hiero \
> --corpus $FISHER/corpus/asr/fisher_train \
> --tune $FISHER/corpus/asr/fisher_dev \
> --test $FISHER/corpus/asr/fisher_dev2 \
> --maxlen 11 \
> --maxlen-tune 11 \
> --maxlen-test 11 \
> --tuner-iterations 1 \
> --lm-order 3
[train-copy-and-filter] rebuilding...
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [NOT FOUND]
cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en) | /joshua/scripts/training/filter-empty-lines.pl | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/train/train.es /home/arezoo1/joshua-tutorial/runs/data/train/train.en
took 1 seconds (1s)
[train-tokenize-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/train/train.es | /joshua/scripts/preparation/normalize.pl es | /joshua/scripts/preparation/tokenize.pl -l es 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es
took 7 seconds (7s)
[train-tokenize-en] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [NOT FOUND]
cmd=/joshua/scripts/training/scat /home/arezoo1/joshua-tutorial/runs/data/train/train.en | /joshua/scripts/preparation/normalize.pl en | /joshua/scripts/preparation/tokenize.pl -l en 2> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en
took 9 seconds (9s)
[train-trim] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [NOT FOUND]
cmd=/joshua/scripts/training/paste /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en | /joshua/scripts/training/trim_parallel_corpus.pl 11 | /joshua/scripts/support/split2files /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en
took 1 seconds (1s)
[train-lowercase-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es
took 0 seconds (0s)
[train-lowercase-en] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en | /joshua/scripts/preparation/lowercase.pl > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en
took 0 seconds (0s)
[train-vocab-es] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.es [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.es | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/train/vocab.es
took 1 seconds (1s)
[train-vocab-en] rebuilding...
dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.en [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.en [NOT FOUND]
cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.en | /joshua/scripts/training/build-vocab.pl > /home/arezoo1/joshua-tutorial/runs/data/train/vocab.en
took 0 seconds (0s)
[tune-copy-and-filter] rebuilding...
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.0 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.1 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.2 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.3 [CHANGED]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.es [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 [NOT FOUND]
dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 [NOT FOUND]
cmd=/joshua/scripts/training/paste <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es) <(cat /home/arezoo1/joshua-tutorial/fisher-callhome-
[The entire original message is not included.]
Re:
Posted by John Hewitt <jo...@seas.upenn.edu>.
Hi Azeroo,
I'm replying to you and to the user@joshua mailing list. Matt is on this
list, the old Google Group isn't used any more, and Hieu is not involved in
Joshua development.
Looks like the job died at
* cmd=rm -f alignments/0/corpus.0-0.*;
/joshua/scripts/training/run-giza.pl <http://run-giza.pl/> --root-dir
alignments/0 -e en -f es -corpus
/home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus -merge
grow-diag-final > alignments/0/giza.log 2>&1 JOB FAILED (return code 127)*
You'll note that stdout and stderr have both been piped to
*alignments/0/giza.log.*
I'd suggest looking there first; you might be able to figure out the issue
based on the error log there. If not, please post its contents in a reply.
Could you let us know if you're using the 6.1 release?
-John
On Sun, Aug 6, 2017 at 7:01 AM, Arezoo Arjomand <ar...@yahoo.com>
wrote:
> I download Apache Joshua (Incubating) and compile it successfully. but
> when i run it as the instruction https://cwiki.apache.org/
> confluence/display/JOSHUA/Joshua+Tutorial the following error is appeared.
> I'm really appreciate if you tell me how can i fix it.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *arezoo1@arezoo1-X450CC:~/joshua-tutorial/runs$ $JOSHUA/bin/pipeline.pl
> <http://pipeline.pl> \ --rundir tessttt \> --readme "Baseline Hiero run" \>
> --source es \> --target en \> --type hiero \> --corpus
> $FISHER/corpus/asr/fisher_train \> --tune $FISHER/corpus/asr/fisher_dev \>
> --test $FISHER/corpus/asr/fisher_dev2 \> --maxlen 11 \> --maxlen-tune 11 \>
> --maxlen-test 11 \> --tuner-iterations 1 \> --lm-order
> 3[train-copy-and-filter] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es
> <http://fisher_train.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es
> <http://train.es> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en [NOT FOUND]
> cmd=/joshua/scripts/training/paste <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.es
> <http://fisher_train.es>) <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_train.en)
> | /joshua/scripts/training/filter-empty-lines.pl
> <http://filter-empty-lines.pl> | /joshua/scripts/support/split2files
> /home/arezoo1/joshua-tutorial/runs/data/train/train.es <http://train.es>
> /home/arezoo1/joshua-tutorial/runs/data/train/train.en took 1 seconds
> (1s)[train-tokenize-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.es
> <http://train.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es
> <http://train.tok.es> [NOT FOUND] cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/train/train.es <http://train.es> |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> es |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l es 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es
> <http://train.tok.es> took 7 seconds (7s)[train-tokenize-en]
> rebuilding... dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.en
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en
> [NOT FOUND] cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/train/train.en |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en
> took 9 seconds (9s)[train-trim] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es
> <http://train.tok.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es
> <http://train.tok.11.es> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en [NOT
> FOUND] cmd=/joshua/scripts/training/paste
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.es
> <http://train.tok.es>
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.en |
> /joshua/scripts/training/trim_parallel_corpus.pl
> <http://trim_parallel_corpus.pl> 11 | /joshua/scripts/support/split2files
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es
> <http://train.tok.11.es>
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en took 1
> seconds (1s)[train-lowercase-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es
> <http://train.tok.11.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es
> <http://train.tok.11.lc.es> [NOT FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.es
> <http://train.tok.11.es> | /joshua/scripts/preparation/lowercase.pl
> <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.es
> <http://train.tok.11.lc.es> took 0 seconds (0s)[train-lowercase-en]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.en |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/train/train.tok.11.lc.en took 0
> seconds (0s)[train-vocab-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.es
> <http://corpus.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.es
> <http://vocab.es> [NOT FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/train/corpus.es <http://corpus.es>
> | /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/train/vocab.es <http://vocab.es>
> took 1 seconds (1s)[train-vocab-en] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.en [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/vocab.en [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/train/corpus.en |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/train/vocab.en took 0 seconds
> (0s)[tune-copy-and-filter] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es
> <http://fisher_dev.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.0
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.1
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.2
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.3
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.es
> <http://tune.es> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 [NOT FOUND]
> cmd=/joshua/scripts/training/paste <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.es
> <http://fisher_dev.es>) <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.0)
> <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.1)
> <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.2)
> <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev.en.3)
> | /joshua/scripts/training/filter-empty-lines.pl
> <http://filter-empty-lines.pl> | /joshua/scripts/support/split2files
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.es <http://tune.es>
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 took 0 seconds
> (0s)[tune-tokenize-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.es <http://tune.es>
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es
> <http://tune.tok.es> [NOT FOUND] cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.es <http://tune.es> |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> es |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l es 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es
> <http://tune.tok.es> took 0 seconds (0s)[tune-tokenize-en.0]
> rebuilding... dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0
> [NOT FOUND] cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.0 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0
> took 1 seconds (1s)[tune-tokenize-en.1] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1 [NOT FOUND]
> cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.1 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1
> took 0 seconds (0s)[tune-tokenize-en.2] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2 [NOT FOUND]
> cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.2 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2
> took 0 seconds (0s)[tune-tokenize-en.3] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3 [NOT FOUND]
> cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.en.3 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3
> took 1 seconds (1s)[tune-trim] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es
> <http://tune.tok.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es
> <http://tune.tok.11.es> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0 [NOT
> FOUND] dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1
> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2 [NOT
> FOUND] dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3
> [NOT FOUND] cmd=/joshua/scripts/training/paste
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.es
> <http://tune.tok.es>
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.0
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.1
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.2
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.en.3 |
> /joshua/scripts/training/trim_parallel_corpus.pl
> <http://trim_parallel_corpus.pl> 11 | /joshua/scripts/support/split2files
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es
> <http://tune.tok.11.es>
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3 took 0
> seconds (0s)[tune-lowercase-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es
> <http://tune.tok.11.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.es
> <http://tune.tok.11.lc.es> [NOT FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.es
> <http://tune.tok.11.es> | /joshua/scripts/preparation/lowercase.pl
> <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.es
> <http://tune.tok.11.lc.es> took 0 seconds (0s)[tune-lowercase-en.0]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.0 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.0 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc
> <http://tune.tok.11.lc>.en.0 took 0 seconds (0s)[tune-lowercase-en.1]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.1 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.1 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc
> <http://tune.tok.11.lc>.en.1 took 0 seconds (0s)[tune-lowercase-en.2]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.2 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.2 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc
> <http://tune.tok.11.lc>.en.2 took 0 seconds (0s)[tune-lowercase-en.3]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc.en.3 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.en.3 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/tune.tok.11.lc
> <http://tune.tok.11.lc>.en.3 took 0 seconds (0s)[tune-vocab-es]
> rebuilding... dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.es
> <http://corpus.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.es <http://vocab.es>
> [NOT FOUND] cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.es
> <http://corpus.es> | /joshua/scripts/training/build-vocab.pl
> <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.es <http://vocab.es>
> took 0 seconds (0s)[tune-vocab-en.0] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.0 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.0 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.0 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.0 took 0 seconds
> (0s)[tune-vocab-en.1] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.1 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.1 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.1 took 0 seconds
> (0s)[tune-vocab-en.2] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.2 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.2 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.2 took 0 seconds
> (0s)[tune-vocab-en.3] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.3 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/tune/corpus.en.3 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/tune/vocab.en.3 took 0 seconds
> (0s)[test-copy-and-filter] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.es
> <http://fisher_dev2.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.0
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.1
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.2
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.3
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.es
> <http://test.es> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.0 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 [NOT FOUND]
> cmd=/joshua/scripts/training/paste <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.es
> <http://fisher_dev2.es>) <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.0)
> <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.1)
> <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.2)
> <(cat
> /home/arezoo1/joshua-tutorial/fisher-callhome-corpus-master/corpus/asr/fisher_dev2.en.3)
> | /joshua/scripts/support/split2files
> /home/arezoo1/joshua-tutorial/runs/data/test/test.es <http://test.es>
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.0
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.1
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.2
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 took 0 seconds
> (0s)[test-tokenize-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.es <http://test.es>
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es
> <http://test.tok.es> [NOT FOUND] cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.es <http://test.es> |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> es |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l es 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es
> <http://test.tok.es> took 1 seconds (1s)[test-tokenize-en.0]
> rebuilding... dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.0
> [CHANGED] dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0
> [NOT FOUND] cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.0 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0
> took 0 seconds (0s)[test-tokenize-en.1] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1 [NOT FOUND]
> cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.1 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1
> took 0 seconds (0s)[test-tokenize-en.2] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2 [NOT FOUND]
> cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.2 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2
> took 1 seconds (1s)[test-tokenize-en.3] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3 [NOT FOUND]
> cmd=/joshua/scripts/training/scat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.en.3 |
> /joshua/scripts/preparation/normalize.pl <http://normalize.pl> en |
> /joshua/scripts/preparation/tokenize.pl <http://tokenize.pl> -l en 2>
> /dev/null > /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3
> took 0 seconds (0s)[test-trim] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es
> <http://test.tok.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es
> <http://test.tok.11.es> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0 [NOT
> FOUND] dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1
> [NOT FOUND]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2 [NOT
> FOUND] dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3
> [NOT FOUND] cmd=/joshua/scripts/training/paste
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.es
> <http://test.tok.es>
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.0
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.1
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.2
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.en.3 |
> /joshua/scripts/training/trim_parallel_corpus.pl
> <http://trim_parallel_corpus.pl> 11 | /joshua/scripts/support/split2files
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es
> <http://test.tok.11.es>
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3 took 0
> seconds (0s)[test-lowercase-es] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es
> <http://test.tok.11.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.es
> <http://test.tok.11.lc.es> [NOT FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.es
> <http://test.tok.11.es> | /joshua/scripts/preparation/lowercase.pl
> <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.es
> <http://test.tok.11.lc.es> took 0 seconds (0s)[test-lowercase-en.0]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.0 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.0 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc
> <http://test.tok.11.lc>.en.0 took 0 seconds (0s)[test-lowercase-en.1]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.1 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.1 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc
> <http://test.tok.11.lc>.en.1 took 0 seconds (0s)[test-lowercase-en.2]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.2 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.2 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc
> <http://test.tok.11.lc>.en.2 took 0 seconds (0s)[test-lowercase-en.3]
> rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3
> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc.en.3 [NOT
> FOUND] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.en.3 |
> /joshua/scripts/preparation/lowercase.pl <http://lowercase.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/test.tok.11.lc
> <http://test.tok.11.lc>.en.3 took 0 seconds (0s)[test-vocab-es]
> rebuilding... dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.es
> <http://corpus.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.es <http://vocab.es>
> [NOT FOUND] cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.es
> <http://corpus.es> | /joshua/scripts/training/build-vocab.pl
> <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/vocab.es <http://vocab.es>
> took 0 seconds (0s)[test-vocab-en.0] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.0 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.0 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.0 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.0 took 0 seconds
> (0s)[test-vocab-en.1] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.1 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.1 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.1 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.1 took 1 seconds
> (1s)[test-vocab-en.2] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.2 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.2 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.2 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.2 took 0 seconds
> (0s)[test-vocab-en.3] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.3 [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.3 [NOT FOUND]
> cmd=cat /home/arezoo1/joshua-tutorial/runs/data/test/corpus.en.3 |
> /joshua/scripts/training/build-vocab.pl <http://build-vocab.pl> >
> /home/arezoo1/joshua-tutorial/runs/data/test/vocab.en.3 took 0 seconds
> (0s)[source-numlines] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/corpus.es
> <http://corpus.es> [CHANGED] cmd=cat
> /home/arezoo1/joshua-tutorial/runs/data/train/corpus.es <http://corpus.es>
> | wc -l took 0 seconds (0s)[source-numlines] retrieved cached result =>
> 77457[giza-0] rebuilding...
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus.es
> <http://corpus.es> [CHANGED]
> dep=/home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus.en
> [CHANGED] dep=alignments/0/model/aligned.grow-diag-final [NOT FOUND]
> cmd=rm -f alignments/0/corpus.0-0.*; /joshua/scripts/training/run-giza.pl
> <http://run-giza.pl> --root-dir alignments/0 -e en -f es -corpus
> /home/arezoo1/joshua-tutorial/runs/data/train/splits/0/corpus -merge
> grow-diag-final > alignments/0/giza.log 2>&1 JOB FAILED (return code
> 127)[aligner-combine] rebuilding...
> dep=alignments/0/model/aligned.grow-diag-final [NOT FOUND]
> dep=alignments/training.align [NOT FOUND] cmd=cat
> alignments/0/model/aligned.grow-diag-final > alignments/training.align JOB
> FAILED (return code 1)cat: alignments/0/model/aligned.grow-diag-final: No
> such file or directory*
>
>
>
>
> Sincerely,
> Arezoo Arjomand Zadeh
>