[jira] [Updated] (JOSHUA-233) Berkeleyaligner to print progress to terminal

["Lewis John McGibbney (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/JOSHUA-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lewis John McGibbney updated JOSHUA-233:
----------------------------------------
    Fix Version/s: 6.1

> Berkeleyaligner to print progress to terminal
> ---------------------------------------------
>
>                 Key: JOSHUA-233
>                 URL: https://issues.apache.org/jira/browse/JOSHUA-233
>             Project: Joshua
>          Issue Type: Bug
>            Reporter: Lewis John McGibbney
>             Fix For: 6.1
>
>
> Right now when testing Joshua from within the Homebrew recipe, a lot of time is being spent on word alignment(???), I think that it would be more helpful if we could see some activity whilst waiting e.g. a progress bar. 
> {code}
> lmcgibbn@LMC-032857 /usr/local(joshua) $ brew test -vd joshua
> /usr/local/Library/brew.rb (Formulary::FormulaLoader): loading /usr/local/Library/Formula/joshua.rb
> Testing joshua
> /usr/local/Library/Homebrew/test.rb (Formulary::FromPathLoader): loading /usr/local/Library/Formula/joshua.rb
> ==> Downloading https://github.com/joshua-decoder/indian-parallel-corpora/archive/1.0.tar.gz
> Already downloaded: /Library/Caches/Homebrew/joshua--indian-parallel-corpora-1.0.tar.gz
> ==> Verifying joshua--indian-parallel-corpora-1.0.tar.gz checksum
> tar xf /Library/Caches/Homebrew/joshua--indian-parallel-corpora-1.0.tar.gz
> ==> $JOSHUA/bin/pipeline.pl --source bn --target en     --no-prepare --aligner berkeley     --type hiero     --corpus /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en     --tune /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/dev.bn-en     --test /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/devtest.bn-en
> [source-numlines] rebuilding...
>   dep=/usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en.bn [CHANGED]
>   cmd=cat /usr/local/Cellar/joshua/6.0.5/share/bn-en/tok/training.bn-en.bn | wc -l
>   took 0 seconds (0s)
> [source-numlines] retrieved cached result =>    20788
> [berkeley-aligner-chunk-0] rebuilding...
>   dep=alignments/0/word-align.conf [CHANGED]
>   dep=/private/tmp/joshua20151106-17227-1kriiqu/data/train/splits/corpus.bn.0 [CHANGED]
>   dep=/private/tmp/joshua20151106-17227-1kriiqu/data/train/splits/corpus.en.0 [CHANGED]
>   dep=alignments/0/training.align [NOT FOUND]
>   cmd=java -d64 -Xmx10g -jar /usr/local/Cellar/joshua/6.0.5/libexec/lib/berkeleyaligner.jar ++alignments/0/word-align.conf
> {code}
> The final line above is the one taking a good while!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)