You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@joshua.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2016/07/15 20:18:20 UTC

[jira] [Closed] (JOSHUA-281) split2files.pl support script no longer exists hence pipeline fails

     [ https://issues.apache.org/jira/browse/JOSHUA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lewis John McGibbney closed JOSHUA-281.
---------------------------------------
    Resolution: Invalid

This is not a bug at all, my input parameters for the pipeline.pl invocation were incorrect.

> split2files.pl support script no longer exists hence pipeline fails
> -------------------------------------------------------------------
>
>                 Key: JOSHUA-281
>                 URL: https://issues.apache.org/jira/browse/JOSHUA-281
>             Project: Joshua
>          Issue Type: Bug
>          Components: pipeline
>    Affects Versions: 6.0.5
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Blocker
>             Fix For: 6.1
>
>
> When I attempt to run a pipeline, I get the following
> {code}
> lmcgibbn@LMC-032857 /usr/local/incubator-joshua(master) $ ../bin/pipeline.pl  --rundir . --type hiero --corpus /usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en --tune /usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en.tune --test /usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en.test --source en --target ru --rundir experiment_1/1 --readme "Russian model generation experiment 1 run 1" --mbr
> [train-copy-and-filter] rebuilding...
>   dep=/usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en.en [CHANGED]
>   dep=/usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en.ru [CHANGED]
>   dep=/usr/local/incubator-joshua/experiment_1/1/data/train/train.en [NOT FOUND]
>   dep=/usr/local/incubator-joshua/experiment_1/1/data/train/train.ru [NOT FOUND]
>   cmd=/usr/local/incubator-joshua/scripts/training/paste /usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en.en /usr/local/jpl/xdata/joshua_experiments/russian_model/commoncrawl.ru-en.ru | /usr/local/incubator-joshua/scripts/training/filter-empty-lines.pl | /usr/local/incubator-joshua/scripts/training/split2files.pl /usr/local/incubator-joshua/experiment_1/1/data/train/train.en /usr/local/incubator-joshua/experiment_1/1/data/train/train.ru
>   JOB FAILED (return code 127)
> /bin/bash: /usr/local/incubator-joshua/scripts/training/split2files.pl: No such file or directory
> {code}
> The following commit changed the name of the file
> {code}
> Repository: incubator-joshua
> Updated Branches:
>   refs/heads/master 09fb6a2d3 -> f02bd279e
> combined split2files implementations
> Project: http://git-wip-us.apache.org/repos/asf/incubator-joshua/repo
> Commit: http://git-wip-us.apache.org/repos/asf/incubator-joshua/commit/f02bd279
> Tree: http://git-wip-us.apache.org/repos/asf/incubator-joshua/tree/f02bd279
> Diff: http://git-wip-us.apache.org/repos/asf/incubator-joshua/diff/f02bd279
> Branch: refs/heads/master
> Commit: f02bd279e892408c9eca2a2a241f21f59cb105e9
> Parents: 09fb6a2
> Author: Matt Post <po...@cs.jhu.edu>
> Authored: Wed May 18 09:12:07 2016 -0400
> Committer: Matt Post <po...@cs.jhu.edu>
> Committed: Wed May 18 09:12:07 2016 -0400
> ----------------------------------------------------------------------
>  scripts/support/split2files              | 44 +++++++++++++++++++++++++++
>  scripts/support/splittabs.pl             | 42 -------------------------
>  scripts/training/pipeline.pl             |  8 ++---
>  scripts/training/split2files.pl          | 38 -----------------------
>  scripts/training/trim_parallel_corpus.pl |  2 +-
>  5 files changed, 49 insertions(+), 85 deletions(-)
> ----------------------------------------------------------------------
> {code}
> I'll submit a PR to do the simple string replace... which is hopefully all that is wrong here.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)