You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@joshua.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2016/11/22 21:41:58 UTC

[jira] [Resolved] (JOSHUA-316) run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a bytes-like object is required, not 'str'

     [ https://issues.apache.org/jira/browse/JOSHUA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lewis John McGibbney resolved JOSHUA-316.
-----------------------------------------
    Resolution: Fixed

> run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a bytes-like object is required, not 'str'
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: JOSHUA-316
>                 URL: https://issues.apache.org/jira/browse/JOSHUA-316
>             Project: Joshua
>          Issue Type: Bug
>          Components: bundler
>    Affects Versions: 6.0.5
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Critical
>             Fix For: 6.1
>
>
> {code}
> [glue-tune] rebuilding...
>   dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_00000.source [CHANGED]
>   dep=/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue [NOT FOUND]
>   cmd=/usr/local/incubator-joshua/scripts/support/create_glue_grammar.sh /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed > /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
>   took 1 seconds (1s)
> [tune-bundle] rebuilding...
>   dep=/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config [CHANGED]
>   dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_00000.source [CHANGED]
>   dep=/usr/local/joshua_resources/russian_experiments/exp2/tune/model/run-joshua.sh [NOT FOUND]
>   cmd=/usr/local/incubator-joshua/scripts/support/run_bundler.py --force --symlink --absolute --verbose -T /usr/local/hadoop-2.5.2/hadoop_tmp_dir /usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config /usr/local/joshua_resources/russian_experiments/exp2/tune/model --copy-config-options '-top-n 300 -output-format "%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm"  -tm0/type hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue' --pack-tm /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed --tm /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
>   JOB FAILED (return code 1)
> * Running the copy-config.pl script with the command: /usr/local/incubator-joshua/scripts/copy-config.pl -top-n 300 -output-format "%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm"  -tm0/type hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue
> Traceback (most recent call last):
>   File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 748, in main
>     operations = collect_operations(opts)
>   File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 637, in collect_operations
>     opts.copy_config_options
>   File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 202, in filter_through_copy_config_script
>     result, err = p.communicate(config_text)
>   File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1072, in communicate
>     stdout, stderr = self._communicate(input, endtime, timeout)
>   File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1700, in _communicate
>     input_view = memoryview(self._input)
> TypeError: memoryview: a bytes-like object is required, not 'str'
> During handling of the above exception, another exception occurred:
> Traceback (most recent call last):
>   File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 760, in <module>
>     main(sys.argv)
>   File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 751, in main
>     error_quit(e.message)
> AttributeError: 'TypeError' object has no attribute 'message'
> * WARNING: no key 'outputformat' found in config file (appending to end)
> * WARNING: no key 'search' found in config file (appending to end)
> * WARNING: no key 'topn' found in config file (appending to end)
> * WARNING: no key 'markoovs' found in config file (appending to end)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)