You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@joshua.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/10/26 02:33:58 UTC
[jira] [Commented] (JOSHUA-316) run_bundler.py returning JOB FAILED
(return code 1) TypeError: memoryview: a bytes-like object is required, not
'str'
[ https://issues.apache.org/jira/browse/JOSHUA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607157#comment-15607157 ]
ASF GitHub Bot commented on JOSHUA-316:
---------------------------------------
GitHub user lewismc opened a pull request:
https://github.com/apache/incubator-joshua/pull/73
JOSHUA-316 run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a bytes-like object is required, not 'str'
This issue addresses https://issues.apache.org/jira/browse/JOSHUA-316
This issue was a complete PITA. The non ascii character in run_bundler.py README template was a frigging big PITA.
Done now folks :)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/lewismc/incubator-joshua JOSHUA-316
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-joshua/pull/73.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #73
----
commit d137f2970d1eace1dcec576d287712cd5ffffb88
Author: Lewis John McGibbney <le...@gmail.com>
Date: 2016-10-26T02:31:10Z
JOSHUA-316 run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a bytes-like object is required, not 'str'
----
> run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a bytes-like object is required, not 'str'
> ---------------------------------------------------------------------------------------------------------------------
>
> Key: JOSHUA-316
> URL: https://issues.apache.org/jira/browse/JOSHUA-316
> Project: Joshua
> Issue Type: Bug
> Components: bundler
> Affects Versions: 6.0.5
> Reporter: Lewis John McGibbney
> Priority: Critical
> Fix For: 6.2
>
>
> {code}
> [glue-tune] rebuilding...
> dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_00000.source [CHANGED]
> dep=/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/create_glue_grammar.sh /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed > /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> took 1 seconds (1s)
> [tune-bundle] rebuilding...
> dep=/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config [CHANGED]
> dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_00000.source [CHANGED]
> dep=/usr/local/joshua_resources/russian_experiments/exp2/tune/model/run-joshua.sh [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/run_bundler.py --force --symlink --absolute --verbose -T /usr/local/hadoop-2.5.2/hadoop_tmp_dir /usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config /usr/local/joshua_resources/russian_experiments/exp2/tune/model --copy-config-options '-top-n 300 -output-format "%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue' --pack-tm /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed --tm /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> JOB FAILED (return code 1)
> * Running the copy-config.pl script with the command: /usr/local/incubator-joshua/scripts/copy-config.pl -top-n 300 -output-format "%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue
> Traceback (most recent call last):
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 748, in main
> operations = collect_operations(opts)
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 637, in collect_operations
> opts.copy_config_options
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 202, in filter_through_copy_config_script
> result, err = p.communicate(config_text)
> File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1072, in communicate
> stdout, stderr = self._communicate(input, endtime, timeout)
> File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1700, in _communicate
> input_view = memoryview(self._input)
> TypeError: memoryview: a bytes-like object is required, not 'str'
> During handling of the above exception, another exception occurred:
> Traceback (most recent call last):
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 760, in <module>
> main(sys.argv)
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 751, in main
> error_quit(e.message)
> AttributeError: 'TypeError' object has no attribute 'message'
> * WARNING: no key 'outputformat' found in config file (appending to end)
> * WARNING: no key 'search' found in config file (appending to end)
> * WARNING: no key 'topn' found in config file (appending to end)
> * WARNING: no key 'markoovs' found in config file (appending to end)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)