You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@joshua.apache.org by "blackthirt33n ." <jj...@gmail.com> on 2017/10/07 22:50:29 UTC
how can i demonstrate joshua
how can I a demonstrate joshua i want to use the english - german language
pack.
James
Re: how can i demonstrate joshua
Posted by "blackthirt33n ." <jj...@gmail.com>.
thanks here where i got to.
should I be running the all ./download-deps.sh before everything else or
running the ./jni/build_kenlm.sh :
vagrant@ubuntu:~/joshua$ sudo apt-get install libeigen3-dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following additional packages will be installed:
pkg-config
Suggested packages:
libeigen3-doc libmrpt-dev
The following NEW packages will be installed:
libeigen3-dev pkg-config
0 upgraded, 2 newly installed, 0 to remove and 3 not upgraded.
Need to get 854 kB of archives.
After this operation, 7,294 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://us.archive.ubuntu.com/ubuntu zesty/main amd64 pkg-config amd64
0.29.1-0ubuntu1 [45.0 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu zesty/universe amd64
libeigen3-dev all 3.3.2-1 [809 kB]
Fetched 854 kB in 0s (1,592 kB/s)
Selecting previously unselected package pkg-config.
(Reading database ... 119852 files and directories currently installed.)
Preparing to unpack .../pkg-config_0.29.1-0ubuntu1_amd64.deb ...
Unpacking pkg-config (0.29.1-0ubuntu1) ...
Selecting previously unselected package libeigen3-dev.
Preparing to unpack .../libeigen3-dev_3.3.2-1_all.deb ...
Unpacking libeigen3-dev (3.3.2-1) ...
Setting up pkg-config (0.29.1-0ubuntu1) ...
Setting up libeigen3-dev (3.3.2-1) ...
vagrant@ubuntu:~/joshua$ ./jni/build_kenlm.sh
Using JOSHUA=/home/vagrant/joshua
-- Boost version: 1.62.0
-- Found the following Boost libraries:
-- program_options
-- system
-- thread
-- unit_test_framework
-- chrono
-- date_time
-- atomic
-- Found Eigen3: /usr/include/eigen3 (Required is at least version "2.91.0")
-- Try OpenMP C flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
CMake Warning (dev) at /usr/share/cmake-3.7/Modules/FindOpenMP.cmake:179
(if):
if given arguments:
"TRUE"
An argument named "TRUE" appears in a conditional statement. Policy
CMP0012 is not set: if() recognizes numbers and boolean constants. Run
"cmake --help-policy CMP0012" for policy details. Use the cmake_policy
command to set the policy and suppress this warning.
Call Stack (most recent call first):
/usr/share/cmake-3.7/Modules/FindOpenMP.cmake:224 (_OPENMP_GET_SPEC_DATE)
lm/interpolate/CMakeLists.txt:20 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.
-- Try OpenMP CXX flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
CMake Warning (dev) at /usr/share/cmake-3.7/Modules/FindOpenMP.cmake:179
(if):
if given arguments:
"TRUE"
An argument named "TRUE" appears in a conditional statement. Policy
CMP0012 is not set: if() recognizes numbers and boolean constants. Run
"cmake --help-policy CMP0012" for policy details. Use the cmake_policy
command to set the policy and suppress this warning.
Call Stack (most recent call first):
/usr/share/cmake-3.7/Modules/FindOpenMP.cmake:266 (_OPENMP_GET_SPEC_DATE)
lm/interpolate/CMakeLists.txt:20 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.
-- Found OpenMP: -fopenmp
-- Configuring done
-- Generating done
-- Build files have been written to: /home/vagrant/joshua/ext/kenlm/build
Scanning dependencies of target kenlm_interpolate
[ 1%] Building CXX object
lm/builder/CMakeFiles/kenlm_builder.dir/corpus_count.cc.o
[ 4%] Built target kenlm_filter
[ 4%] Building CXX object
lm/builder/CMakeFiles/kenlm_builder.dir/initial_probabilities.cc.o
[ 4%] Building CXX object
util/CMakeFiles/kenlm_util.dir/stream/line_input.cc.o
[ 5%] Building CXX object
util/CMakeFiles/kenlm_util.dir/stream/rewindable_stream.cc.o
[ 5%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/backoff_reunification.cc.o
[ 11%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/pipeline.cc.o
[ 5%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/split_worker.cc.o
[ 11%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_weights.cc.o
[ 6%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_instances.cc.o
[ 7%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/universal_vocab.cc.o
[ 8%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/bounded_sequence_encoding.cc.o
[ 9%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/normalize.cc.o
[ 10%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/merge_probabilities.cc.o
[ 11%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/merge_vocab.cc.o
[ 12%] Building CXX object
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_derivatives.cc.o
g++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-6/README.Bugs> for instructions.
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/build.make:158: recipe for
target 'lm/interpolate/CMakeFiles/kenlm_interpolate.dir/normalize.cc.o'
failed
make[2]: ***
[lm/interpolate/CMakeFiles/kenlm_interpolate.dir/normalize.cc.o] Error 4
make[2]: *** Waiting for unfinished jobs....
g++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-6/README.Bugs> for instructions.
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/build.make:278: recipe for
target 'lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_weights.cc.o'
failed
make[2]: ***
[lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_weights.cc.o] Error 4
g++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-6/README.Bugs> for instructions.
lm/interpolate/CMakeFiles/kenlm_interpolate.dir/build.make:254: recipe for
target
'lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_instances.cc.o' failed
make[2]: ***
[lm/interpolate/CMakeFiles/kenlm_interpolate.dir/tune_instances.cc.o] Error
4
g++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-6/README.Bugs> for instructions.
util/CMakeFiles/kenlm_util.dir/build.make:374: recipe for target
'util/CMakeFiles/kenlm_util.dir/stream/rewindable_stream.cc.o' failed
make[2]: *** [util/CMakeFiles/kenlm_util.dir/stream/rewindable_stream.cc.o]
Error 4
make[2]: *** Waiting for unfinished jobs....
CMakeFiles/Makefile2:1345: recipe for target
'util/CMakeFiles/kenlm_util.dir/all' failed
make[1]: *** [util/CMakeFiles/kenlm_util.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 13%] Linking CXX static library ../../lib/libkenlm_builder.a
[ 16%] Built target kenlm_builder
CMakeFiles/Makefile2:2668: recipe for target
'lm/interpolate/CMakeFiles/kenlm_interpolate.dir/all' failed
make[1]: *** [lm/interpolate/CMakeFiles/kenlm_interpolate.dir/all] Error 2
Makefile:138: recipe for target 'all' failed
make: *** [all] Error 2
cp: cannot stat 'bin/query': No such file or directory
cp: cannot stat 'bin/lmplz': No such file or directory
cp: cannot stat 'bin/build_binary': No such file or directory
g++: error: lm/CMakeFiles/kenlm.dir/*.o: No such file or directory
On Tue, Oct 10, 2017 at 10:33 AM, Matt Post <po...@cs.jhu.edu> wrote:
> you have to install libbz2. this will have a package name of something
> like “bzip2-devel”.
>
> matt (from my phone)
>
> Le 10 oct. 2017 à 17:08, blackthirt33n . <jj...@gmail.com> a écrit :
>
> i have been following that but have hit a snag:
>
> vagrant@ubuntu:~/joshua$ ./jni/build_kenlm.sh
> Using JOSHUA=/home/vagrant/joshua
> -- The C compiler identification is GNU 6.3.0
> -- The CXX compiler identification is GNU 6.3.0
> -- Check for working C compiler: /usr/bin/cc
> -- Check for working C compiler: /usr/bin/cc -- broken
> CMake Error at /usr/share/cmake-3.7/Modules/CMakeTestCCompiler.cmake:51
> (message):
> The C compiler "/usr/bin/cc" is not able to compile a simple test
> program.
>
> It fails with the following output:
>
> Change Dir: /home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp
>
>
>
> Run Build Command:"/usr/bin/make" "cmTC_44219/fast"
>
> /usr/bin/make -f CMakeFiles/cmTC_44219.dir/build.make
> CMakeFiles/cmTC_44219.dir/build
>
> make[1]: Entering directory
> '/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp'
>
> Building C object CMakeFiles/cmTC_44219.dir/testCCompiler.c.o
>
> /usr/bin/cc -o CMakeFiles/cmTC_44219.dir/testCCompiler.c.o -c
> /home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp/testCCompiler.c
>
> Linking C executable cmTC_44219
>
> /usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_44219.dir/link.txt
> --verbose=1
>
> /usr/bin/cc -lz -lbz2 -llzma CMakeFiles/cmTC_44219.dir/testCCompiler.c.o
> -o
> cmTC_44219 -rdynamic
>
> /usr/bin/ld: cannot find -lbz2
>
> collect2: error: ld returned 1 exit status
>
> CMakeFiles/cmTC_44219.dir/build.make:97: recipe for target 'cmTC_44219'
> failed
>
> make[1]: *** [cmTC_44219] Error 1
>
> make[1]: Leaving directory
> '/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp'
>
> Makefile:126: recipe for target 'cmTC_44219/fast' failed
>
> make: *** [cmTC_44219/fast] Error 2
>
>
>
>
>
> CMake will not be able to correctly generate this project.
> Call Stack (most recent call first):
> CMakeLists.txt:4 (project)
>
>
> -- Configuring incomplete, errors occurred!
> See also "/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/
> CMakeOutput.log".
> See also "/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeError.log".
> make: *** No targets specified and no makefile found. Stop.
> cp: cannot stat 'bin/query': No such file or directory
> cp: cannot stat 'bin/lmplz': No such file or directory
> cp: cannot stat 'bin/build_binary': No such file or directory
> g++: error: lm/CMakeFiles/kenlm.dir/*.o: No such file or directory
> g++: error: util/CMakeFiles/kenlm_util.dir/*.o: No such file or directory
> g++: error: util/CMakeFiles/kenlm_util.dir/double-conversion/*.o: No such
> file or directory
>
> On Sun, Oct 8, 2017 at 10:14 PM, John Hewitt <jo...@seas.upenn.edu>
> wrote:
>
>> Hi James,
>>
>> The instructions should be relatively self-contained with in the
>> following tutorial:
>>
>> https://cwiki.apache.org/confluence/display/JOSHUA/Language+
>> Packs#LanguagePacks-UsingLanguagePacks
>>
>> The first few commands there should start you on your way; let us know if
>> you have more specific questions.
>>
>> -John
>>
>> On Sat, Oct 7, 2017 at 6:50 PM, blackthirt33n . <jj...@gmail.com>
>> wrote:
>>
>>> how can I a demonstrate joshua i want to use the english - german
>>> language pack.
>>> James
>>>
>>
>>
>
Re: how can i demonstrate joshua
Posted by Matt Post <po...@cs.jhu.edu>.
you have to install libbz2. this will have a package name of something like “bzip2-devel”.
matt (from my phone)
> Le 10 oct. 2017 à 17:08, blackthirt33n . <jj...@gmail.com> a écrit :
>
> i have been following that but have hit a snag:
>
> vagrant@ubuntu:~/joshua$ ./jni/build_kenlm.sh
> Using JOSHUA=/home/vagrant/joshua
> -- The C compiler identification is GNU 6.3.0
> -- The CXX compiler identification is GNU 6.3.0
> -- Check for working C compiler: /usr/bin/cc
> -- Check for working C compiler: /usr/bin/cc -- broken
> CMake Error at /usr/share/cmake-3.7/Modules/CMakeTestCCompiler.cmake:51 (message):
> The C compiler "/usr/bin/cc" is not able to compile a simple test program.
>
> It fails with the following output:
>
> Change Dir: /home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp
>
>
>
> Run Build Command:"/usr/bin/make" "cmTC_44219/fast"
>
> /usr/bin/make -f CMakeFiles/cmTC_44219.dir/build.make
> CMakeFiles/cmTC_44219.dir/build
>
> make[1]: Entering directory
> '/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp'
>
> Building C object CMakeFiles/cmTC_44219.dir/testCCompiler.c.o
>
> /usr/bin/cc -o CMakeFiles/cmTC_44219.dir/testCCompiler.c.o -c
> /home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp/testCCompiler.c
>
> Linking C executable cmTC_44219
>
> /usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_44219.dir/link.txt
> --verbose=1
>
> /usr/bin/cc -lz -lbz2 -llzma CMakeFiles/cmTC_44219.dir/testCCompiler.c.o -o
> cmTC_44219 -rdynamic
>
> /usr/bin/ld: cannot find -lbz2
>
> collect2: error: ld returned 1 exit status
>
> CMakeFiles/cmTC_44219.dir/build.make:97: recipe for target 'cmTC_44219'
> failed
>
> make[1]: *** [cmTC_44219] Error 1
>
> make[1]: Leaving directory
> '/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp'
>
> Makefile:126: recipe for target 'cmTC_44219/fast' failed
>
> make: *** [cmTC_44219/fast] Error 2
>
>
>
>
>
> CMake will not be able to correctly generate this project.
> Call Stack (most recent call first):
> CMakeLists.txt:4 (project)
>
>
> -- Configuring incomplete, errors occurred!
> See also "/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeOutput.log".
> See also "/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeError.log".
> make: *** No targets specified and no makefile found. Stop.
> cp: cannot stat 'bin/query': No such file or directory
> cp: cannot stat 'bin/lmplz': No such file or directory
> cp: cannot stat 'bin/build_binary': No such file or directory
> g++: error: lm/CMakeFiles/kenlm.dir/*.o: No such file or directory
> g++: error: util/CMakeFiles/kenlm_util.dir/*.o: No such file or directory
> g++: error: util/CMakeFiles/kenlm_util.dir/double-conversion/*.o: No such file or directory
>
>> On Sun, Oct 8, 2017 at 10:14 PM, John Hewitt <jo...@seas.upenn.edu> wrote:
>> Hi James,
>>
>> The instructions should be relatively self-contained with in the following tutorial:
>>
>> https://cwiki.apache.org/confluence/display/JOSHUA/Language+Packs#LanguagePacks-UsingLanguagePacks
>>
>> The first few commands there should start you on your way; let us know if you have more specific questions.
>>
>> -John
>>
>>> On Sat, Oct 7, 2017 at 6:50 PM, blackthirt33n . <jj...@gmail.com> wrote:
>>> how can I a demonstrate joshua i want to use the english - german language pack.
>>> James
>>
>
Re: how can i demonstrate joshua
Posted by "blackthirt33n ." <jj...@gmail.com>.
i have been following that but have hit a snag:
vagrant@ubuntu:~/joshua$ ./jni/build_kenlm.sh
Using JOSHUA=/home/vagrant/joshua
-- The C compiler identification is GNU 6.3.0
-- The CXX compiler identification is GNU 6.3.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- broken
CMake Error at /usr/share/cmake-3.7/Modules/CMakeTestCCompiler.cmake:51
(message):
The C compiler "/usr/bin/cc" is not able to compile a simple test program.
It fails with the following output:
Change Dir: /home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp
Run Build Command:"/usr/bin/make" "cmTC_44219/fast"
/usr/bin/make -f CMakeFiles/cmTC_44219.dir/build.make
CMakeFiles/cmTC_44219.dir/build
make[1]: Entering directory
'/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp'
Building C object CMakeFiles/cmTC_44219.dir/testCCompiler.c.o
/usr/bin/cc -o CMakeFiles/cmTC_44219.dir/testCCompiler.c.o -c
/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp/testCCompiler.c
Linking C executable cmTC_44219
/usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_44219.dir/link.txt
--verbose=1
/usr/bin/cc -lz -lbz2 -llzma CMakeFiles/cmTC_44219.dir/testCCompiler.c.o
-o
cmTC_44219 -rdynamic
/usr/bin/ld: cannot find -lbz2
collect2: error: ld returned 1 exit status
CMakeFiles/cmTC_44219.dir/build.make:97: recipe for target 'cmTC_44219'
failed
make[1]: *** [cmTC_44219] Error 1
make[1]: Leaving directory
'/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeTmp'
Makefile:126: recipe for target 'cmTC_44219/fast' failed
make: *** [cmTC_44219/fast] Error 2
CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
CMakeLists.txt:4 (project)
-- Configuring incomplete, errors occurred!
See also "/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeOutput.log".
See also "/home/vagrant/joshua/ext/kenlm/build/CMakeFiles/CMakeError.log".
make: *** No targets specified and no makefile found. Stop.
cp: cannot stat 'bin/query': No such file or directory
cp: cannot stat 'bin/lmplz': No such file or directory
cp: cannot stat 'bin/build_binary': No such file or directory
g++: error: lm/CMakeFiles/kenlm.dir/*.o: No such file or directory
g++: error: util/CMakeFiles/kenlm_util.dir/*.o: No such file or directory
g++: error: util/CMakeFiles/kenlm_util.dir/double-conversion/*.o: No such
file or directory
On Sun, Oct 8, 2017 at 10:14 PM, John Hewitt <jo...@seas.upenn.edu> wrote:
> Hi James,
>
> The instructions should be relatively self-contained with in the following
> tutorial:
>
> https://cwiki.apache.org/confluence/display/JOSHUA/
> Language+Packs#LanguagePacks-UsingLanguagePacks
>
> The first few commands there should start you on your way; let us know if
> you have more specific questions.
>
> -John
>
> On Sat, Oct 7, 2017 at 6:50 PM, blackthirt33n . <jj...@gmail.com>
> wrote:
>
>> how can I a demonstrate joshua i want to use the english - german
>> language pack.
>> James
>>
>
>
Re: how can i demonstrate joshua
Posted by John Hewitt <jo...@seas.upenn.edu>.
Hi James,
The instructions should be relatively self-contained with in the following
tutorial:
https://cwiki.apache.org/confluence/display/JOSHUA/Language+Packs#LanguagePacks-UsingLanguagePacks
The first few commands there should start you on your way; let us know if
you have more specific questions.
-John
On Sat, Oct 7, 2017 at 6:50 PM, blackthirt33n . <jj...@gmail.com> wrote:
> how can I a demonstrate joshua i want to use the english - german language
> pack.
> James
>