You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@joshua.apache.org by Hoàng Đình Long <lo...@gmail.com> on 2017/05/08 03:29:27 UTC
Hello, I'm new here and I need some help to begin.
Hello,
My name is Long. I'm from Vietnam. I'm a programmer. Recently, I have
downloaded Joshua vi-en language package and feel interested in it. I think
I can help to improve it but I don't know where to begin.
I don't have background in machine translation. I only have a very general
overview of machine learning (I know what it is, I know what it does and I
used Weka a few times for some simple examples).
So, my goal is:
1> Improve the existing Vi-En language package.
2> Making a new language package.
I decided to learn machine translation by doing (writing code), so I
followed the tutorial here:
https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial
But in "Run the pipeline" section I can't find the "joshua-tutorial/runs"
file. When I tried building Joshua using Maven, it says "BUILD SUCCESS!".
But during the process, I noticed this error: ERROR - Can't find libken.so
(libken.dylib on OS X) on the Java library path.
How do I check if the I built it successfully?
Regards,
Long
Ps: Because I want to learn machine translation by writing code, it would
be much help if someone can show me where to begin. I don't need a hands on
tutorial, I only need some clues of where to begin. If some one can give me
some specifications, I can implement it and contribute the code.
Re: Hello, I'm new here and I need some help to begin.
Posted by Hoàng Đình Long <lo...@gmail.com>.
Hi Michael,
I checked everything and found that my $JOSHUA variable was not permanent,
hence when I restarted the computer, it was gone. That made
the build_kenlm.sh fail even though Boost had been installed properly.
Now everything is built properly. I am reading the document for more
information.
Thank you for taking your time answering my email!
Regards,
Long
On Wed, May 10, 2017 at 8:40 AM, Michael A. Hedderich <
mail@michael-hedderich.de> wrote:
> Hi Long,
>
> > But in "Run the pipeline" section I can't find the "joshua-tutorial/runs"
> file.
>
> "runs" is not a file but a directory. You create it in the first step of
> the section "Run the pipeline" with the command
>
> mkdir ~/joshua-tutorial/runs
>
> and afterwards you change into that directory with "cd" and do the training
> runs in that directory. The name of the directory is probably not even
> relevant.
>
> > I noticed this error: ERROR - Can't find libken.so (libken.dylib on OS X)
> on the Java library path.
>
> That indicates that there is a problem with KenLM. KenLM is a tool to
> create a language model efficiently. Have you followed the steps in the
> section "Dependencies - KenLM" on the "Getting Started" page?
>
> Regards,
> Michael
>
>
>
> 2017-05-07 23:29 GMT-04:00 Hoàng Đình Long <lo...@gmail.com>:
>
> > Hello,
> >
> > My name is Long. I'm from Vietnam. I'm a programmer. Recently, I have
> > downloaded Joshua vi-en language package and feel interested in it. I
> think
> > I can help to improve it but I don't know where to begin.
> >
> > I don't have background in machine translation. I only have a very
> general
> > overview of machine learning (I know what it is, I know what it does and
> I
> > used Weka a few times for some simple examples).
> >
> > So, my goal is:
> > 1> Improve the existing Vi-En language package.
> > 2> Making a new language package.
> >
> > I decided to learn machine translation by doing (writing code), so I
> > followed the tutorial here:
> > https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial
> > But in "Run the pipeline" section I can't find the "joshua-tutorial/runs"
> > file. When I tried building Joshua using Maven, it says "BUILD SUCCESS!".
> > But during the process, I noticed this error: ERROR - Can't find
> libken.so
> > (libken.dylib on OS X) on the Java library path.
> >
> > How do I check if the I built it successfully?
> >
> > Regards,
> > Long
> >
> > Ps: Because I want to learn machine translation by writing code, it would
> > be much help if someone can show me where to begin. I don't need a hands
> on
> > tutorial, I only need some clues of where to begin. If some one can give
> me
> > some specifications, I can implement it and contribute the code.
> >
>
--
_Long HĐi_
Re: Hello, I'm new here and I need some help to begin.
Posted by "Michael A. Hedderich" <ma...@michael-hedderich.de>.
Hi Long,
> But in "Run the pipeline" section I can't find the "joshua-tutorial/runs"
file.
"runs" is not a file but a directory. You create it in the first step of
the section "Run the pipeline" with the command
mkdir ~/joshua-tutorial/runs
and afterwards you change into that directory with "cd" and do the training
runs in that directory. The name of the directory is probably not even
relevant.
> I noticed this error: ERROR - Can't find libken.so (libken.dylib on OS X)
on the Java library path.
That indicates that there is a problem with KenLM. KenLM is a tool to
create a language model efficiently. Have you followed the steps in the
section "Dependencies - KenLM" on the "Getting Started" page?
Regards,
Michael
2017-05-07 23:29 GMT-04:00 Hoàng Đình Long <lo...@gmail.com>:
> Hello,
>
> My name is Long. I'm from Vietnam. I'm a programmer. Recently, I have
> downloaded Joshua vi-en language package and feel interested in it. I think
> I can help to improve it but I don't know where to begin.
>
> I don't have background in machine translation. I only have a very general
> overview of machine learning (I know what it is, I know what it does and I
> used Weka a few times for some simple examples).
>
> So, my goal is:
> 1> Improve the existing Vi-En language package.
> 2> Making a new language package.
>
> I decided to learn machine translation by doing (writing code), so I
> followed the tutorial here:
> https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial
> But in "Run the pipeline" section I can't find the "joshua-tutorial/runs"
> file. When I tried building Joshua using Maven, it says "BUILD SUCCESS!".
> But during the process, I noticed this error: ERROR - Can't find libken.so
> (libken.dylib on OS X) on the Java library path.
>
> How do I check if the I built it successfully?
>
> Regards,
> Long
>
> Ps: Because I want to learn machine translation by writing code, it would
> be much help if someone can show me where to begin. I don't need a hands on
> tutorial, I only need some clues of where to begin. If some one can give me
> some specifications, I can implement it and contribute the code.
>