[jira] [Created] (JOSHUA-284) Phrase-based decoding changes

["Matt Post (JIRA)" <ji...@apache.org>]

Matt Post created JOSHUA-284:
--------------------------------

             Summary: Phrase-based decoding changes
                 Key: JOSHUA-284
                 URL: https://issues.apache.org/jira/browse/JOSHUA-284
             Project: Joshua
          Issue Type: Bug
            Reporter: Matt Post
             Fix For: 6.1


Joshua's phrase-based decoding creates a lot of complications in the pipeline.

Currently, phrase-based rules are simply left-branching Hiero rules. This means that, prior to packing or loading, rules have to have a nonterminal prepended to them. For example, Thrax will extract

    [X] ||| yo quiero ||| i want ||| ...

This has to be changed to

    [X] ||| [X,1] yo quiero ||| [X,1] yo quiero ||| ...

This means, for one, that phrase tables share a format but are specific to either the hiero or phrase-based decoder.

A better idea would be to change the phrase-based decoder a bit so that, instead of using left-branching phrase rules, it made use of proper glue rules, the same way Hiero does. The advantages are:

- both formalisms would use the same format
- both formalisms would have a glue grammar
- there should be no impact in running time



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)