A hierarchical phrase-based model for statistical machine translation.pdf

A Hierarchical Phrase-Based Model for Statistical Machine Translation David Chiang Institute for Advanced Computer Studies (UMIACS) University of Maryland, College Park, MD 20742, USA dchiang@ Abstract We present a statistical phrase-based transla- tion model that uses hierarchical phrases— phrases that contain subphrases. The model is formally a synchronous context-free gram- mar but is learned from a bitext without any syntactic information. Thus it can be seen as a shift to the formal machinery of syntax- based translation systems without any lin- guistic commitment. In our experiments us- ing BLEU as a metric, the hierarchical phrase- based model achieves a relative improve- ment of 7.5% over Pharaoh, a state-of-the-art phrase-based system. 1 Introduction The alignment template translation model (Och and Ney, 2004) and related phrase-based models ad- vanced the previous state of the art by moving from words to phrases as the basic unit of transla- tion. Phrases, which can be any substring and not necessarily phrases in any syntactic theory, allow these models to learn local reorderings, translation of short idioms, or insertions and deletions that are sensitive to local context. They are thus a simple and powerful mechanism for machine translation. The basic phrase-based model is an instance of the noisy-channel approach (Brown et al., 1993), 1 in which the translation of a French sentence f into an 1 Throughout this paper, we follow the convention of Brown et al. of designating the source and target languages as “French” and “English,” respectively. The variables f and e stand for source and target sentences; f j i stands for the substring of f from position i to position j inclusive, and similarly for e j i . English sentence e is modeled as: arg max e P(e | f ) = arg max e P(e, f )(1) = arg max e (P(e) × P( f | e))(2) The translation model P( f | e) “encodes” e into f by the following steps: 1. segment e into phrases e?1 · · · e?I , typically with a uniform d