Chen, Stanley F.2015-10-061995Chen, Stanley F. Bayesian Grammar Induction for Language Modeling. Harvard Computer Science Group Technical Report TR-01-95.http://nrs.harvard.edu/urn-3:HUL.InstRepos:23017264We describe a corpus-based induction algorithm for probabilistic context-free grammars. The algorithm employs a greedy heuristic search within a Bayesian framework, and a post-pass using the Inside-Outside algorithm. We compare the performance of our algorithm to n-gram models and the Inside-Outside algorithm in three language modeling tasks. In two of these domains, our algorithm outperforms these other techniques, marking the first time a grammar-based language model has surpassed n-gram modeling in a task of at least moderate size.en-USResearch Paper or Report2015-10-06