Skip to main content

Learning grammar with a divide-and-concur neural network

Cornell Affiliated Author(s)

Author

S. Deyo
V. Elser

Abstract

We implement a divide-and-concur iterative projection approach to context-free grammar inference. Unlike most state-of-the-art models of natural language processing, our method requires a relatively small number of discrete parameters, making the inferred grammar directly interpretable - one can read off from a solution how to construct grammatically valid sentences. Another advantage of our approach is the ability to infer meaningful grammatical rules from just a few sentences, compared to the hundreds of gigabytes of training data many other models employ. We demonstrate several ways of applying our approach: classifying words and inferring a grammar from scratch, taking an existing grammar and refining its categories and rules, and taking an existing grammar and expanding its lexicon as it encounters new words in new data. © 2022 American Physical Society.

Date Published

Journal

Physical Review E

Volume

105

Issue

6

URL

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85134633651&doi=10.1103%2fPhysRevE.105.064303&partnerID=40&md5=cbd7802d610c2bb1185339576419880a

DOI

10.1103/PhysRevE.105.064303

Group (Lab)

Veit Elser Group

Download citation