Recently, it has been shown that recurrent neural networks can be used as adaptive neural parsers. Given a set of positive and negative examples, picked up from a given language, adaptive neural parsers can effectively be trained to recognize its grammar. Many efforts have been focused on regular languages for which the continuous computation can be approximated by the set of transition rules of a finite state machine. In this paper we face the problem of inferring grammars from positive and negative examples that, however, may be corrupted by a noise that simply changes the membership of the strings. We propose using second-order recurrent networks and suggest a training algorithm, referred to as HFF (hybrid Finite state Filter), based on a parsimony principle that penalizes the development of complex rules.
Gori, M., Maggini, M., G., S. (1996). Inductive inference from noisy examples: The rule-noise dilemma and the hybrid finite state filter. In Proceedings of the workshop on Neural Networks and Structural Knowledge at the European Conference on Artificial Intelligence (ECAI’96) (pp.53-58).
Inductive inference from noisy examples: The rule-noise dilemma and the hybrid finite state filter
GORI, MARCO;MAGGINI, MARCO;
1996-01-01
Abstract
Recently, it has been shown that recurrent neural networks can be used as adaptive neural parsers. Given a set of positive and negative examples, picked up from a given language, adaptive neural parsers can effectively be trained to recognize its grammar. Many efforts have been focused on regular languages for which the continuous computation can be approximated by the set of transition rules of a finite state machine. In this paper we face the problem of inferring grammars from positive and negative examples that, however, may be corrupted by a noise that simply changes the membership of the strings. We propose using second-order recurrent networks and suggest a training algorithm, referred to as HFF (hybrid Finite state Filter), based on a parsimony principle that penalizes the development of complex rules.File | Dimensione | Formato | |
---|---|---|---|
ECAI96.pdf
non disponibili
Tipologia:
Pre-print
Licenza:
NON PUBBLICO - Accesso privato/ristretto
Dimensione
711.01 kB
Formato
Adobe PDF
|
711.01 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11365/36426
Attenzione
Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo