How will you react to the next post that you are going to read? In this paper we propose a learning system that is able to artificially alter the picture of a face in order to generate the emotion that is associated with a given input text. The face generation procedure is function of further information about the considered person, either given (topics of interest) or automatically estimated from the provided picture (age, sex). In particular, two Convolutional Networks are trained to predict age and sex, while two other Recurrent Neural Network-based models predict the topic and the dominant emotion in the input text. First Order Logic (FOL)-based functions are introduced to mix the outcome of the four neural models and to decide which emotion to generate, following the theory of T-Norms. Finally, the same theory is exploited to build a neural generative model of facial expressions, that is used create the final face. Experimental results are performed to assess the quality of the information extraction process and to show the outcome of the generative network.

Graziani, L., Melacci, S., Gori, M. (2020). Generating Facial Expressions Associated with Text. In Artificial Neural Networks and Machine Learning – ICANN 2020 (pp.621-632). Springer Science and Business Media Deutschland GmbH [10.1007/978-3-030-61609-0_49].

Generating Facial Expressions Associated with Text

Melacci S.;Gori M.
2020-01-01

Abstract

How will you react to the next post that you are going to read? In this paper we propose a learning system that is able to artificially alter the picture of a face in order to generate the emotion that is associated with a given input text. The face generation procedure is function of further information about the considered person, either given (topics of interest) or automatically estimated from the provided picture (age, sex). In particular, two Convolutional Networks are trained to predict age and sex, while two other Recurrent Neural Network-based models predict the topic and the dominant emotion in the input text. First Order Logic (FOL)-based functions are introduced to mix the outcome of the four neural models and to decide which emotion to generate, following the theory of T-Norms. Finally, the same theory is exploited to build a neural generative model of facial expressions, that is used create the final face. Experimental results are performed to assess the quality of the information extraction process and to show the outcome of the generative network.
2020
978-3-030-61608-3
978-3-030-61609-0
Graziani, L., Melacci, S., Gori, M. (2020). Generating Facial Expressions Associated with Text. In Artificial Neural Networks and Machine Learning – ICANN 2020 (pp.621-632). Springer Science and Business Media Deutschland GmbH [10.1007/978-3-030-61609-0_49].
File in questo prodotto:
File Dimensione Formato  
melacci_ICANN2020.pdf

non disponibili

Tipologia: PDF editoriale
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 1.07 MB
Formato Adobe PDF
1.07 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11365/1122694