Many applications require to jointly learn a set of related functions for which some a–priori mutual constraints are known. In particular, we consider a multitask learning problem in which a set of constraints among the different tasks are know to hold in most cases. Basically, beside a set of supervised examples provided to learn each task, we assume that some background knowledge is available in the form of functions that define the admissible configurations of the task function outputs for almost each input. We exploit a semi–supervised approach in which a potentially large set of unlabeled examples is used to enforce the constraints on a large region of the input space by means of a proper penalty function. However, since the constraints are known to be subject to exceptions and the inputs corresponding to these exceptions are not known a–priori, we propose to embed a selection criterion in the penalty function that reduces the constraint effect on those points that are likely to yield an exception. We report some experiments on multi–view object recognition showing the benefits of the proposed selection mechanism with respect to an uniform enforcement of the constraints.
Maggini, M., Papini, T. (2010). Multitask semi–supervised learning with constraints and constraint exceptions. In Proceedings of the International Conference on Artificial Neural Networks (ICANN10) (pp.218-227). Springer Verlag [10.1007/978-3-642-15825-4_27].
Multitask semi–supervised learning with constraints and constraint exceptions
MAGGINI, MARCO;PAPINI, TIZIANO
2010-01-01
Abstract
Many applications require to jointly learn a set of related functions for which some a–priori mutual constraints are known. In particular, we consider a multitask learning problem in which a set of constraints among the different tasks are know to hold in most cases. Basically, beside a set of supervised examples provided to learn each task, we assume that some background knowledge is available in the form of functions that define the admissible configurations of the task function outputs for almost each input. We exploit a semi–supervised approach in which a potentially large set of unlabeled examples is used to enforce the constraints on a large region of the input space by means of a proper penalty function. However, since the constraints are known to be subject to exceptions and the inputs corresponding to these exceptions are not known a–priori, we propose to embed a selection criterion in the penalty function that reduces the constraint effect on those points that are likely to yield an exception. We report some experiments on multi–view object recognition showing the benefits of the proposed selection mechanism with respect to an uniform enforcement of the constraints.File | Dimensione | Formato | |
---|---|---|---|
ICANN10.pdf
non disponibili
Tipologia:
Post-print
Licenza:
NON PUBBLICO - Accesso privato/ristretto
Dimensione
251.79 kB
Formato
Adobe PDF
|
251.79 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11365/38885
Attenzione
Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo