In recent years, Deep Neural Networks (DNNs) have led to impressive results in a wide variety of machine learning tasks, typically relying on the existence of a huge amount of supervised data. However, in many applications (e.g., bio-medical image analysis), gathering large sets of labeled data can be very difficult and costly. Unsupervised domain adaptation exploits data from a source domain, where annotations are available, to train a model able to generalize also to a target domain, where labels are unavailable. Recent research has shown that Generative Adversarial Networks (GANs) can be successfully employed for domain adaptation, although deciding when to stop learning is a major concern for GANs. In this work, we propose some confidence measures that can be used to early stop the GAN training, also showing how such measures can be employed to predict the reliability of the network output. The effectiveness of the proposed approach has been tested in two domain adaptation tasks, with very promising results.

Bonechi, S., Andreini, P., Bianchini, M., Pai, A., Scarselli, F. (2019). Confidence measures for deep learning in domain adaptation. APPLIED SCIENCES, 9(11) [10.3390/app9112192].

Confidence measures for deep learning in domain adaptation

Bonechi, S.;Andreini, P.;Bianchini, M.;Scarselli, F.
2019-01-01

Abstract

In recent years, Deep Neural Networks (DNNs) have led to impressive results in a wide variety of machine learning tasks, typically relying on the existence of a huge amount of supervised data. However, in many applications (e.g., bio-medical image analysis), gathering large sets of labeled data can be very difficult and costly. Unsupervised domain adaptation exploits data from a source domain, where annotations are available, to train a model able to generalize also to a target domain, where labels are unavailable. Recent research has shown that Generative Adversarial Networks (GANs) can be successfully employed for domain adaptation, although deciding when to stop learning is a major concern for GANs. In this work, we propose some confidence measures that can be used to early stop the GAN training, also showing how such measures can be employed to predict the reliability of the network output. The effectiveness of the proposed approach has been tested in two domain adaptation tasks, with very promising results.
2019
Bonechi, S., Andreini, P., Bianchini, M., Pai, A., Scarselli, F. (2019). Confidence measures for deep learning in domain adaptation. APPLIED SCIENCES, 9(11) [10.3390/app9112192].
File in questo prodotto:
File Dimensione Formato  
applsci-09-02192.pdf

accesso aperto

Tipologia: PDF editoriale
Licenza: Creative commons
Dimensione 621.53 kB
Formato Adobe PDF
621.53 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11365/1080150