Computational models of visual attention are at the crossroad of disciplines like cognitive science, computational neuroscience, and computer vision. This paper proposes a model of attentional scanpath that is based on the principle that there are foundational laws that drive the emergence of visual attention. We devise variational laws of the eye-movement that rely on a generalized view of the Least Action Principle in physics. The potential energy captures details as well as peripheral visual features, while the kinetic energy corresponds with the classic interpretation in analytic mechanics. In addition, the Lagrangian contains a brightness invariance term, which characterizes significantly the scanpath trajectories. We obtain differential equations of visual attention as the stationary point of the generalized action, and we propose an algorithm to estimate the model parameters. Finally, we report experimental results to validate the model in tasks of saliency detection.

Zanca, D., Gori, M. (2017). Variational Laws of Visual Attention for Dynamic Scenes. In ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS. 10010 NORTH TORREY PINES RD, LA JOLLA, CALIFORNIA 92037 USA : NEURAL INFORMATION PROCESSING SYSTEMS (NIPS).

Variational Laws of Visual Attention for Dynamic Scenes

Zanca, D
;
Gori, M
2017-01-01

Abstract

Computational models of visual attention are at the crossroad of disciplines like cognitive science, computational neuroscience, and computer vision. This paper proposes a model of attentional scanpath that is based on the principle that there are foundational laws that drive the emergence of visual attention. We devise variational laws of the eye-movement that rely on a generalized view of the Least Action Principle in physics. The potential energy captures details as well as peripheral visual features, while the kinetic energy corresponds with the classic interpretation in analytic mechanics. In addition, the Lagrangian contains a brightness invariance term, which characterizes significantly the scanpath trajectories. We obtain differential equations of visual attention as the stationary point of the generalized action, and we propose an algorithm to estimate the model parameters. Finally, we report experimental results to validate the model in tasks of saliency detection.
2017
Zanca, D., Gori, M. (2017). Variational Laws of Visual Attention for Dynamic Scenes. In ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS. 10010 NORTH TORREY PINES RD, LA JOLLA, CALIFORNIA 92037 USA : NEURAL INFORMATION PROCESSING SYSTEMS (NIPS).
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11365/1107822
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo