Human action recognition in video streams is a fast developing field in pattern recognition and machine learning. Local image representations, e. g. space-time interest points [1], have proven to be the current most reliable choice of feature in sequences in which the region of interest is difficult to determine [2]. However, the question how to deal with more severe occlusions has large been ignored [2]. This work proposes a new approach which directly addresses heavy occlusions by modeling the skeleton-based features using a probability density functions (PDF) defined over graphs. We integrated the proposed density into an hidden Markov model (HMM) to model sequences of graphs of arbitrary sizes, i.e. occlusions setting may change over time. The approach is evaluated using a dataset embracing three action classes, studying six different types of occlusions (involving the removal of subgraphs from the graphical representation of action sequence). The presented study shows clearly that actions from even heavily occluded sequences can be reliably recognized.
M., G., Trentin, E., F., S., G., P. (2013). Hidden Markov Models With Graph Densities for Action Recognition. In Proc. of IJCNN 2013 (INNS IEEE International Joint Conference on Neural Networks. New York : IEEE.
Hidden Markov Models With Graph Densities for Action Recognition
TRENTIN, EDMONDO;
2013-01-01
Abstract
Human action recognition in video streams is a fast developing field in pattern recognition and machine learning. Local image representations, e. g. space-time interest points [1], have proven to be the current most reliable choice of feature in sequences in which the region of interest is difficult to determine [2]. However, the question how to deal with more severe occlusions has large been ignored [2]. This work proposes a new approach which directly addresses heavy occlusions by modeling the skeleton-based features using a probability density functions (PDF) defined over graphs. We integrated the proposed density into an hidden Markov model (HMM) to model sequences of graphs of arbitrary sizes, i.e. occlusions setting may change over time. The approach is evaluated using a dataset embracing three action classes, studying six different types of occlusions (involving the removal of subgraphs from the graphical representation of action sequence). The presented study shows clearly that actions from even heavily occluded sequences can be reliably recognized.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11365/47084
Attenzione
Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo