Multi-person tracking with variational Bayes models

Silèye Ba, Xavier Alameda-Pineda, Alessio Xompero and Radu Horaud

We recently got a paper accepted at Computer Vision and Image Understanding: An On-line Variational Bayesian Model for Multi-Person Tracking from Cluttered Scenes [1]

Abstract: Object tracking is an ubiquitous problem that appears in many applications such as remote sensing, audio processing, computer vision, human-machine interfaces, human-robot interaction, etc. Although thoroughly investigated in computer vision, tracking a time-varying number of persons remains a challenging open problem. In this paper, we propose an on-line variational Bayesian model for multi-person tracking from cluttered visual observations provided by person detectors. The contributions of this paper are the followings. First, we propose a variational Bayesian framework for tracking an unknown and varying number of persons. Second, our model results in a variational expectation-maximization (VEM) algorithm with closed-form expressions for the posterior distributions of the latent variables and for the estimation of the model parameters. Third, the proposed model exploits observations from multiple detectors, and it is therefore multimodal by nature. Finally, we propose to embed both object-birth and object-visibility processes in an effort to robustly handle person appearances and disappearances over time. Evaluated on classical multiple person tracking datasets, our method shows competitive results with respect to state-of-the-art multiple-object tracking models, such as the probability hypothesis density (PHD) filter among others.


  1. S. Ba, X. Alameda-Pineda, A. Xompero, and R. Horaud, “An On-line Variational Bayesian Model for Multi-Person Tracking from Cluttered Scenes,” Computer Vision and Image Understanding, vol. 153, pp. 64-76, 2016. [ bib pdf arxiv ]
      title = {An On-line Variational Bayesian Model for Multi-Person Tracking from Cluttered Scenes},
      author = {Sileye Ba and Xavier Alameda-Pineda and Alessio Xompero and Radu Horaud},
      journal = {Computer Vision and Image Understanding},
      volume = {153},
      pages = {64-76},
      url = {},
      arxiv = {},

Category: Research

No responses yet.

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>