Segmentação de Vídeo em duas Camadas, em Tempo Real e em Ambientes não Controlados, para Aplicações de Substituição de Fundo: Visão Geral e Principais Desafios (Bilayer Segmentation of Live Video in Uncontrolled Environments for Background Substitution: An Overview and Main Challenges)

Silvio Ricardo Rodrigues Sanches (, Ricardo Nakamura (, Valdinei Freire da Silva (, Romero Tori (

1Escola Politécnica da Universidade de São Paulo (POLI-USP)
2Escola de Artes, Ciências e Humanidades da Universidade de São Paulo (EACH-USP)

This paper appears in: Revista IEEE América Latina

Publication Date: Sept. 2012
Volume: 10,   Issue: 5 
ISSN: 1548-0992

Bilayer segmentation of live video in uncontrolled environments is an essential task for home applications in which the original background of the scene must be replaced, as in videochats or traditional videoconference. The main challenge in such conditions is overcome all difficulties in problem-situations (e.g., illumination change, distract events such as element moving in the background and camera shake) that may occur while the video is being captured. This paper presents a survey of segmentation methods for background substitution applications, describes the main concepts and identifies events that may cause errors. Our analysis shows that although robust methods rely on specific devices (multiple cameras or sensors to generate depth maps) which aid the process. In order to achieve the same results using conventional devices (monocular video cameras), most current research relies on energy minimization frameworks, in which temporal and spacial information are probabilistically combined with those of color and contrast.

Index Terms:
Background Substitution, Bilayer Segmentation, Computer Vision, Image Processing, Live Video   

Documents that cite this document
This function is not implemented yet.

[PDF Full-Text (991)]