Background Extraction Using Random Walk Image Fusion
  Kai-Lung Hua      Hong-Cyuan Wang     Chih-Xian Yeh     Wen-Huang Cheng     Yu-Chi Lai  
Hua, K.-L., Wang, H.-C., Yeh, C.-X., Cheng, W.-H., and Lai, Y.-C. Lai, "Background Extraction Using Random Walk Image Fusion.", IEEE Transactions on Cybernetics, Volume: 99 PP, Issue: 99, Pages: 1 - 13, DOI: 10.1109/TCYB.2016.2640288, 2016

It is important to extract a clear background for computer vision and augmented reality. Generally, background extraction assumes the existence of a clean background shot through the input sequence, but realistically, situations may violate this assumption such as highway traffic videos. Therefore, our probabilistic model-based method formulates fusion of candidate background patches of the input sequence as a random walk problem and seeks a globally optimal solution based on their temporal and spatial relationship. Furthermore, we also design two quality measures to consider spatial and temporal coherence and contrast distinctness among pixels as background selection basis. A static background should have high temporal coherence among frames, and thus, we improve our fusion precision with a temporal contrast filter and an optical-flow-based motion-less patch extractor. Experiments demonstrate that our algorithm can successfully extract artifact-free background images with low computational cost while comparing to state-of-the-art algorithms.




This work was supported by the Ministry of Science and Technology of Taiwan under Grants MOST 104-2221-E-011-091-MY2, MOST 105-2622-E-011-012-CC3, MOST 105-2628-E-001-003-MY3, MOST 104-2221-E-011-029-MY3, MOST 105-2218-E-011-005, and MOST 105-2221-E-011-120-MY2.