Frank R. Schmidt

Postdoctoral Researcher

 

Video Segmentation with Just a Few Strokes

Naveen Nagaraja, Frank R. Schmidt, Thomas Brox
IEEE International Conference on Computer Vision (ICCV) - Dec 2015
Download the publication : 3 MB 
As the use of videos is becoming more popular in computer vision, the need for annotated video datasets increases. Such datasets are required either as training data or simply as ground truth for benchmark datasets. A particular challenge in video segmentation is due to disocclusions, which hamper frame-to-frame propagation, in conjunction with non-moving objects. We show that a combination of motion from point trajectories, as known from motion segmentation, along with minimal supervision can largely help solve this problem. Moreover, we integrate a new constraint that enforces consistency of the color distribution in successive frames. We quantify user interaction effort with respect to segmentation quality on challenging ego motion videos. We compare our approach to a diverse set of algorithms in terms of user effort and in terms of performance on common video segmentation benchmarks.

Images and movies

teaser.png (401 KB)
demo.mp4 (32 MB)
 

BibTex references

@InProceedings\{NSB15,
  author       = "Nagaraja, Naveen and Schmidt, Frank R. and Brox, Thomas",
  title        = "Video Segmentation with Just a Few Strokes",
  booktitle    = "IEEE International Conference on Computer Vision (ICCV)",
  month        = "Dec",
  year         = "2015",
  address      = "Santiago, Chile",
  url          = "http://www.frank-r-schmidt.de/Publications/2015/NSB15"
}