algorithm - 从视频中删除分段(例如人或鸟)的标准技术是什么？

Question

假设您正在拍摄视频(相机处于稳定位置)，一只鸟从相机的视野中飞过。应该可以进行图像分割并自动从视频中删除这只鸟。

这些算法风格是什么？它们通常是如何实现的？

Answer 1

有一种技术叫做 Simple Image Object Extraction (SIOX) - 它使用一种技术来识别静止图像和视频图像中的前景与背景对象。开源GIMP编辑器有它的实现，并且有 more information about it here .

从概述:

SIOX stands for Simple Interactive Object Extraction and is a solution for extracting foreground from still images with very little user interaction. SIOX is fast, noise robust, and can therefore also be used for the segmentation of videos. It avoids many of the drawbacks of graph-based segmentation methods but performs about equally well on different benchmarks. SIOX is open and free (Apache License) and the authors have intentionally not patented any part of the technology. As a result, it has been integrated into several open-source image manipulation programs over the past years. SIOX is the underlying algorithm of the foreground extraction tool in the GNU Image Manipulation Program (GIMP) and is part of the tracer tool in Inkscape. SIOX originates from E-Chalk where an instructor standing in front of an electronic chalkboard is segmented. Variants of SIOX are being used for robotic vision and for improving 3D time-of-flight camera segmentation.

这是 Java Reference Implementation of SIOX 的链接.

这是 PDF with details 的链接关于算法变体的工作原理。

您应该能够调整它以使用帧间插值通过使用来自周围帧的时间数据从视频的每个帧中删除特定的前景对象。