Self-Supervised Scene De-occlusion
We investigate the problem of scene de-occlusion, which aims to recover the underlying occlusion ordering and complete the invisible parts of occluded ...
self-supervised-learning computer-vision de-occlusion image-generation research article code paper video arxiv:2004.02788

We make the first attempt to address the problem through a novel and unified framework that recovers hidden scene structures without ordering and amodal annotations as supervisions. This is achieved via Partial Completion Network (PCNet)-mask (M) and -content (C), that learn to recover fractions of object masks and contents, respectively, in a self-supervised manner. Based on PCNet-M and PCNet-C, we devise a novel inference scheme to accomplish scene de-occlusion, via progressive ordering recovery, amodal completion and content completion.

Don't forget to tag @XiaohangZhan in your comment, otherwise they may not be notified.

Authors
PhD student in MMLab, CUHK
Share this project
Similar projects
The Illustrated Self-Supervised Learning
A visual introduction to self-supervised learning methods in Computer Vision
SimCLR in TensorFlow 2
(Minimally) implements SimCLR (https://arxiv.org/abs/2002.05709) in TensorFlow 2.
Holopix50k: A Large-Scale In-the-wild Stereo Image Dataset
The largest dataset of in-the-wild stereo image pairs (50K) crowd-sourced from the Holopix lightfield image-sharing social network.
G-SimCLR
TensorFlow implementation of G-SimCLR.
Top collections