TY - JOUR
T1 - Adv-Depth
T2 - Self-Supervised Monocular Depth Estimation with an Adversarial Loss
AU - Li, Kunhong
AU - Fu, Zhiheng
AU - Wang, Hanyun
AU - Chen, Zonghao
AU - Guo, Yulan
PY - 2021
Y1 - 2021
N2 - Loss function plays a key role in self-supervised monocular depth estimation methods. Current reprojection loss functions are hand-designed and mainly focus on local patch similarity but overlook the global distribution differences between a synthetic image and a target image. In this paper, we leverage global distribution differences by introducing an adversarial loss into the training stage of self-supervised depth estimation. Specifically, we formulate this task as a novel view synthesis problem. We use a depth estimation module and a pose estimation module to form a generator, and then design a discriminator to learn the global distribution differences between real and synthetic images. With the learned global distribution differences, the adversarial loss can be back-propagated to the depth estimation module to improve its performance. Experiments on the KITTI dataset have demonstrated the effectiveness of the adversarial loss. The adversarial loss is further combined with the reprojection loss to achieve the state-of-the-art performance on the KITTI dataset.
AB - Loss function plays a key role in self-supervised monocular depth estimation methods. Current reprojection loss functions are hand-designed and mainly focus on local patch similarity but overlook the global distribution differences between a synthetic image and a target image. In this paper, we leverage global distribution differences by introducing an adversarial loss into the training stage of self-supervised depth estimation. Specifically, we formulate this task as a novel view synthesis problem. We use a depth estimation module and a pose estimation module to form a generator, and then design a discriminator to learn the global distribution differences between real and synthetic images. With the learned global distribution differences, the adversarial loss can be back-propagated to the depth estimation module to improve its performance. Experiments on the KITTI dataset have demonstrated the effectiveness of the adversarial loss. The adversarial loss is further combined with the reprojection loss to achieve the state-of-the-art performance on the KITTI dataset.
KW - Monocular depth estimation
KW - self-supervised learning
KW - single-image depth prediction
UR - http://www.scopus.com/inward/record.url?scp=85102717722&partnerID=8YFLogxK
U2 - 10.1109/LSP.2021.3065203
DO - 10.1109/LSP.2021.3065203
M3 - Article
AN - SCOPUS:85102717722
SN - 1070-9908
VL - 28
SP - 638
EP - 642
JO - IEEE Signal Processing Letters
JF - IEEE Signal Processing Letters
M1 - 9376591
ER -