Integrating Efficient Optimal Transport and Functional Maps for Unsupervised Shape Correspondence Learning

Abstract
In the realm of computer vision and graphics, accu- rately establishing correspondences between geometric 3D shapes is pivotal for applications like object tracking, reg- istration, texture transfer, and statistical shape analysis. Moving beyond traditional hand-crafted and data-driven feature learning methods, we incorporate spectral methods with deep learning, focusing on functional maps (FMs) and optimal transport (OT). Traditional OT-based approaches, often reliant on entropy regularization OT in learning-based framework, face computational challenges due to their quadratic cost. Our key contribution is to employ the sliced Wasserstein distance (SWD) for OT, which is a valid fast op- timal transport metric in an unsupervised shape matching framework. This unsupervised framework integrates func- tional map regularizers with a novel OT-based loss derived from SWD, enhancing feature alignment between shapes treated as discrete probability measures. We also introduce an adaptive refinement process utilizing entropy regularized OT, further refining feature alignments for accurate point- to-point correspondences. Our method demonstrates supe- rior performance in non-rigid shape matching, including near-isometric and non-isometric scenarios, and excels in downstream tasks like segmentation transfer. The empirical results on diverse datasets highlight our frameworkâs effec- tiveness and generalization capabilities, setting new stan- dards in non-rigid shape matching with efficient OT metrics and an adaptive refinement module. Code is available at1.
Cite
@inproceedings{integrating-efficient-optimal-transport-and-functional-maps-for-2024,
author = {Tung Le and Khai Nguyen and Shanlin Sun and Nhat Ho and Xiaohui Xie},
title = {Integrating Efficient Optimal Transport and Functional Maps for Unsupervised Shape Correspondence Learning},
booktitle = {CVPR},
pages = {23188-23198},
year = {2024},
doi = {10.1109/CVPR52733.2024.02188},
url = {https://doi.org/10.1109/CVPR52733.2024.02188},
}