Coupling matrix manifolds assisted optimization for optimal transport problems

Machine Learning - Tập 110 - Trang 533-558 - 2021
Dai Shi1, Junbin Gao1, Xia Hong2, S. T. Boris Choy1, Zhiyong Wang3
1Discipline of Business Analytics, The University of Sydney Business School, The University of Sydney, Sydney, Australia
2Department of Computer Science, University of Reading, Reading, UK
3School of Computer Science, The University of Sydney, Sydney, Australia

Tóm tắt

Optimal transport (OT) is a powerful tool for measuring the distance between two probability distributions. In this paper, we introduce a new manifold named as the coupling matrix manifold (CMM), where each point on this novel manifold can be regarded as a transportation plan of the optimal transport problem. We firstly explore the Riemannian geometry of CMM with the metric expressed by the Fisher information. These geometrical features can be exploited in many essential optimization methods as a framework solving all types of OT problems via incorporating numerical Riemannian optimization algorithms such as gradient descent and trust region algorithms in CMM manifold. The proposed approach is validated using several OT problems in comparison with recent state-of-the-art related works. For the classic OT problem and its entropy regularized variant, it is shown that our method is comparable with the classic algorithms such as linear programming and Sinkhorn algorithms. For other types of non-entropy regularized OT problems, our proposed method has shown superior performance to other works, whereby the geometric information of the OT feasible space was not incorporated within.

Tài liệu tham khảo