Return to Colloquia & Seminar listing
Riemannian Optimization for the Projection Robust Wasserstein Distance
Faculty Research SeminarSpeaker: | Shiqian Ma, UC Davis |
Location: | Zoom |
Start time: | Tue, Feb 9 2021, 12:10PM |
The Wasserstein distance has become increasingly important in machine learning and deep learning. Despite its popularity, the Wasserstein distance is hard to approximate because of the curse of dimensionality. A recently proposed approach to alleviate the curse of dimensionality is to project the sampled data from the high dimensional probability distribution onto a lower-dimensional subspace, and then compute the Wasserstein distance between the projected data. However, this approach requires to solve a max-min problem over the Stiefel manifold, which is very challenging in practice. In this talk, we propose a Riemannian block coordinate descent (RBCD) method to solve this problem, which is based on a novel reformulation of the regularized max-min problem over the Stiefel manifold. We analyze the complexity of arithmetic operations for RBCD to obtain an approximate stationary point, and show that it significantly improves the corresponding complexity of existing methods. Numerical results on both synthetic and real datasets demonstrate that our method is more efficient than existing methods, especially when the number of sampled data is very large. (At the beginning of the talk, I will briefly talk about some other projects that my group is working on.)