publications

2024

1. MCOM

   Properties of Discrete Sliced Wasserstein Losses

   Eloi Tanguy, Rémi Flamary, and Julie Delon

   Mathematics of Computation Jun 2024

   Abs arXiv Bib URL PDF Slides

   The Sliced Wasserstein (SW) distance has become a popular alternative to the Wasserstein distance for comparing probability measures. Widespread applications include image processing, domain adaptation and generative modelling, where it is common to optimise some parameters in order to minimise SW, which serves as a loss function between discrete probability measures (since measures admitting densities are numerically unattainable). All these optimisation problems bear the same sub-problem, which is minimising the Sliced Wasserstein energy. In this paper we study the properties of \(E: Y \longmapsto SW_2^2(\gamma_Y, \gamma_Z)\), i.e. the SW distance between two uniform discrete measures with the same amount of points as a function of the support \(Y ∈R^n \times d\)of one of the measures. We investigate the regularity and optimisation properties of this energy, as well as its Monte-Carlo approximation \(E_p\) (estimating the expectation in SW using only \(p\)samples) and show convergence results on the critical points of \(E_p\)to those of \(E\), as well as an almost-sure uniform convergence and a uniform Central Limit result on the process \(E_p\). Finally, we show that in a certain sense, Stochastic Gradient Descent methods minimising \(E\)and \(E_p\)converge towards (Clarke) critical points of these energies.

   @article{tanguy2023discrete_sw_losses,
     author = {Tanguy, Eloi and Flamary, R{\'e}mi and Delon, Julie},
     journal = {Mathematics of Computation},
     title = {Properties of Discrete Sliced {W}asserstein Losses},
     month = jun,
     year = {2024},
     url = {https://www.ams.org/journals/mcom/0000-000-00/S0025-5718-2024-03994-7/}
   }

2. CRAS

   Reconstructing discrete measures from projections. Consequences on the empirical Sliced Wasserstein Distance

   Eloi Tanguy, Rémi Flamary, and Julie Delon

   Comptes Rendus. Mathématique Jun 2024

   Abs arXiv Bib URL PDF

   This paper deals with the reconstruction of a discrete measure \(\gamma_Z \)on \(R^d\)from the knowledge of its pushforward measures \(P_i\)#\(\gamma_Z\)linear applications \(P_i: R^d →R^h\) (for instance projections onto subspaces). The measure \(\gamma_Z \)being fixed, assuming that the rows of the matrices \(P_i\)are independent realizations of laws which do not give mass to hyperplanes, we show that if \(\sum_i h_i > d\), this reconstruction problem has almost certainly a unique solution. This holds for any number of points in \(\gamma_Z\). A direct consequence of this result is an almost-sure separability property on the empirical Sliced Wasserstein distance.

   @article{tanguy2024reconstructing,
     author = {Tanguy, Eloi and Flamary, R{\'e}mi and Delon, Julie},
     journal = {Comptes Rendus. Math\'ematique},
     pages = {1121--1129},
     title = {Reconstructing discrete measures from projections. Consequences on the empirical Sliced {W}asserstein Distance},
     publisher = {Acad\'emie des sciences, Paris},
     volume = {362},
     year = {2024},
     doi = {10.5802/crmath.601},
     url = {https://comptes-rendus.academie-sciences.fr/mathematique/articles/10.5802/crmath.601/}
   }

3. PREPRINT

   Constrained Approximate Optimal Transport Maps

   Eloi Tanguy, Agnès Desolneux, and Julie Delon

   arXiv preprint arXiv:2407.13445 Jul 2024

   Abs arXiv Bib PDF

   We investigate finding a map \(g\)within a function class \(G \)that minimises an Optimal Transport (OT) cost between a target measure \(ν \)and the image by \(g \)of a source measure \(μ \). This is relevant when an OT map from \(μ \)to \(ν \)does not exist or does not satisfy the desired constraints of \(G\). We address existence and uniqueness for generic subclasses of \(L\)-Lipschitz functions, including gradients of (strongly) convex functions and typical Neural Networks. We explore a variant that approaches a transport plan, showing equivalence to a map problem in some cases. For the squared Euclidean cost, we propose alternating minimisation over a transport plan \(\pi \)and map \(g \), with the optimisation over \(g \)being the \(L^2 \)projection on \(G \)of the barycentric mapping \(\overline\pi\). In dimension one, this global problem equates the \(L^2 \)projection of \(\overline\pi^* \)onto \(G \)for an OT plan \(\pi^* \)between \(μ \)and \(ν \), but this does not extend to higher dimensions. We introduce a simple kernel method to find g within a Reproducing Kernel Hilbert Space in the discrete case. Finally, we present numerical methods for \(L\)-Lipschitz gradients of \(\ell\)-strongly convex potentials..

   @article{tanguy2024constrained,
     author = {Tanguy, Eloi and Desolneux, Agn\`es and Delon, Julie},
     journal = {arXiv preprint arXiv:2407.13445},
     title = {Constrained Approximate Optimal Transport Maps},
     year = {2024},
     month = jul,
   }

2023

1. TMLR

   Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses

   Eloi Tanguy

   Transactions on Machine Learning Research Oct 2023

   Abs arXiv Bib URL PDF

   Optimal Transport has sparked vivid interest in recent years, in particular thanks to the Wasserstein distance, which provides a geometrically sensible and intuitive way of comparing probability measures. For computational reasons, the Sliced Wasserstein (SW) distance was introduced as an alternative to the Wasserstein distance, and has seen uses for training generative Neural Networks (NNs). While convergence of Stochastic Gradient Descent (SGD) has been observed practically in such a setting, there is to our knowledge no theoretical guarantee for this observation. Leveraging recent works on convergence of SGD on non-smooth and non-convex functions by Bianchi et al. (2022), we aim to bridge that knowledge gap, and provide a realistic context under which fixed-step SGD trajectories for the SW loss on NN parameters converge. More precisely, we show that the trajectories approach the set of (sub)-gradient flow equations as the step decreases. Under stricter assumptions, we show a much stronger convergence result for noised and projected SGD schemes, namely that the long-run limits of the trajectories approach a set of generalised critical points of the loss function.

   @article{tanguy2023convergence_sgd_sw_nn,
     author = {Tanguy, Eloi},
     journal = {Transactions on Machine Learning Research},
     title = {Convergence of SGD for Training Neural Networks with Sliced {W}asserstein Losses},
     year = {2023},
     month = oct,
     url = {https://openreview.net/forum?id=aqqfB3p9ZA},
     issn = {2835-8856}
   }

2022

1. MASTER THESIS

   [Report] Generalised Wasserstein Barycentres

   Eloi Tanguy, Julie Delon, and Rémi Flamary

   Sep 2022

   Abs Bib PDF

   We generalise Wasserstein Barycentres, allowing the computation of barycentres between measures in different spaces. We provide efficient solvers for this new problem, and study a particular case which corresponds to a reconstruction problem. Studying the properties of this problem, we draw partial conclusions on the optima of the discrete Sliced Wasserstein Distance.

   @report{reportGWB,
     title = {[Report] Generalised Wasserstein Barycentres},
     author = {Tanguy, Eloi and Delon, Julie and Flamary, Rémi},
     year = {2022},
     month = sep,
     journal = {Master Thesis},
   }