Kantorovich Dual Problem (for general costs): Difference between revisions
Line 31: | Line 31: | ||
The main idea is to use minimax principle, i.e. interchanging inf sup with sup inf in the proof. | The main idea is to use minimax principle, i.e. interchanging inf sup with sup inf in the proof. | ||
For this, we need some basic convex analysis techniques, namely Legendre-Fenchel transform and Theorem on Fenchel-Rockafellar Duality (its proof is based on Hahn-Banach theorem [https://en.wikipedia.org/wiki/Hahn%E2%80%93Banach_theorem] consequence on separating convex sets). The required statements can be found in the book by Rockafellar<ref name=Rockafellar /> | For this, we need some basic convex analysis techniques, namely Legendre-Fenchel transform and Theorem on Fenchel-Rockafellar Duality (its proof is based on Hahn-Banach theorem [https://en.wikipedia.org/wiki/Hahn%E2%80%93Banach_theorem] consequence on separating convex sets). The required statements can be found in the book by Rockafellar<ref name=Rockafellar /> and the book by Bauschke and Bredettes<ref name=BandC />. | ||
Take a note that at some point we use Arzela-Ascoli Theorem [https://en.wikipedia.org/wiki/Arzel%C3%A0%E2%80%93Ascoli_theorem]. In a non-compact space this is not possible. | Take a note that at some point we use Arzela-Ascoli Theorem [https://en.wikipedia.org/wiki/Arzel%C3%A0%E2%80%93Ascoli_theorem]. In a non-compact space this is not possible. |
Revision as of 11:49, 30 May 2020
The Kantorovich Dual Problem is one of the minimization problems in Optimal Transport. It is a dual problem of the Kantorovich Problem.
Introduction
The main advantage of Kantorovich Problem, in comparison to Monge Problem, is in the convex constraint property. Hence, it is possible to formulate the dual problem in the very general metric spaces called Polish spaces (complete separable metric spaces).
The Shipper's Problem
One of the ways to understand this problem is stated by Caffarelli. We will provide the modern rephrase of his statement.
During the COVID-19 pandemic, people are in the lockdown and it is the best time to enjoy a coffee time. All in all, it costs Amazon dollars to ship one box of necessary espresso capsules from place to place , i.e. from warehouses to homes. We want to optimize this expensive habit and consequently to solve appropriate Monge-Kantorovich problem. The mathematicians come to Amazon and propose the new kind of payment. For every box at place they will charge dollars and dollars to deliver at place . However, mathematicians will not reveal their shipping routes. Of course, in order for Amazon to accept this offer, the price The moral is that if the mathematicians are smart enough, they will be capable to make this shipment cheaper. This is provided by Kantorovich duality theorem. Take care that in the same cases, mathematicians will also give negative prices, if it is necessary!
Statement of Theorem
This is the statement of the Theorem in the book "Topics in Optimal Transportation", by Cedric Villani.
- Theorem.[1] Let X and Y be Polish spaces, let and , and let a cost function be lower semi-continuous.
Whenever and , define
.
Define to be the set of Borel probability measures on such that for all measurable sets and , , , and define to be the set of all measurable functions satisfying for almost everywhere in X and almost everywhere in Y.
Then .
Moreover, the infimum is attained. In addition it is possible to restrict and to be continuous and bounded.
Ideas and the techniques used in the proof
First, we assume that our spaces and are compact and that the cost function is continuous. The general case follows by an approximation argument.
The main idea is to use minimax principle, i.e. interchanging inf sup with sup inf in the proof. For this, we need some basic convex analysis techniques, namely Legendre-Fenchel transform and Theorem on Fenchel-Rockafellar Duality (its proof is based on Hahn-Banach theorem [1] consequence on separating convex sets). The required statements can be found in the book by Rockafellar[2] and the book by Bauschke and Bredettes[3].
Take a note that at some point we use Arzela-Ascoli Theorem [2]. In a non-compact space this is not possible. In order to evade compactness property, we have to use Prokhorov's theorem.
- Theorem.[4] Let be a sequence of tight probability measures on Polish space . Then, there exists and convergent subsequence such that in the dual of . Conversely, every sequence is tight.
The proof of the previous Theorem can be found in [4]. For more information on duality, take a look at Dual space of C_0(x) vs C_b(x).
C-concave functions
There are a few alternative proofs of the above Theorem. First, we will discuss the conclusion of the Theorem.
In Kantorovich Duality Theorem, the left-hand side of the last equality, the infimum is attained. We do not know anything similar about the right-hand side. However, when cost function is bounded we can restrict to pairs where is bounded and
The pair is called a pair of conjugate c-concave functions. It is known that and that is measurable. The proof can be found in the book [4] (Chapter 1, p.27).
In addition, it is possible to give a proof of Kantorovich Duality theorem using c-concave functions. Namely, we can find c-concave function such that
The proof of this fact can also be found in the book [4] (Chapter 1, p.11).
References
- ↑ C. Villani, Topics in Optimal Transportation, Chapter 1, pages 17-21
- ↑ R.T. Rockafellar,Convex Analysis, Princeton University Press, Princeton, 1970>
- ↑ Heinz H. Bauschke, Patrick L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces
- ↑ 4.0 4.1 4.2 4.3 F. Santambrogio, Optimal Transport for Applied Mathematicians, Chapter 1, pages 9-16