Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Sampling

[ad_1]

Sampling from a high-dimensional distribution is a elementary job in statistics, engineering, and the sciences. A canonical method is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. That is the sampling analog of Gradient Descent. Regardless of being studied for a number of many years in a number of communities, tight mixing bounds for this algorithm stay unresolved even within the seemingly easy setting of log-concave distributions over a bounded area. This paper utterly characterizes the blending time of the Langevin Algorithm to its stationary distribution on this setting (and others). This mixing outcome will be mixed with any certain on the discretization bias with the intention to pattern from the stationary distribution of the continual Langevin Diffusion. On this means, we disentangle the examine of the blending and bias of the Langevin Algorithm.
Our key perception is to introduce a way from the differential privateness literature to the sampling literature. This system, referred to as Privateness Amplification by Iteration, makes use of as a possible a variant of Rényi divergence that’s made geometrically conscious by way of Optimum Transport smoothing. This offers a brief, easy proof of optimum mixing bounds and has a number of extra interesting properties. First, our method removes all pointless assumptions required by different sampling analyses. Second, our method unifies many settings: it extends unchanged if the Langevin Algorithm makes use of projections, stochastic mini-batch gradients, or strongly convex potentials (whereby our mixing time improves exponentially). Third, our method exploits convexity solely by means of the contractivity of a gradient step — paying homage to how convexity is utilized in textbook proofs of Gradient Descent. On this means, we provide a brand new method in direction of additional unifying the analyses of optimization and sampling algorithms.

[ad_2]

Leave a Comment

Your email address will not be published. Required fields are marked *