Conservative Stochastic Optimization With Expectation Constraints

@article{Akhtar2020ConservativeSO,
  title={Conservative Stochastic Optimization With Expectation Constraints},
  author={Zeeshan Akhtar and A. S. Bedi and Ketan Rajawat},
  journal={IEEE Transactions on Signal Processing},
  year={2020},
  volume={69},
  pages={3190-3205},
  url={https://api.semanticscholar.org/CorpusID:221112456}
}
A novel conservative stochastic optimization algorithm (CSOA) that is not only projection-free but also achieves zero average constraint violation and decay of the optimality gap is proposed.
[PDF] Semantic Reader

Figures and Tables from this paper

25 Citations

Stochastic Compositional Gradient Descent Under Compositional Constraints

The numerical results show that the proposed algorithm outperforms the state-of-the-art algorithms in terms of the convergence rate and improves upon the best-known sample complexity results for the constrained settings.

Distributed Frank-Wolfe Solver for Stochastic Optimization With Coupled Inequality Constraints

This article proposes a distributed stochastic FW primal-dual algorithm (DSFWPD), which is the first stochastic FW solver for DSO problems with coupled constraints, and achieves zero constraint violation on average with a sublinear decay of the optimality gap over a directed and time-varying network.

Achieving Zero Constraint Violation for Concave Utility Constrained Reinforcement Learning via Primal-Dual Approach

By leveraging a generative model, it is proved that CSPDA not only exhibits O (cid:0) 1 /(cid:15) 2 (cid:1) sample complexity, but also achieves zero constraint violations for the concave utility CMDP.

Stochastic First-Order Algorithms for Constrained Distributionally Robust Optimization

A generic stochastic first-order meta-algorithm, where the decision variables and uncertain distribution parameters are each updated separately by applying stochastic first-order methods, which shows the usefulness of the algorithm, in particular when the dimension of the distribution parameters is large.

Achieving Zero Constraint Violation for Constrained Reinforcement Learning via Primal-Dual Approach

A conservative stochastic primal-dual algorithm (CSPDA) is proposed which is shown to exhibit O(1/epsilon^2) sample complexity to achieve epsilon-optimal cumulative reward with zero constraint violations and provides a significant improvement compared to the state of the art.

Hinge-Proximal Stochastic Gradient Methods for Convex Optimization with Functional Constraints

This work develops a hinge-proximal framework that utilizes an exact penalty reformulation to yield updates involving only one linearized constraint (and hence accessing one constraint gradient) per-iteration, and admits a novel hinge-proximal three-point inequality relying on smoothness rather than global Lipschitz continuity of the constraint functions.

Stochastic Sequential Quadratic Programming for Optimization with Functional Constraints

This work proposes a stochastic sequential quadratic programming (SSQP) algorithm that works entirely in the primal domain, avoids projecting onto the feasible region, obviates the need for bounded gradients, and achieves state-of-the-art oracle complexity under standard smoothness and convexity assumptions.

Projected Gradient Descent for Constrained Decision-Dependent Optimization

This paper proposes a new method termed repeated projected gradient descent (RPGD), which iteratively projects points onto evolving feasible sets throughout the optimization process, and shows a Lipschitz continuity property of projections onto varying sets with an explicitly given Lipschitz constant.

Automatic debiasing of neural networks via moment-constrained learning

Causal and nonparametric estimands in economics and biostatistics can often be viewed as the mean of a linear functional applied to an unknown outcome regression function. Naively learning the…

Scenario Generation Based on a Gaussian Mixture Model for the Stochastic Optimization of Crowd Control

A scenario generation based on a Gaussian mixture model is proposed in this paper for the stochastic optimization of crowd control and achieves robust crowd control with a small number of measured scenarios, which was previously impossible without a sufficient number of measured scenarios.

44 References

Algorithms for stochastic optimization with expectation constraints

This paper presents a new stochastic approximation (SA) type algorithm, namely the cooperative SA (CSA), to handle problems with the expectation constraint on devision variables, and shows that this algorithm exhibits the optimal ${\cal O}(1/\sqrt{N})$ rate of convergence, in terms of both optimality gap and constraint violation.

Online Convex Optimization with Stochastic Constraints

This paper considers online convex optimization (OCO) with stochastic constraints, which generalizes Zinkevich's OCO over a known simple fixed set by introducing multiple stochastic functional…

Stochastic Approximation Proximal Method of Multipliers for Convex Stochastic Programming

It is shown that this method exhibits sublinear regret for both objective reduction and constraint violation if parameters in the algorithm are properly chosen, and the high probability performance of the proposed method under the standard light-tail assumption is investigated.

Stochastic Conditional Gradient Methods: From Convex Minimization to Submodular Maximization

Stochastic conditional gradient methods are proposed as an alternative solution relying on Approximating gradients via a simple averaging technique requiring a single stochastic gradient evaluation per iteration, and replacing projection step in proximal methods by a linear program lowers the computational complexity of each iteration.

Optimal Convergence for Stochastic Optimization with Multiple Expectation Constraints

This paper extends the cooperative stochastic approximation algorithm from Lan and Zhou [2016], and provides a novel proof technique to show that the algorithm attains the optimal rate of convergence for both optimality gap and constraint violation when the functions are generally convex.

Convex Approximations of Chance Constrained Programs

A large deviation-type approximation, referred to as “Bernstein approximation,” of the chance constrained problem is built that is convex and efficiently solvable and extended to the case of ambiguous chance constrained problems, where the random perturbations are independent with the collection of distributions known to belong to a given convex compact set.

Stochastic Gradient Descent with Only One Projection

This work develops novel stochastic optimization algorithms that do not need intermediate projections to obtain a feasible solution in the given domain and achieves an O(1/√T) convergence rate for general convex optimization and a O(ln T/T) rate for strongly conveX optimization under mild conditions about the domain and the objective function.

Stochastic Approximation approach to Stochastic Programming

It is intended to demonstrate that a properly modified SA approach can be competitive and even significantly outperform the SAA method for a certain class of convex stochastic problems.

Trading regret for efficiency: online convex optimization with long term constraints

This paper proposes an efficient algorithm which achieves O(√T) regret bound and O(T3/4) bound on the violation of constraints and proposes a multipoint bandit feedback algorithm with the same bounds in expectation as the first algorithm.

An optimal method for stochastic composite optimization

The accelerated stochastic approximation (AC-SA) algorithm based on Nesterov’s optimal method for smooth CP is introduced, and it is shown that the AC-SA algorithm can achieve the aforementioned lower bound on the rate of convergence for SCO.