-
Distributed Difference of Convex Optimization
Authors:
Vivek Khatana,
Murti V. Salapaka
Abstract:
In this article, we focus on solving a class of distributed optimization problems involving $n$ agents with the local objective function at every agent $i$ given by the difference of two convex functions $f_i$ and $g_i$ (difference-of-convex (DC) form), where $f_i$ and $g_i$ are potentially nonsmooth. The agents communicate via a directed graph containing $n$ nodes. We create smooth approximations…
▽ More
In this article, we focus on solving a class of distributed optimization problems involving $n$ agents with the local objective function at every agent $i$ given by the difference of two convex functions $f_i$ and $g_i$ (difference-of-convex (DC) form), where $f_i$ and $g_i$ are potentially nonsmooth. The agents communicate via a directed graph containing $n$ nodes. We create smooth approximations of the functions $f_i$ and $g_i$ and develop a distributed algorithm utilizing the gradients of the smooth surrogates and a finite-time approximate consensus protocol. We term this algorithm as DDC-Consensus. The developed DDC-Consensus algorithm allows for non-symmetric directed graph topologies and can be synthesized distributively. We establish that the DDC-Consensus algorithm converges to a stationary point of the nonconvex distributed optimization problem. The performance of the DDC-Consensus algorithm is evaluated via a simulation study to solve a nonconvex DC-regularized distributed least squares problem. The numerical results corroborate the efficacy of the proposed algorithm.
△ Less
Submitted 23 July, 2024;
originally announced July 2024.
-
Adaptive Online Model Update Algorithm for Predictive Control in Networked Systems
Authors:
Vivek Khatana,
Chin-Yao Chang,
Wenbo Wang
Abstract:
In this article, we introduce an adaptive online model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on historical data for offline model identification, our approach utilizes real-time data for continuous model updates. This method integrates seamlessly with existing o…
▽ More
In this article, we introduce an adaptive online model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on historical data for offline model identification, our approach utilizes real-time data for continuous model updates. This method integrates seamlessly with existing online control and optimization algorithms and provides timely updates in response to real-time changes. This methodology offers significant advantages, including a reduction in the communication network bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt after disturbances. Furthermore, our algorithm is tailored for non-linear convex models, enhancing its applicability to practical scenarios. The efficacy of the proposed method is validated through a numerical study, demonstrating improved control performance using a synthetic IEEE test case.
△ Less
Submitted 17 July, 2024; v1 submitted 1 May, 2024;
originally announced May 2024.
-
Guaranteeing Service in Connected Microgrids: Storage Planning and Optimal Power Sharing Policy
Authors:
Arnab Dey,
Vivek Khatana,
Ankur Mani,
Murti V. Salapaka
Abstract:
The integration of renewable energy sources (RES) into power distribution grids poses challenges to system reliability due to the inherent uncertainty in their power production. To address this issue, battery energy sources (BESs) are being increasingly used as a promising solution to counter the uncertainty associated with RES power production. During the overall system planning stage, the optima…
▽ More
The integration of renewable energy sources (RES) into power distribution grids poses challenges to system reliability due to the inherent uncertainty in their power production. To address this issue, battery energy sources (BESs) are being increasingly used as a promising solution to counter the uncertainty associated with RES power production. During the overall system planning stage, the optimal capacity of the BES has to be decided. In the operational phase, policies on when to charge the BESs and when to use them to support loads must be determined so that the BES remains within its operating range, avoiding depletion of charge on one hand and remaining within acceptable margins of maximum charge on the other. In this paper, a stochastic control framework is used to determine battery capacity, for microgrids, which ensures that during the operational phase, BESs' operating range is respected with pre-specified high probability. We provide an explicit analytical expression of the required BESs energy capacity for a single microgrid with RES as the main power source. Leveraging insights from the single microgrid case, the article focuses on the design and planning of BESs for the two-microgrid scenario. In this setting, microgrids are allowed to share power while respecting the capacity constraints imposed by the power lines. We characterize the optimal power transfer policy between the microgrids and the optimal BES capacity for multiple microgrids. This provides the BES savings arising from connecting the microgrids.
△ Less
Submitted 10 July, 2024; v1 submitted 12 March, 2024;
originally announced March 2024.
-
Distributed Average Consensus Over Noisy Communication Links in Directed Graphs
Authors:
Vivek Khatana,
Murti V. Salapaka
Abstract:
Motivated by the needs of resiliency, scalability, and plug-and-play operation, distributed decision-making is becoming increasingly prevalent. The problem of achieving consensus in a multi-agent system is at the core of distributed decision-making. In this article, we study the problem of achieving average consensus over a directed multi-agent network when the communication links are corrupted wi…
▽ More
Motivated by the needs of resiliency, scalability, and plug-and-play operation, distributed decision-making is becoming increasingly prevalent. The problem of achieving consensus in a multi-agent system is at the core of distributed decision-making. In this article, we study the problem of achieving average consensus over a directed multi-agent network when the communication links are corrupted with noise. We propose an algorithm where each agent updates its estimates based on the local mixing of information and adds its weighted noise-free initial information to its updates during every iteration. We demonstrate that with appropriately designed weights the agents achieve consensus under additive communication noise. We establish that when the communication links are noiseless the proposed algorithm moves towards consensus at a geometric rate. Under communication noise, we prove that the agent estimates reach a consensus value almost surely. We present numerical experiments to corroborate the efficacy of the proposed algorithm under different noise realizations and various algorithm parameters.
△ Less
Submitted 11 November, 2022;
originally announced November 2022.
-
Transactive Framework for Dynamic Energy Storage Allocation for Critical Load Management
Authors:
Arnab Dey,
Vivek Khatana,
Ankur Mani,
Murti V. Salapaka
Abstract:
Increased penetration of Distributed Energy Resources (DER) and Renewable Energy Systems (RES) transforming the conventional distribution grid into a transactive framework supervised by a distribution system operator (DSO). Although the emerging transactive energy management techniques improve the grid reliability, the inherent uncertainty of RES poses a challenge in meeting the power demand of th…
▽ More
Increased penetration of Distributed Energy Resources (DER) and Renewable Energy Systems (RES) transforming the conventional distribution grid into a transactive framework supervised by a distribution system operator (DSO). Although the emerging transactive energy management techniques improve the grid reliability, the inherent uncertainty of RES poses a challenge in meeting the power demand of the critical infrastructure in the microgrid unless sufficient battery energy storage is maintained. However, maintaining expensive battery storage increases the operating cost of the DSO. In this article, we propose a cost-effective dynamic resource allocation strategy to optimize the battery reserve requirement while ensuring the critical demand is met with a provable guarantee. Our proposed scheme enables the DSO to optimize the RES and battery reserve allocation to eliminate the risk of over or underproduction. We present numerical simulations under three different scenarios of multiple microgrids with uncertain renewable generation. The simulation results demonstrate the efficacy of the proposed transactive stochastic control algorithm.
△ Less
Submitted 5 September, 2023; v1 submitted 14 January, 2021;
originally announced January 2021.
-
Convex Decreasing Algorithms: Distributed Synthesis and Finite-time Termination in Higher Dimension
Authors:
James Melbourne,
Govind Saraswat,
Vivek Khatana,
Sourav Patel,
Murti V. Salapaka
Abstract:
We introduce a general mathematical framework for distributed algorithms, and a monotonicity property frequently satisfied in application. These properties are leveraged to provide finite-time guarantees for converging algorithms, suited for use in the absence of a central authority. A central application is to consensus algorithms in higher dimension. These pursuits motivate a new peer to peer co…
▽ More
We introduce a general mathematical framework for distributed algorithms, and a monotonicity property frequently satisfied in application. These properties are leveraged to provide finite-time guarantees for converging algorithms, suited for use in the absence of a central authority. A central application is to consensus algorithms in higher dimension. These pursuits motivate a new peer to peer convex hull algorithm which we demonstrate to be an instantiation of the described theory. To address the diversity of convex sets and the potential computation and communication costs of knowing such sets in high dimension, a lightweight norm based stopping criteria is developed. More explicitly, we give a distributed algorithm that terminates in finite time when applied to consensus problems in higher dimensions and guarantees the convergence of the consensus algorithm in norm, within any given tolerance. Applications to consensus least squared estimation and distributed function determination are developed. The practical utility of the algorithm is illustrated through MATLAB simulations.
△ Less
Submitted 30 July, 2020; v1 submitted 26 July, 2020;
originally announced July 2020.
-
On Mitigating the Uncertainty in Renewable Generation in Distribution Microgrids
Authors:
Arnab Dey,
Vivek Khatana,
Ankur Mani,
Murti V. Salapaka
Abstract:
In this article, we focus on the problem of mitigating the risk of not being able to meet the power demand, due to the inherent uncertainty of renewable energy generation sources in microgrids. We consider three different demand scenarios, namely meeting short-time horizon power demand, a sustained energy demand and a scenario where the power demand at a prescribed future time has to be met with a…
▽ More
In this article, we focus on the problem of mitigating the risk of not being able to meet the power demand, due to the inherent uncertainty of renewable energy generation sources in microgrids. We consider three different demand scenarios, namely meeting short-time horizon power demand, a sustained energy demand and a scenario where the power demand at a prescribed future time has to be met with almost sure guarantee with power generation being stochastic and following dynamics governed by geometric Brownian motion. For each of these scenarios we provide solutions to meet the electrical demand. We present results of numerical experiments to demonstrate the applicability of our schemes.
△ Less
Submitted 16 July, 2020;
originally announced July 2020.
-
DC-DistADMM: ADMM Algorithm for Constrained Distributed Optimization over Directed Graphs
Authors:
Vivek Khatana,
Murti V. Salapaka
Abstract:
This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees. \textcolor{black}{The algorithm accrues all the benefits of the Alternating Direction Method of Multipliers (ADMM) approach}. It also overcomes the limitations of existing methods…
▽ More
This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees. \textcolor{black}{The algorithm accrues all the benefits of the Alternating Direction Method of Multipliers (ADMM) approach}. It also overcomes the limitations of existing methods on convex optimization problems with linear inequality, equality and set constraints by allowing directed communication topologies. Moreover, the algorithm can be synthesized distributively. The developed algorithm has: (i) a $O(1/k)$ rate of convergence, where $k$ is the iteration counter, when individual functions are convex but not-necessarily differentiable, and (ii) a geometric rate of convergence to any arbitrary small neighborhood of the optimal solution, when the objective functions are smooth and restricted strongly convex at the optimal solution. The efficacy of the algorithm is evaluated by a comparison with state-of-the-art constrained optimization algorithms in solving a constrained distributed $\ell_1$-regularized logistic regression problem, and unconstrained optimization algorithms in solving a $\ell_1$-regularized Huber loss minimization problem. Additionally, a comparison of the algorithm's performance with other algorithms in the literature that utilize multiple communication steps is provided.
△ Less
Submitted 24 August, 2022; v1 submitted 30 March, 2020;
originally announced March 2020.
-
Gradient-Consensus: Linearly Convergent Distributed Optimization Algorithm over Directed Graphs
Authors:
Vivek Khatana,
Govind Saraswat,
Sourav Patel,
Murti V. Salapaka
Abstract:
In this article, we propose a new approach, optimize then agree for minimizing a sum $ f = \sum_{i=1}^n f_i(x)$ of convex objective functions over a directed graph. The optimize then agree approach decouples the optimization step and the consensus step in a distributed optimization framework. The key motivation for optimize then agree is to guarantee that the disagreement between the estimates of…
▽ More
In this article, we propose a new approach, optimize then agree for minimizing a sum $ f = \sum_{i=1}^n f_i(x)$ of convex objective functions over a directed graph. The optimize then agree approach decouples the optimization step and the consensus step in a distributed optimization framework. The key motivation for optimize then agree is to guarantee that the disagreement between the estimates of the agents during every iteration of the distributed optimization algorithm remains under any apriori specified tolerance; existing algorithms do not provide such a guarantee which is required in many practical scenarios. In this method, each agent during each iteration maintains an estimate of the optimal solution and, utilizes its locally available gradient information along with a finite-time approximate consensus protocol to move towards the optimal solution (hence the name Gradient-Consensus algorithm). We establish that the proposed algorithm has a global R-linear rate of convergence if the aggregate function $f$ is strongly convex and Lipschitz differentiable. We also show that under the relaxed assumption of $f_i$'s being convex and Lipschitz differentiable, the objective function error residual decreases at a Q-linear rate (in terms of the number of gradient computation steps) until it reaches a small value, which can be managed using the tolerance value specified on the finite-time approximate consensus protocol; no existing method in the literature has such strong convergence guarantees when $f_i$ are not necessarily strongly convex functions. The communication overhead for the improved guarantees on meeting constraints and better convergence of our algorithm is $O(k\log k)$ iterates in comparison to $O(k)$ of the traditional algorithms. Further, we numerically evaluate the performance of the proposed algorithm by solving a distributed logistic regression problem.
△ Less
Submitted 26 May, 2021; v1 submitted 22 September, 2019;
originally announced September 2019.
-
Distributed finite-time termination for consensus algorithm in switching topologies
Authors:
Govind Saraswat,
Vivek Khatana,
Sourav Patel,
Murti V. Salapaka
Abstract:
In this article, we present a finite time stopping criterion for consensus algorithms in networks with dynamic communication topology. Recent results provide asymptotic convergence to the consensus algorithm. However, the asymptotic convergence of these algorithms pose a challenge in the practical settings where the response from agents is required in finite time. To this end, we propose a Maximum…
▽ More
In this article, we present a finite time stopping criterion for consensus algorithms in networks with dynamic communication topology. Recent results provide asymptotic convergence to the consensus algorithm. However, the asymptotic convergence of these algorithms pose a challenge in the practical settings where the response from agents is required in finite time. To this end, we propose a Maximum-Minimum protocol which propagates the global maximum and minimum values of agent states (while running consensus algorithm) in the network. We establish that global maximum and minimum values are strictly monotonic even for a dynamic topology and can be utilized to distributively ascertain the closeness to convergence in finite time. We show that each node can have access to the global maximum and minimum by running the proposed Maximum-Minimum protocol and use it as a finite time stopping criterion for the otherwise asymptotic consensus algorithm. The practical utility of the algorithm is illustrated through experiments where each agent is instantiated by a NodeJS socket.io server.
△ Less
Submitted 30 August, 2019;
originally announced September 2019.