Conditions for State and Control Constraint Activation in Coordination of Connected and Automated Vehicles
A M Ishtiaque Mahbub, Andreas A. Malikopoulos

TL;DR
This paper analyzes the conditions under which constraints activate in the optimal coordination of connected and automated vehicles, providing a closed-form solution and simulation validation.
Contribution
It offers a novel analytical framework to identify when state and control constraints become active in CAV coordination problems.
Findings
Derived conditions for constraint activation in CAV coordination
Provided a closed-form analytical solution for constrained optimization
Validated results through numerical simulation
Abstract
Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce pollution, energy consumption, and travel delays. In earlier work, we addressed the optimal coordination of CAVs using Hamiltonian analysis. In this paper, we investigate the nature of the unconstrained problem and provide conditions under which the state and control constraints become active. We derive a closed-form analytical solution of the constrained optimization problem and evaluate the solution using numerical simulation.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Conditions for State and Control Constraint Activation in Coordination of Connected and Automated Vehicles
A M Ishtiaque Mahbub, Student Member, IEEE, Andreas A. Malikopoulos, Senior Member, IEEE This research was supported by ARPAE’s NEXTCAR program under the award number DE-AR0000796.The authors are with the Department of Mechanical Engineering, University of Delaware, Newark, DE 19716 USA (emails: [email protected];[email protected].)
Abstract
Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce pollution, energy consumption, and travel delays. In earlier work, we addressed the optimal coordination of CAVs using Hamiltonian analysis. In this paper, we investigate the nature of the unconstrained problem and provide conditions under which the state and control constraints become active. We derive a closed-form analytical solution of the constrained optimization problem and evaluate the solution using numerical simulation.
I Introduction
The implementation of an emerging transportation system with connected automated vehicles (CAVs) enables a novel computational framework to provide real-time control actions that optimizes energy consumption and associated benefits. CAVs can alleviate congestion at major transportation segments [1, 2], reduce emission, improve fuel efficiency [3, 4], and increase passenger safety. Several research efforts have been reported in the literature proposing either centralized or decentralized approaches on coordinating CAVs at different traffic scenarios, e.g., intersections, merging at roadways and roundabouts, speed reduction zones, to improve traffic flow and reduce stop-and-go driving. Some papers have used a reservation scheme [5, 6, 7] to control a signal-free intersection of two roads. Other approaches have focused on coordinating vehicles to improve the traffic flow [8, 9, 10].
More recently, an optimal control framework was established for coordinating online CAVs. A closed-form, analytical solution without considering state and control constraints was presented in [11] for coordinating online CAVs at highway on-ramps, in [12] at intersections, and in [13] for traffic corridors. The solution to the state and control unconstrained optimization problem discussed above shows possible state and control constraint activation within the optimization horizon and at the boundaries. To mitigate terminal jerk, Ntousakis et al. [11] reformulated the optimal control problem with terminal constraint on state and control, which does not guarantee constrained state/control values within the optimization horizon. The optimal control problem considering state and control constraints was addressed in [4] at an urban intersection, where the resulting formulation relies on piecing the unconstrained and constrained arcs together, and leads to a recursive computation of the solution until all constraint activation cases are resolved. This procedure may end up in a complicated recursive structure, and can become computationally exhaustive due to the presence of implicit system of equations to be solved numerically, preventing possible real-time implementation. The process is similar if the rear-end safety constraint is included [14].
In this paper, we investigate the formulation presented in [4] to provide useful insights about the state and control constraint activation to increase computational efficiency, and derive closed form analytical solution using the Hamiltonian analysis. In particular, we provide (1) conditions under which the constraint activation space can be reduced, and (2) conditions under which specific combination of state and control constraint activation can be identified to increase computational efficiency.
The remainder of the paper is organized as follows. In Section II, we introduce the problem formulation and present the unconstrained case. In Section III, we discuss different aspects of the state and control constrained formulation in detail. In Section IV, we provide the analytical solution of the constrained optimization. In Section V, we evaluate the effectiveness of the proposed approach in a simulation environment. We draw conclusions and discuss next steps in Section VI.
II Problem Formulation
Although our theoretical framework can be applied to any traffic scenario, e.g., merging at roadways [11] and roundabouts, passing through speed reduction zones [15], we use an intersection (Fig. 1) as a reference to present the fundamental ideas and results of this paper, since an intersection provides unique features making it technically more challenging compared to other traffic scenarios.
We define the area illustrated by the red square of dimension in Fig. 1 as the merging zone where possible lateral collision may occur. Upstream of the merging zone, we define a control zone of length , inside of which CAVs can coordinate with each other before they pass the merging zone. The intersection has a coordinator that only maintains the queue of the CAVs inside the control zone, and is not involved in any decision-making process. When a CAV enters the control zone, the coordinator receives its information and assigns a unique identity to it. The objective of each CAV is to derive its optimal control input to cross the intersection without activating any of the safety, state and control constraints.
II-A Vehicle Dynamics and Constraints
Let , where is the number of CAVs inside the control zone at time , be the queue of CAVs inside the control zone. We model each CAV as a double integrator
[TABLE]
where , , and denote the position, speed and acceleration (control input) of each CAV in the corridor. The sets , , and , are complete and totally bounded subsets of . Let denote the state vector of each CAV , with initial value taking values in . The state space for each CAV is closed with respect to the induced topology on and thus, it is compact. Each CAV enters the control zone at , enters the merging zone at , and exits the merging zone at .
To ensure that the control input and vehicle speed are within a given admissible range, the following constraints are imposed
[TABLE]
where , are the minimum and maximum acceleration for each CAV , and , are the minimum and maximum speed limits respectively.
We impose the following rear-end safety constraint
[TABLE]
where denotes the distance of CAV from CAV which is physically immediately ahead of , and denotes minimum safe distance which is a function of speed .
In the modeling framework described above, we impose the following assumptions:
Assumption 1. Each CAV is equipped with sensors to measure and share their local information.
Assumption 2. Communication among CAVs occurs without any delays or errors.
Assumption 1 restricts the problem to the case of 100% CAV penetration rate. Assumption 2 may be strong, but it is relatively straightforward to relax as long as the noise in the measurements and/or delays is bounded. For example, we can determine upper bounds on the state uncertainties as a result of sensing or communication errors and delays, and incorporate these into more conservative safety constraints.
II-B Upper-Level Vehicle Coordination
The queue of CAVs inside the control zone can be determined as an outcome of an upper-level vehicle coordination problem as described in [16, 12]. In what follows, we assume that the time that each CAV enters the merging zone is determined as the solution of some upper-level coordination problem, and will focus only on a low-level energy optimization problem that will yield the optimal control input for each CAV to achieve the assigned merging time .
II-C Low-Level Energy Optimization Problem
For each CAV traveling inside the control zone, we formulate an optimal control problem to minimize the -norm of the control input, i.e., , so that the transient engine operation can be minimized, and thus, fuel consumption [4],
[TABLE]
Note that, we do not provide a desired speed at . Additionally, we do not explicitly include the lateral and rear-end (3) safety constraints. We enforce the lateral collision constraint by selecting the appropriate merging time for each CAV in the upper-level vehicle coordination problem. The activation of rear-end safety constraint can be avoided under proper initial conditions as it was shown in [15]. From (4) and the state equations (1), we formulate the state and control constraint (2) adjoined Hamiltonian function H_{i}\big{(}t,\boldsymbol{\lambda}(t),\boldsymbol{\mu}(t),\textbf{x}(t),u(t)\big{)} for each CAV ,
[TABLE]
where are the co-state components corresponding to the state vector , and , , , are the Lagrange multipliers with the following KKT conditions, , , , , and , , , on the constrained arc. The Euler-Lagrange equations are
[TABLE]
II-D Unconstrained Optimization
If the inequality state and control constraints (2) are not active, we have . From (6) and (7), for each CAV we derive the optimal control input , and the optimal states as
[TABLE]
where , , , and are constants of integration which can be computed by using the boundary conditions in (4).
III Constrained Optimization
To derive a closed-form analytical solution for (5), we (1) identify the conditions for constraint(s) exclusion, (2) define the condition under which they become active, and (3) derive the final constrained optimal solution without recursion.
III-A Condition of Constraint Exclusion
Although we have two state and two control constraints from (2), there are 15 constraint combinations in total that can be activated. In this section, we show that it is only possible for a subset of the constraints to be active within an unconstrained solution. Therefore, it is not necessary to consider all the cases in the constrained problem. In what follows, we delve deeper into the nature of the uncontrolled optimal solution to derive useful information about the possible existence of constraint activation within the control zone.
Lemma 1. If is not prescribed, and the terminal time is fixed, then
[TABLE]
Proof:
For fixed terminal time and unspecified state , . Using in (8), we have , and the result follows. ∎
Corollary 1. The constants and always have opposite signs.
Lemma 2. The unconstrained optimal control input is linearly decreasing if . The unconstrained optimal control input is linearly increasing if .
Proof:
From (9) and (10), we can write and . With , we have
[TABLE]
From (10), we have Using the results from (12), and (11) in the above equation and solving for , we have
[TABLE]
Since , is non positive if , which in turn implies negative slope of the linear control input , i.e., linearly decreasing acceleration profile. The second part of Lemma 2 can be proved following similar steps. ∎
Lemma 3. For a given unconstrained optimal profile, only a subset of state-control constraints can remain active. Furthermore, if either or is activated, none of the constraint pairs and can be activated. The reverse also holds.
Proof:
The optimal solution derived from the unconstrained case yields a linear control profile increasing or decreasing to the terminal value zero (Lemma 2). If the acceleration profile is linearly decreasing, we have , , implying that the constraint will never be activated. Now, applying the necessary condition of optimality in (9), we have , which yields the inflection point at time corresponding to the vertex of the concave parabola of (9), and equal to according to Lemma 1. As the inflection point of the concave parabola is located at and , we have , . This concludes the proof of the first part of Lemma 3. The second part of Lemma 3 can be proved following similar steps. ∎
Remark 1. The sign of the constant provides insight for the possible state and control constraint activation.
The following result provides the condition under which certain state and control constraints never become active.
Theorem 1. (i) The state constraint and the control constraint are not activated if . (ii) The state constraint and the control constraint are not activated, if .
Proof:
If holds, then from Lemma 2, is negative and the optimal control input is linearly decreasing. From Lemma 3, a decreasing optimal control input indicates that the state constraint and the control constraint will never be activated, which concludes the proof of the first part. The second part of Theorem 1 can be proved following similar procedure. ∎
III-B Conditions of Constraint Activation
The following results provide the condition for which specific state and control constraints are activated.
Lemma 4. Activation of the control constraint or occurs at time .
Proof:
For , there is a possibility that either the state constraint , or the control constraint , or both to be activated (Lemma 3). In this case, the control input linearly decreases to zero at time . Therefore, any activation of the control constraint occurs at time . Following similar reasoning, it can be proved that the activation of occurs at time ∎
Theorem 2. (i) If , the state constraint is activated if . (ii) If , the state constraint is activated if .
Proof:
Suppose that for , there exists a time at which the state constraint is activated. Using (12), from (9) we have . Solving for , we have , yielding two possible solutions, either or . Since is not feasible as cannot be negative or equal to zero to satisfy , is the only acceptable solution. To satisfy , we have resulting in . Using (13), the first part of Theorem 2 follows. The second part of Theorem 2 can be proved for following similar arguments. ∎
Theorem 3. (i) For , the control constraint is activated if . (ii) For , control constraint is activated if .
Proof:
Based on Lemma 4, the control constraint activation occurs at . For , we have . Without loss of generality, for , we have . Substituting from (13), we obtain . Solving the above quadratic term for , we obtain
[TABLE]
The first term of (14) is always positive since . Therefore, the second part has to be negative, and the result follows. Following similar steps, the second part of Theorem 3 can be proved for . ∎
We have discussed so far the conditions under which the state and control constraints are activated individually. With this information, we can solve the constrained optimization problem and derive corresponding analytical solutions, which we will present in the following section. However, there is a possibility that the constrained optimal solution may result in additional activation of constraint arcs, i.e., a state constrained optimal solution might cause a control constraint activation. Similarly, a control constrained optimal solution might cause a state constraint activation. In such cases, the optimization problem has to be resolved by piecing all constrained arcs together to derive the corresponding solution. To overcome this recursive procedure, we can identify a priori under which conditions whether other constraint arcs might be activated.
Theorem 4. (i) The constrained optimal solution corresponding to the state constraint with a junction point at may result in activating the control constraint , if . (ii) The constrained optimal solution corresponding to state constraint with a junction point at may result in activating the control constraint , if .
Proof:
Suppose that the state constrained () solution has a junction point between the constrained and unconstrained arc at , where . Therefore, we focus on the unconstrained arc of the constrained solution with the time horizon instead of . Following similar procedure as in the proof of Theorem 3, we can construct the condition of the first part of Theorem 4 that indicates whether the control constraint is being activated within the time horizon . The second part of Theorem 4 can be proved following similar arguments. ∎
Theorem 5. (i) The constrained optimal solution corresponding to the control constraint with a junction point at may result in activating the state constraint , if . (ii) The constrained optimal solution corresponding to the control constraint with a junction point at may result in activating the state constraint , if .
Proof:
Suppose that the control constrained () solution has a junction point between the constrained and unconstrained arc at . Therefore, we focus on the unconstrained arc of the control constrained solution with the time horizon instead of . Following similar procedure to the proof of Theorem 2, we can construct the condition stated in the first part of Theorem 5 which indicates whether the state constraint is being activated within the time horizon . Similar approach can be employed to prove the second part of Theorem 5. ∎
IV Analytical Solution of Constrained Optimization
To derive the analytical solution of (4) using Hamiltonian analysis, we adopt the standard procedure used in optimal control problems with control and state constraints [17], and present a simplified framework. We first start with the result of Theorem 1 to reduce the set of possible constraint activations. Then we evaluate the conditions in Theorem 2 and 3 to identify possible constraint activations. If no activation is identified, we simply derive the unconstrained solution. If any contraint activation is detected by applying the conditions in Theorem 2 and 3, we then use the conditions in Theorem 4 and 5 to identify any additional constraint activations that might rise from the previous case. Once the nature of the current and additional constraint activations is specified, we then piece together the relevant unconstrained and constrained arcs that yield a set of algebraic equations which are solved simultaneously using the boundary conditions of and interior conditions between the arcs.
Case 1: If only the state constraint is activated, we have . The corresponding necessary condition for optimality, and the Euler-Lagrangian equations (6) for the costates become , , and . Let us assume that the time such that , the unconstrained arc enters the constrained arc. We denote and as the immediate left and the right side of . We have an tangency condition , which yields the optimal state and control on the constraint arc. Considering the jump conditions of the costates and Hamiltonian at the entry point as follows,
[TABLE]
where, is a constant Lagrange multiplier. Note that, the state variables remain continuous, i.e., . From the above equations, both the position costate and the Hamiltonian are continuous at . With , (16) yields , which implies continuity of control. Using (6), (7), state and control continuity, the initial and final conditions (4), and the terminal condition of co-states at , we can formulate a closed form analytical solution piecing the unconstrained and constrained arcs together at .
Case 2: If only the control constraint is activated, we have . The corresponding necessary condition for optimality, and the Euler-Lagrangian equations (6) for the costates become , , and Let us assume that at a time , the unconstrained arc leaves the constrained arc. We denote and as the immediate left and the right side of . For pure control constraint case, we do not have any discontinuity of the costates and Hamiltonian at , i.e., and . Solving these jump conditions, we have implying the continuity of control input at . Using (6), (7), state and control continuity, the initial and final conditions (4), and the terminal condition of co-states at , we can formulate a similar closed form solution as mentioned in case 1.
Case 3: If both the control constraint and state constraint are activated, we can derive the analytical solution following the procedure described in the previous two cases.
The remaining constraint activation cases for only , only and their combination can be derived following similar procedure as described above.
V Simulation Results
We validate the analytical solution of the constrained optimization problem through numerical analysis in MATLAB. We select the initial and final position as m and m, and the initial speed as m/s. We enforce maximum speed and maximum acceleration m/s2. We present only the cases with the state constraint and control constraint activation.
The unconstrained optimal trajectory for two different merging time at s and s is shown in Fig. 2. As stated in Lemma 2, we observe two different types of optimal trajectories. This implies that based on the terminal conditions, a CAV may speed up, or slow down optimally to satisfy the boundary conditions. We also observed that both the predefined state and control constraints (for ) are activated in Fig. 2 (top-left and right).
We can save computational effort for producing the unconstrained results in Fig. 2, if we know that any of the constraints might be activated. Once we employ Theorem 1 to reduce possible constraint activation set, we use Theorems 2 and 3 to pinpoint the specific constraint activation case. We illustrate the optimal state and control trajectories for only state constrained in Fig. 3 (top) and only control constrained in Fig. 3 (bottom) cases. However, the results in Fig. 3 have to be recalculated if additional constraint activation is encountered. We can avoid the unnecessary computational effort to produce the intermediate result in Fig. 3 based on the following observation. Note that, in the state constrained solution, the control constraint is activated (Fig. 3, top-right) which was non-existent before, as discussed in theorem 4. Similarly, we observe in Fig. 3 (bottom-right) that the control constrained optimal trajectory creates a possibility of additional state constraint activation (Fig. 3, bottom-left) due to the increased speed, as discussed in Theorem 5. Hence, we need to take the additional constraint activation into account from Theorems 4 and 5, and enforce both state and control constraints if needed. The unconstrained and fully constrained state and control constrained trajectories are shown in Fig. 4. The four-point boundary value problem is solved in this case, and two constrained and one unconstrained arcs are pieced together to provide the optimal solution.
VI Concluding Remarks
In this paper, we presented a theoretical analysis of the decentralized optimal control framework for coordinating CAVs that was presented earlier [4]. We provided the conditions under which the state and control constraints are activated along with the corresponding solutions. These conditions can provide insight about when any of the state and control constrained arc is activated, and thus can be useful for real-time implementation. Ongoing work includes the analysis of other cases, including safety constraints, along with the conditions that a solution always exists. A potential direction of future research includes the enhancement of this analysis by considering different penetration rates of CAVs and the implications of error or delays in the communication.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] R. Margiotta and D. Snyder, “An agency guide on how to establish localized congestion mitigation programs,” U.S. Department of Transportation. Federal Highway Administration, Tech. Rep., 2011.
- 2[2] A. M. I. Mahbub, V. Karri, D. Parikh, S. Jade, and A. Malikopoulos, “A decentralized time- and energy-optimal control framework for connected automated vehicles: From simulation to field test,” in SAE WCX 2020 , 2020 (to appear).
- 3[3] J. Lee, B. B. Park, K. Malakorn, and J. J. So, “Sustainability assessments of cooperative vehicle intersection control at an urban corridor,” Transportation Research Part C: Emerging Technologies , vol. 32, pp. 193–206, 2013.
- 4[4] A. A. Malikopoulos, C. G. Cassandras, and Y. J. Zhang, “A decentralized energy-optimal control framework for connected automated vehicles at signal-free intersections,” Automatica , vol. 93, pp. 244 – 256, 2018.
- 5[5] K. Dresner and P. Stone, “A multiagent approach to autonomous intersection management,” Journal of artificial intelligence research , vol. 31, pp. 591–656, 2008.
- 6[6] A. de La Fortelle, “Analysis of reservation algorithms for cooperative planning at intersections,” 13th International IEEE Conference on Intelligent Transportation Systems , pp. 445–449, Sep. 2010.
- 7[7] S. Huang, A. Sadek, and Y. Zhao, “Assessing the Mobility and Environmental Benefits of Reservation-Based Intelligent Intersections Using an Integrated Simulator,” IEEE Transactions on Intelligent Transportation Systems , vol. 13, no. 3, pp. 1201–1214, 2012.
- 8[8] I. H. Zohdy, R. K. Kamalanathsharma, and H. Rakha, “Intersection management for autonomous vehicles using i CACC,” 2012 15th International IEEE Conference on Intelligent Transportation Systems , pp. 1109–1114, 2012.
