Autonomous-Collaborative Energy Optimization for Interconnected Energy Hubs Based on Transactive Control
Yizhi Cheng, Peichao Zhang

TL;DR
This paper proposes a bi-level transactive control framework for optimizing energy management across interconnected energy hubs, balancing privacy, operational control, and real-time efficiency.
Contribution
It introduces a novel storage-energy-equivalent method with mathematical proof to relax nonlinear constraints in energy hub models within a bi-level optimization framework.
Findings
Effective energy optimization in interconnected hubs demonstrated through simulation
Preserves privacy and operational authority of individual energy hubs
Achieves real-time control requirements successfully
Abstract
Motivated by various benefits of multi-energy integration, this paper establishes a bi-level framework based on transactive control to realize energy optimization among multiple interconnected energy hubs (EHs). A storage-energy-equivalent method as well as its mathematical proof are provided in the lower level to realize nonlinear constraints relaxation of EH model, while the upper level solves the collaborative problem iteratively in both day-ahead and real-time stages. The proposed method can preserve information privacy and operation authority of each EH while satisfying real-time control requirement, and its effectiveness has also been verified by a simulation case.
| No. | C* | D** | No. | C | D | No. | C | D |
|---|---|---|---|---|---|---|---|---|
| 1 | 18504 | 18492 | 6 | 17982 | 18038 | 11 | 24717 | 24743 |
| 2 | 17064 | 17067 | 7 | 4860 | 4888 | 12 | 15425 | 15446 |
| 3 | 22886 | 22862 | 8 | 17499 | 17518 | 13 | 22858 | 22817 |
| 4 | 21209 | 21189 | 9 | 12660 | 12611 | 14 | 26982 | 26986 |
| 5 | 7928 | 7928 | 10 | 11766 | 11766 | 15 | 4833 | 4833 |
| EH number | 10 | 20 | 50 | 100 |
|---|---|---|---|---|
| Day-ahead iteration | 140 | 117 | 78 | 92 |
| Real-time iteration | 9 | 9 | 9 | 9 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMicrogrid Control and Optimization · Integrated Energy Systems Optimization · Smart Grid Energy Management
Autonomous-Collaborative Energy Optimization
for Interconnected Energy Hubs
Based on Transactive Control
Yizhi Cheng This work was supported by the National Key R&D Program of China (2018YFB0905000) Department of Electrical Engineering
Shanghai Jiao Tong University
Shanghai, China
Email: [email protected]
Peichao Zhang
Department of Electrical Engineering
Shanghai Jiao Tong University
Shanghai, China
Email: [email protected]
Abstract
Motivated by various benefits of multi-energy integration, this paper establishes a bi-level framework based on transactive control to realize energy optimization among multiple interconnected energy hubs (EHs). A storage-energy-equivalent method as well as its mathematical proof are provided in the lower level to realize nonlinear constraints relaxation of EH model, while the upper level solves the collaborative problem iteratively in both day-ahead and real-time stages. The proposed method can preserve information privacy and operation authority of each EH while satisfying real-time control requirement, and its effectiveness has also been verified by a simulation case.
Index Terms:
Energy Hub, Transactive Control, Two-stage Optimization.
I Introduction
Continuous environment deterioration and energy depletion have necessitated the comprehensive utilization of various forms of energy in modern life. It is believed that the development of relevant technologies would spur the advent of integrated energy service companies that manage several types of energy concurrently. Despite that multi-energy integration might improve overall energy efficiency at lower costs, complexities are also introduced to the system with regards to operation and management. To solve such problems, researchers from ETH Zurich, Switzerland has proposed concept of energy hub (EH) to investigate the energy system as a whole, whose path has been followed by a number of researches[1]. Recent years have also witnessed a research re-orientation from energy optimization of a standalone EH to a collaborative optimization among multiple interconnected EHs (IEH)[2].
Transactive control (TC) developed in recent years is a set of economic and control mechanisms that allows the dynamic balance of supply and demand across the entire electrical infrastructure using value as a key operational parameter[3]. Although many studies have used TC in energy management, according to the authors’ knowledge, to date few researches have applied the TC framework to IEH energy optimization.
This paper assumes an IEH that is connected to main grid and natural gas network and can provide energy services for its inferior sectors EHs. At the same time, the IEH agent serves as an interface between lower-level EHs and the main grid while responding to dispatching signals from upstream grid. This paper then proposes an autonomous-collaborative optimization framework based on TC to coordinate energy management for IEH where incentive and responsive signals are exchanged back and forth between IEH agent and EH. The main contributions of this paper include:
- •
it establishes a bi-level framework to coordinate energy management among interconnected EHs based on TC;
- •
it proposes a storage-energy-equivalent method with its proof to model the lower-level problem in a convex way;
- •
it simplifies dual variables of the upper-level problem and further solves the problem by bisection method iteratively to meet real-time control requirements.
II Lower-level: Autonomous optimization based on storage-energy-equivalent method
II-A EH model
Fig. 1 shows the structure of an EH consists of combined heat and power(CHP) plant, natural gas furnace(GF), electric energy storage(EES) and thermal energy storage(TES). Its model is:
[TABLE]
where denotes the electricity power EH imports from the main gird at time , and implies that the EH sells surplus electricity to the gird. and denote natural gas consumed by CHP and GF, respectively. denotes transmission efficiency. and are the gas-electric and gas-thermal efficiencies of CHP, and is the efficiency of GF. demonstrates the power generated by renewable energies under the maximum power point tracking mode. and represents the charging and discharging power of EES, respectively, while and are the charging and discharging amount of TES. and denote the shiftable electric load and thermal load, while and denote corresponding non-shiftable loads. and demonstrate the curtailed renewable energies and heat.
II-B Problem formulation
The operating cost during period can be split into two parts: electricity purchasing cost and gas purchasing cost.
[TABLE]
where and denote the utility electricity price and natural gas price at time , respectively.
During every scheduling period, after updating forecasted local renewable energies output and load demand, each EH seeks to minimize the expected costs across the remaining periods in an autonomous manner.
In addition to power balance constraints(1) and constraints (4-16) in [4], constraints also include limits of charging and discharging power:
[TABLE]
constraints associated with shiftable loads:
[TABLE]
and upper and lower limits of energy curtailment:
[TABLE]
The autonomous optimization problem can thus be formulated as:
[TABLE]
where and denote current and end time index.
II-C Storage-energy-equivalent method
Some researchers have introduced binary variables[5] to remove bi-linear terms in constraint(3), while this section proposes a method to relax this constraint and turn the autonomous optimization into a convex one. In this case, (P1) then can be represented as:
[TABLE]
The relationship between optimal solutions of problem (P1) and (P2) is discussed below. Without loss of generality, this paper only discusses the mutual exclusiveness of charging/discharging mode of EES, and the same method is also applicable to TES.
Let the feasible regions of (P1) and (P2) be , , optimal solutions be , , and optimal values be ,, respectively. Let and denote the optimal charging/discharging power of EES in at time . Then net energy change of EES during this period is:
[TABLE]
where and denote charging and discharging efficiencies of EES, respectively.
The transformation method first calculates a pair of charging/discharging power value that leads to equivalent energy change during the control time for EES:
[TABLE]
Then, for , modify the optimal EES power from and to and , respectively. Besides, modify curtailment variable as well to maintain power balance after the transformation:
[TABLE]
where can be calculated as:
[TABLE]
Let denotes the new vector after the modification.
The following theorem provides a sufficient condition for equivalency of these two optimal solutions:
Theorem 1**.**
If no renewable energies need to be curtailed, then holds.
Proof.
To prove it by contradiction, suppose that , such that . Without loss of generality, assume that , and similar proof can be derived when . According to (7), the net discharge power change (9) can be simplified as:
[TABLE]
which means that compared with , EES in consumes less power. Since there is no renewable energies curtailment, according to (1), the IEH agent could purchase less electricity from the main grid to supply loads, thus reducing the overall costs, which contradicts with the fact that is defined as an optimal solution of (P2). ∎
According to Theorem 1, without energy curtailment the model has no incentive to charge and discharge simultaneously[6]. Actually, references[6, 7] have conducted similar relaxation steps under the precondition that this sufficient condition is always established. However, when renewable energies are abundant compared with the local load level, surplus power should be curtailed and this precondition is not established. In this case, an augmented sufficient condition is given in the following theorem:
Theorem 2**.**
If optimal solution of (P2) satisfies:
[TABLE]
then the new vector is an optimal solution of (P1).
Proof.
Condition 1: When . First, since (3) is satisfied and the right-hand-side of (11) equals zero, condition (11) is always met. Second, on the one hand, because and denote the feasible and optimal solution of (P1) respectively, it can be derived that . On the other hand, since , then . Therefore, and is also an optimal solution of (P1). At last, it is obvious that . To sum up, is an optimal solution of (P1).
Condition 2: When , which means that , such that . Let’s first verify that still satisfy constraints associated with modified variables,i.e. and . It is obvious that satisfies (1)(3) already. Since state-of-charge (SOC) change of EES stays unchanged, all SOC-related constraints still hold. Besides, upper and lower limits of EES charging/discharging power are satisfied according to (7). At last, substitute (10), (11) into (8), and it can be proved that constraints(5) are satisfied. Therefore, all constraints of (P1) are met for , and is a feasible solution of (P1). Since , hereafter we apply conclusion of condition 1, and it can be finally derived that . Thus, is an optimal solution of (P1). ∎
It should be pointed out that extreme circumstance when (11) is unsatisfied never occurs due to the optimal planning procedure of EH in practical operations. This fact is also verified in the simulation case. As a consequence, by solving (P2), an optimal solution of problem (P1) can be obtained. Therefore, in the subsequent model, each EH autonomously optimizes according to (P2).
III Upper-level: Collaborative optimization based on transactive control
III-A Problem formulation and decomposition
The structure of IEH is shown in Fig. 2(a). During each period, upper-level IEH agent aims at minimizing its overall costs across the remaining periods while balancing the supply and demand, and limiting the transformer capacity. The optimization problem can be modeled as follows:
[TABLE]
where is the EH index. is the electricity that transformer imports from the main grid. are the maximum power exchanged with the main grid.
The upper level problem(P3) should have been solved in an absolute centralized manner after gathering all EHs’ detailed information. However, to preserve information privacy, this paper advocates to solve it in a distributed way by employing Lagrange dual decomposition method and transactive control. The Lagrangian relaxed dual problem is:
[TABLE]
where is the Lagrangian relaxation function after introducing the Lagrange multipliers associated with power balancing constraints:
[TABLE]
Since the primal problem (P3) is linear, strong duality theorem holds and the optimal value of (P4) is equivalent to (P3).
For , define local electricity price , then problem (P4) is decomposed into one master problem where the IEH agent adjusts local price vector to strike a general supply and demand balance, in addition to subproblems where each EH minimizes its cost under the local electricity price and the transformer itself maximizes its profits through exchanging electricity power with the main gird.
III-B Two-stage procedure
A market is established in the upper level where each EH participates as independent energy demander and the transformer participates as the supplier. This paper then proposes a two-stage procedure to obtain optimal result as well as to meet the real-time requirement.
III-B1 Day-ahead (DA) optimization
The process is illustrated in Fig. 2(b). Gradient method is adopted during day-ahead stage to solve the master problem iteratively.
Assume that the forecasted local price vector of -th iteration is:
[TABLE]
where denotes the forecasted local price at time after -th iteration.
At each iteration, each EH solves subproblem according to the broadcasted price and bids the optimal power vector to the market. After receiving all bidding data, the IEH agent obtains optimal transformer power vector and computes the balance vector . The IEH agent then updates and broadcasts the price vector where denotes a feasible step length. These steps are iteratively repeated until supply and demand balance is achieved.
III-B2 Real-time (RT) optimization
The process is illustrated in Fig. 2(c). During every control period, the IEH agent endeavors to eliminate the impacts of multiple uncertainties through rolling horizon optimization. Besides, at time , local electricity prices at time are assumed to be equal to the DA forecasted prices. Let and denote the upper and lower bound of local electricity price, and the processes of real-time optimization are described as follows:
S0: The IEH agent broadcasts the DA forecast price vector: ;
S1: The IEH agent broadcasts price of , where is real-time iteration index. ( and ).
S2: Each EH generates the -th price vector:
[TABLE]
The EH then solves the autonomous subproblems and bids , optimal power of current period, to the market.
S3: The IEH agent obtains , the optimal transformer power of current period, and calculates the overall power balance:
[TABLE]
S4: If power balance equals zero, then set clearing price to be and step into S5. Else, the IEH agent uses bisection method to update price according to , and step back to S1.
S5: Each EH implements optimal result and moves into period .
It should be noted that both DA and RT stage require multiple iterations to solve the optimization master problem. Since relatively accurate price vector has been forecasted in DA stage, the RT schedule transforms high-dimensional local prices to single-dimensional ones, thus making it feasible to update by the bisection method, which outperforms gradient method with respect to convergence speed.
IV Case Study
IV-A Simulation Setup
An IEH consisting of 15 EHs is illustrated in the simulation case. Parameters of EHs, together with load and renewable energies data are listed in [4]. The interval period is 1h, maximum and minimum electricity price in the market is 1.5 and 0 yuan/kWh, respectively. The main grid follows real-time utility electricity prices. The price of natural gas is 3.3 yuan/m3. Its density is 0.79kg/m3, and the calorific value is 45MJ/kg. The day-ahead, intra-day, and real-time forecast errors of renewable energies are , , and , respectively; the day-ahead, intra-day, and real-time forecast errors of load are , , and , respectively[8].
IV-B Results and Discussions
To verify the effectiveness of the proposed method, the upper-level problem is solved by the centralized rolling optimization method and the proposed scheme, separately. The total cost of IEH using method proposed in this paper is 247,185 yuan, while the centralized result is 247,173 yuan. Energy costs of each EH are listed in Table I. Result of the propsoed method is verified to be very close to that of the centralized optimization method. Therefore, the method proposed in this paper is efficient in obtaining a rather optimal solution of the collaborative optimization in a distributed manner.
Fig. 3 compares the main transformer power when using the two different schemes, the main grid real-time electricity price, the DA forecast price and the RT clearing electricity price curve. It can be seen that during 7:00-23:00, the real-time utility price is relatively high. The main transformer is not congested, and its power is basically the same in the two cases. On the contrary, the price is relatively low during 24:00-6:00. Congestion occurs, but both schemes ensure that the main transformer power is limited within the maximum capacity. Furthermore, it can also be seen from Fig. 3 that the clearing electricity price is higher than the forecast electricity price at 24:00. It is because that remaining unsatisfied shiftable loads are forced to be satisfied during the last scheduling period, thus lowering the EH’s control flexibility. Besides, due to the existence of renewable energies and loads uncertainties, transformer power differences between these two schemes have been observed during some time periods such as 7:00 and 19:00.
Simulation results of electric power of one EH is given in Fig. 4. As expected, conditions where (11) is unsatisfied have not been witnessed in the simulation case.
This paper further simulates the efficiency of the proposed method in coordinating IEH of different scales. Results are shown in Table II. The results show that by applying proposed method, the number of iterations during RT stage are greatly reduced compared with DA iteration. In addition, the number of iterations before and during the day will not increase significantly with the growth of EH numbers. These ensure that the computation complexity and iteration speed can meet the efficiency requirement for real-time control within the day, and system’s scalability is also maintained.
V Conclusion
Considering issues associated with information privacy and operation authority among different management sectors, this paper introduces TC method in managing IEH. Specially, a bi-level two-stage optimization framework is established, where each EH performs autonomous optimization in the lower level, and TC method is applied to realize collaborative energy management for IEH in the upper level.
In the autonomous optimization, this paper proposes an equivalent method of energy storage and provides its mathematical proof, in order to relax the nonlinear equality constraint and model the problem in a convex way. In the collaborative optimization, a two-stage procedure is designed to simplify the dual variables in the real-time stage, thus enabling the later utilization of a bisection method to solve the clearing price. Since bisection method excels in convergence performance, the optimization method can meet the real-time control requirements. The simulation case reaffirms that precise prices forecasted in the day-ahead stage can help the upper level to obtain a rather close result to the centralized method.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] E. Dall’Anese, P. Mancarella, and A. Monti, “Unlocking flexibility: Integrated optimization and control of multienergy systems,” IEEE Power and Energy Magazine , vol. 15, no. 1, pp. 43–52, Jan 2017.
- 2[2] Y. Zhang, Y. He, M. Yan, C. Guo, and Y. Ding, “Linearized stochastic scheduling of interconnected energy hubs considering integrated demand response and wind uncertainty,” Energies , vol. 11, p. 2448, 09 2018.
- 3[3] J. Hu, G. Yang, K. Kok, Y. Xue, and H. W. Bindner, “Transactive control: a framework for operating power systems characterized by high penetration of distributed energy resources,” Journal of Modern Power Systems and Clean Energy , vol. 5, no. 3, pp. 451–464, May 2017. [Online]. Available: https://doi.org/10.1007/s 40565-016-0228-1
- 4[4] M. Ji and P. Zhang, “Transactive control and coordination of multiple integrated energy systems,” in 2017 IEEE Conference on Energy Internet and Energy System Integration (EI 2) , Nov 2017, pp. 1–6.
- 5[5] M. Majidi, S. Nojavan, and K. Zare, “A cost-emission framework for hub energy system under demand response program,” Energy , vol. 134, pp. 157 – 166, 2017. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S 0360544217309957
- 6[6] T. Beck, H. Kondziella, G. Huard, and T. Bruckner, “Assessing the influence of the temporal resolution of electrical load and pv generation profiles on self-consumption and sizing of pv-battery systems,” Applied Energy , vol. 173, pp. 331 – 342, 2016. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S 0306261916305104
- 7[7] J. Hu, G. Yang, C. Ziras, and K. Kok, “Aggregator operation in the balancing market through network-constrained transactive energy,” IEEE Transactions on Power Systems , pp. 1–1, 2018.
- 8[8] H. Wang, Q. Ai, L. Gan, X. Zhou, and F. HU, “Collaborative optimization of combined cooling heating and powersystem based on multi-scenario stochastic programming and model predictive control,” Automation of Electric Power System , vol. 42, pp. 51–58, 2018. (in Chinese).
