1. Introduction
Europe has set an ambitious target to combat global warming by reducing the greenhouse gas emissions by at least 40% by 2030 and 80% by 2050 compared to the 1990 levels [
1]. The emissions from the heating sector are about 600 Mt or 32% of Europe’s total emissions [
2]. Electrification of heating combined with the increased use of renewable generation plays a vital role in reducing these emissions. Electric heat pumps are seen as a leading technology to provide a path towards a low carbon heating sector [
3]. At the same time, increased use of variable renewable generation from wind and PV reduces power system inertia, as these generators are connected through a power electronics interface and do not provide inertia. The reduction in system inertia due to the increased penetration of renewable generation has the potential to cause cascading failures and blackouts due to the high rate of change of frequency (RoCoF) unless actions are taken to mitigate it. This paper investigates the role that heat pump technology can play in providing an emulated inertial and fast frequency response in the context of low inertia power systems. In particular, it investigates whether a controlled response from heat pumps can provide a virtual inertia-type response to the system.
The concept of using the demand-side response as a cost-effective solution to provide greater system flexibility in the context of growing variable renewable penetration is well known. Domestic appliances such as electric water and space heaters, air conditioners, and heat pumps make use of inherent thermal inertia and can be built to aid in the system frequency regulation [
4] while minimising the impact on end-users. For example, in the U.K., domestic heat pumps have become common, and it has been estimated that they could provide a frequency regulation capacity of 2 GW by 2030 [
5]. In California, thermostatically controlled loads (TCLs) such as air conditioners, heat pumps, water heaters, and refrigerators have a frequency regulation capacity of 0.6 GW [
6]. In many European countries, the electrification of heating combined with increased renewable generation is seen as an important pathway to energy system decarbonization, so it is likely that heat pumps as a potential resource for frequency regulation will grow in the future.
The participation of heats pumps in frequency regulation has been investigated in previous works. However, most of these works have focused on the response to centrally dispatched direct load control signals (DLC). For example, the work in [
7] investigated such a response, but only including the dynamics of a heat pump induction machine in the model. The work in [
8] developed a dynamic model of the VSHP, which included the dynamics of a variable speed drive (VSD) controlled induction machine, a heat pump cooling cycle, and an experimental commercial building. This was used to estimate the effect of DLC application to the VSHP on the building indoor air temperature. The work in [
5] presented a thermodynamic model of the entire population of localised load controlled heat pumps connected to the U.K. power system, but it only reflected the frequency response based on an on/off control of the heat pump. The works in [
9,
10] presented a hardware demonstration of VSHP participating in frequency response through a centralised control signal.
Although the concept of providing frequency response from direct centralised control of heat pumps has been studied, the provision of emulated inertia from heat pumps has received little attention. In contrast to previous studies, in this paper, the provision of a controlled inertial response from VSHP is investigated. In the power system, inertia is an inherent property of the synchronous machine, present due to energy stored in its large rotating mass and its electromechanical coupling to the grid. In low inertia systems, the main concern for systems operators is to ensure adequate frequency response that is effective in the first hundreds of milliseconds after an event, which is most likely to impact the system dynamics [
11]. Consequently, an emulated inertial response should act on fast localised measurements and not rely on centralised communications. The key to an inertial response is that it is proportional to the rate of change of frequency (RoCoF) and not the frequency deviation.
The provision of emulated inertia from power electronics interfaced storage and generation has gained attention in recent years, through for example virtual synchronous machine-type controls [
12,
13] of the power electronics converters. Providing an inertial response typically requires short-term energy storage, and it has been investigated for energy storage systems (ESS) such as batteries, supercapacitors, and flywheel storage in [
14,
15,
16,
17,
18,
19] and for photo-voltaic systems operating off their maximum power point [
20]. For wind turbines, the stored kinetic energy in the turbine rotor can be used in combination with VSMcontrol, as shown in [
21,
22,
23].
The contribution of this paper is to develop a virtual inertia control for the variable speed heat pump (VSHP) and, using this, estimate the level of inertial response that can be contributed by increasing use of VSHP in a distribution system. To do this, a detailed dynamic model of the VSHP is first developed including the dynamics of the VSD controlled induction machine, heat pump cooling cycle, thermal model of a residential building, phase-locked loop (PLL), and virtual inertia control. The resulting small-signal model based on transfer functions is validated with measurements from hardware. Using this model, the virtual inertia control is designed, and the resulting inertial response is characterised. These results show that the inertial response is limited by the uni-directional nature of the typical VSHP drive topology. Consequently, to achieve increased response, a modification of the drive approach is investigated, which can extract the machine stored kinetic energy to provide maximum support for grid frequency regulation. Finally, simulation studies are performed to evaluate and quantify the aggregated frequency response and virtual inertia capability of a population of such heat pumps in an urban distribution system.
2. Modelling and Control Architecture
2.1. Overview
A simplified schematic of the air source heat pump, which is widely used in the residential sector to exchange heat from the outside air to the building, is shown in
Figure 1. The figure shows the VSHP, its electrical drive, and its controls, including virtual inertia control and indoor air temperature control. The variable speed electrical drive consists of a single-phase full-bridge diode rectifier and active power factor correction (PFC) feeding a voltage source inverter driving an induction machine. The single-phase full-bridge rectifier with active boost converter based PFC is used to control the DC voltage to the inverter. The voltage source inverter acts as the variable speed drive for the induction machine and is used to control the power consumed by the machine. The heat pump itself contains an evaporator, a compressor, which is driven by the induction machine, a condenser, and an expansion valve. The evaporator exchanges the heat between the refrigerant and the outside air, then the refrigerant temperature and pressure are further raised using the compressor. The heat collected from the evaporator and the compressor is transferred to the ambient air using the condenser. Finally, the expansion valve reduces refrigerant pressure.
The heat pump heating cycle model is used to determine the operational characteristics in both steady-state and transient operation [
8]. An equivalent thermal parameter (ETP) model of the building being heated is included to determine the power setpoints and indoor temperature variations. The power setpoint for the VSHP is usually provided by a temperature controller, which attempts to control the room temperature to the user input setpoint.
The frequency response control is achieved by an outer closed-loop power control of the induction machine, which drives the heat pump compressor. For this work, it is assumed that the induction machine has a 2 kW rated power and 230 V rated voltage. The induction machine has an inner vector controller such that the rotor flux is always maintained constant in the steady-state [
24]. An enhanced phase-locked loop (EPLL) [
25,
26] is used to determine the frequency of the grid voltage. The temperature controller provides the power setpoint
. The virtual inertia controller provides the modifying power
to provide frequency response. The combination of temperature setpoint
and modifying power
from the virtual inertia control provides a reference to the outer power controller of the induction machine drive, which then determines a torque reference for the vector control of the induction machine. The vector control outputs the modulation index, and the inverter is controlled using the sinusoidal pulse width modulation (SPWM) technique.
The thermal model of a residential building, EPLL, and virtual inertia control are implemented as explained in the section below. The goal of the modelling is to determine the dynamics of the variation of the heat pump power consumption, which can be achieved in response to a system frequency and RoCoF change. In order to achieve this, the various parts of the system and their small-signal models are described in detail in the section below.
The electrical drive topology of the VSHP shown in
Figure 1, although commonly used, does not allow for energy to be returned to the grid supply due to the use of the diode bridge rectifier. However, the stored kinetic energy from induction machine loads can be extracted and returned to the source by employing regenerative braking with the VSD [
27].
Figure 2 presents a variation in design of the VSHP drive system, which replaces the diode bridge and power factor correction circuit with a bi-directional full-bridge converter and passive LCLfilter. This allows bidirectional power exchange with the grid so that kinetic energy stored in the induction machine can if required be returned to the grid. In this approach, the full bridge converter is controlled so as to maintain the DC link voltage constant. The indicated DC bus voltage controller regulates the DC bus voltage
under variable load power
, and the controller design is implemented as in [
24]. The LCL filter is used to minimise the input current harmonics.
2.2. Thermal Model of a Residential Building
An equivalent thermal parameter (ETP) model of a residential building is used to provide the temperature feedback signal for the temperature controller. The ETP model of a residential building can be used to evaluate the thermal load capacities and the indoor air temperature variation due to the frequency responsive heating loads [
28]. The evaluated thermal load capacities from the ETP model provides knowledge about how long the duration of the space heater power can be reduced to support frequency, without significantly changing the room temperature.
The ETP model is described by the following differential equations:
where
is the heat flow into the building provided by the heat pump.
are the building indoor air and mass heat capacity, respectively.
are the thermal resistance between air to the ambient environment and air to the mass respectively.
, and
are the indoor air, building mass, and ambient temperature, respectively. Typically, the
is very large, and the temperature variation
is negligible, Hence, it is assumed that
=
and the equivalent heat capacity
, and the equivalent model is reduced as shown in Equation (
3).
Table 1 presents the parameters for a residential building used in the equivalent electric circuit of an equivalent thermal parameter model, as shown in
Figure 1. The time constants
, associated with the temperature controller, are much greater than the frequency response time constants, and hence, they do not interact, essentially meaning that reducing the space heater’s power for a few seconds has a negligible impact on the room temperature.
2.3. Dynamic Model of the Heat Pump
The dynamic model of the heat pump used follows the approach presented in [
8], which developed a simplified dynamic model of a VSHP for real-time simulation studies. The characteristics of a VSHP (Equations (
4) and (
6)) in both steady-state and transient operation are extracted from the experimentally verified coupled nonlinear differential equation presented in [
29,
30], which relates the mass, momentum, and energy balances of all components in the refrigeration cycle [
8]. From the data presented in [
10], it is shown that the steady-state relationship between the compressor steady-state mechanical power
and shaft speed
, ambient temperatures
, and indoor air temperatures
can be very reasonably approximated as a linear one as described in Equation (
4). Since in this work, the main purpose of this relationship is to determine the steady state operating point for different indoor and outdoor temperatures, it is not expected that minor deviations from the assumed linear relationship would have any significant impact on the dynamic response of interest. The four parameters
,
,
, and
were determined using a multiple polynomial regression algorithm applied to 94 different combinations of input variables and output data obtained from the work conducted in [
31].
Perturbing (
4) and eliminating the small-signal cross products, DC terms yield the small-signal variation in steady-state mechanical power,
, for a small variation in
,
, and
.
In terms of dynamics, the time constants associated with variations in temperature
and
are much larger than those associated with
[
8]. Hence, for the purposes of fast inertial response, these can be neglected.
The transient change in power,
, resulting from a change in mechanical speed is of interested here. In [
8], it was shown that this dynamic relationship could be accurately approximated by a second-order system as shown in Equation (
6). The work in [
8] showed that the dynamic response approximated by the second-order system was virtually indistinguishable from that obtained from the nonlinear differential equations. The four coefficients
,
,
, and
are estimated using the polynomial regression algorithm [
8].
The mechanical power variation of the compressor with respect to speed variation and mechanical torque variation can be expressed as:
where
and
are the initial operating torque and speed of the compressor, respectively. Substituting Equation (
7) in Equation (
6) yields the small-signal transfer function of the compressor.
Similarly, the heat flow rate, which is the input to the building model,
=
+
, can be expressed in the same form as Equations (
4) and (
6) with different parameter values estimated using the polynomial regression algorithm.
2.4. Enhanced Phase-Locked Loop
A vital component of this control architecture is the PLL, which is required to calculate the angle and frequency of the grid voltage waveform with reasonable accuracy. The method for the calculation of the rate of change of frequency (RoCoF) is based on the derivative of the frequency measurement from the PLL. When measuring the RoCoF, noise is a critical issue. This noise comes from the grid voltage and also from the harmonics of the grid voltage, which can give rise to large fluctuations in measured RoCoF unless appropriate filtering is used. There is thus a trade-off between the accuracy and time response in the measurement of RoCoF. In general, increasing accuracy requires filtering, which also increases the time response.
Here, the enhanced phase-locked loop (EPLL) introduced in [
25] is used, which has been shown to be more suitable for single-phase measurement in frequency varying and harmonics conditions. An adaptive notch filter is used in the EPLL to eliminate the double frequency errors and to estimate the voltage amplitude [
26]. Low pass filters with time constants
and
are used in the EPLL measuring frequency and RoCOF, respectively. The schematic representation of the EPLL is shown in
Figure 3.
Small-Signal Model of EPLL
The EPLL differential equations and output of the EPLL phase detector were presented in [
26], which are used to derive the small-signal model of EPLL.
Assuming
=
and representing Equation (
9) in the Laplace domain representation yield:
Substituting (
11) in (
10) yields:
The actual phase angle to actual frequency in the Laplace domain representation is:
Substituting Equation (
13) in Equation (
12) yields the closed loop transfer function of the EPLL without the added filter:
The outputs from the EPLL are further low pass filtered, before being used to calculate the power reference to remove the disturbances caused by the harmonics. The low pass filter associated with the EPLL measurement for frequency and RoCoF are taken as first-order filters with transfer functions given as:
where
and
are the time constant of the low pass filters used in the EPLL measuring frequency and RoCoF, respectively. The overall small-signal transfer functions of the EPLL including the low pass filter are given as:
The EPLL control parameter represents the time constant of the adaptive notch filter, whereas , represent the natural frequency and damping ratio of the EPLL, respectively. Higher values for the EPLL parameter () provide a faster response, but higher noise while measuring RoCoF. Lower gain values measure RoCoF without noise, but give a slower response. Hence, there is a trade-off between response time and noise attenuation while selecting the parameters. An appropriate set of EPLL parameters is selected using a trial and error approach in order to obtain a critically damped response, and the parameters obtained are as follows: , , and . The low pass filter time constants and are selected as 0.05 s and 0.1 s, respectively.
2.5. Virtual Inertia Control
The virtual inertia control is a strategy that emulates the dynamics of the synchronous machine, including inertia emulation, and damping power, when used to control converter interfacing distributed generation or energy storage [
14]. Here, the control is only used to provide the frequency response by emulating the inertial response and the damping power of a synchronous machine. The power control block is shown in
Figure 4. The controller modulates the power reference with a component that is proportional to frequency deviation (droop) and a component that is proportional to RoCoF (inertial). The output power reference of the controller
is given by Equation (
19) [
32].
Here, and represent the virtual inertia and droop factor of the virtual inertia control, respectively, is a measurement of the angular frequency of the grid, and is the reference grid frequency. Note that the parameter provides damping to the response during transients and also provides a steady-state response proportional to a frequency deviation. The saturation block limits the reference power to the rated power and maximum export power to the grid. Both components incorporate a dead-band, and if the frequency deviation and RoCoF are within this band, then no component is generated. The control receives its frequency and RoCoF measurement from the phase-locked loop (PLL) and then outputs the , which modifies the power setpoint from the temperature controller.
Perturbing Equation (
19) and eliminating small-signal cross-products and DC terms gives the virtual inertia control small-signal transfer function:
where
and
are obtained from Equations (
17) and (
18), respectively.
2.6. Induction Machine Power Control
The induction machine is operated with an outer power controller and an inner torque vector control. The outer power controller receives its reference from the temperature controller and the frequency response controller. It utilises a PI control to output a reference torque for the inner torque controller. Here, we assume that the power reference change results only from the frequency controller as described by Equation (
19). The inner torque control uses a standard vector control technique, the details of which can be found in [
24]. Since the main goal of this section is to determine the small-signal response for power consumption, the torque control is only very briefly reviewed. The PI power controller outputs the machine electrical torque reference
according to the following relation:
where
are the power controller proportional and integrator gain, power reference, and measured power in the DC bus, respectively. Making use of a rotating reference frame synchronised with the rotor field, the q-axis component of stator current reference
can be taken to be linearly related to the machine electrical torque reference:
where
, and
are the rotor leakage factor, rotor inductance, magnetising inductance, and the magnetising current, and assuming that
, the machine magnetising current is held constant. Thus, torque can be controlled using the q-axis component of stator current. With a properly designed current controller, the q-axis stator current can be made to follow its reference with a first-order lag, so that:
where
is the time constant of the current controller. The electrical torque
is linearly related to the q-axis component of stator current
as:
Perturbing Equations (
21)–(
24) and eliminating the small-signal cross products and DC terms yield:
Combining Equations (
25)–(
28) yields:
The speed variation
of the induction machine in response to a change in electrical torque
and mechanical torque
is given as:
where
J and
B are the inertia and friction coefficient of the induction machine, respectively. Rearranging Equation (
30) yields:
Substituting Equation (
29) in Equation (
31):
Similarly, combining Equations (
21)–(
23), perturbing, and eliminating the small-signal cross products and DC terms yield:
Neglecting the losses in the AC/DC converter (single phase rectifier with the boost PFC), the power consumed by the induction machine is:
where
and
are the
-axis stator voltages and
and
are the
-axis stator currents. Assuming the power loss is negligible or constant and a
system aligned with the rotor field, i.e., with
set to zero, then the power consumed by the induction machine
can be expressed as:
The q-axis stator voltage variation is given as [
8]:
where
=
and
=
. In order to measure the DC power for feedback, a low pass filter is used to remove the disturbances while measuring the DC bus power. The measured power with the filter dynamics is given as:
where
is the time constant of the low pass filter used in measuring power. Substituting Equations (
32), (
33), and (
38) into Equation (
37) yields the complete closed loop transfer function from commanded change in reference power to actual change.
where
,
, and
.
is the compressor transfer function presented in Equation (
8).
Figure 5 now shows the complete small-signal frequency domain model of the induction machine power control with the main equations used summarised in
Table 2.
2.7. Overall Small-Signal Model
For this analysis, it is assumed that the power consumed by the PFC or DC bus voltage controller is negligible, and it is assumed that
. Therefore, the overall closed loop transfer function is given as:
where
and
are obtained from Equations (
39) and (
20), respectively.
2.8. Induction Motor Power Controller Design
Table 3 summarises the initial operating point and parameter values used for controller design studies. From Equation (
37), the input power variation of the VSD controlled VSHP (
) has a dependence on the dynamics of the stator current
and the motor speed
. With the correct design of the current controller,
can be made to change rapidly. The change in
is limited by the compressor characteristics (inertia, friction, etc.). The
term dominates the initial change so that the initial input power variation is similar for different compressor characteristics.
Figure 6a presents the Bode plot for the open loop transfer function from the change in
to the resulting change in measured DC link power
for the operating conditions in
Table 3. It is inferred from
Figure 6a that the input power of the VSD controlled VSHP
can be actively controlled to follow the power reference
with large PI controller gains. The cross-over frequency of the controlled system is chosen to be one decade less than the switching frequency (i.e., 1000 Hz) and a phase margin of 60°, which yields
and
equal to 0.103 and 455.67, respectively.
Figure 6b shows the resulting closed loop transfer function from a change in
to the resulting change in DC power
. It can be inferred that the closed loop system is stable.
Figure 7 shows the step response of VSHP power consumption
to 1 W variation in
, which responds in 0.5 ms.
2.9. Virtual Inertia Control Parameter Selection
In order to choose the virtual inertia controller parameters,
and
, some estimate of the quantity of response available is required. The quantity of demand response available from the VSHP obviously depends on its operating conditions. The speed setpoint for different ambient temperatures is determined from the thermal model of a residential building described in
Section 2.2. Manufacturers recommend that the heat pump should not be turned off/on frequently and should operate at a minimum speed of (i.e., 1/3 of the rated speed). Hence, a constraint is introduced such that VSHP speed is always greater than or equal to its minimum speed. For this analysis, the VSHP minimum speed is set as 1/3 of its rated speed. The available demand response is constrained by speed variation
, where
is an operating speed for a particular ambient temperature,
is the minimum speed of the VSHP, and
is the maximum available speed variation. The maximum available demand response or the maximum power variation to maximum speed variation is determined using Equation (
6).
The maximum released kinetic energy due to heat pump speed variation can be estimated as:
The estimated inertia for heat pump with rated power 0.9 kW and nominal speed 1500 rpm is
J = 0.0127 kgm
using the formula presented in [
33].
Table 4 shows the calculated maximum available speed variation, demand response, and released kinetic energy for different ambient temperatures. These parameters can be used as a basis for setting the values of inertia and droop based on the worst case frequency variation scenario as described in the next section.
Selection Based on the Worst Case Scenario
A constraint for the selection of the control parameter based on the worst case scenario is introduced such that the controller provides its entire available power
plus the stored kinetic energy
as estimated in the previous section, for the worst case scenario. The worst case scenario considered is a system with maximum RoCoF of 1 Hz/s and maximum frequency deviation of 1 Hz with all of the available kinetic energy released over 1 s. Substituting these constraints in Equations (
19) yields:
A fixed droop of 4% is used, i.e., for a 4% change in frequency; the power change is 100%, which yields:
Substituting Equation (
43) in Equation (
42) yields the maximum available virtual inertia.
Based on these assumptions,
Table 5 presents the selected control parameters for different outdoor temperatures.