Linear time-periodic dynamical systems: An H2 analysis and a model reduction framework
Caleb C. Magruder, Serkan Gugercin, Christopher A. Beattie

TL;DR
This paper introduces a new model reduction framework for linear time-periodic systems using an extended H2 analysis, enabling efficient simulation of complex systems in fluid dynamics, electronics, and mechanics.
Contribution
It generalizes H2 optimal model reduction methods from LTI to LTP systems, providing an algorithm that preserves periodic structure and includes an a posteriori error bound.
Findings
Successfully applied to numerical examples demonstrating effectiveness.
Retains periodic structure in reduced models.
Provides an a posteriori error bound for model accuracy.
Abstract
Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear models. Such LTP systems can reach orders that make repeated simulation or other necessary analysis prohibitive, motivating the need for model reduction. We develop here an algorithmic framework for constructing reduced models that retains the linear time-periodic structure of the original LTP system. Our approach generalizes optimal approaches that have been established previously for linear time-invariant (LTI) model reduction problems. We employ an extension of the usual H2 Hardy space defined for the LTI setting to time-periodic systems and within this broader framework develop an a posteriori error bound expressible in terms of related LTI systems.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsModel Reduction and Neural Networks · Numerical methods for differential equations · Real-time simulation and control systems
Linear time-periodic dynamical systems: An analysis and a model reduction framework
\nameC.C. Magrudera*∗*, S. Gugercinb and C.A. Beattieb ∗Corresponding author. Email: [email protected] aDepartment of Computational and Applied Mathematics, Rice University,
6100 Main St. - MS 134, Houston, TX, 77005-1892, USA;
bDepartment of Mathematics, Virginia Tech,
460 McBryde Hall, 225 Stanger Street Blacksburg, VA 24061-0123
(Original Submission June 2016, Revision received June 2017)
Abstract
Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear models. Such LTP systems can reach orders that make repeated simulation or other necessary analysis prohibitive, motivating the need for model reduction.
We develop here an algorithmic framework for constructing reduced models that retains the linear time-periodic structure of the original LTP system. Our approach generalizes optimal approaches that have been established previously for linear time-invariant (LTI) model reduction problems. We employ an extension of the usual Hardy space defined for the LTI setting to time-periodic systems and within this broader framework develop an a posteriori error bound expressible in terms of related LTI systems. Optimization of this bound motivates our algorithm. We illustrate the success of our method on two numerical examples.
keywords:
time-varying systems, linear time-periodic dynamical systems, model reduction, norm
{classcode}
37M05, 37M99, 93A15, 65K99, 93C05
1 Introduction
We consider linear continuous-time-periodic (LTP) single-input/single-output (SISO) dynamical systems realized through a state-space representation,
[TABLE]
where and are -periodic, with , and for some fixed and we assume that . Let denote the vector space of real-valued square integrable functions (having “bounded energy”).
[TABLE]
We assume that the system in (3) is causal and is a bounded, linear mapping from -inputs to -outputs, .
For any given order , our goal is to find a reduced-order model,
[TABLE]
where and with and also -periodic and chosen in such a way so that over a wide class of inputs .
Starting with a Floquet transformation of the LTP system (3), our approach to this problem involves conversion of the LTP model reduction problem into a closely related linear time-invariant (LTI) multiple-input/multiple-output (MIMO) model reduction problem, connecting the model reduction error in the original LTP setting directly to a related LTI model reduction error. In particular, we are able to provide a posteriori bounds for the error between the full- and reduced-order LTP systems directly in terms of the error in an LTI MIMO model reduction counterpart. This in turn invites the use of the Iterative Rational Krylov Algorithm (IRKA) [1] as a way of minimizing the error bound we establish. We find that this approach generates superior performance over other applicable and commonly used model reduction techniques for the examples considered in this paper.
2 Background
2.1 Previous work on the analysis and reduction of LTP systems
A significant body of literature has developed focussing on model reduction of linear time-invariant (LTI) systems [2, 3, 4]. Analogous developments for continuous-time LTP systems have been far more limited and usually appear as a special case of the more general problem class of model reduction for general linear time-varying systems where computationally effective strategies for large scale problems have not yet emerged (see, e.g., [5, 6, 7]). Available strategies for this problem have focussed on extensions of balanced truncation to general linear time-varying systems. The computational challenges are formidable even for modest order and are typified by the need to solve two large-scale Lyapunov differential inequalities [5]. Notably, the recent work [7] is a step towards addressing this computational challenge. By way of contrast, it is worth noting that for the case of linear discrete-time periodic systems, strategies built upon balanced truncation have been somewhat more successful, producing strategies that still are computationally demanding but that could remain tractable for problems with modest order (see, e.g., [8, 9, 10, 11, 12]). Throughout this work, our focus is on continuous-time LTP systems.
Aside from model reduction, there is a significant body of literature that has developed on LTP systems focussing on a variety of other important topics including control, spectral analysis, and harmonic response, among others. Wereley and Hall [13, 14] develop a Fourier analysis of state-space systems with periodic matrices via the harmonic balance method. They represent the LTP system as generalization of a frequency response operator called the Harmonic Transfer Function which can be viewed as an operator on a family of functions called exponentially modulated periodic inputs. The operator is infinite-dimensional and consists of a countable number of time-invariant LTI components.
Sandberg et al. [15, 16] expand the impulse response of LTP systems via Fourier series expansion. The frequency response of the system is understood as a countable collection of infinite-dimensional LTI transfer functions called the Floquet-Fourier representation, making analytic expressions of frequency responses considerably easier to represent .
Zhou and Hagiwara [17, 18, 19, 20, 21] address dynamical system norm computation using truncations of the Harmonic Transfer Function. Convergence of the truncations is proven. Additionally, the authors discuss the spectral characteristics of LTP systems as input/output operators.
2.2 Linear Time-Invariant Dynamical Systems
We review briefly the basic features of linear time-invariant dynamical systems that are relevant to our approach and that will serve to establish our notation. In that context, we consider MIMO linear dynamical systems given in the following state-space form:
[TABLE]
where \mathbf{u}(t)\in{\mathbb{R}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{u}}}}, \mathbf{y}(t)\in{\mathbb{R}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{y}}}}, and are respectively, the inputs, outputs, and states of so that , \mathbf{B}\in{\mathbb{R}}^{n\times{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{u}}}} and \mathbf{C}\in{\mathbb{R}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{y}}}\times n}. Let and denote the Laplace transforms of and , respectively. Then by taking the Laplace transform of (7), we obtain the transfer function of the system , where and
[TABLE]
is the transfer function of the associated dynamical system in (7). is a matrix-valued function \mathbf{G}:{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{{\mathbb{C}}\to{\mathbb{C}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{u}}}}\times{\mathbb{C}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{y}}}}}} with entries consisting of proper rational functions with poles at the eigenvalues of .
2.2.1 Projection-Based Model Reduction
When the state-space dimension of is large, it may be useful to replace the original model (7) with a reduced model that has much smaller state space dimension yet still is able to replicate significant features of the original input/output dynamics. Toward this end, we seek a reduced model
[TABLE]
where , \widetilde{{\mathbf{B}}}\in{\mathbb{R}}^{r\times{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{u}}}}, and \widetilde{{\mathbf{C}}}\in{\mathbb{R}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{y}}}\times r} with , and such that for a large class of inputs . In order to make the quality of this approximation largely independent of input, it becomes necessary that the transfer function of (9) given by
[TABLE]
should approximate well, to the extent that the error is small with respect to natural metrics that we discuss below.
The most common way to obtain the reduced-order models as in (9) is via projection: Construct two matrices and such that . Then, approximate the full-order state by , and enforce the Petrov-Galerkin condition, forcing orthogonality of the residual dynamics to the range of :
[TABLE]
Then the reduced model state-space matrices become
[TABLE]
Obviously the choice of and will determine the accuracy of the reduced model approximation.
2.2.2 The Inner-product Space
Let denote the set of n_{y}\times{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{u}}} matrix-valued functions analytic in the open right half-plane such that \sup_{x>0}\int_{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{-\infty}}}^{\infty}\|{\mathbf{H}}(x+{\dot{\imath\!\imath}}y)\|_{F}^{2}\,dy<\infty. The space is a Hilbert space endowed with the inner product
[TABLE]
with the associated norm
[TABLE]
where \bm{g}(t)\in{\mathbb{R}}^{{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{y}}}\times{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{n_{u}}}} is the matrix-valued impulse response of the MIMO dynamical system, . The norm is of particular interest because it bounds the dynamical system output for bounded-energy inputs as,
[TABLE]
The next result, used frequently throughout this paper, provides an alternative representation of the inner product using the residue calculus.
Theorem 2.1**.**
[1, Lemma 2.4, p.615]** Suppose that and are stable (poles contained in the open left halfplane) and suppose that has poles at . Then
[TABLE]
In particular, if has only simple or semi-simple poles at , then , where is the residue of at , and
[TABLE]
2.2.3 Optimal Approximation
We seek reduced models for LTP systems that are accurate with respect to a metric that is equivalent to the norm for LTI systems (which are special cases of LTP systems). Indeed, for the case of LTI systems, we are able to do this optimally, finding a degree- LTI reduced model with transfer function that minimizes (at least locally) the error norm over all degree- reduced models with transfer functions . The optimal LTI approximant satisfies certain Hermite tangential interpolation conditions; for details, see, e.g., [22, 1]. Significant for the present work is the availability of a numerically effective algorithm with which one may construct (local) -optimal approximants, namely the Iterative Rational Krylov Algorithm (IRKA) of [1]. IRKA is an iterative algorithm; it typically converges quite rapidly though its speed of convergence may slow as the number of inputs and outputs grows. Beattie and Gugercin in [23] developed a modified version of IRKA, in order to address this slowing of convergence and improved the performance of IRKA significantly for MIMO problems; see [23] for more details. Convergence of IRKA is guaranteed for special cases [24] even though there are known, but rare, cases where convergence may fail [1, 24]. Upon convergence, the resulting reduced model is guaranteed to be a local -minimizer. In [25], Beattie and Gugercin developed a trust-region framework for IRKA, which is globally convergent to a local -minimizer. The added guarantees this approach provides seem unnecessary for most problems at hand and the original formulation of IRKA has been successfully applied to large-scale problems in various application settings in order to provide (locally) optimal reduced models; see, e.g., [26, 27, 1]. We will employ IRKA as a critical step in the model reduction framework for LTP systems that we propose here.
2.3 Linear Time-Periodic Dynamical Systems
We view the time-periodic system (3) as a causal linear map , that maps an input signal to an output signal . This can be expressed via a convolution integral with an generalized impulse response which, for , gives the response of the system (3) to an impulsive input at . Thus,
[TABLE]
Unlike LTI systems, the impulse response of a time-varying system depends on the time of the impulse and not simply on the time elapsed since the impulse was applied, . Since the state-space parameters are -periodic, so too are the impulse responses. That is,
[TABLE]
In this setting, causality implies that for .
2.3.1 Frequency Coupling
An important characteristic of stable LTI systems is that their steady state response to a single-frequency sinusoid is another sinusoid of the same frequency. That is, if is the transfer function of an LTI system , then
[TABLE]
Note that we write “” to describe the steady-state behavior of after the transient response has decayed.
By way of contrast, LTP systems produce a countable number of harmonics of the input frequency. Let . Since is -periodic in , the impulse response can be expanded into a Fourier series in ,
[TABLE]
We call the subsystems of . Now, let and be the fundamental frequency of the LTP system . Then,
[TABLE]
For a single frequency input, an LTP system will have output frequencies , where ; see Sandberg [15].
2.3.2 Floquet Transformations
The Floquet transformation is a time-dependent change-of-variable that transforms the time-periodic differential equation
[TABLE]
to an equivalent system of differential equations with constant coefficients, via a periodic, time-dependent change of variables, ; see, e.g., [28] for details. In particular, we have
Theorem 2.2** (Floquet’s Theorem).**
Let be continuous and periodic with period for Then any fundamental matrix of the differential equation has a representation of the form
[TABLE]
and is a constant matrix.
The constant matrix, is defined so that where the matrix is the monodromy matrix associated with (16). Note that is stable precisely when is a contraction. The -periodic matrix is defined as for .
Given an LTP system, , a Floquet transformation using the periodic change of variable from Theorem 2.2, can be performed so that
[TABLE]
The Floquet transformation can be costly to determine for large-scale LTP systems. Methods have been developed recently to make the transformation computationally tractable for modest order; see, e.g., [29, 30] for a discussion. The main computational cost in most cases will be the calculation of the monodromy matrix, which necessitates the solution of independent initial value problems associated with (16). The remaining tasks scale with a complexity of , so this can be feasible for modest orders of . In this work, we will not consider the practical difficulties associated with constructing this transformation of the original LTP system; we will suppose that our LTP system is presented with a realization having the form (17) with constant and -periodic input and output maps.
3 An Analysis for LTP systems
We develop here for LTP systems the metrics and associated analysis that extend certain notions of -approximation that are well-established for LTI systems.
3.1 The Periodic Inner Product
Let and be two LTP systems with fundamental frequency . The inner product is defined in terms of their impulse responses and ,
[TABLE]
The next results express this inner product in terms of the kernel subsystems; this can be found as Corollary 1 in Sandberg et al. [16]. Our formulation is framed in the frequency domain whereas the original formulation of Sandberg et al. [16] places it in the time domain.
Theorem 3.1**.**
Let and be two LTP systems with subsystems and , respectively. Then,
[TABLE]
where and denote the Laplace transformations of and , respectively, and is the regular -inner product for LTI systems defined in (12).
It follows immediately that
[TABLE]
This expression for the norm will allow us to develop a simple test for the boundedness of the norm of an LTP system . We adapt the following (standard) definition to our context:
Definition 3.2**.**
For , denotes the set of continuous periodic functions (say, with period T and fundamental frequency ) such that for some finite , uniformly for all .
Note that with consists only of constant functions and consists of Lipschitz continuous periodic functions which in turn will be contained within for any .
Our main result related to the analysis of LTP systems makes use of the following two lemmata:
Lemma 3.3**.**
*([31, Theorem 1, p.176]).
Let and denote the usual normed spaces of absolutely summable and square summable (scalar) sequences, respectively. If {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\{a_{k}\}}}\in\ell_{1} and {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\{x_{k}\}}}\in\ell_{1} then the convolution is absolutely convergent; {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\{y_{k}\}}}\in\ell_{1}. If {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\{a_{k}\}}}\in\ell_{1} and {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\{x_{k}\}}}\in\ell_{2} then the convolution is an sequence; {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\{y_{k}\}}}\in\ell_{2}.*
Lemma 3.4**.**
Let the vector-valued function be -periodic with components in with . Then
the Fourier expansion is absolutely convergent and (Bernstein’s Theorem, **[32, Theorem VI.3.1]**). 2. 2.
the Fourier coefficients satisfy (componentwise) as (**[32, II.4]**)
The following theorem can be understood as a special case of Lemma 1 of Sandberg et al. [15], which pertains to a more general class of impulse response functions. The proof provided here is instead a concise frequency domain-based proof for dynamical systems with state space representations.
Theorem 3.5**.**
Given system {\mathcal{G}}=\left[\begin{array}[]{c|c}{\mathbf{A}}(t)&{\mathbf{b}}(t)\\ \hline\cr\mathbf{c}^{T}(t)&\end{array}\right] with , and having components that are T-periodic and in with . If the Floquet-transformed state space matrix is Hurwitz, then .
Proof.
Without loss of generality, assume is in the Floquet form. Let
[TABLE]
denote the Fourier expansions of and , respectively. Then from Sandberg (2006) [15] we know with . Additionally, from (20). First, show that :
[TABLE]
where in the last step we used . One can immediately observe that
[TABLE]
where “ * ” denotes the convolution operator. Note that by Lemma 3.4. Therefore, it follows from Lemma 3.3 that the sequence is an sequence indexed in . Since is Hurwitz, then . Thus, forms an sequence indexed in . Since , . ∎
3.2 Pole-Residue Representation of Inner Product
An important result from LTI system theory is the representation of inner products and norms in terms of poles and residues as shown in (14). For SISO LTI systems, and , that are stable, and assuming simple poles, for and for for , these inner product/norm representations simplify to:
[TABLE]
Even though this formulation of the inner product is rarely used for computation, it has been used in deriving optimality conditions for approximation, see [1, 22]. In what follows, we extend this result to SISO LTP systems.
In the LTP setting, the meromorphic functions in question no longer have a finite number of poles. Although the pole residue formulation of the inner product provided above extends naturally in the way one would hope, the proof of this extension is considerably more difficult as the next theorem shows.
Theorem 3.6**.**
Let {\mathcal{G}}=\left[\begin{array}[]{c|c}{\mathbf{Q}}&\widetilde{{\mathbf{b}}}(t)\\ \hline\cr\widetilde{{\mathbf{c}}}^{T}(t)&\end{array}\right] and {\mathcal{H}}=\left[\begin{array}[]{c|c}{\mathbf{Q}}&{\mathbf{b}}(t)\\ \hline\cr{\mathbf{c}}^{T}(t)&\end{array}\right] denote two LTP systems sharing state space matrix with , , , having components that are -periodic and in with . Let be the -th subsystems of and respectively where
[TABLE]
Assume that the eigenvalues of are in the open left-half plane and that the fundamental frequency bounds the largest imaginary component of the spectrum of . That is,
[TABLE]
If has simple poles, then and have poles at {\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\lambda_{j}^{(\ell)}=\lambda_{j}({\mathbf{Q}})-{\dot{\imath\!\imath}}\ell\omega_{0},\ \ell\in{\mathbb{Z}}}} and the inner product, can be written as
[TABLE]
The -norm of is given by
[TABLE]
Proof.
Fix . We note that residue calculus immediately provides the pole residue formulation for subsystems with a finite number of poles. However, the subsystems and we consider have a countable number of poles that tesselate along the imaginary axis, for .
First, consider the case where is scalar: , with . Without loss of generality we assume . Then . Define and . Thus, we obtain
[TABLE]
with .
Consider the rectangular contour defined by the vertices , , , , for integer , so that contains poles. Define , , , to represent the the top, left, bottom, and right contours of the rectangle respectively (see Figure 1). Finally, write to represent the entire contour.
From residue calculus we have . We first show that as . Observe that . Then,
[TABLE]
We know that if is continuous and bounded on the finite contour , then
[TABLE]
Therefore, using (25), we can bound the contour integral over with ,
[TABLE]
Next, we show that as :
[TABLE]
Then for ,
[TABLE]
Note that The inequality (25) yields
[TABLE]
We need to show that the quantity on the right approaches [math] as . To accomplish this, we perform a change of variable on the first summation,
[TABLE]
Then we can pass the limit,
[TABLE]
since M|{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\widetilde{\phi}_{\hat{\ell}-M}}}|=M|{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{\widetilde{c}_{k-(\hat{\ell}-M)}\widetilde{b}_{\hat{\ell}-M}}}|\to 0 by Lemma 3.4.
We can employ a similar argument for to show that
[TABLE]
Then we obtain
[TABLE]
To consider the case where with , we need to guarantee that the poles of and , i.e., for will not coincide and consequently remain simple. The assumption that is a sufficient condition to keep the poles simple and hence the case for finite dimension is a natural generalization,
[TABLE]
The expression for the -norm follows immediately. ∎
Now we are in a position to give a result analogous to (21), but for LTP systems, representing the inner product and norm using poles and residues.
Theorem 3.7**.**
Let and be two LTP systems as in Theorem 3.6 sharing the same state-matrix with , , , having components that are -periodic and in with . Let be the th subsystems of and respectively. Assume where denotes the fundamental frequency of and . Then,
[TABLE]
and
[TABLE]
where is as defined in Theorem 3.6.
Proof.
The result follows from combining Theorem 3.6 and Theorem 3.1. More specifically, combining (23) with (19) yields (26), and combining (24) with (20) yields (27). ∎
Theorem 3.7 extends the formulae (21)-(22) to the LTP setting. However, note that the inner product formula in the LTP setting assumes that the systems share the same matrix. Even though formulae are more complicated including two infinite sums, it is analogous to the LTI case in the sense it is a weighted sum of the residues where the weight is the subsystem transfer function evaluated at the mirror images of the poles. In the LTI case, this formulation has lead to the interpolatory optimality conditions for model reduction [1]. This is a potential research direction to pursue for the LTP setting.
4 An -based Model Reduction Framework for LTP systems
Given the full-order LTP system as in (3) with state-space dimension , we seek a low-order LTP approximant as in (6) with state-space dimension , where . The mumerical implementation of the proposed method presented below assumes the availability of a Floquet-transformed equivalent system. Since we know such a transformation exists for every LTP system, without loss of generality, we assume in this section. We note that in some prominent applications, e.g., in the analysis of mechanical systems with moving loads as considered in [33], the full-order system has already a constant state-mapping matrix . In other applications, e.g., nonlinear circuit modeling and analysis, one can compute the Floquet-transformation from the sampled simulation data as we did in our numerical example in Section 5.3.
Our approach uses a Petrov-Galerkin projection framework to perform reduction. Given the LTP system as in (3) with now , we will construct two matrices with such that the reduced LTP system in (6) is given by , and . Our proposed approach converts the LTP model reduction problem into an equivalent MIMO LTI problem, utilizing the optimal, numerically efficient model reduction techniques for LTI systems to construct projection subspaces, and for the LTP problem. We are then able to provide an error bound for the approximation error in the original LTP setting.
Stykel and Vasilyev [33] introduced a model reduction scheme for linear time-varying (LTV) systems that was developed independently of the earlier thesis [34] upon which the present work is based. Stykel and Vasilyev considered a special class of LTV systems describing mechanical systems with moving loads; creating a time-dependent linear dynamical system equivalent in structure to a -- realization considered in Theorem 3.6 but for arbitrarily time-varying and . The approach we pursue here originates with the presumed periodicity of and , leading to a substantially different approach from that of [33]. We are able to take advantage of this presumed periodicity both analytically and computationally. Indeed, the extended- space of LTP systems introduced above allows for familiar performance guarantees entirely analogous to those in the LTI setting.
4.1 Connection of LTP Systems to LTI MIMO Systems
If and have finite order Fourier series expansions,
[TABLE]
then the LTP system has finite number of nontrivial subsystems, each of which have only finite spectra. This system has inputs formed by the Fourier coefficients of and outputs formed by the Fourier coefficients of resulting in nontrivial subsystems. The next result connects the norm of such an LTP system to the norm of an LTI system.
Theorem 4.1**.**
Let \displaystyle{\mathcal{G}}=\left[\begin{array}[]{c|c}{\mathbf{Q}}&{\mathbf{b}}(t)\\ \hline\cr{\mathbf{c}}^{T}(t)&\mathbf{0}\end{array}\right] be an LTP system where and have the finite Fourier expansions as in (28). We define an associated LTI MIMO system
[TABLE]
Then the norm of the LTP dynamical system can be bounded in terms of the norm of the LTI dynamical system , namely
[TABLE]
Proof.
The above system, , has subsystems that can be written
[TABLE]
Each of these terms are finite-dimensional LTI systems. Using equation (20),
[TABLE]
Now we use that \|a_{1}+\ldots+a_{K}\|^{2}\leq{\color[rgb]{0,0,0}\definecolor[named]{pgfstrokecolor}{rgb}{0,0,0}\pgfsys@color@gray@stroke{0}\pgfsys@color@gray@fill{0}{K}}(\|a_{1}\|^{2}+\ldots\|a_{K}\|^{2}) (application of the triangle inequality and the property, for ) to conclude
[TABLE]
Then we have
[TABLE]
where we recognize the last term as the norm of the MIMO system,
[TABLE]
Thus, . ∎
This result leads to the model order reduction algorithm for LTP systems outlined in the next section.
4.2 A Model Reduction Method for a Special Case of LTP Systems
Inspired by Theorem 4.1, here we introduce a model-reduction scheme that works for a special case of LTP systems with time-invariant . We begin by introducing a performance guarantee of reduced-order LTP systems constructed from projection matrices and . By Theorem 4.1, we immediately obtain the following corollary.
Corollary 4.2**.**
Given an LTP system of the form {\mathcal{G}}=\left[\begin{array}[]{c|c}{\mathbf{Q}}&{\mathbf{b}}(t)\\ \hline\cr{\mathbf{c}}^{T}(t)&\mathbf{0}\end{array}\right] where and have finite Fourier expansions as in (28). Let be projection matrices such that and define the reduced LTP system
[TABLE]
Then
[TABLE]
where and are the LTI MIMO counterparts, i.e.,
[TABLE]
Corollary 4.2 connects the model reduction error resulting from the analogous LTI MIMO problem to the original LTP model reduction problem. This gives a lot of flexibility since the tools for LTI model reduction are well established and one can employ various model reduction methods, such as Balanced Truncation [35, 36], optimal Hankel Norm Approximation [37], or Iterative Rational Krylov Algorithm (IRKA) [1]. However, since the error bound is given in terms of the error and IRKA produces locally optimal approximations in the sense, IRKA is a natural candidate for producing that minimizes .
Corollary 4.2 analyzed the case for finite Fourier expansion. The error analysis for the case with infinitely many Fourier coefficients is given next.
Corollary 4.3**.**
Given an LTP system of the form {\mathcal{G}}=\left[\begin{array}[]{c|c}{\mathbf{Q}}&{\mathbf{b}}(t)\\ \hline\cr{\mathbf{c}}^{T}(t)&\mathbf{0}\end{array}\right] with Fourier expansions and , let denote the Fourier truncated LTP system
[TABLE]
and the system is the associated LTI MIMO system for ,
[TABLE]
*Moreover, let be projection matrices such that and define the reduced system
[TABLE]
Then the dynamical system error is bounded by
[TABLE]
where is the Petrov-Galerkin approximation of , i.e.,
[TABLE]
A sketch of the proposed model reduction algorithm is given in Algorithm 1.
5 Numerical Results
We demonstrate the proposed model reduction scheme on three examples: (1) a heat equation with a moving point source, (2) a nonlinear transmission line LTP model, and (3) a constructed example, the structural model of component 1r (Russian service module) of the International Space Station. As most of the linear-time varying model reduction methods are computationally challenging for the problems we would like to consider, we compare our method to the Linear Time Varying Balanced Truncation method of [7] and Proper Orthogonal Decomposition (POD) [38], which remains computationally tractable even for large-scale problems since it only requires a time-domain simulation. Steih and Urban [39] introduce a space-time reduced basis method for time-periodic parametric partial differential equations. However, since we only consider nonparametric LTP systems here, for our purposes, it is enough to consider regular POD.
The proposed method as described in Algorithm 1 applies IRKA to a system with inputs and outputs. As mentioned briefly in Section 2.2.3, the convergence of IRKA may slow down as the number of inputs and outputs increases. Thus, for modest , one might expect that IRKA in Step 3 of Algorithm 1 may be slow to converge. The residue correction step introduced by Beattie and Gugercin in [23] has largely resolved this issue and improved the MIMO behavior of IRKA significantly; see [23]. For the problems studied here, we have found that the (regular) IRKA algorithm converged after a modest number of iterations even without the residue correction methodology of [23].
5.1 Computation of the norm for error comparisons
Even though Algorithm 1 does not require computing the norm at any point, in order to provide a detailed comparison to the reader between the reduced models resulting from Algorithm 1 and POD, we present the resulting error norms. However, computing the error of LTP systems is a nontrivial exercise and we discuss a practical implementation based on Zhou and Hagiwara, [19].
To compute the norm of an LTP system {\mathcal{G}}=\left[\begin{array}[]{c|c}{\mathbf{Q}}&{\mathbf{b}}(t)\\ \hline\cr{\mathbf{c}}^{T}(t)&\end{array}\right], construct a new system, \mathfrak{G}_{N}=\left[\begin{array}[]{c|c}\mathfrak{A}_{N}&\mathfrak{B}_{N}\\ \hline\cr\mathfrak{C}_{N}&\end{array}\right] from a finite number of Floquet-Fourier coefficients and where
[TABLE]
Then we can approximate the LTP norm with arbitrary accuracy as we keep more of the Floquet-Fourier coefficients.
Theorem 5.1** (Zhou & Hagiwara, [19]).**
If \mathfrak{G}_{N}=\left[\begin{array}[]{c|c}\mathfrak{A}_{N}&\mathfrak{B}_{N}\\ \hline\cr\mathfrak{C}_{N}&\end{array}\right] where , and are defined according to (34), then
[TABLE]
where and are, respectively, the solutions of the finite-dimensional Lyapunov equations
[TABLE]
We note that in practice the Lyapunov equations (35) can be enormous in size as where is the number of Fourier coefficients retained and is the order of the system. However, due to the block diagonal structure of , the dominant cost of the Lyapunov solver is the Schur decomposition of , which can be computed once and reused for . Then the back substitution in the Bartels-Stewart algorithm can be done on each block individually, avoiding the cost of an Schur decomposition. For description of the Bartels-Stewart algorithm, see Sorensen and Zhou [40]. We found this to be a critical step in making the norm computations feasible for illustrating the model reduction errors.
In the three numerical examples below, to illustrate the formula (33), we plot the error and its upper bound. However, as the discussion above illustrates, computing the exact Fourier truncation error is not numerically feasible if has an infinite Fourier expansion. Indeed, in the numerical example of Section 5.3, we do not even have full access to . Therefore, in Sections 5.2 and 5.3, we keep all the Fourier coefficient that we are able to obtain via a numerical simulation and treat this system approximately as , i.e., . This means that in Sections 5.2 and 5.3, the norm plots show the error together with its upper bound . On the other, the numerical example of Section 5.4 is constructed such that the LTP system has only Fourier coefficients. Therefore, in that example we have and the norm computations are exact.
5.2 1D Heat Model
The following model is a modified version of Example 1 in [7] of the 1D heat equation,
[TABLE]
with a moving point source where is the Dirac delta function and and denote the heat source position and thermal flux respectively.
The PDE is discretized via a finite difference discretization with equidistant grid points. Due to the Dirichlet boundary condition the discretized system has degrees of freedom. Simulations are discretized in time via Backwards Euler with final time [sec] and [sec]. To make the source term periodic, we choose .
For this model we include a comparison to POD and the Linear Time-Varying Balanced Truncation (LTV BT) method introduced by Lang et al. [7] This approach solves the two Lyapunov equations at every time step and produces different ROM trial and test spaces ( and ) for every time step as well. While LTV BT produces very accurate reduced models, solving many Lyapunov equations is expensive. The authors alleviate this issue with an iterative process that warm-starts the Lyapunov solver at each time step with the solution from the previous time step; however, the computational cost of LTV BT is still considerably larger than our approach as is demonstrated in the numerical results that follow. It is important to note that our approach exploits periodicity of the state space representation, whereas LTV BT does not and indeed can handle a broader class of time-varying problems than we consider here.
We train POD with the constant input function . Both POD and H2-Based reduced models use for dimension of the reduced system. On the other hand, since the model reduction bases vary at every time step, LTV BT uses a varying reduced order throughout the simulation, , depending on the time step. The LTV BT simulations take considerably longer to run ( [sec]) whereas POD and the proposed -Based approach, i.e., Algorithm 1, each took less than five seconds. In Figure 2, we plot the output (the top plot) and the output errors (the bottom plot) due to the three reduced models obtained via POD, LTV BT, and the proposed method (labeled as “H2-Based”). The input for these simulations is the same input function that was used to train POD. The first observation is that the input/output based approaches outperform POD as illustrated by the error plot in Figure 2. For this example, LTV BT and the H2-based proposed approach perform similarly. However, one might expect LTV BT to outperform the proposed approach in general since it uses time varying model reduction bases and at every time step; as opposed to the proposed approach where the model reduction bases are fixed. Therefore, it is encouraging that the proposed method is able to mimic the accuracy of LTV BT for this example. Since LTV BT has time varying bases and , the resulting reduced model does not allow norm computations. Therefore, we compute the error norms only for POD and the H2-based method. Results in Figure 3 show the error as the dimension of the ROM increases. To make the computation affordable, we have chosen a FOM with degrees of freedom. Once again the proposed method significantly outperforms POD.
5.3 Nonlinear Transmission Line
The following model is the “Test Network 2” from Noda et al. [41]. It represents an RLC circuit with nonlinear inductors to model the effect of saturable transformers. The network is split into 10 sections, each consisting of 6 states. Therefore, the full model has 60 states representing the current and voltages through each section.
In Figure 4, where [rad/sec] and [kV]. The circuit is supplied with an “overvoltage” by a factor of to induce a noticeable saturation in the nonlinear inductors, . The current through is where is the magnetic flux through the inductor and and depend on the section. For a table of the resistor, capacitor, and inductor values, see Figure 8 in Noda et al. [41]. See Figure 4 for the nonlinear circuit schematic.
The steady-state solution to the problem is time-periodic. Noda et al. [41] are concerned with the transient deviations from the steady-state solution from perturbations of the input . The voltage and current are the input and output of the dynamical system. As both quantities are degrees of freedom in the dynamical system, the input matrix and output matrix do not vary with time. Therefore, a linearization of the nonlinear dynamical system results in a time-periodic system of the form (3) where are -periodic with [sec] and represents the perturbation in the state from the steady-state solution and represents the perturbation from .
Unlike the previous 1D Heat model, the full LTP models in this example and the next are stiff, requiring many time-samples to resolve the numerical simulation, even with the implicit backward Euler scheme. This results in significantly more Lyapunov equations to solve increasing the cost of LTV BT even further compared to the previous example. Therefore, for these last two examples, we only provide comparison to POD. However, even though LTV BT might be computationally more intensive, we still accept it to provide very accurate reduced models due to the time-varying model reduction bases. To run POD, we generated simulations of the system when the control was the Heaviside function, [kV]. After generating the numerical simulation of the state , we collect the simulation into a snapshot matrix, and perform an SVD to construct the subspace . The result of the reduced-order model generated according to (6) with from above is labeled as POD in Figure 5.
For the model reduction via Algorithm 1, we begin by performing a Floquet transformation on the periodic . For this example, we have the snapshots for 256 uniformly spaced temporal points in the period, [sec]. Therefore, the Floquet-Fourier transformation resulted in a state-space matrices of the form: , . We preserve all 256 Fourier modes of the input and output and used IRKA to construct the Petrov-Galerkin subspaces and .
Figure 5 shows the outputs (the top plot) and the output errors (the bottom plot) in time domain simulations due to two reduced models obtained via POD and the proposed method (labeled as “H2-Based”), each with reduced order . We also perform a similar comparison for a variety of reduced order sizes in Figure 6, measuring the error of the LTP systems. Note that the POD-based reduced model becomes unstable for ; hence, the error is infinite in these cases and are not plotted.
As Figures 5 and 6 illustrate the proposed approach demonstrates superior performance to POD, in terms of stability and dynamical system error measured in the norm for LTP systems. In terms of both the time domain simulation and the error norm, the error due to the proposed method is almost two orders of magnitude smaller than that of POD. We note that this superior performance is obtained in the best case scenario for POD since the model reduction error is measured for the same input which was used to train POD. Still the -based proposed method produces a significantly better reduced model. We note also that the error bound predicts the true error behavior well.
5.4 Structural Model of Component 1r (Russian service module) of the International Space Station
We consider the 1r Russian service module that has states, inputs and outputs. We make this model LTP by placing modulators on inputs and . We do the same for outputs and . Define \mathbf{B}=\left[\begin{array}[]{ccc}{\mathbf{b}}_{0}&{\mathbf{b}}_{1}&{\mathbf{b}}_{2}\end{array}\right] to be the original input vector and to be the original output vector. Then we construct a SISO system by feeding the input into two modulators with local oscillator frequencies of and respectively,
[TABLE]
To see this abstracted into a diagram see Figure 7.
The system is already in the Floquet-Fourier form of dimension and since the Fourier expansions of and have 5 nontrivial terms. We tried to reduce the model by POD, using a test function of but each reduced model was unstable for reduced orders greater than or equal to 5. The frequency [rad/sec] was chosen after determining that it excited many of the system harmonics. Since the resulting reduced systems were unstable, we omitted the POD simulation results from these comparisons.
For , we run simulations of the full model and reduced model obtained via Algorithm 1. As shown in Figure 8, the reduced LTP model is almost indistinguishable from the full LTP model.
As in the previous example, we construct reduced order models of dimensions to using Algorithm 1 and compare their respective error system error norm in Figure 9. The error bound accurately predicts the true error.
6 Conclusions
We develop a model reduction scheme for LTP systems by converting the model reduction problem into an analogous LTI problem and employing existing model reduction techniques to the new problem. Numerical results demonstrate the success of the proposed method. Moreover, we extend the analysis of the certain notions of -approximation established for LTI systems to LTI systems.
In practice, current approaches for computing Floquet transformations do not scale well to large-scale systems, so this aspect may remain a bottleneck for effective model reduction for general LTP systems. In a variety of circumstances, however, this step is not difficult or problematic. We do not consider this aspect of the problem in the present work and the algorithm we propose here truncates the Floquet-Fourier coefficients, keeping centered coefficients. The error introduced by this step becomes arbitrarily small as we increase the number of coefficients conserved, . Note that for any given , the coefficients that are kept need not be an optimal choice and investigating what may constitute a better selection of coefficients would benefit any further refinement of this approach.
7 Acknowledgements
We thank to Dr. Taku Noda and Dr. Jens Saak for generously providing us with the MATLAB code used to generate the results in their paper [41] and [7], respectively. The work of C. Magruder was supported in part by the ExxonMobil Ken Kennedy Institute 2015/2016 High Performance Computing Graduate Fellowship. The work of S. Gugercin was supported in part by NSF through Grants DMS-1217156 and DMS-1522616, and by the Alexander von Humboldt Foundation. The work of C. Beattie was supported in part by NSF through Grant DMS-1217156 and by the Einstein Foundation - Berlin.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] S. Gugercin, A.C. Antoulas, and C. Beattie, ℋ 2 subscript ℋ 2 \mathcal{H}_{2} model reduction for large-scale linear dynamical systems , SIAM journal on matrix analysis and applications 30 (2008), pp. 609–638.
- 2[2] A.C. Antoulas, Approximation of large-scale dynamical systems , Vol. 6, SIAM, 2005.
- 3[3] P. Benner, S. Gugercin, and K. Willcox, A survey of projection-based model reduction methods for parametric dynamical systems , SIAM Review 57 (2015), pp. 483–531.
- 4[4] A.C. Antoulas, D.C. Sorensen, and S. Gugercin, A survey of model reduction methods for large-scale systems , Contemporary Mathematics 280 (2001), pp. 193–220.
- 5[5] H. Sandberg and A. Rantzer, Balanced truncation of linear time-varying systems , Automatic Control, IEEE Transactions on 49 (2004), pp. 217–229.
- 6[6] H. Sandberg, A case study in model reduction of linear time-varying systems , Automatica 42 (2006), pp. 467–472.
- 7[7] N. Lang, J. Saak, and T. Stykel, Balanced truncation model reduction for linear time-varying systems , Mathematical and Computer Modelling of Dynamical Systems 22 (2016), pp. 267–281.
- 8[8] A. Varga, Balancing related methods for minimal realization of periodic systems , Systems & Control Letters 36 (1999), pp. 339–349.
