Abstract
We present a balanced truncation model reduction approach for a class of nonlinear systems with time-varying and uncertain inputs. First, our approach brings the nonlinear system into quadratic-bilinear (QB) form via a process called lifting, which introduces transformations via auxiliary variables to achieve the specified model form. Second, we extend a recently developed QB balanced truncation method to be applicable to such lifted QB systems that share the common feature of having a system matrix with zero eigenvalues. We illustrate this framework and the multi-stage lifting transformation on a tubular reactor model. In the numerical results we show that our proposed approach can obtain reduced-order models that are more accurate than proper orthogonal decomposition reduced-order models in situations where the latter are sensitive to the choice of training data.
Access provided by Autonomous University of Puebla. Download chapter PDF
Similar content being viewed by others
Keywords
1 Introduction
We consider reduced-order modeling for large-scale nonlinear systems with time-dependent and uncertain inputs, as such models appear in many practical engineering applications. A reduced-order model (ROM) has to capture the rich dynamics resulting from time-dependent inputs [1]. Proper orthogonal decomposition (POD) [18] is the most common model reduction framework for nonlinear systems. As a trajectory-based method, POD relies on user-specified training data, leaving the method vulnerable to poor choices in training inputs.
Interpolatory model reduction approaches that focus on the transfer function mapping from inputs to outputs—and do not require training data—are mature for linear systems [1, 2]. Moreover, significant progress has been made for input-output model reduction for nonlinear systems with known governing equations [4, 6, 8]. In the situation where the governing equations are unknown and only frequency-domain input-output data is available, Antoulas and Gosea [13] proposed a data-driven reduced-order modeling framework for quadratic-bilinear (QB) systems.
Balanced truncation methods offer another promising avenue for model reduction. Initially proposed by Moore [24] for linear systems, many extensions are available, such as snapshot-based approximations (in the stable [29] and unstable case [11]), as well as weighted and time-limited balanced truncation methods, see e.g., the survey [16]. Extending balancing transformations to large-scale nonlinear systems is an open problem, since the balancing transformations become state-dependent (see [12, 27]) and are hence impractical when the model dimension is large. To overcome this computational bottleneck, approximate Gramians that are state-independent (as they are in the linear case) can be used. Balanced truncation for nonlinear systems based on algebraic Gramians [14] requires the solution of Lyapunov-type equations, and is hence appealing from a computational perspective. A computationally efficient framework via truncated Gramians for QB systems has been proposed in [5]. Empirical Gramians for nonlinear systems [21] can also be used, yet their computation requires as many simulations of the full systems as there are inputs and outputs: each simulation uses an impulse disturbance per input channel while setting the other inputs to zero. A method for approximating the nonlinear balanced truncation reduction map via reproducing kernel Hilbert spaces has been proposed in [7].
In this work, we propose a balanced truncation model reduction method for a class of nonlinear systems with time-varying inputs. As a first step, we use variable transformations and lifting, which allows us to bring the nonlinear system in QB form via the introduction of auxiliary variables. Lifting transformations that transform general nonlinear systems into polynomial models have been explored over several decades in different communities [4, 15, 19, 20, 22, 23, 26, 28]. We show that the lifted QB models often have a special structure, namely that the linear system matrix becomes has zero eigenvalues, making the balancing algorithm for QB systems [5] not directly applicable due to the typical requirement that the system matrix be stable. We thus propose a modified approach for balanced truncation of lifted QB systems, which uses the definition of the lifted variable to artificially introduce a stabilization to the system. As an example, we consider a nonlinear tubular reactor model for which we present a lifting transformation that brings the model into QB form, and subsequently perform balancing.
This paper is organized as follows. Section 2 reviews truncated Gramians for QB systems. Section 3 illustrates that lifted QB models often have a common structure and also introduces the tubular reactor model and its lifted QB model. Section 4 proposes our balancing approach for lifted QB systems with special structure. Section 5 presents numerical results for the tubular reactor model.
2 Quadratic-Bilinear Systems and Balancing
A QB system of ordinary differential equations can be written as
where \(\mathbf {x}(t) \in \mathbb {R}^{n}\) is the state, \(t\ge 0\) denotes time, the initial condition is \(\mathbf {x}(0)=\mathbf {x}_0\), \(\mathbf {u}(t) \in \mathbb {R}^m\) is a time-dependent input and \(\mathbf {u}_k\) its kth component, \(\mathbf {B}\in \mathbb {R}^{n\times m}\) is the input matrix, \(\mathbf {A}\in \mathbb {R}^{n\times n}\) is the system matrix, \(\mathbf {C}\in \mathbb {R}^{p\times n}\) is the output matrix and the \(\mathbf {N}_k \in \mathbb {R}^{n\times n}, k=1, \ldots , m\) represent the bilinear coupling between input and state. The matrix \(\mathbf {H}\) is viewed as a mode-1 matricization of a tensor \(\mathcal {H}\in \mathbb {R}^{n\times n \times n}\), so \(\mathcal {H}^{(1)} = \mathbf {H}\). Moreover, \(\mathcal {H}^{(2)}\) denotes the mode-2 matricization of the tensor \(\mathcal {H}\). We assume without loss of generality (see [4, Sect. 3.1]) that the matrix \(\mathbf {H}\) is symmetric in that \(\mathbf {H}(\mathbf {x}_1 \otimes \mathbf {x}_2) = \mathbf {H}(\mathbf {x}_2 \otimes \mathbf {x}_1)\).
For system (1)–(2) the controllability and observability energy functions are defined as
where \(\mathcal {E}_c\) quantifies the minimum amount of energy required to steer the system from \(\mathbf {x}(-\infty )=0\) to \(\mathbf {x}(0)=\mathbf {x}_0\), and \(\mathcal {E}_o\) quantifies the output energy generated by the nonzero initial condition \(\mathbf {x}_0\) and \(\mathbf {u}(t)\equiv 0\).
Balanced truncation achieves reduction in the dimension of the state space by eliminating those states that are hard to control (large \(\mathcal {E}_c\)) and hard to observe (small \(\mathcal {E}_o\)). Thus, an important component of balanced truncation model reduction is to find the coordinate transformation that ranks the controllability and observability of the states. The Gramian matrices (formally introduced below) are central to finding this balanced coordinate transformation for system (1)–(2). In particular, if symmetric positive definite Gramians \(\mathbf {P}= \mathbf {L}_\mathbf {P}{\mathbf {L}_\mathbf {P}}^\top \) and \(\mathbf {Q}=\mathbf {L}_\mathbf {Q}{\mathbf {L}_\mathbf {Q}}^\top \) for the QB system (1)–(2) are available, we can obtain transformation matrices \(\mathbf {V}\) and \(\mathbf {W}\), with \(\mathbf {V}= \mathbf {W}^{-1}\) that diagonalize the Gramians, \(\mathbf {V}^\top \mathbf {P}\mathbf {V}= \mathbf {W}^\top \mathbf {Q}\mathbf {W}=\mathcal {S}=\text {diag}{(\sigma _1, \ldots , \sigma _n)}\), where \(\sigma _i\) are the singular valuesFootnote 1 of \({\mathbf {L}_\mathbf {Q}}^\top \mathbf {L}_\mathbf {P}\). The energy functions in the balanced state \(\tilde{\mathbf {x}} = \mathbf {W}\mathbf {x}\) can then be bounded as \( \mathcal {E}_c(\tilde{\mathbf {x}})\ge \frac{1}{2}\tilde{\mathbf {x}}^\top \mathcal {S}^{-1} \tilde{\mathbf {x}}\), and \( \mathcal {E}_o(\tilde{\mathbf {x}})\le \frac{1}{2} \tilde{\mathbf {x}}^\top \mathcal {S} \tilde{\mathbf {x}}\) in a neighborhood of the origin [5, Sect. 4]. From these inequalities, we see that states corresponding to small singular values of \({\mathbf {L}_\mathbf {Q}}^\top \mathbf {L}_\mathbf {P}\) are hard to control and hard to observe. The subspaces spanned by the singular vectors corresponding to small singular values can thus be discarded in a ROM.
We now turn to the computation of the Gramian matrices \(\mathbf {P}\) and \(\mathbf {Q}\). For the special case of QB systems, the next proposition states conditions under which approximate algebraic Gramians exist, and suggests a computational framework to find those.
Proposition 1
([5], Cor. 3.4) Consider the QB system (1)–(2). If \(\mathbf {A}\) is a stable matrix, then the truncated Gramians \(\mathbf {P}_{\mathcal {T}}, \mathbf {Q}_{\mathcal {T}}\) are defined as solutions to
where \(\mathbf {P}_1\) and \(\mathbf {Q}_1\) are solutions to the standard linear Lyapunov equations
The Gramians \(\mathbf {P}_{\mathcal {T}}, \ \mathbf {Q}_{\mathcal {T}}\) are used to obtain a QB reduced-order model (QB-ROM) as follows: Compute the singular value decomposition \(\mathbf {L}_{\mathbf {Q}_\mathcal {T}}^\top \mathbf {L}_{\mathbf {P}_\mathcal {T}}= \mathcal {U} \mathcal {S} \mathcal {V}^\top \) and let its rank r approximation be denoted as \(\mathcal {U}_r \mathcal {S}_r \mathcal {V}_r^\top \). The projection matrices are \(\mathbf {W}= \mathbf {L}_{\mathbf {Q}_\mathcal {T}} \mathcal {U}_r \mathcal {S}_r^{-1/2}\) and \(\mathbf {V}= \mathbf {L}_{\mathbf {P}_\mathcal {T}} \mathcal {V}_r \mathcal {S}_r^{-1/2}\). The balanced QB-ROM has the form
with the matrices \( \widehat{\mathbf {A}} = \mathbf {W}^\top \mathbf {A}\mathbf {V}, \quad \widehat{\mathbf {B}} = \mathbf {W}^\top \mathbf {B}, \quad \widehat{\mathbf {C}} = \mathbf {C}\mathbf {V}, \quad \widehat{\mathbf {N}}_k = \mathbf {W}^\top \mathbf {N}_k \mathbf {V}, \quad \widehat{\mathbf {H}} = \mathbf {W}^\top \mathbf {H}(\mathbf {V}\otimes \mathbf {V})\). The Gramians of the QB-ROM are balanced, i.e., the matrices \(\widehat{\mathbf {P}}_\mathcal {T}=\widehat{\mathbf {Q}}_\mathcal {T}\) are equal and diagonal.
3 Lifting Systems to QB Form: Introducing Structure
In Sect. 3.1 we illustrate that lifting transformations for nonlinear systems often lead to a specific structure of the lifted system. Section 3.2 introduces a nonlinear tubular reactor model, and its subsequent lifted QB model with this special structure.
3.1 Structure in Lifted QB Systems
As an example of a higher-order dynamical system that can be lifted to QB form, consider the nonlinear ordinary differential equation
where x(t) is the one-dimensional state variable, \(a_1, \ldots , a_d\) are known coefficients, \(x^k\) is the kth power of x(t), u(t) is an input function, and \(b \in \mathbb {R}\) is a parameter. We consider here a one-dimensional ordinary differential equation (ODE) for illustration and note that the lifting framework directly applies to n-dimensional nonlinear systems. Our goal is to rewrite this system in QB form by introducing auxiliary variables. For this example, we define auxiliary variables \(w_\ell := x^{\ell +1}\), so that the governing equation can be written as a linear system
The auxiliary state dynamics are computed via the chain rule (or Lie derivative) as
and here \(w_0:=x\). Note that the right-hand-side contains quadratic products \(w_{\ell -1}(t)w_k(t)\) as well as bilinear products \(b (\ell +1) u(t) w_{\ell -1}(t)\). Another choice to write the auxiliary dynamics would be to replace \(w_{\ell -1}x\) with \(w_\ell \). Next, we show two examples of polynomial and non-polynomial models where lifting leads to a similar structure.
Example 1 Consider the ODE
Our goal is to lift this system to QB form by introducing auxiliary variables. Let
be the auxiliary variables. Note that the original dynamics then become linear, i.e., \(\dot{x} = aw_2 + bu\). We compute the auxiliary state dynamics \(\dot{w}_1 = 2 x \dot{x} = 2a x w_2 + 2xbu\) and \(\dot{w}_2 = 3 x^2 \dot{x} = 3 w_1 (aw_2 + bu)\). Taken together, the nonlinear equation (10) with one state variable is equivalent to the QB-ODE with three state variables
The system (11) is equivalent to the original nonlinear equation (10), in the sense that both systems yield the same solution x(t). We can write (11) in the QB form of equation (1) with the lifted state \(\mathbf {x}=[x, w_1, w_2]^\top \) and matrices
Example 2 Consider an ODE with non-polynomial term and linear term:
which we lift to QB form. We introduce \(w_1 = e^{-x}\) as the auxiliary variable, so that \(\dot{w}_1 = -w_1 ( ax + w_1 + bu ) = -aw_1x - w_1^2 -w_1bu\), which can be written in QB form as
We observe that the lifted matrices in the previous two examples (Eqs. (12) and (13)) have the following block-structure:
where \({\textbf {0}}\) is a matrix of zeros of appropriate dimensions. Note, that the system matrix of the lifted system (14) has zero eigenvalues. Moreover, the original input \(\mathbf {B}u(t)\) only affects the original state, but appears as a bilinear term in the auxiliary states after application of the chain rule. Thus, the \(\mathbf {N}\) matrix is nonzero only in the rows corresponding to the auxiliary states. The matrix structure in Eq. (14) commonly occurs in QB systems that were obtained from lifting transformations, for instance the systems given in Example 1 and Example 2. Nevertheless, due to the non-uniqueness of lifting transformations, the block structure in (14) is both a result of the original dynamical system form and the chosen lifting transformation.
3.2 Tubular Reactor Model
We consider a non-adiabatic tubular reactor model with single reaction as in [17] and follow the discretization in [30]. The model describes the evolution of the species concentration \(\psi (s,t)\) and temperature \(\theta (s,t)\) with spatial variable \(s\in (0,1)\) and time \(t >0\). The PDE model is
with input function \(u=u(t)\) and a function \(b=b(s)\) encoding the influence of the input to the computational domain. The parameters are the Damköhler number \(\mathcal {D}\), Pèclet number Pe as well as known constants \(\mathcal {B},\ \beta , \ \theta _{\text {ref}}, \gamma \). The polynomial nonlinear term that drives the reaction is
with given constants \(c_0, \ldots c_3\).
Robin boundary conditions are imposed on the left boundary of the domain and Neumann boundary conditions on the right
The initial conditions are prescribed as \(\psi (s,0) = \psi _0(s)\), and \(\theta (s,0) = \theta _0(s)\). The output of interest is the temperature oscillation at the reactor exit, i.e., the quantity \(y(t) = \theta (s=1,t)\). The diffusive and convective terms are approximated with second-order centered differences in the interior of the domain. Second-order forward and backward difference schemes are used for the inflow and outflow boundary conditions, respectively. The finite difference approximation of dimension 2n of the tubular reactor PDE is then
Here, the (Hadamard) componentwise product of two vectors is denoted as \([\boldsymbol{\psi } \odot \boldsymbol{\theta }]_i = \boldsymbol{\psi }_i\boldsymbol{\theta }_i\), and the powers of vectors are also taken componentwise. The constant vector \( \mathbf {b}_\psi \) encodes the boundary condition, and \(\mathbf {b}_\theta \) is the sum of contributions from the boundary conditions and the \(\beta \cdot \theta _\text {ref}\) term in Eq. (16). The term \(\mathbf {A}_\psi \boldsymbol{\psi }\) is a discretized version of the advection-diffusion terms \(\frac{1}{Pe} \psi _{ss} - \psi _s \) and \(\mathbf {A}_\theta \boldsymbol{\theta }\) is a discretized representation of the \(\frac{1}{Pe} \theta _{ss} - \theta _s - \beta \theta \) terms.
We quadratic-bilinearize the finite dimensional system via a lifting transformation.Footnote 2 Footnote 3 To lift the system, we introduce the auxiliary variables
so that we have the equivalent QB system of dimension 7n:
Note, that the original state equations for species and temperature, (19)–(20), are linear in the new state variables, whereas the differential equations for the added state variables (21)–(25) are quadratic in the state variables (after inserting \(\dot{\boldsymbol{\psi }}, \dot{\boldsymbol{\theta }}\), which are linear). Hence, the system is of QB form (1)–(2), where \(\mathbf {x}(t) = [\boldsymbol{\psi }^\top \ \boldsymbol{\theta }^\top \ \mathbf {w}_1^\top \ \mathbf {w}_2^\top \ \mathbf {w}_3^\top \ \mathbf {w}_4^\top \ \mathbf {w}_5^\top ]^\top \in \mathbb {R}^{7n}\) is the new lifted state. The lifted state Eqs. (19)–(25) again induce a specific structure of the system matrices:
Note that the original dynamics are linear after the lifting is applied, and the auxiliary states have no linear parts, as the time derivative of the auxiliary variables consistently results in purely quadratic dynamics. Thus, the matrix \(\mathbf {A}\) has zero eigenvalues, and \(\mathbf {H}\) is such that there is no contribution in the rows corresponding to the original state. Moreover, the bilinear state-input interactions only occur in the auxiliary states. This structure is exactly the one presented in Eq. (14).
4 Balancing for Lifted Systems with Special Structure
Section 4.1 introduces an artificial numerical parameter that guarantees existence of truncated Gramians. Section 4.2 derives the Gramians for the linear part of the system, while Sect. 4.3 presents the truncated Gramians for the QB system.
4.1 Artificial Stabilization
The special structure of the system matrix \(\mathbf {A}\) that arises from lifting transformations leads to zero eigenvalues. Hence, there are no unique solutions to the Lyapunov equations (3)–(5) and the standard QB balanced truncation method from [5] cannot be applied. To circumvent this problem, we observe that if the original nonlinear system is polynomial (cf. (8) and its lifted version (9)) then \(-\alpha w_\ell + \alpha x^{\ell +1} =0\) for any \(\alpha \in \mathbb {R}\). We can use this equality to artificially stabilize the linear term. For example, in Eq. (21) of the tubular reactor ODE, we can introduce a term \(-\alpha \mathbf {w}_1 + \alpha (\boldsymbol{\psi }\odot \boldsymbol{\theta })\). Applying this to every auxiliary variable, the linear system matrix becomes
and the quadratic tensor \(\mathbf {H}(\alpha ) = \mathbf {H}+ \widetilde{\mathbf {H}}(\alpha )\), where \(\widetilde{\mathbf {H}}(\alpha )\) contains the artificially added terms such that \(-\alpha [{\textbf {0}}^\top , \mathbf {w}^\top ]^\top + \widetilde{\mathbf {H}}(\alpha )(\mathbf {x}\otimes \mathbf {x}) = {\textbf {0}}\). With this system matrix \(\mathbf {A}(\alpha )\), the Lyapunov equations (3)–(5) have unique positive semi-definite solutions if \(\mathbf {A}_{11}\) is stable. Similar concepts have been used recently in [25]. For all results in this section to hold, we require that \(\mathbf {A}_{11}\) is stable.
4.2 Balancing with Gramians of Linearized System
The Lyapunov equations for the linear system part, Eq. (5) are needed to compute the truncated Gramians for the QB system. The next two propositions detail the computation of those linear Lyapunov equations.
Proposition 2
The solutions to the standard linear Lyapunov equations (5) with \(\mathbf {A}(\alpha )\) from equation (27) are given by
where
Proof
For the controllability Gramian computation we have that
which results in the four equations
Since \((\mathbf {A}_{11}^\top - \alpha \mathbf {I})\) is invertible, the last three equations yield that \(\mathbf {P}_{22}={\textbf {0}}\) and \(\mathbf {P}_{12}={\textbf {0}}\). Next, we consider the observability Lyapunov equation
Blockwise multiplication results in the three distinct equations
which we can solve successively to get \(\mathbf {Q}_{11}, \mathbf {Q}_{12}, \mathbf {Q}_{22}\). We define \(\widetilde{\mathbf {Q}}_{22}{(\alpha )} = \mathbf {A}_{12}^\top \mathbf {Q}_{12}{ (\alpha )} + \mathbf {Q}_{12}^\top {(\alpha )} \mathbf {A}_{12}\) so that the explicit dependence on \(1/\alpha \) appears as \(\mathbf {Q}_{22}(\alpha ) = \frac{1}{2\alpha } \widetilde{\mathbf {Q}}_{22}(\alpha )\). \(\square \)
Proposition 3
Consider the Gramians from Proposition 2, and let \(\mathbf {P}_{11} = \mathbf {L}_{\mathbf {P}_{11}} \mathbf {L}_{\mathbf {P}_{11}}^\top \) and \(\mathbf {Q}_{11} = \mathbf {L}_{\mathbf {Q}_{11}} \mathbf {L}_{\mathbf {Q}_{11}}^\top \) be Cholesky factorizations. Let the singular value decomposition approximate the product \(\mathbf {L}_{\mathbf {Q}_{11}}^\top \mathbf {L}_{\mathbf {P}_{11}} \approx \mathcal {U}_{r} \mathcal {S}_r \mathcal {V}_r^\top \). Then the projection matrices for the balancing transformation are given as
Proof
To obtain the balancing transformation, we need to compute the product \(\mathbf {L}_{\mathbf {Q}_1}^\top \mathbf {L}_{\mathbf {P}_1}\). We have that
For the Cholesky factorization of \(\mathbf {Q}_1\) we introduce the Schur complement \( \mathbf {S}(\alpha ) = \frac{1}{2\alpha }\widetilde{\mathbf {Q}}_{22}(\alpha ) - \mathbf {Q}_{12}(\alpha )^\top \mathbf {Q}_{11}^{-1} \mathbf {Q}_{12}(\alpha ) = \mathbf {L}_{\mathbf {S}(\alpha )} \mathbf {L}_{\mathbf {S}(\alpha )}^\top \), so that we have
as follows from the results for the block-diagonal form of the Cholesky factorization (which can be verified by direct computation). To obtain the balancing transformation, we consider the approximation via singular value decomposition
We then compute
which completes the proof.\(\square \)
The two propositions show that only Lyapunov equations in the original model dimensions are necessary (and not in the lifted dimensions), which is computationally appealing. For example, for the tubular reactor model in Sect. 3.2, the original model dimensions are 2n and the lifted dimensions are 7n and we only solve 2n-dimensional Lyapunov equations.
4.3 Balancing with Truncated (Quadratic) Gramians
The next two propositions consider the solution of the Lyapunov equations (3)–(4) for the truncated Gramians, which take into consideration the QB nature of the problem by incorporating \(\mathbf {H}\) and \(\mathbf {N}\).
Proposition 4
Let \(\mathbf {P}_{1}\) be the solution from Proposition 2. The truncated Gramian from equation (3) for the QB system is given as
via the following equations:
Proof
The generalized controllability Lyapunov equation (3) is a linear equation, therefore we can decompose the truncated Gramian \(\mathbf {P}_\mathcal {T} = \mathbf {P}_1 + \mathbf {P}_2(\alpha )\), where \(\mathbf {P}_1\) is the solution from Proposition 2. Therefore, \(\mathbf {P}_2(\alpha )\) is the solution to
With the matrices from above, we compute
The symmetric positive semi-definite solution \(\mathbf {P}_2(\alpha )\) needs to satisfy
which yields the equations
We define \(\widetilde{\mathbf {P}}_{22}(\alpha ) = [\mathbf {H}_{21}(\alpha )(\mathbf {P}_{11} \otimes \mathbf {P}_{11})\mathbf {H}_{21}(\alpha )^\top + \mathbf {N}_{21} \mathbf {P}_{11} \mathbf {N}_{21}^\top ]\), so that \(\widehat{\mathbf {P}}_{22}(\alpha ) = \frac{1}{2\alpha } \widetilde{\mathbf {P}}_{22}(\alpha )\). Due to the symmetry of \(\widehat{\mathbf {P}}_{22}(\alpha )\), equations (32) and (33) are the same, and after substitution, we obtain \( \widehat{\mathbf {P}}_{12}(\alpha ) = - \frac{1}{2\alpha }(\mathbf {A}_{11} - \alpha \mathbf {I})^{-1} \mathbf {A}_{12} \widetilde{\mathbf {P}}_{22}(\alpha ) := \frac{1}{2\alpha }\widetilde{\mathbf {P}}_{12}(\alpha ), \) with \(\widetilde{\mathbf {P}}_{12}(\alpha ) : = - (\mathbf {A}_{11} - \alpha \mathbf {I})^{-1} \mathbf {A}_{12} \widetilde{\mathbf {P}}_{22}(\alpha )\). Substitution of \(\widehat{\mathbf {P}}_{12}(\alpha )\) into equation (31) yields the result.\(\square \)
Proposition 5
Let the matrix \(\mathbf {Q}_1\) be as in Proposition 2. The truncated Gramian \(\mathbf {Q}_{\mathcal {T}}\) that solves equation (4) is given by
where
Proof
We begin by computing
and for notational convenience partition the full matrix
which is a symmetric matrix since \(\mathbf {P}_1\) and \(\mathbf {Q}_1\) are symmetric Gramians. We then solve for the truncated Gramian via
Thus, the Gramian solution has to satisfy the equations
from which we get the stated result.\(\square \)
By decomposing the Lyapunov solution into block form, we can again compute the truncated Gramians by only working in the original dimensions (not the lifted dimensions). Due to the dependence on \(1/\alpha \) the Gramians \(\mathbf {Q}_{\mathcal {T}}, \mathbf {P}_{\mathcal {T}}\) are not defined for \(\alpha \rightarrow 0\) and taking the limit \(\alpha \rightarrow 0\) can therefore result in numerical difficulties. We summarize our proposed approach below.
Proposition 6
An approximate balancing transformation for the QB structure arising in lifting of nonlinear systems can be computed as follows:
-
1.
Choose \(\alpha \in (0,\infty )\) and compute \(\mathbf {P}_\mathcal {T}, \mathbf {Q}_\mathcal {T}\) from Propositions 4 and 5 with \(\mathbf {A}(\alpha )\).
-
2.
Compute Cholesky factors \(\ \mathbf {P}_\mathcal {T} = \mathbf {L}_{\mathbf {P}_\mathcal {T}}\mathbf {L}_{\mathbf {P}_\mathcal {T}}^\top \) and \(\ \mathbf {Q}_\mathcal {T} = \mathbf {L}_{\mathbf {Q}_\mathcal {T}} \mathbf {L}_{\mathbf {Q}_\mathcal {T}}^\top \).
-
3.
Compute SVD \(\ \mathbf {L}_{\mathbf {Q}_\mathcal {T}}^\top \mathbf {L}_{\mathbf {P}_\mathcal {T}} = \mathcal {U} \mathcal {S} \mathcal {V}^\top \); denote rank r approximation as \(\ \mathcal {U}_r \mathcal {S}_r \mathcal {V}_r^\top \).
-
4.
Projection matrices \(\ \mathbf {W}= \mathbf {L}_{\mathbf {Q}_\mathcal {T}} \mathcal {U}_r \mathcal {S}_r^{-1/2}\) and \(\ \mathbf {V}= \mathbf {L}_{\mathbf {P}_\mathcal {T}} \mathcal {V}_r \mathcal {S}_r^{-1/2}\).
-
5.
Matrices for QB-ROM (6)–(7) are
$$\begin{aligned} \widehat{\mathbf {A}} = \mathbf {W}^\top \mathbf {A}\mathbf {V}, \quad \widehat{\mathbf {B}} = \mathbf {W}^\top \mathbf {B}, \quad \widehat{\mathbf {C}} = \mathbf {C}\mathbf {V}, \quad \widehat{\mathbf {N}}_k = \mathbf {W}^\top \mathbf {N}_k \mathbf {V}, \quad \widehat{\mathbf {H}} = \mathbf {W}^\top \mathbf {H}(\mathbf {V}\otimes \mathbf {V}). \end{aligned}$$
5 Numerical Results
For the tubular reactor model in Sect. 3.2, the parameters are \(\mathcal {D}=0.17\), \(Pe=25\), \(\mathcal {B}=0.5\), \(\beta =2.5\), \(\theta _{\text {ref}}\equiv 1\), \(\gamma =5\), and \(n=199\). We compare the approximate balanced truncation ROM, denoted QB-BT, from Proposition 6 with a ROM computed from POD with discrete empirical interpolation [9], denoted as POD-DEIM. For the predictive comparison, the full-order model and ROMs are simulated until \(t_f = 30\)s with different inputs u(t) and initial conditions \(\mathbf {x}(0)=\mathbf {x}_0\) as given below.
The POD-DEIM models are obtained as follows: We simulate the full-order model until \(t_\text {train}=15\)s with training input \(u_\text {train}(t)\) and training initial condition \(\mathbf {x}_{0,\text {train}}\). We record a snapshot every 0.01s and store the snapshots in a matrix \(\mathbf {X}\), compute the POD basis \(\mathbf {V}\in \mathbb {R}^{n\times r}\) of dimension r, and project the system matrices in (17)–(18) onto \(\mathbf {V}\). For every r-dimensional POD-DEIM ROM we use r DEIM interpolation points using the QDEIM algorithm from [10].
For the QB-BT models, we discussed in Sect. 4.1 that the parameter \(\alpha \in (0,\infty )\). Here, we found that \(\alpha =20\) resulted in the most accurate balanced ROMs and that for \(\alpha \ll 1\) the Gramians’ subspaces would lead to unstable ROMs. This could be related to the influence of the field of values of \(\mathbf {A}(\alpha )\) on the decay of the singular values of the solution to the Lyapunov equation [3]. Here, for \(\alpha >\alpha _c=2.6\), the field of values of \(\mathbf {A}(\alpha )\) is in the open left-half plane, which we can choose as a selection criterion for \(\alpha \).
Reduced-order models constructed via POD-DEIM depend on the snapshot data that is obtained from training simulations. In contrast, balancing transformations only depend on the matrices defining the full-order QB system \(\mathbf {A},\mathbf {H}, \mathbf {N}, \mathbf {B}, \mathbf {C}\); the basis generation does not require a choice of training data. To illustrate this point, we consider four test cases with different testing conditions and for which the POD-DEIM training choices vary. For each test case we compare the output error \(\sum _{i=1}^s \vert y(t_i) - y_r(t_i)\vert \) with \(s=3,000\) for the POD-DEIM and QB-BT ROMs. We detail each case below.
Case 1: \(u(t) = \cos (t), \ u_\text {train}(t) = u(t), \mathbf {x}_{0,\text {train}} = \mathbf {x}_0\). For this test case, training and testing conditions are the same, so we expect POD-DEIM ROMs to accurately reproduce the full-order model (FOM) simulations. The output quantity of interest of the FOM compared to two ROMs with \(r=20\) basis functions for this test case is shown in Fig. 1, left. Table 1 shows the output error for various ROM model sizes. We see that the POD-DEIM ROM outperforms the QB-BT ROM in this case.
Case 2: \(u(t) = \cos (t), \ u_\text {train}(t) = u(t), \ \mathbf {x}_{0,\text {train}} = \mathbf {x}_0\); noise = \(10\%\) Here we use the same training input and training initial conditions as in Case 1. However, we add noise to the training data, reflecting a situation that practitioners often face where measurements are noise-corrupted. In particular, we use \(\tilde{X} = X + 0.1 X(-1 + 2\Xi )\) where \(\Xi = \mathcal {N}(0,1)\) is a normally distributed random variable. Figure 1, right, shows the model output for the FOM and both ROMs for \(r=20\) where we see that the POD-DEIM model does not capture the output amplitude well. Table 2 shows the output errors for increasing ROM sizes. We observe that the QB-BT ROM outperforms the POD-DEIM model in this case, as the POD-DEIM model suffers from a two orders of magnitude loss in accuracy (compared to Table 1) due to noisy snapshots.
Case 3: \(u(t) = 0.5(1+ t^2\exp (-t/4)\sin (6t)), \ u_\text {train}(t) = 0.5, \ \mathbf {x}_{0,\text {train}} = \mathbf {x}_0\) This case illustrates a scenario where a practitioner trained a model assuming that input conditions are operating at a constant equilibrium. However during operation of the plant the inputs indeed vary but the oscillations are damped and revert to the equilibrium position of 0.5. Figure 2, left, shows the model output for the FOM and both ROMs for \(r=20\); both ROMs are reproducing the output well. Table 3 shows the output errors for increasing ROM sizes. The QB-BT ROM is again more accurate, yet at one model order, \(r=20\), the POD-DEIM model is more accurate.
Case 4: \(u(t) = \cos (t), \ u_\text {train}(t) = 0.5, \ \mathbf {x}_{0,\text {train}}(1:n) =0, \ \mathbf {x}_{0,\text {train}}(n+1:2n)=1\). Here, the training initial condition is different from the initial condition used for prediction, i.e., \(\mathbf {x}_{0,\text {train}} \ne \mathbf {x}_{0}\). Figure 2, right, shows the model output for the FOM and both ROMs for \(r=20\); the QB-BT model slightly outperforms the POD-DEIM model, but both fall short of predicting the full amplitude. Table 4 shows the output errors for increasing ROM sizes, where the QB-BT model again seems to outperform the POD-DEIM model for all basis sizes.
6 Conclusions
We presented a balanced truncation model reduction approach that is applicable to a large class of nonlinear systems with time-varying and uncertain inputs. As a first step, our approach lifts the nonlinear system to quadratic-bilinear form via the introduction of auxiliary variables. As lifted systems often have system matrices with zero eigenvalues, we first introduced an artificial stabilization parameter and then derived a balancing algorithm for those lifted quadratic-bilinear systems that only requires expensive matrix computations in the original—and not in the lifted—dimension. The method was illustrated by the model reduction problem for a tubular reactor model, for which we derived the multi-stage lifting transformations and performed balanced model reduction. The numerical results showed that through our proposed method, we can obtain ROMs for nonlinear systems that are superior to POD-DEIM models in situations where a good choice of training data is not feasible.
Notes
- 1.
In the linear case those would be the Hankel singular values.
- 2.
Lifting is not unique, and there might be lower-order quadratic systems than the one suggested here. However, how to obtain them is an open problem.
- 3.
Lifting for a tubular reactor model with Arrhenius reaction term has been considered by the authors in [20], however that lifting transformation resulted in QB-DAEs, for which balancing model reduction is an open problem.
References
Antoulas, A.C.: Approximation of Large-Scale Dynamical Systems. Advances in Design and Control. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA (2005)
Antoulas, A.C., Beattie, C.A., Gugercin, S.: Interpolatory model reduction of large-scale dynamical systems. In: Efficient modeling and control of large-scale systems, pp. 3–58. Springer (2010)
Baker, J., Embree, M., Sabino, J.: Fast singular value decay for Lyapunov solutions with nonnormal coefficients. SIAM J. Matrix Anal. Appl. 36(2), 656–668 (2015)
Benner, P., Breiten, T.: Two-sided projection methods for nonlinear model order reduction. SIAM J. Sci. Comput. 37(2), B239–B260 (2015)
Benner, P., Goyal, P.: Balanced truncation model order reduction for quadratic-bilinear control systems (2017). arXiv:1705.00160
Benner, P., Goyal, P., Gugercin, S.: H2-quasi-optimal model order reduction for quadratic-bilinear control systems. SIAM J. Matrix Anal. Appl. 39(2), 983–1032 (2018)
Bouvrie, J., Hamzi, B.: Kernel methods for the approximation of nonlinear systems. SIAM J. Control Optim. 55(4), 2460–2492 (2017)
Cao, X., Maubach, J., Weiland, S., Schilders, W.: A novel Krylov method for model order reduction of quadratic bilinear systems. In: 2018 IEEE Conference on Decision and Control (CDC), pp. 3217–3222. IEEE (2018)
Chaturantabut, S., Sorensen, D.: Nonlinear model reduction via discrete empirical interpolation. SIAM J. Sci. Comput. 32(5), 2737–2764 (2010)
Drmac, Z., Gugercin, S.: A new selection operator for the discrete empirical interpolation method–Improved a priori error bound and extensions. SIAM J. Sci. Comput. 38(2), A631–A648 (2016)
Flinois, T.L., Morgans, A.S., Schmid, P.J.: Projection-free approximate balanced truncation of large unstable systems. Phys. Rev. E 92(2), 023012 (2015)
Fujimoto, K., Scherpen, J.M.: Balanced realization and model order reduction for nonlinear systems based on singular value analysis. SIAM J. Control Optim. 48(7), 4591–4623 (2010)
Gosea, I.V., Antoulas, A.C.: Data-driven model order reduction of quadratic-bilinear systems. Numer. Linear Algebra Appl. 25(6), e2200 (2018)
Gray, W.S., Verriest, E.I.: Algebraically defined Gramians for nonlinear systems. In: 2006 45th IEEE Conference on Decision and Control, pp. 3730–3735. IEEE (2006)
Gu, C.: QLMOR: a projection-based nonlinear model order reduction approach using quadratic-linear representation of nonlinear systems. IEEE Trans. Comput-Aided Des. Integr. Circuits Syst. 30(9), 1307–1320 (2011)
Gugercin, S., Antoulas, A.C.: A survey of model reduction by balanced truncation and some new results. Int. J. Control 77(8), 748–766 (2004)
Heinemann, R.F., Poore, A.B.: Multiplicity, stability, and oscillatory dynamics of the tubular reactor. Chem. Eng. Sci. 36(8), 1411–1419 (1981)
Holmes, P., Lumley, J.L., Berkooz, G.: Turbulence, Coherent Structures, Dynamical Systems and Symmetry. Cambridge Monographs on Mechanics. Cambridge University Press (1996)
Kerner, E.H.: Universal formats for nonlinear ordinary differential systems. J. Math. Phys. 22(7), 1366–1371 (1981)
Kramer, B., Willcox, K.: Nonlinear model order reduction via lifting transformations and proper orthogonal decomposition. AIAA J. 57(6), 2297–2307 (2019)
Lall, S., Marsden, J.E., Glavaški, S.: A subspace approach to balanced truncation for model reduction of nonlinear control systems. Int. J. Robust Nonlinear Control: IFAC-Affil. J. 12(6), 519–535 (2002)
Liu, J., Zhan, N., Zhao, H., Zou, L.: Abstraction of elementary hybrid systems by variable transformation. In: International Symposium on Formal Methods, pp. 360–377. Springer (2015)
McCormick, G.P.: Computability of global solutions to factorable nonconvex programs: part I-convex underestimating problems. Math. Program. 10(1), 147–175 (1976)
Moore, B.: Principal component analysis in linear systems: controllability, observability, and model reduction. IEEE Trans. Autom. Control 26(1), 17–32 (1981)
Pulch, R., Narayan, A.: Balanced truncation for model order reduction of linear dynamical systems with quadratic outputs. SIAM J. Sci. Comput. 41(4), A2270–A2295 (2019)
Savageau, M.A., Voit, E.O.: Recasting nonlinear differential equations as S-systems: a canonical nonlinear form. Math. Biosci. 87(1), 83–115 (1987)
Scherpen, J.M.: Balancing for nonlinear systems. Syst. Control Lett. 21(2), 143–153 (1993)
Swischuk, R., Kramer, B., Huang, C., Willcox, K.: Learning physics-based reduced-order models for a single-injector combustion process. AIAA J. 58(6), 2658–2672 (2020)
Willcox, K., Peraire, J.: Balanced model reduction via the proper orthogonal decomposition. AIAA J. 40(11), 2323–2330 (2002)
Zhou, Y.B.: Model Reduction for Nonlinear Dynamical Systems with Parametric Uncertainties. Ph.D. thesis, Massachusetts Institute of Technology (2012)
Acknowledgements
This work has been supported in part by the Air Force Center of Excellence on Multi-Fidelity Modeling of Rocket Combustor Dynamics under award FA9550-17-1-0195, by the Air Force Office of Scientific Research (AFOSR) MURI on managing multiple information sources of multi-physics systems, Award Numbers FA9550-15-1-0038 and FA9550-18-1-0023, and the AEOLUS MMICC center under the Department of Energy grant DE-SC0019303. The authors thank the reviewer for the very valuable comments which helped us improve our previous stabilization approach in Sect. 4.1. The authors thank Dr. Pawan Goyal for valuable discussions about the truncated Gramian framework. The authors thank Prof. Mark Embree for insightful feedback on the manuscript, and pointing out the connection to the field of values and the choice of \(\alpha \) in our algorithm.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kramer, B., Willcox, K. (2022). Balanced Truncation Model Reduction for Lifted Nonlinear Systems. In: Beattie, C., Benner, P., Embree, M., Gugercin, S., Lefteriu, S. (eds) Realization and Model Reduction of Dynamical Systems. Springer, Cham. https://doi.org/10.1007/978-3-030-95157-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-95157-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95156-6
Online ISBN: 978-3-030-95157-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)