Abstract
The aim of this work is to investigate the optimal control of the treatment in a simple pandemic model as a switched nonlinear system. We used a newly developed approach based on the theory of moments. This approach allows to transform a nonlinear, non-convex optimal control problem to an equivalent linear and convex one. To illustrate our finding, we used the example of influenza pandemic to compare the full treatment approach to our optimal moment and time switching solution.
Access provided by CONRICYT-eBooks. Download conference paper PDF
Similar content being viewed by others
Keywords
AMS subject classifications [2010]
1 Introduction
In order to avoid high mortalities and as a result of the severity of these outbreaks over years, humans have focused their efforts on finding the best strategies to control the spread of infectious diseases.
Due to poor planning, these efforts frequently fall short. For example, the supplies of drug treatments are often inadequate and inefficient, causing health facilities to run out of resources before meeting the needs [28].
For these reasons, the optimization of the existing control resources is a continuous concern in the public health. The optimal control theory has been a powerful approach to solve optimality problems in many disciplines. The majority of the techniques used in optimal control disease outbreak models (see e.g. [25]) are based on the Pontryagin maximum principle [20] and forward-backward numerical algorithms to solve the state and adjoint system of equations (for the use of numerical methods in optimal control of epidemiological models see [2, 16] and for all other types of optimal control problems see [24]).
One of the issues in using the standard optimal control approach is the suggested control might not take into consideration some realistic constraints. For example, the control agent could be a drug treatment that is not necessarily available at all times [15] or simply might run-out [1]. In this case, it is clear that assuming that control agent to be a continuous function is too optimistic of an assumption. In this situation, a switched control system would be a better approach to deal with a control problem of this nature.
Switched control systems are a class of hybrid systems that are composed of a number of subsystems which are defined by the switches [17]. These systems have extensively been used in recent years due to their applications in engineering and other disciplines [5, 29]. Hence, different studies have adapted the maximum principle to find the optimal control switched systems [9, 23, 26, 27]. However, one the biggest problems of these versions of maximal principle of switched systems is that they are numerically expensive since they involve the use of mixed integer programming [3, 4].
The recent work of Mojica-Nava et al. [19] introduced a new approach to finding the optimal switched control system. This approach is based on the use of the theory of moments for global polynomial optimization via semidefinite programming, which eases the numerical burden of using the previous approaches.
In this work, we use this new approach [19] in a simple classical model that reflects the switched aspect of the control in a pandemic model. A similar version of this model without switched control can be found in a recent work of Brauer [6, 7]. Our goal is to minimize the outflow from infected classes.
The paper is organized as follows: We introduce the problem in Sect. 2 then we transform the problem to an optimal control of switched system in Sect. 3. In Sect. 4, we present relaxation using moments approach where we transform the nonlinear, non-convex optimal control problem to a linear and convex one. Issues related to the implementation of the proposed method are presented in Sect. 5. Finally, we illustrate our results with simulation in Sect. 6. We draw conclusions and present discussion of our findings in Sect. 6.
2 Problem Statement
The aim of this work is to investigate the effect of treatment run-out supplies during a pandemic. For this reason, we consider the following simple pandemic treatment model
where the total population N is defined as \(N=N(t_0)=S(t_0)+I(t_0)\). This SITR model is an extension of the standard model of Kermack and Mckendrick by adding a fraction of infectives to be treated [6, 7], where S, I and T represent the susceptible, the infected and treated individuals. The parameters in model (1) are defined as follows: \(\beta \) is the transmission rate from susceptible to infected host and \(\alpha \) is the per capita loss rate of infected individuals through both mortality and recovery. We assume that individuals in the T class have infectivity reduced by a factor \(\delta \) and \(\gamma \) is the rate of infectives that are treated. We also assume that the rate of removal from treated class is \( \eta \).
The flow chart of our model is given in Fig. 1.
The basic reproduction number is calculated in [6] as
and the final size is given by [7]
The parameter u in (1) is the treatment control which takes values 0 or 1, where \(u=1\) means treatment is underway and \(u=0\) means no treatment. Accordingly, system (1) can switch between two different subsystems (modes of operations), corresponding to \(u=i, \ i =0,1\), as time progresses. Thus, we have a switched system.
3 The Switched System
By considering \(x=(S,I,T)^\top \), we can rewrite our system (1) as
where \(f_{i} : { I\! R}^3 \rightarrow { I\! R}^3\) is the ith vector field, \(\sigma : [t_0,t_f] \rightarrow \mathscr { Q}= \{ 0,1 \} \) is the switching signal, a piecewise constant function of time, and \([t_0, t_f]\) is the time interval under consideration. The initial conditions are given by \(x(0)=(S(0),I(0),T(0))^\top \). Every mode of operation of the system corresponds to a specific subsystem \( \dot{x}(t)= f_{i} (x(t))\), for each \(i\in \mathscr { Q}\), where \(i=0\) corresponds to \(u=0\) and \(i=1\) corresponds to \(u=1\).
Our goal is to study the number of possible switches of treatment that allows us to reduce the burden of the infection by reducing the size of the pandemic. Each subsystem \(\dot{x}(t)= f_{i} (x(t))\), for \(i \in \mathscr { Q}\), corresponds to a mode of the switching signal \(\sigma (t)\) which is our control input. The values of the switching input signal must be chosen in a way to satisfy the given initial conditions and the desirable final conditions that represent specific desirable pandemic outcome. The optimal switching signal \(\sigma \) would represent a public health optimal strategy to control the pandemic within the limits of the available resources.
Before we continue our analysis, we assume the following [19]:
-
There are no infinite switching accumulation points in time.
-
The state does not have jump discontinuities.
Accordingly, we define the switched control of our system as a duplet of finite sequence of modes and a finite sequence of switching times \(t_0<t_1<... <t_f\).
Our optimal control cost function is defined, in Bolza form, as the functional
with the running cost \(L_{\sigma (t)}(t,x(t))\) is given by
where the term \( (\alpha I(t) +\eta T (t)) \) represents the outflow from infected classes at time t [12], and \(\sigma (t)\in \{0,1\}\).
The switched optimal control problem becomes
subject to
where J is defined by (5) and \(\sigma (t)\in \{0,1\}\).
Following the approach in [19], we use Lagrange polynomials to transform the system (8) to a continuous non-switched control system. Therefore, we introduce a new continuous control variable \(w \in \varOmega =\{w\in { I\! R}\,\big |\,g(w)=0\}\), where
Let the kth Lagrange polynomial, \(l_k(w),\ k=0,1\), be defined by
Then, according to Proposition 4 in [19], we can write system (8) as the following equivalent continuous system with polynomial dependence, \(\mathscr { F}(x,w)\), in the new control variable \(w\in \varOmega \):
Similarly, the running cost \(L_{\sigma (t)}(t,x(t))\) is equivalently represented by the polynomial \(\mathscr { L}(x,w) \) of degree 1 in w:
and the cost function J in (5) becomes
Finally, the polynomial equivalent optimal control problem (PEOCP) can be stated as
subject to
with \(x(0)=x_0\), a given initial state. The polynomial constraint \(w\in \varOmega \) (\(g(w)=0\)) makes the problem nonconvex, as the feasible set \(\varOmega \) is non convex. To overcome the nonconvexity of the problem, the moments approach, described in the next section, is used to redefine the PEOCP in terms of moment variables which will render the optimization problem convex.
4 Relaxation Using Moments Approach
In this section, the moments approach is described for the relaxation of the PEOCP which transforms the nonconvex PECOP into convex semidefinite programs (SDPs). This approach is based on the concepts of moment and localizing matrices of probability measures supported in \(\varOmega \).
4.1 Moment and Localizing Matrices
The concept of moment and localizing matrices of a probability measure is described in details in [13, 14]. For the convenience of the reader, we report only the important aspects.
Let \(\mathscr {P}_r\) be the space of univariate polynomials of degree at most r in the variable \(x\in { I\! R}\). If \(\mu \) is a probability measure supported in some set \(A\subset { I\! R}\), the ith moment of \(\mu \) is defined as
with \(m_0=1\). If \(p(x)\in \mathscr { P}_r\) of degree r, \(\displaystyle p(x)=\sum _{i=0}^r p_{i} x^{i}, \) then
Now, if \(m=\{m_{j}\}_{j=0}^{2r}\) is a sequence a moments of some probability measure \(\mu \), the moment matrix \(M_r(m)\) is defined as the symmetric \((r+1)\times (r+1)\) matrix with (i, j) entries \(M_r(m)(i,j)=m_{i+j},\ 0\le i,j\le r\), i.e.,
The localizing matrix relative to a polynomial q(x) is defined as follows. Given a polynomial q(x) of degree s, \(\displaystyle q(x)=\sum _{i=0}^s q_{i} x^{i} \), the localizing matrix denoted by \(M_r(q\,m)\) is defined as the symmetric matrix of size \((r+1)\times (r+1)\) with (i, j) entries, \(0\le i,j\le r\), given by
As an example, in the case of \(r=3\), the moment matrix \(M_3(m)\) is
If \(q(x)=2-x^2\), \(\{q_i\}=\{2,0,-1\}\), the (i, j) entries of the localizing matrix is given by \(M_3(q\,m)(i,j)=2m_{i+j} -m_{i+j+2}\), i.e.,
A key property of \(M_r(m)\) and \(M_r(q\,m)\) used in this paper is their positive semidefiniteness stated in the following proposition.
Proposition 1
If \(m=\{m_i\}\) is a sequence of moments of some probability measure \(\mu \) supported in some set \(A\subset { I\! R}\) and \(q(x)=\sum \limits _k q_k x^k\) is a polynomial with \(q(x)\ge 0\), \(\forall \ x\in A\), then the matrices \(M_r(m)\) and \(M_r(q\,m)\) are positive semidefinite.
Proof
Let \(c=(c_0,c_1,\ldots ,c_r)\in { I\! R}^{r+1}\). Let \(\displaystyle p(x)=\sum _{i=0}^r c_i x^i\). Then
which prove the positive semidefiniteness of \(M_r(m)\) and \(M_r(q\,m)\), since c is an arbitrary vector in \({ I\! R}^{r+1}\).
4.2 Semidefinite Programs Using Moments Approach
It has been shown in [13], see also [14], that the minimisation problem (14) is equivalent to the minimisation problem
that is,
where \(P(\varOmega )\) is the space of probability measures supported in \(\varOmega \). Since J is a polynomial of degree 1 in w (see (12) and (13)), we can rewrite the minimisation problem in terms of the moments of \(\mu \) as
where \(\alpha _{00}=1, \alpha _{01}=-1, \alpha _{10}=0, \alpha _{11}=1\), are the coefficients of the Lagrange polynomials \(l_0(w)\) and \(l_1(w)\) in (10), and \(\mathscr { M}\) is the space of moments defined by
The system state, Eq. (15), is rewritten in terms of the moments \(m_i\) as
The constraint \(m\in \mathscr {M}\) in (17) states that m is a vector of moments of some probability measure. This implies that
The constraint on the control variable \(w\in \varOmega \), \(g(w)=w(w-1)=w^2-w=0\), is written as two inequality constraints:
The degree of both constraint functions \(g_1\) and \(g_2\) is even \(({=}2)\), so following the results in [13], we consider the family of relaxed convex SDPs, with relaxation order \(r\ge \max (\text {degree}(g_1)/2,\text {degree}(g_2)/2)=1\):
It was shown also in [13] that \(\min \,\) SDP\(_r\) is an increasing sequence of lower bounds for \(\min \,J\), and as \(r\longrightarrow \infty \), \(\min \,\) SDP\(_r\,\uparrow \min J\).
For the lowest order of relaxation \(r=1\), we have the following SDP
It is worth mentioning that one can use a higher relaxation order r but the number of moment variables will increase, which can make the problem numerically inefficient. However, it is found that in many situations the lowest order of relaxation can achieve the optimal value. In our simulation, we treat our problem with the lowest order of relaxation \(r=1\).
5 Numerical Implementation
In this section, we explain the numerical implementation steps used to solve (22). The SDP in (22) is a constrained minimisation problem over the moments m(t) which are time dependent. We discretize the interval \([t_0,t_f]\) with nodal points \(t_i\), \(i=0,1,\ldots ,N\), with \( t_N=t_f\), using a uniform step h. Denote by \({\mathbf m_i}\) the vector of the ith moments, i.e., \({\mathbf m_i}=\{m_i(t_j)\}_{j=0,1,\ldots ,N-1}\). Note that \({\mathbf m_0}=[1,\ 1, \ldots ,\ 1]\), since the zeroth moment \(m_0=1\) for all t. Let the vector \({\mathbf m}=[{\mathbf m_1} \ {\mathbf m_2}]\) of length 2N.
The integral defining the objective function and the state constraint differential equation in (22) are descritized using appropriate quadratures. A trapezoidal rule quadrature for the integral and a one-step forward discretization of the state equation give the following discrete version of (22):
where the minimisation is now over the vector \({\mathbf m}=[{\mathbf m_1} \ {\mathbf m_2}]\).
Problem (23) is solved using the built in Matlab function fmincon, which is a function designed for solving numerically nonlinear constrained minimization problems.
Once an optimal solution \(\mathbf {m}^*(t_j)=(m_1^*(t_j), m_2^*(t_j))\) of (23) is reached, the switching signal \(\sigma (t_j)\) is determined using a rank condition [19] as follows. If \(\mathrm {rank}(\textit{M}_1(\mathbf {m}^*(\textit{t}_\textit{j})))=\text{ rank }(\textit{M}_0(\mathbf {m}^*(\textit{t}_\textit{j})))=1\), then the optimal switching signal at \(t_j\) is \(\sigma (t_j)=m_1(t_j)\), otherwise we use a sum up rounding procedure [21] as follows
where \(\lceil \cdot \rceil \) and \(\lfloor \cdot \rfloor \) are the ceiling and floor functions, respectively.
6 Numerical Simulation
To illustrate our model, we need to simulate the results of our analysis. We choose the influenza pandemic as parameters of our model. The following parameters can be found in different papers that have studied the influenza pandemic. In our case, we used the parameters for models that studied the control strategy via vaccination and treatment [8, 10, 11]. The parameters are presented in Table 1.
The simulations illustrated in Fig. 2 describe the plot of the relaxed moment solution function \(m_1^*(t_j)\) and the switching signal \(\sigma (t_j)\). Figure 3 depicts the time series of the three compartments’ populations considered in the model.
The optimal moment function and optimal switching signal showed that range of the switches corresponding to optimal solution is between \(t=0\) to \(t=26\) time units (which is days in the case of influenza) to treat the infected population. After that time there is no need for treatment. This finding is reflected on the time series in Fig. 3 where the peak size and the peak time of the pandemic curve of \(u=1\) (in red), which represent the full availability of the treatment at any given time, completely match the case of optimal switched control. This shows that we can achieve the same outcome of controlling the pandemic antiviral treatment by only treating (on and off) for a a limited period of time, hence, avoiding the consequences of the long term antiviral treatment which may exhaust drug stockpile and may develop drug resistance.
7 Conclusion
In this paper, we studied the optimal control problem of a SITR model. The control aimed to optimize the number of infected and treated population via only one control agent, i.e. the treatment. The method used for solving the optimal control problem of switched nonlinear systems was based on a polynomial approach developed by Mojica-Nava et al. [19]. The method based on transforming the problem into a polynomial system which was transformed into a relaxed convex problem using the method of moments [13].
Our results showed that, by using this approach, we can achieve the same outcome of continuous treatment by only limiting treatment for period of time. This indicates that if the treatment is not available or run-out after a specific time, the outcome of the pandemic would be the same as if treatment is available at all times. It is important to mention that the suggested control switches are all in the early time of the pandemic, which line-up with the results in [1, 10]. Although the antiviral drug in a pandemic, like influenza, has been considered as the first line of the defence [1], the long term use of this drug could lead to the development of drug-resistance. This finding also suggests a solution to the long and extensive use of the antiviral drug by limiting its use (on and off) in the beginning of the pandemic and for a limited period of time.
The model suggested in this work is very simple and does not include other control strategies such as vaccination and isolation, that are used to protect the public health in the case of pandemics such as influenza. Our next step is to include these defence measures as switched control in more extended models that include all different levels of heterogeneities.
References
Arino, J., Bowman, C.S., Moghadas, S.M.: Antiviral resistance during pandemic influenza: implications for stockpiling and drug use. BMC Infect. Dis. 9(8) (2009). doi:10.1186/1471-2334-9-8
Behncke, H.: Optimal control of deterministic epidemics. Optim. Control Appl. Methods 21, 269–285 (2000)
Bemporad, A., Morari, M.: Control of systems integrating logic, dynamics, and constraints. Automatica 35(3), 407–427 (1999)
Bemporad, A., Morari, M., Dua, V., Pistikopoulos, E.N.: The explicit solution of model predictive control via multiparametric quadratic programming. Proc. Am. Control Conf. Chicago 872–876 (2000)
Bengea, S., DeCarlo, R.: Optimal control of switching systems. Automatica 41, 11–27 (2005)
Brauer, F.: General compartmental epidemic models. Chin. Ann. Math. 31B(3), 289–304 (2010). doi:10.1007/s11401-009-0454-1
Brauer, F.: Age of infection epidemic models. MTBI May 2015
Chowell, G., Ammon, C.E., Hengartner, N.W., Hyman, J.M.: Transmission dynamics of the great influenza pandemic of 1918 in Geneva, Switzerland: assessing the effects of hypothetical interventions. J. Theor. Biol. 241(2), 193–204 (2006)
Dmitruk, A.V., Kaganovich, A.M.: The hybrid maximum principle is a consequence of Pontryagin maximum principle. Syst. Control Lett. 57(11), 964–970 (2008)
Feng, Z., Towers, S., Yang,Y.: Modeling the effects of vaccination and treatment on pandemic influenza. AAPS J. 13(3) (2011)
Gani, R., Hughes, H., Fleming, D., Grifin, T., Medlock, J., Leach, S.: Potential impact of antiviral use during influenza pandemic. Emerg. Infect. Dis. 11, 1355–1362 (2005)
Jaberi-Doraki, M., Moghadas, S.M.: Optimal control of vaccination dynamics during an influenza epidemic. Math. Biosci. Eng. 11, 5 (2014)
Lasserre, J.: Global optimization with polynomials and the problem of moments. SIAM J. Optim. 11(3), 796–817 (2001)
Lasserre, J.: Semidefinite programming vs LP relaxations for polynomial programming. Math. Oper. Res. 27(2), 347–360 (2002)
Lee, S., Chowell, G., Castillo-Chávez, C.: Optimal control for pandemic influenza: the role of limited antiviral treatment and isolation. J. Theor. Biol. 265(2), 136–150 (2010)
Lenhart, S., Workman, J.T.: Optimal Control Applied to Biological Models. Chapman and Hall/CRC (2007)
Liberzon, D.: Switching in Systems and Control. Systems & Control: Foundations and Applications series. Birkhauser, Boston (2003)
Longini Jr., I.M., Halloran, M.E., Nizam, A., Yang, Y.: Containing pandemic influenza with antiviral agents. Am. J. Epidemiol. 159(7), 623–633 (2004)
Mojica-Nava, E., Quijano, N., Rakoto-Ravalontsalama, N.: A polynomial approach for optimal control of switched nonlinear systems. Int. J. Rub. Nonlinear. Control 24, 1797–1808 (2014)
Pontryagin, L.S., Boltyanskii, V.G., Gamkrelidze, R.V., Mishchenko, E.F.: The Mathematical Theory of Optimal Processes. Translated by K. N. Trirogoff. Classics of Soviet Mathematics. Original. Gordon & Breach Science Publishers, New York, NY (1961)
Sager, S.: Reformulations and algorithms for the optimization of switching decisions in nonlinear optimal control. J. Process Control 19(8), 1238–1247 (2009)
Sunmi, L., Gerardo, C., Castillo-Chavez, C.: Optimal control for pandemic influenza: the role of limited antiviral treatment and isolation. J. Theoret. Biol. 265, 136–150 (2010)
Sussmann, H.: A maximum principle for hybrid optimal control problems. In: Proceedings of the 38th IEEE Conference on Decision and Control, Phoenix, vol. 1, pp. 425-430 (1999)
Rao, A.V.: A survey of numerical methods for optimal control. Adv. Astron. Sci. 135(1), 497–528 (2009)
Rachah, A., Torres, D.F.M.: Mathematical Modelling, Simulation, and Optimal Control of the 2014 Ebola Outbreak in West Africa. Discrete Dynamics in Nature and Society Volume 2015, Article ID 842792, 9 pages, 2015, http://dx.doi.org/10.1155/2015/842792
Riedinger, P., Daafouz, J., Iung, C.: Suboptimal switched controls in context of singular arcs. In: Proceedings of the 42nd IEEE Conference on Decision and Control, Hawaii, pp. 6254–6259 (2003)
Shaikh, M.S., Caines, P.E.: On the hybrid optimal control problem: theory and algorithms. IEEE Trans. Autom. Control 52(9), 1587–1603 (2007)
Shillcutt, S., Morel, C., Goodman, C., Coleman, P., Bell, D., Whitty, C.J.M., Mills, A.: Cost effectiveness of malaria diagnostic methods in sub-saharan africa in an era of combination therapy. Bull. World Organ. 86(2), 101–110 (2008)
Xu, X., Antsaklis, P.J.: Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans. Auto. Cont. 49(1) (2004)
Acknowledgements
The authors would like to thank the reviewer for the valuable comments and suggestions which help improve the quality of this work. The research of A.T and M.A.H is supported by the College of Sciences individual grant at United Arab Emirates University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Tridane, A., Hajji, M.A., Mojica-Nava, E. (2017). Optimal Drug Treatment in a Simple Pandemic Switched System Using Polynomial Approach. In: Abualrub, T., Jarrah, A., Kallel, S., Sulieman, H. (eds) Mathematics Across Contemporary Sciences. AUS-ICMS 2015. Springer Proceedings in Mathematics & Statistics, vol 190. Springer, Cham. https://doi.org/10.1007/978-3-319-46310-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-46310-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46309-4
Online ISBN: 978-3-319-46310-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)