Acessibilidade / Reportar erro

Adaptive GMRES(m) for the Electromagnetic Scattering Problem

ABSTRACT

In this article, an adaptive version of the restarted GMRES (GMRES(m)) is introduced for the resolution of the finite difference approximation of the Helmholtz equation. It has been observed that the choice of the restart parameter m strongly affects the convergence of standard GMRES(m). To overcome this problem, the GMRES(m) is formulated as a control problem in order to adaptively combine two strategies: a) the appropriate variation of the restarted parameter m, if a stagnation in the convergence is detected; and b) the augmentation of the search subspace using vectors obtained at previous cycles. The proposal is compared with similar iterative methods of the literature based on standard GMRES(m) with fixed parameters. Numerical results for selected matrices suggest that the switching adaptive proposal method could overcome the stagnation observed in standard methods, and even improve the performance in terms of computational time and memory requirements.

Keywords:
iterative method; adaptive GMRES(m); electromagnetic scattering

RESUMO

Este artigo apresenta uma versão adaptativa do GMRES com reinício (GMRES(m)) para a resolução da aproximação por diferenças finitas da equação de Helmholtz. Foi observado que a escolha do parâmetro de reinicialização m afeta fortemente a convergência do GMRES(m). Para contornar este problema, o GMRES(m) é formulado como um problema de controle, que permite combinar adaptativamente duas estratégias: a) a variação apropriada do parâmetro de reinicialização m, se for detectado um estancamento na convergência; e b) o aumento do subespaço de busca, usando vetores obtidos em ciclos anteriores. A proposta é comparada com métodos iterativos semelhantes aos obtidos na literatura. Os resultados numéricos sugerem que o método adaptativo de comutação pode contornar o estancamento observado em métodos conhecidos e até mesmo melhorar o desempenho computacional e os requisitos de memória.

Palavras-chave:
método iterativo; GMRES(m) adaptável; espalhamento eletromagnético

1. INTRODUCTION

This article deals with the numerical resolution of a Helmholtz scattering problem by using an adaptive version of the restarted GMRES. The resolution of the Helmholtz scattering equation using iterative methods is particularly difficult since the problem is ill-posed for a set of frequencies that physically corresponds to the resonance modes of the domain to be solved, the discretization grid has to be refined as a function of the frequency of the operator, and the oscillatory and non-local structure of the solution affects the numerical methods 1010. O.G. Ernst & M.J. Gander. Why it is difficult to solve Helmholtz problems with classical iterative methods. In “Numerical analysis of multiscale problems”. Springer (2012), pp. 325-363.. As a consequence, fast methods (like multigrid) and preconditioners (like incomplete LU) fail to give fast convergence for discretizations of the Helmholtz equation; in fact, the improvement of numerical methods and preconditioners for this kind of problems are an active area of research 77. K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705.
http://www.sciencedirect.com/science/art...
), (1010. O.G. Ernst & M.J. Gander. Why it is difficult to solve Helmholtz problems with classical iterative methods. In “Numerical analysis of multiscale problems”. Springer (2012), pp. 325-363.), (1111. M.J. Gander, I.G. Graham & E.A. Spence. Applying GMRES to the Helmholtz equation with shifted Laplacian preconditioning: what is the largest shift for which wavenumber-independent convergence is guaranteed? Numerische Mathematik, 131(3) (2015), 567-614..

The design of a preconditioner is not a trivial task, since it involves the knowledge of the problem, with the possibility of being extremely expensive. In the context of this work, the discretization of the Helmholtz equation yields a linear system of equations that is hard to solve. This occurs because linear systems can be highly indefinite, leading to difficulties when attempting to extract effective preconditioners 55. E. Chow & Y. Saad. Experimental study of ILU preconditioners for indefinite matrices. Journal of Computational and Applied Mathematics, 86(2) (1997), 387-414.. For instance, the standard incomplete LU is ineffective, and in some cases, it does not assure a better rate of convergence 1919. D. Osei-Kuffuor & Y. Saad. Preconditioning Helmholtz linear systems. Applied numerical mathematics, 60(4) (2010), 420-431. and when it is used with GMRES, the performance deteriorates as the wavenumber becomes larger 1010. O.G. Ernst & M.J. Gander. Why it is difficult to solve Helmholtz problems with classical iterative methods. In “Numerical analysis of multiscale problems”. Springer (2012), pp. 325-363.. For improvement, a static alternative consists in modifying the diagonal of the matrix A by adding purely imaginary values 1919. D. Osei-Kuffuor & Y. Saad. Preconditioning Helmholtz linear systems. Applied numerical mathematics, 60(4) (2010), 420-431., while a dynamic alternative consists in using a flexible method allowing to change the preconditioner at each step 88. H.C. Elman, O.G. Ernst & D.P. O’leary. A multigrid method enhanced by Krylov subspace iteration for discrete Helmholtz equations. SIAM Journal on scientific computing, 23(4) (2001), 1291-1315.), (2121. V. Simoncini & D.B. Szyld. Recent computational developments in Krylov subspace methods for linear systems. Numerical Linear Algebra with Applications, 14(1) (2007), 1-59.. Unfortunately, the aforementioned strategies require the selection of some parameters, which may be hard to tune. Moreover, when solving the Helmholtz equation, it is generally expected that an iterative method with good convergence properties will benefit from a good preconditioner. But a preconditioner can mask the convergence problems of a certain iterative method. Thus to have good matching towards convergence between the iterative method and the preconditioner, the improvement of the iterative method is an important issue in the resolution of the Helmholtz equation.

Generalized Minimal Residual Method (GMRES) is an iterative method frequently selected for its robustness in problems whose discretization results in a large sparse non-Hermitian linear system 2020. Y. Saad & M. Schultz. GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems. SIAM Journal on Scientific and Statistical Computing, 7(3) (1986), 856-869. doi:10.1137/0907058.
https://doi.org/10.1137/0907058...
. This method approximates the solution of the linear system Au=f at each iteration, where An×n is nonsingular and u,fn. GMRES is a method based on Krylov subspace which obtains at each iteration an approximate solution by minimizing 2-norm of the residual, building an orthogonal basis for the Krylov subspace. To maintain the computational and memory requirement of the orthogonalization process under control, the GMRES is restarted, i.e., the dimension of the Krylov subspace is allowed to grow to a certain maximum m and then, using the obtained approximation of the solution, a new residual is computed and a new Krylov subspace is built. This procedure allows to maintain the dimension of the Krylov subspace at m at the most, and consequently keep the cost under control for the orthogonalization at each cycle of the GMRES(m).

Unfortunately, the convergence to the solution is not guaranteed if the selection of the fixed parameter m is not appropriate, causing slowdown or, even more serious, stagnation in its rate of convergence 2121. V. Simoncini & D.B. Szyld. Recent computational developments in Krylov subspace methods for linear systems. Numerical Linear Algebra with Applications, 14(1) (2007), 1-59.. If the rate of convergence presents stagnation, a simple alternative consists of enlarging the maximum allowed dimension m, enlarging the subspace information. However, this strategy does not always ensure faster convergence (9), 2121. V. Simoncini & D.B. Szyld. Recent computational developments in Krylov subspace methods for linear systems. Numerical Linear Algebra with Applications, 14(1) (2007), 1-59.. It is necessary to include another kind of information or modify the search subspace. Several adaptive strategies to modify the restart parameter are encountered in the literature (see for instance 1515. W. Joubert. On the convergence behavior of the restarted GMRES algorithm for solving nonsymmetric linear systems. Numerical Linear Algebra with Applications, 1(5) (1994), 427-447. doi:10.1002/nla.1680010502. URL http://doi.wiley.com/10.1002/nla.1680010502.
http://doi.wiley.com/10.1002/nla.1680010...
). In 1212. M. Habu & T. Nodera. GMRES(m) algorithm with changing the restart cycle adaptively. In “Proceedings of Algorithmy 2000 Conference on Scientific Computing” (2000), pp. 254-263., the use of a stagnation test was proposed; 2525. L. Zhang & T. Nodera. A new adaptive restart for GMRES(m) method. ANZIAM Journal, 46 (2005), 409-425. doi:10.21914/anziamj.v46i0.968. URL http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/968.
http://journal.austms.org.au/ojs/index.p...
was based on the difference of the Ritz and harmonic Ritz values; 11. A. Baker, E. Jessup & T. Kolev. A simple strategy for varying the restart parameter in GMRES(m). Journal of Computational and Applied Mathematics, 230(2) (2009), 751-761. doi:10.1016/J.CAM.2009.01.009. URL https://www.sciencedirect.com/science/article/pii/S0377042709000132.
https://www.sciencedirect.com/science/ar...
presented a simple strategy based on the angles between consecutive residual vectors for modifying the restart parameter; and 66. R. Cuevas Núñez, C.E. Schaerer & A. Bhaya. A proportional-derivative control strategy for restarting the GMRES(m) algorithm. Journal of Computational and Applied Mathematics, 337 (2018), 209-224. doi:10.1016/J.CAM.2018.01.009. URL https://www.sciencedirect.com/science/article/pii/S037704271830030X.
https://www.sciencedirect.com/science/ar...
introduced a proportional-derivative control-inspired strategy for choosing the parameter m adaptively. Other modification strategies are hybrid iterative methods and acceleration techniques 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
. Our work is framed into the category of augmented methods that is a class of acceleration techniques. Some augmented methods are presented in 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
), (1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
), (1717. R.B. Morgan. GMRES with Deflated Restarting. SIAM Journal on Scientific Computing, 24(1) (2002), 20-37. doi:10.1137/S1064827599364659. URL http://epubs.siam.org/doi/10.1137/S1064827599364659.
http://epubs.siam.org/doi/10.1137/S10648...
), (2323. Z. Teng & X. Wang. Heavy Ball Restarted CMRH Methods for Linear Systems. Mathematical and Computational Applications, 23(1) (2018), 10..

In this work, we concentrate our efforts on the improvement of the convergence of the GMRES method itself. To this end, an adaptive control strategy is proposed which includes information from previous cycles for overcoming the stagnation. The proposed strategy is used for the resolution of a linear system of equations obtained from the discretization of an electromagnetic cavity problem 1414. J. Jin. “The Finite Element Method in Electromagnetics”. Wiley (2015).. For this problem, the standard GMRES(m) (and modified implementations using fixed parameters 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
), (1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
) have a poor rate of convergence for large wave numbers 77. K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705.
http://www.sciencedirect.com/science/art...
. Numerical results for the electromagnetic cavity problem with large wave numbers illustrate the efficiency of the proposed method.

This paper is organized as follows. In §2, the formulation of GMRES(m) is introduced and the Electromagnetic Scattering Problem is characterized. In §3, the strategies for overcoming the stagnation are described. The numerical results (presented in §4 with conclusion in §5), show that the adaptive strategy improves the convergence of GMRES(m).

Throughout this paper, ℂn×m is the set of all n × m complex matrices. I n is the n × n identity matrix, and e j is its j-th column. Given a matrix M, M T denotes its transpose and M* its conjugate transpose or Hermitian transpose. Notation ║ ║ denotes the 2-norm for vectors and the induced norm for matrices. The inner product is denoted as 〈·,·〉.

2 GMRES(M) AND ITS MODIFICATIONS

GMRES(m) approximates the solution to the linear system at the j-th restart cycle using the previous residual, rj1=fAuj1, for constructing a Krylov subspace of Hm(A,rj1)=spanrj1,Arj1,...,Am1rj1 of dimension m. The j-th approximation is built as

u j = u j 1 + H m ( A , r j 1 ) , (2.1)

where the index m denotes that the restarting parameter was set to the value m. GMRES(m) obtains an approximate solution which minimizes the 2-norm of the residual r j , i.e.,

m i n u j u j - 1 + H m a , r j - 1 f - A u j . (2.2)

To solve this problem, the Arnoldi process is normally used for obtaining an orthonormal basis for the Krylov subspace. At the j-th cycle, the first m steps of this procedure can be expressed as:

A V m = V m + 1 H ~ m , (2.3)

where Vmn×m and Vm+1:=[Vmvm+1]n×(m+1) have orthonormal columns and H~m(m+1)×m is the upper Hessenberg matrix formed by an upper matrix H m of dimension m × m and an entry h m+1,m placed at position (m+1,m). If the Arnoldi process starts with v1=(1β)rj1, where β=rj1, then by construction the columns of V m are an orthogonal basis of the subspace Km(A,rj1).

The approximate solution u j is obtained by uj=uj1+Vmyj 2020. Y. Saad & M. Schultz. GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems. SIAM Journal on Scientific and Statistical Computing, 7(3) (1986), 856-869. doi:10.1137/0907058.
https://doi.org/10.1137/0907058...
and the expression (2.2) becomes,

m i n y j r j 1 A V m y j . (2.4)

Therefore, the approximate solution u j minimizes the residual norm. GMRES(m) does not maintain orthogonality between approximation spaces generated at successive restarts 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
), (2020. Y. Saad & M. Schultz. GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems. SIAM Journal on Scientific and Statistical Computing, 7(3) (1986), 856-869. doi:10.1137/0907058.
https://doi.org/10.1137/0907058...
. As a result, GMRES(m) exhibits a slower rate of convergence than its counterpart the GMRES. The problem arises when the residual norm between consecutive cycles does not have an adequate decrease, i.e., when an abrupt slowering occurs in its rate of convergence. A more extreme situation appears when the rate of convergence exhibits a stagnation, i.e. when the reduction in the residual norms at consecutive cycles is very small, i.e., rjrj1. Therefore, the residual vectors point in nearly the same direction at the end of every restart cycle, i.e., (rj,rj1)0, meaning that the GMRES(m) did not introduce a large decrease in the residual norm between consecutive cycles 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
), (66. R. Cuevas Núñez, C.E. Schaerer & A. Bhaya. A proportional-derivative control strategy for restarting the GMRES(m) algorithm. Journal of Computational and Applied Mathematics, 337 (2018), 209-224. doi:10.1016/J.CAM.2018.01.009. URL https://www.sciencedirect.com/science/article/pii/S037704271830030X.
https://www.sciencedirect.com/science/ar...
.

There are several strategies for modifying GMRES(m) to accelerate and avoid stagnation. In this paper, we focus on the so-called augmented methods. The general idea consists in determining a subspace of dimension s, as the direct sum of two spaces of smaller dimension, denoted as spanν1,...,νm,ω1,...,ωk where the first m vectors are determined using the standard Arnoldi procedure with the current residual normalized, i.e., rj1/rj1; while the remaining vectors, which consist of the augmented part, contain relevant information saved from outer cycles. Two alternative methods are explored. The first one is the GMRES-E(m, d), proposed in 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
. This method computes ω1,...,ωd as harmonic Ritz vectors associated with the smallest harmonic Ritz value. This strategy seems to be particularly effective when a priori information on the problem confirms the presence of a group of relative small eigenvalues, which occurs in Electromagnetic Scattering Problem 77. K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705.
http://www.sciencedirect.com/science/art...
. The second method is the LGMRES(m, l) proposed in 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
. In this case, at each restart cycle an approximate solution is constructed by using the first m vectors ν 1 , . . . , ν m and an additional basis ω 1 , . . . , ω l , in which each of the vectors contains error information of the each previously built l subspaces. Next, the above methods are described.

GMRES-E(m, d): Including approximate eigenvectors. The goal consists in the elimination of the components that supposedly slow down convergence 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
. The strategy consists of enriching the subspace by introducing eigenvectors associated to the problematic eigenvalues. In practice, the approximate eigenvectors are the harmonic Ritz vectors associated to the harmonic Ritz values per cycle 33. J.C. Cabral, P. Torres & C.E. Schaerer. On control strategy for stagnated GMRES(m). J. Comp. Int. Sci., 14 (2017), 109-118. URL http://epacis.net/jcis/PDF_JCIS/JCIS11-art.0127.pdf.
http://epacis.net/jcis/PDF_JCIS/JCIS11-a...
), (1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
), (1818. Q. Niu & L. Lu. Restarted GMRES method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations. International Journal of Mathematical and Computational Sciences, 6 (2012). URL https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf.
https://pdfs.semanticscholar.org/111c/4c...
.

At the j-th cycle, the harmonic Ritz value λ~k with the associated harmonic Ritz vector ϑk=Wsgk, where gks, with respect to the subspace A𝒦s(A,rj1) satisfies the following expression

( A ϑ k λ ~ k ϑ k ) A K s ( A , r 0 ) , (2.5)

which implies,

A W s H A W s g k - λ ~ k W s g k = 0 , W s H A H A W s g k = λ ~ k W s H A H W s g k . (2.6)

Using the Arnoldi relation,

A W s = V s + H ~ s 1 (2.7)

where W s is a n × s matrix, its first m columns are Arnoldi’s vectors and the last d corresponds to the approximate eigenvectors ϑ k and V s+1 is the n×(s+1) orthonormal matrix whose first m+1 columns are the Arnoldi vectors and last d columns result from orthogonalizing the d approximation eigenvectors (ϑk,k=1,...,d) against the previous columns of Arnoldi’s vectors. H~s is an (s+1)×s upper Hessenberg matrix with its elements constructed by the new orthogonalization process. At the j-th cycle, the reduced generalized eigenvalue problem is defined using the expression (2.6) and the new Arnoldi relation (2.7).

H ~ s * H ~ s g k = λ ~ k H s * g k , (2.8)

where H~s* is the hermitian of the upper Hessenberg matrix whose dimension is s×(s+1) and Hs* is the hermitian of the Hessenberg matrix whose dimension is s × s. Usually the value of s is much less than n. These eigenvalues are called harmonic Ritz values and are the roots of the GMRES residual polynomial 2121. V. Simoncini & D.B. Szyld. Recent computational developments in Krylov subspace methods for linear systems. Numerical Linear Algebra with Applications, 14(1) (2007), 1-59.. The eigenvectors associated with these harmonic Ritz values are called harmonic Ritz vectors. Some g k associated with the smallest λ~k are needed to deflates the smallest eigenvalues and thus improves the convergence 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
), (1717. R.B. Morgan. GMRES with Deflated Restarting. SIAM Journal on Scientific Computing, 24(1) (2002), 20-37. doi:10.1137/S1064827599364659. URL http://epubs.siam.org/doi/10.1137/S1064827599364659.
http://epubs.siam.org/doi/10.1137/S10648...
. Since the harmonic Ritz vectors are useful only at an specific cycle, it needs to be recomputed at each cycle. For this reason, only the residuals are stored for being reused in the next cycle 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
.

At the end of the j-th restart cycle, GMRES-E(m, d) seeks the approximate solution u j of the form

u j = u j 1 + W s y j , (2.9)

such that y j is obtained by solving the following minimization problem

r j = f - A u j = m i n y j s + 1 β e 1 - H ~ s y j . (2.10)

where β=rj1. The sequence of the residual norm of the GMRES-E(m, d) has the property of being non-increasing but can not guarantee convergence 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
), (1818. Q. Niu & L. Lu. Restarted GMRES method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations. International Journal of Mathematical and Computational Sciences, 6 (2012). URL https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf.
https://pdfs.semanticscholar.org/111c/4c...
.

LGMRES(m, l): Including the error approximations in the search subspace. The motivation of LGMRES(m, l) is based on preventing an alternating behavior observed in the GMRES(m) residual at consecutive cycles which results in deteriorating the convergence 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
. LGMRES(m, l) includes approximations to the error in the current search subspace. The error approximation at the j-th restart cycle is defined by using the approximate solution at previous cycles as

φ j 1 = u j 1 u j 2 (2.11)

and φj0 for j<1. This error approximation vector is used for augmenting the search subspace K m (A, r j−1 ) at the next cycle. Note that φj𝒦m(A,rj2). Therefore, this error approximation φj in some sense represents the space K m (A, r j−2 ) generated in the previous cycle and subsequently discarded in the restarting procedure. Hence it is a natural choice for enriching the next approximation space 𝒦m (A, r j−1 ).

The augmented approximation space I=𝒦m(A,rj1)span{φk},k={(jl),...,(j1)} has dimension s=m+l. This method, instead of using 𝒦 m (A, r j−1 ) in equation (2.1), uses the subspace ℐ. The matrix V s+1 is the n×(s+1) orthonormal matrix whose first m+1 columns are the Arnoldi vectors and the last l columns result from orthogonalizing the l error approximation vectors (φk,k=(jl),...,(j1)) against the previous columns of Arnoldi vectors. W s is an n × s matrix whose first m columns are the orthogonalized Arnoldi vectors and the last l columns are the l most recent error approximations (typically normalized so that all columns are of unit length). Then the new relationship at the j-th cycle is

A W s = V s + 1 H ~ s (2.12)

holds for LGMRES(m, l), H~s denotes an (s+1)×s upper Hessenberg matrix. In practice, l<<m, following 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
l3 is a good choice for for LGMRES(m, l). Similar to expressions (2.9) and (2.10), the approximate solution at the j-th cycle is uj=uj1+Wsyj with Ws=[v1 v2...vm φjl...φj1] and y j minimize the residual norm ║r j ║.

Remark. It is important to remark that LGMRES is not helpful when one of the following situations occurs:

  • (a) when GMRES(m) skip angles ((rj,rj2)) are not small;

  • (b) when GMRES(m) sequential angles ((rj,rj1)) vary greatly from cycle to cycle;

  • (c) when GMRES(m) converges in a small number of iterations; or

  • (d) when GMRES(m) skip angles and sequential angles are near zero (indicating stagnation).

LGMRES is not typically a substitute for preconditioning and does not help when a problem stagnates for a given restart parameter. Possible improvements to the algorithm include a robust adaptive variant 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
.

A-LGMRES-E(m, d, l): Including approximate eigenvectors and errors approximations simultaneously with adaptive restart parameter. The proposed method, an adaptive version of GMRES(m) denoted as A-LGMRES-E(m, d, l), is inspired by the augmented method presented in 1818. Q. Niu & L. Lu. Restarted GMRES method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations. International Journal of Mathematical and Computational Sciences, 6 (2012). URL https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf.
https://pdfs.semanticscholar.org/111c/4c...
that combine the GMRES-E(m, d) and LGMRES(m, l) with fixed parameters. In problems with stagnation, according to remark (d) of LGMRES, the error approximation vectors do not help to improve the rate of convergence, i.e., φj1=uj1uj20. Hence, these errors vector are discarded and only the harmonic Ritz vectors are maintained to enrich the search subspace. As can be seen in the numerical results of the LGMRES-E, keeping constant m and enriching the search subspace, it does not necessarily avoid stagnation. To solve this problem a controller to augment the size of the search subspace is proposed for enlarging the Arnoldi basis, since decreasing the restart parameter does not contribute to an improvement in the convergence 44. J.C. Cabral F. & C.E. Schaerer. On adaptive strategy for overcome stagnation in LGMRES(m,l). In “XXXVIII Iberian Latin-American Congress on Computational Methods in Engineering” (2017).. This is done by adding a positive integer value α to the value m. Thus the search subspace is formed by the mj1+α Arnoldi vectors and d harmonic Ritz vectors, where m j−1 is the restart parameter of the previous cycle. The dimension of the search subspace at the j-th cycle is defined by the following rule:

s j = m j - 1 + l + d if y j - 1 δ m j - 1 + α + d if y j - 1 δ , (2.13)

where δ is the stagnation threshold parameter. A slow convergence is considered to occur when yj1<δ. The α and δ values are constant and are selected according to before works and numerical experiments (see Section 4). According to the previous rule, the matrix W s in the j-th cycle is formed in the following way,

W s = v 1 v m ϑ 1 ϑ d φ j - l φ j - 1 i f y j - 1 δ v 1 v m v m + 1 v m + α ϑ 1 ϑ d i f y j - 1 < δ . (2.14)

Finally, the approximate solution at the j-th cycle is,

u j = u j 1 + W s y j , (2.15)

where y j is the vector that minimizes the residual norm ║r j ║ and W s is a n × s j matrix containing the Krylov subspace enriched with information from previous cycles. Baker 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
and Morgan 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
suggest between 1 and 3 as the number of error approximations l and the harmonic Ritz vectors d, respectively; since the increase of these values does not significantly improve the decrease in the number of cycles necessary for convergence. In this work, the values l=1 and d=3 are chosen considering the above suggestions and giving more importance to the harmonic Ritz vectors, since the error approximations allow to accelerate the convergence but do not avoid stagnation. When the matrix is non-Hermitian and non-normal, as in the case of the problem addressed in this work, it is observed that the best selection of the aforementioned parameters is difficult to obtain since an a priori behavior of the iterative method with respect to the parameters is not completely understood.

The pseudocode for the j-th cycle of the proposed method denoted as A-LGMRES-E(m, d, l) is presented in the Algorithm 1.

Algorithm 1
The j-th cycle of A-LGMRES-E(m, l, d)

3 AN ELECTROMAGNETIC CAVITY PROBLEM

The electromagnetic problem observed at Figure 1 is focused on a 2-D geometry by assuming that the medium is invariant in the z-direction and nonmagnetic with constant magnetic permeability µ(x,y)=µ0. The ground plane (x-axis) and the wall of the cavity are perfect electric conductors, and the interior of the cavity is filled with inhomogeneous material characterized with its relative permittivity ε r (x, y) 77. K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705.
http://www.sciencedirect.com/science/art...
.

Figure 1:
The scattering geometry. εr=1 en Ω1 and εr=2 in Ω1 77. K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705.
http://www.sciencedirect.com/science/art...
), (2424. Y. Wang, K. Du & W. Sun. Preconditioning iterative algorithm for the electromagnetic scattering from a large cavity. Numerical Linear Algebra with Applications, 16(5) (2009), 345-363. doi:10.1002/nla.615. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/nla.615.
https://onlinelibrary.wiley.com/doi/abs/...
.

For a transverse magnetic (TM) polarization, in which the magnetic field is transverse to the invariant direction and the electric field is E=(0,0,u(x,y)), the modeling of the cavity problem yields the Helmholtz equation (3.1) together with a Sommerfeld’s radiation condition imposed at infinity (equation (3.3)):

Δ u + k 0 2 ε r u = f , i n Ω = [ 0 , a ] × [ b , 0 ] , (3.1)

u = 0 , o n S , (3.2)

n u = T ( u ) + g , o n Γ (3.3)

where k 0 is the free space wave number, Ω=[0,a]×[b,0]2 is the problem domain, f is the source term and f=0 in the free space, S denotes the walls of cavity, 𝒯 is a non-local boundary operator, Γ is the aperture between the cavity and the free space and g(x)=2iβeiαx.

The discretization by finite differences of equation (3.1) gives:

u i 1 , j 2 u i , j + u i + 1 , j h x 2 + u i , j 1 2 u i , j + u i , j + 1 h y 2 + k 0 2 ε r ( x i , y j ) u i , j = f ( x i , y j ) (3.4)

for i=1,2,...,M,j=1,2,...,N. The expression (3.2) is discretized by

u 0 , j = u M + 1 , j = u i , 0 = 0 , i = 1 , 2 , . . . , M , j = 1 , . . . , N . (3.5)

The discrete form of the non-local boundary condition (3.3) is given by

u i , N + 1 u i , N h y = l M g i l u l , N + 1 + g ( x i ) , i = 1 , . . . , M . (3.6)

For more details about the system of equations, see 77. K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705.
http://www.sciencedirect.com/science/art...
.

The discretization of Helmholtz problem (3.1)-(3.3) by finite differences yields a linear system of equations Au=f, in which the coefficient matrix A is non Hermitian and highly indefinite for large values of the wave number k 01111. M.J. Gander, I.G. Graham & E.A. Spence. Applying GMRES to the Helmholtz equation with shifted Laplacian preconditioning: what is the largest shift for which wavenumber-independent convergence is guaranteed? Numerische Mathematik, 131(3) (2015), 567-614.. In addition, the obtained linear system of equations is ill-conditioned and the growth of the mesh size (M and N) leads to very large matrices, and hence to high computational costs. Usually, direct methods do not perform well, and a general iterative method is required. GMRES is normally used in this context (non-Hermitian and indefinite matrices 2020. Y. Saad & M. Schultz. GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems. SIAM Journal on Scientific and Statistical Computing, 7(3) (1986), 856-869. doi:10.1137/0907058.
https://doi.org/10.1137/0907058...
) but due to the high computational and memory requirements the GMRES(m) is normally used. Unfortunately, as mentioned at the introduction section, §1, the possible problems of convergence of the GMRES(m) are exacerbated by the particularities of the Helmholtz problem described above. This is the reason way the A-LGMRES-E(m, d, l) is designed and numerically analyzed for the resolution of this problem.

The mesh size is determined by accuracy requirements on the discretization. The quantities,

λ h x = 2 π k 0 h x = 2 π k ( N + 1 ) , (3.7)

λ h y = 2 π k 0 h y = 2 π k ( M + 1 ) , (3.8)

are the numbers of mesh points per wavelength in both directions. A commonly employed engineering rule [8] states that, for a second order finite difference,

λ h x 10 o r , k 0 h x π / 5 , (3.9)

λ h y 10 o r , k 0 h y π / 5 , (3.10)

is required to obtain satisfactory results. This rule is used in this work, hence the number of points per wavelength is maintained as a constant, which means that the grid is refined as the wave number is increasing, i.e., when the wave number is increased, the values of M and N is also increased.

4 NUMERICAL EXPERIMENTS

The numerical experiments consider Ω=[0,1]×[0.25,0] filled with the non-homogeneous medium:

ε r = 2 i n Ω 1 = 0 . 2 , 0 . 8 × - 0 . 25 , - 0 . 20 , 1 i n Ω \ Ω 1 . (4.1)

The experiments were run on a computer with Intel Core i7-6700T with 8GB RAM, using the software MATLAB R2016a for Windows 10. The resulting linear system Au=f was solved with the following iterative methods: GMRES(m) 2020. Y. Saad & M. Schultz. GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems. SIAM Journal on Scientific and Statistical Computing, 7(3) (1986), 856-869. doi:10.1137/0907058.
https://doi.org/10.1137/0907058...
; GMRES-E(m, d) 1616. R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
https://doi.org/10.1137/S089547989325397...
using d harmonic Ritz vectors for augmenting the search subspace, whose dimension at each cycle is s=m+d; LGMRES(m, l) 22. A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
https://doi.org/10.1137/ S08954798034220...
using l errors approximation vectors for augmenting the search subspace, whose dimension at each cycle is s=m+l; LGMRES-E(m, l) 1818. Q. Niu & L. Lu. Restarted GMRES method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations. International Journal of Mathematical and Computational Sciences, 6 (2012). URL https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf.
https://pdfs.semanticscholar.org/111c/4c...
using l errors approximation vectors and d harmonic Ritz vectors for augmenting the search subspace, whose dimension at each cycle is s=m+l+d. For enriching the subspace in the proposed A-LGMRES-E(m j , l, d) method, if yjδ it is used an adaptive restart parameter mj=mj1,d harmonic Ritz vectors and l error approximation vectors; while if yj<δ it is used a restart parameter mj=mj1+α and d harmonic Ritz vectors only. In the latter case, the dimension at each cycle is according to rule (2.13).

It has also implemented a modified version of standard GMRES (m), that uses the rule (2.13) to modify adaptively the restart parameter and without any enrichment for the search subspace, i.e., l=d=0. This method is denoted as GMRES(m j ) and it is used for comparison purposes. The strategies that modify the restart parameter include a minimum m min and a maximum m max for it, i.e., mminmjmmax. The initial restart parameter is denoted as m 0 and is chosen m0=mmin for these strategies.

In Table 1 is presented the considered wave numbers k 0 and size of the grid for the matrices tested of the problem introduced in §3. In this table, the size, the number of nonzero matrix elements and the condition number of the matrix A are defined as size(A), nnz(A) and cond(A) respectively; M, N are discretization parameters. The minimum and the maximum eigenvalue (in magnitude) are represented by λ 1 and λ n , respectively. The initial solution is x0=0 for all numerical experiments in this section, the stopping criterion on the relative residual norm is rj/r0<106 or a maximum amount of 3000 restart cycles. The parameters considered for each method are summarized in Table 2. The harmonic Ritz vectors are obtained using the eigs MATLAB function with an initial vector of ones instead of using a random vector as it does by default. This allows to keep the same number of restarts cycles when a problem is running several times. The following parameters are those defined by default in the eigs function. Some of these principal parameters are tolerance of 10−6 and a maximum number of 300 iterations 2222. G.W. Stewart. A Krylov-Schur algorithm for large eigenproblems. SIAM Journal on Matrix Analysis and Applications, 23(3) (2002), 601-614.. For the cases where the method does not reach convergence before 3000 restart cycles, the method is stopped and the time is denoted as NC.

Table 1:
List of test problems in the cavity problem with different wave numbers and grids.

Table 2:
Parameters considered for each method.

Experimentally, it is observed that the values ║y j ║ are between 1E-01 and 1E-07 for the numerical tests of the GMRES(m) (see Table 3). Note that only four problems converged to the prescribed tolerance, which shows that the problem of the cavity is difficult for the GMRES(m) with m fixed and without subspace enrichment. The problems where the GMRES(m) exhibits stagnation (from cavity05 to cavity12) have in general a mean(║y j ║) lower than the problems where it converges faster (cavity01 and cavity02). This gives an idea of how susceptible is the method to suffer stagnation in case of the value of m remains constant. In this work, the stagnation threshold parameter is considered to be δ=0.5 and it is of the order of max(║y j ║) for problems without stagnation (see Table 3). The value of δ is chosen heuristically. Smaller values of δ could modify the values of m unnecessarily (recall that the modification of the value of m is given by the rule (2.13) and it is directly affected by the value of δ). With reference to the value of α, which is the increment of the restart parameter m when there is stagnation, previous works have used very small increments such as Δm=2 1313. M. Habu & T. Nodera. GMRES(m) algorithm with changing the restart cycle adaptively. In “Proceedings of Algorithmy 2000 Conference on Scientific Computing” (2000), pp. 254-263. and Δm=3 66. R. Cuevas Núñez, C.E. Schaerer & A. Bhaya. A proportional-derivative control strategy for restarting the GMRES(m) algorithm. Journal of Computational and Applied Mathematics, 337 (2018), 209-224. doi:10.1016/J.CAM.2018.01.009. URL https://www.sciencedirect.com/science/article/pii/S037704271830030X.
https://www.sciencedirect.com/science/ar...
when a stagnation is detected. In this work, we considered the same order of increase, but with a value of 4, i.e., according to our incremental rule, we consider α=4.

Table 3:
Results for GMRES(m) for each problem in Table 1.

Table 3 presents the behavior of the norm of the vector y j , when GMRES(m) method is used for all the tested problems. It is observed that the norm of the vector y j (see equation (2.15)) is small (less than 10−2) indicating a slowdown rate of convergence; i.e., rjrj1. Table 4 shows results on problems from Table 1 for the proposed method A-LGMRES-E. It is listed the numbers of cycles required for converging to rj/r0<10-6, as well as, min(||y j ||), mean(||y j || and max(║y j ║) which are the minimal, mean and maximal values of ║y j ║, respectively. A-LGMRESE converged to the prescribed tolerance in all cases, with exception of three problems: the cavity08, cavity09 and cavity12. For these problems, the proposed method achieves the lowest relative norm with respect to the other iterative methods tested (see Table 6).

Table 4:
Results for A-LGMRES-E(m j ,3,1) for each problem in Table 1.

Table 5:
Metrics for selected matrices and iterative methods: time in seconds and number of cycles required for rj/r0<10-6 (Cycles).

Table 6:
Relative residual norm for problems that do not converge before 3000 cycles for each method of Table 2.

Figures 2-(a) and 2-(b) show the convergence curves and the value ||y j || versus the number of restart cycles for the problems cavity03 and cavity04. It is observed that the A-LGMRES-E method, which includes information from previous cycles and updates the restart parameter according to rule (2.13), presents a similar rate of convergence to the GMRES(m j ) method, which updates only the restart parameter without including information from previous cycles. Also, in Figure 2, the search subspace dimension of the adaptive methods is compared in the second sub-figure of columns (a) and (b), that is, the value m j for GMRES(m j ) and the value s j for A-LGMRES-E(s j ). The value s j has lower growth than m j , and this allows a smaller number of matrix-vector multiplications for the A-LGMRES-E(s j ) in the first fifty cycles. In the third sub-figure, the controlled variable ||y j || are presented for the two methods. The values ||y j || of A-LGMRES-E(s j ) are relatively larger than the corresponding values provided by GMRES(m j ) but lower than the threshold δ in some cases, allowing the increase of the value s j more slowly than the m j of GMRES(m j ).

Figure 2:
Comparative numerical results for adaptive methods. Relative residual norm rj/r0; search subspace dimension (m j for GMRES(m j ) and s j for A-LGMRES-E(s j )) and controlled variable ║y j ║ for (a) cavity03 and (b) cavity04.

Comparing the augmented methods with information of previous cycles (see Figure 3), i.e. the LGMRES(m, l), GMRES-E(m, d), LGMRES-E(m, l, d) and A-LGMRES-E(m j , l, d); the A-LGMRES-E has better rate of convergence for the showed problems, having lowest execution times and number of restart cycles. Furthermore, the LGMRES(m, l) does not converge for the problems cavity06 and cavity11 (Figures 3-(c) and 3-(d)). This is also true for the LGMRESE(m, l, d), which combines error approximations and harmonic Ritz vectors 1818. Q. Niu & L. Lu. Restarted GMRES method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations. International Journal of Mathematical and Computational Sciences, 6 (2012). URL https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf.
https://pdfs.semanticscholar.org/111c/4c...
, when constant values of m, l and d are used. This shows that the addition of information vectors from previous cycles with fixed restart parameter is not enough to get the convergence, so an adjustment of m is needed to improve the rate of convergence.

Figure 3:
Convergence curves for the augmented methods A-LGMRES-E, LGMRES-E, LGMRES and GMRES-E: relative residual norm vs. number of restart cycles, for (a) cavity03, (b) cavity04, (c) cavity06 and (d) cavity10. Parameters for the adaptive strategy A-LGMRES-E: δ=0.5,α=4. NC means that the method does not reach convergence before 3000 cycles.

All implemented methods are compared in Table 5. It is observed that the method A-LGMRESE(m j , l, d) has lowest values for the number of cycles necessary for converging and produces steepest decrease in the rate of convergence with respect to the methods that use fixed parameter. For problems that do not converge, the proposed method achieves the best reduction of the relative residual norm ║r j/r 0║ with respect to the other methods tested. The best reduction of the relative residual norm for difficult problems are indicated by boldface in Table 6. It is observed that the methods with fixed parameters achieved lower reduction of the relative residual norm in cycles carried out with respect to the other tested methods.

5 CONCLUSION

An adaptive method based on a threshold criterion was introduced for identifying stagnation in the GMRES(m). The criterion yields the expansion of the search subspace for both improving the speed and overcoming the stagnation. The proposed method, as well as several standard methods, were implemented for the resolution of the finite difference approximation of the Helmholtz equation. Numerical experiments for different discrete domain sizes and values of wave number k 0 were compared, and the results show that the proposal is good enough to improve convergence when comparing with other iterative methods with either fixed parameters and enriched subspace, or adaptive parameters without subspace enrichment. The computation is especially challenging when k 0 is increased. In this case, a more exhaustive research is necessary for linear systems with large k 0 in order to identify what is more convenient; either to modify the restart parameter m or an appropriate augmentation of the search subspace for GMRES(m).

ACKNOWLEDGEMENTS

GEE thanks the technical support given by NIDTEC, Polytechnic School, UNA. JCC acknowledges the financial support given by CONACyT through scholarship Prociencia-2015 and the Vinculation Program for Scientists and Technologists PVCT18-32. CES thanks to the PRONII-CONACyT program.

REFERENCES

  • 1
    A. Baker, E. Jessup & T. Kolev. A simple strategy for varying the restart parameter in GMRES(m). Journal of Computational and Applied Mathematics, 230(2) (2009), 751-761. doi:10.1016/J.CAM.2009.01.009. URL https://www.sciencedirect.com/science/article/pii/S0377042709000132
    » https://doi.org/10.1016/J.CAM.2009.01.009» https://www.sciencedirect.com/science/article/pii/S0377042709000132
  • 2
    A. Baker, E. Jessup & T. Manteuffel. A Technique for Accelerating the Convergence of Restarted GMRES. SIAM Journal on Matrix Analysis and Applications, 26(4) (2005), 962-984. doi:10.1137/ S0895479803422014.
    » https://doi.org/10.1137/ S0895479803422014
  • 3
    J.C. Cabral, P. Torres & C.E. Schaerer. On control strategy for stagnated GMRES(m). J. Comp. Int. Sci., 14 (2017), 109-118. URL http://epacis.net/jcis/PDF_JCIS/JCIS11-art.0127.pdf
    » http://epacis.net/jcis/PDF_JCIS/JCIS11-art.0127.pdf
  • 4
    J.C. Cabral F. & C.E. Schaerer. On adaptive strategy for overcome stagnation in LGMRES(m,l). In “XXXVIII Iberian Latin-American Congress on Computational Methods in Engineering” (2017).
  • 5
    E. Chow & Y. Saad. Experimental study of ILU preconditioners for indefinite matrices. Journal of Computational and Applied Mathematics, 86(2) (1997), 387-414.
  • 6
    R. Cuevas Núñez, C.E. Schaerer & A. Bhaya. A proportional-derivative control strategy for restarting the GMRES(m) algorithm. Journal of Computational and Applied Mathematics, 337 (2018), 209-224. doi:10.1016/J.CAM.2018.01.009. URL https://www.sciencedirect.com/science/article/pii/S037704271830030X
    » https://doi.org/10.1016/J.CAM.2018.01.009» https://www.sciencedirect.com/science/article/pii/S037704271830030X
  • 7
    K. Du. GMRES with adaptively deflated restarting and its performance on an electromagnetic cavity problem. Applied Numerical Mathematics, 61(9) (2011), 977 - 988. doi: https://doi.org/10.1016/j.apnum.2011.04.003. URL http://www.sciencedirect.com/science/article/pii/S0168927411000705
    » https://doi.org/10.1016/j.apnum.2011.04.003» http://www.sciencedirect.com/science/article/pii/S0168927411000705
  • 8
    H.C. Elman, O.G. Ernst & D.P. O’leary. A multigrid method enhanced by Krylov subspace iteration for discrete Helmholtz equations. SIAM Journal on scientific computing, 23(4) (2001), 1291-1315.
  • 9
    M. Embree. The Tortoise and the Hare Restart GMRES. SIAM Review, 45(2) (2003), 259-266. doi:10.1137/S003614450139961. URL http://epubs.siam.org/doi/10.1137/S003614450139961
    » https://doi.org/10.1137/S003614450139961» http://epubs.siam.org/doi/10.1137/S003614450139961
  • 10
    O.G. Ernst & M.J. Gander. Why it is difficult to solve Helmholtz problems with classical iterative methods. In “Numerical analysis of multiscale problems”. Springer (2012), pp. 325-363.
  • 11
    M.J. Gander, I.G. Graham & E.A. Spence. Applying GMRES to the Helmholtz equation with shifted Laplacian preconditioning: what is the largest shift for which wavenumber-independent convergence is guaranteed? Numerische Mathematik, 131(3) (2015), 567-614.
  • 12
    M. Habu & T. Nodera. GMRES(m) algorithm with changing the restart cycle adaptively. In “Proceedings of Algorithmy 2000 Conference on Scientific Computing” (2000), pp. 254-263.
  • 13
    M. Habu & T. Nodera. GMRES(m) algorithm with changing the restart cycle adaptively. In “Proceedings of Algorithmy 2000 Conference on Scientific Computing” (2000), pp. 254-263.
  • 14
    J. Jin. “The Finite Element Method in Electromagnetics”. Wiley (2015).
  • 15
    W. Joubert. On the convergence behavior of the restarted GMRES algorithm for solving nonsymmetric linear systems. Numerical Linear Algebra with Applications, 1(5) (1994), 427-447. doi:10.1002/nla.1680010502. URL http://doi.wiley.com/10.1002/nla.1680010502
    » https://doi.org/10.1002/nla.1680010502» http://doi.wiley.com/10.1002/nla.1680010502
  • 16
    R. Morgan. A Restarted GMRES Method Augmented with Eigenvectors. SIAM Journal on Matrix Analysis and Applications, 16(4) (1995), 1154-1171. doi:10.1137/S0895479893253975.
    » https://doi.org/10.1137/S0895479893253975
  • 17
    R.B. Morgan. GMRES with Deflated Restarting. SIAM Journal on Scientific Computing, 24(1) (2002), 20-37. doi:10.1137/S1064827599364659. URL http://epubs.siam.org/doi/10.1137/S1064827599364659
    » https://doi.org/10.1137/S1064827599364659» http://epubs.siam.org/doi/10.1137/S1064827599364659
  • 18
    Q. Niu & L. Lu. Restarted GMRES method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations. International Journal of Mathematical and Computational Sciences, 6 (2012). URL https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf
    » https://pdfs.semanticscholar.org/111c/4cbc91b183467e57b60b5485872646c5d028.pdf
  • 19
    D. Osei-Kuffuor & Y. Saad. Preconditioning Helmholtz linear systems. Applied numerical mathematics, 60(4) (2010), 420-431.
  • 20
    Y. Saad & M. Schultz. GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems. SIAM Journal on Scientific and Statistical Computing, 7(3) (1986), 856-869. doi:10.1137/0907058.
    » https://doi.org/10.1137/0907058
  • 21
    V. Simoncini & D.B. Szyld. Recent computational developments in Krylov subspace methods for linear systems. Numerical Linear Algebra with Applications, 14(1) (2007), 1-59.
  • 22
    G.W. Stewart. A Krylov-Schur algorithm for large eigenproblems. SIAM Journal on Matrix Analysis and Applications, 23(3) (2002), 601-614.
  • 23
    Z. Teng & X. Wang. Heavy Ball Restarted CMRH Methods for Linear Systems. Mathematical and Computational Applications, 23(1) (2018), 10.
  • 24
    Y. Wang, K. Du & W. Sun. Preconditioning iterative algorithm for the electromagnetic scattering from a large cavity. Numerical Linear Algebra with Applications, 16(5) (2009), 345-363. doi:10.1002/nla.615. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/nla.615
    » https://doi.org/10.1002/nla.615» https://onlinelibrary.wiley.com/doi/abs/10.1002/nla.615
  • 25
    L. Zhang & T. Nodera. A new adaptive restart for GMRES(m) method. ANZIAM Journal, 46 (2005), 409-425. doi:10.21914/anziamj.v46i0.968. URL http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/968
    » https://doi.org/10.21914/anziamj.v46i0.968» http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/968

Publication Dates

  • Publication in this collection
    30 Apr 2020
  • Date of issue
    Jan-Apr 2020

History

  • Received
    10 Dec 2018
  • Accepted
    10 Jan 2020
Sociedade Brasileira de Matemática Aplicada e Computacional Rua Maestro João Seppe, nº. 900, 16º. andar - Sala 163 , 13561-120 São Carlos - SP, Tel. / Fax: (55 16) 3412-9752 - São Carlos - SP - Brazil
E-mail: sbmac@sbmac.org.br