Summary
We investigate the behavior of Kaczmarz's method with relaxation for inconsistent systems. We show that when the relaxation parameter goes to zero, the limits of the cyclic subsequences generated by the method approach a weighted least squares solution of the system. This point minimizes the sum of the squares of the Euclidean distances to the hyperplanes of the system. If the starting point is chosen properly, then the limits approach the minimum norm weighted least squares solution. The proof is given for a block-Kaczmarz method.
Similar content being viewed by others
References
Ben-Israel, A., Greville, T.N.E.: Generalized Inverses: Theory and applications. New York: Wiley-Interscience 1974
Censor, Y.: Row-action methods for huge and sparse systems and their applications. SIAM Rev.23, 444–466 (1981)
Eggermont, P.P.B., Herman, G.T., Lent, A.: Iterative algorithms for large partitioned linear systems, with applications to image reconstruction. Linear Algebra Appl.40, 37–67 (1981)
Elfving, T.: Block-iterative methods for consistent and inconsistent linear equations. Numer. Math.35, 1–12 (1980)
Herman, G.T.: Image reconstruction from projections, the fundamentals of computerized tomography. New York: Academic Press 1980
Herman, G.T., Lent, A., Lutz, P.H.: Relaxation methods for image reconstruction. Commun. Assoc. Comput. Mach.21, 152–158 (1978)
Kaczmarz, S.: Angenäherte Auflösung von Systemen linearer Gleichungen. Bull. Acad. Polon. Sci. Lett. A35, 355–357 (1937)
Tanabe, K.: Projection method for solving a singular system of linear equations and its applications. Numer. Math.17, 203–214 (1971)
Vasil'chenko, G.P., Svetlakov, A.A.: A projection algorithm for solving systems of linear algebraic equations of high dimensionality. U.S.S.R. Comput. Math. and Math. Phys.20, 1, 1–8 (1980)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Censor, Y., Eggermont, P.P.B. & Gordon, D. Strong underrelaxation in Kaczmarz's method for inconsistent systems. Numer. Math. 41, 83–92 (1983). https://doi.org/10.1007/BF01396307
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01396307