Skip to main content
Log in

On the Extrema of Linear Least-Squares Problems

  • Technical Note
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

We use the concept of generalized inverses to show that the extrema of the function \(G(x) = \|Ax-b\|^2\) are minima, A being a rectangular matrix not necessarily of full rank

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. F. E. Udwadia R. E. Kalaba (1996) Analytical Dynamics: A New Approach Cambridge University Press Cambridge, England

    Google Scholar 

  2. T.N.E. Greville (1960) ArticleTitleSome Applications of the Pseudoinverse of a Matrix SIAM Review 2 15–22 Occurrence Handle10.1137/1002004 Occurrence Handle0168.13303 Occurrence Handle22 #1067

    Article  MATH  MathSciNet  Google Scholar 

  3. T. N. E. Greville (1961) ArticleTitleNote on Fitting of Functions of Several Independent Variables SIAM Journal on Applied Mathematics 9 109–115 Occurrence Handle0168.14902 Occurrence Handle23 #B2149

    MATH  MathSciNet  Google Scholar 

  4. C. R. Rao (1962) ArticleTitleA Note on a Generalized Inverse of a Matrix with Applications to Problems in Mathematical Statistics Journal of the Royal Statistical Society 24b 152–158

    Google Scholar 

  5. C. R. Rao (1973) Linear Statistical Inference and Its Applications EditionNumber2 Wiley New York, NY

    Google Scholar 

  6. C. R. Rao (1988) ArticleTitleMethodology Based on the L1-norm in Statistical Inference Sankhya 50A 289–313

    Google Scholar 

  7. T.W. Anderson (1958) An Introduction to Multivariate Statistical Analysis John Wiley and Sons New York, NY

    Google Scholar 

  8. G. S. G. Beveridge R. S. Schechter (1970) Optimization: Theory and Practice McGraw-Hill New York, NY

    Google Scholar 

  9. S. Kourouklis C. C. Paige (1981) ArticleTitleA Constrained Least Squares Approach to the General Gauss-Markov Linear Model Journal of the American Statistical Association 76 620–625 Occurrence Handle82m:62147

    MathSciNet  Google Scholar 

  10. M. J. Panik (1976) Classical Optimization Foundations and Extensions North- Holland Publishing Company New York, NY

    Google Scholar 

  11. D. Russell (1970) Optimization Theory W. A. Benjamin New York, NY

    Google Scholar 

  12. F. Graybill (1983) Matrices and Applications to Statistics Wadsworth Belmont, California

    Google Scholar 

  13. A. Ben-israel T. N. E. Greville (2003) Generalized Inverses Springer Verlag New York, NY

    Google Scholar 

  14. A. Albert (1972) Regression and the Moore-Penrose Pseudoinverse Academic Press New York, NY

    Google Scholar 

  15. R. M. Pringle A. A. Rayner (1971) Generalized Inverse Matrices Hafner New York, NY

    Google Scholar 

  16. L. B. Thomas L. O. Patrick (1971) Generalized Inverse Matrices Wiley- Interscience New York, NY

    Google Scholar 

  17. F. A. Graybill (1969) Introduction to Matrices with Applications in Statistics Wadsworth Belmont, California

    Google Scholar 

  18. F. E. Udwadia R. E. Kalaba (1969) ArticleTitleAn Alternative Proof of the Greville Formula Journal of Optimization Theory and Applications 94 23–28 Occurrence Handle98a:65045

    MathSciNet  Google Scholar 

  19. F. E. Udwadia R. E. Kalaba (1999) ArticleTitleGeneral Forms for the Recursive Determination of Generalized Inverses Journal of Optimization Theory and Applications 101 509–523 Occurrence Handle10.1023/A:1021781918962 Occurrence Handle2000e:65046

    Article  MathSciNet  Google Scholar 

  20. F. E. dwadia R. E. Kalaba (2003) ArticleTitleSequential Determination of the {1,4}-Inverse of a Matrix Journal of Optimization Theory and Applications 117 1–7 Occurrence Handle2004g:15007

    MathSciNet  Google Scholar 

  21. F. E. Udwadia R. E. Kalaba (1999) ArticleTitleA Unified Approach for the Recursive Determination of Generalized Inverses Computers and Mathematics with Applications 37 125–130 Occurrence Handle10.1016/S0898-1221(98)00247-8 Occurrence Handle99h:65073

    Article  MathSciNet  Google Scholar 

  22. C. R. Rao S. K. Mitra (1971) Generalized Inverses of Matrices and Their Applications Wiley New York, NY

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Phohomsiri, P. On the Extrema of Linear Least-Squares Problems. J Optim Theory Appl 127, 665–669 (2005). https://doi.org/10.1007/s10957-005-7509-6

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-005-7509-6

Keywords

Navigation