Top

Published in:

2016 | OriginalPaper | Chapter

1. Introduction to Scientific Computing

Author : Mark H. Holmes

Published in: Introduction to Scientific Computing and Data Analysis

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This chapter provides a brief introduction to the floating-point number system used in most scientific and engineering applications. A few examples are given in the next section illustrating some of the challenges using finite precision arithmetic, but it is worth quoting Donald Knuth to get things started. If you are unfamiliar with him, he was instrumental in the development of the analysis of algorithms, and is the creator of TeX. Anyway, here are the relevant quotes (Knuth [1997]:

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

next chapter Solving A Nonlinear Equation

Abdi, H., Williams, L.J.: Principal component analysis. Wiley Interdiscip. Rev. Comput. Stat. 2 (4),433–459 (2010). ISSN 1939-0068. doi:10.1002/ wics.101

Anderson, M., Adali, T.: A general approach for robustification of ICA algorithms. In: Vigneron, V., Zarzoso, V., Moreau, E., Gribonval, R., Vincent, E. (eds.) Latent Variable Analysis and Signal Separation. Lecture Notes in Computer Science, vol. 6365, pp. 295–302. Springer, Berlin (2010). ISBN 978-3-642-15994-7. doi:10.1007/978-3-642-15995-4_37 CrossRef

Andersen, A.H., Gash, D.M., Avison, M.J.: Principal component analysis of the dynamic response measured by fMRI: a generalized linear systems framework. Magn. Reson. Imaging 17 (6), 795–815 (1999)CrossRef

ANSI/IEEE: IEEE Standard for Binary Floating-Point Arithmetic, volume Std 754-1985. IEEE, New York (1985)

Applegate, D.L., Bixby, R.E., Chvátal, V., Cook, W.J.: The Traveling Salesman Problem: A Computational Study. Princeton Series in Applied Mathematics. Princeton University Press, Princeton (2006)MATH

Ascher, U.M., Petzold, L.R.: Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations. SIAM, Philadelphia, PA (1998). ISBN 0898714125MATHCrossRef

Astier, P., Guy, J., Regnault, N., Pain, R., Aubourg, E., Balam, D., Basa, S., Carlberg, R.G., Fabbro, S., Fouchez, D., Hook, I.M., Howell, D.A., Lafoux, H., Neill, J.D., Palanque-Delabrouille, N., Perrett, K., Pritchet, C.J., Rich, J., Sullivan, M., Taillet, R., Aldering, G., Antilogus, P., Arsenijevic, V., Balland, C., Baumont, S., Bronder, J., Courtois, H., Ellis, R.S., Filiol, M., Gonçalves, A.C., Goobar, A., Guide, D., Hardin, D., Lusset, V., Lidman, C., McMahon, R., Mouchet, M., Mourao, A., Perlmutter, S., Ripoche, P., Tao, C., Walton, N.: The supernova legacy survey:measurement of ω _m, ω _Λ and w from the first year data set. Astron. Astrophys. 447 (1), 31–48 (2006). doi:10.1051/0004-6361:20054185. http://dx.doi.org/10.1051/0004-6361:20054185

Bailey, D.H., Lee, K., Simon, H.D.: Using Strassen’s algorithm to accelerate the solution of linear systems. J. Supercomput. 4, 357–371 (1991)MATHCrossRef

Ballard, G., Demmel, J., Holtz, O., Schwartz, O.: Minimizing communication in numerical linear algebra. SIAM J. Matrix Anal. Appl. 32 (3), 866–901 (2011). doi:10.1137/090769156. http://dx.doi.org/10.1137/090769156 MathSciNetMATHCrossRef

Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face recognition by independent component analysis. IEEE Trans. Neural Netw. 13 (6), 1450–1464 (2002). ISSN 1045-9227. doi:10.1109/tnn.2002.804287

Batterson, S., Smillie, J.: Rayleigh quotient iteration fails for nonsymmetric matrices. Appl. Math. Lett. 2 (1), 19–20 (1989). ISSN 0893-9659. doi:http://dx.doi.org/10.1016/0893-9659(89)90107-9

Beattie, C., Fox, D.: Localization criteria and containment for Rayleigh quotient iteration. SIAM J. Matrix Anal. Appl. 10 (1), 80–93 (1989). doi:10.1137/0610006MathSciNetMATHCrossRef

Benzi, M.: Preconditioning techniques for large linear systems: a survey. J. Comput. Phys. 182 (2), 418–477 (2002)MathSciNetMATHCrossRef

Berman, G.P., Izrailev, F.M.: The Fermi-Pasta-Ulam problem: fifty years of progress. Chaos 15 (1), 015104 (2005). ISSN 10541500

Bernoulli, J.: Meditationes de chordis vibrantibus. Comment. Acad. Sci. Imp. Petropol. 3,13–28 (1728)

Bjöurck, A.: The calculation of linear least squares problems. Acta Numer. 13, 1–53 (2004). ISSN 1474-0508. doi:10.1017/S0962492904000169. http://journals.cambridge.org/article_S0962492904000169

Bjöurck, A.: Numerical Methods in Matrix Computations. Springer, Cham (2015). ISBN 978-3-319-05088-1CrossRef

Bogaert, I.: Iteration-free computation of Gauss–Legendre quadrature nodes and weights. SIAM J. Sci. Comput. 36 (3), A1008–A1026 (2014). doi:10.1137/140954969. http://dx.doi.org/10.1137/140954969 MathSciNetMATHCrossRef

Boyd, J.P.: Solving Transcendental Equations: The Chebyshev Polynomial Proxy and Other Numerical Rootfinders, Perturbation Series, and Oracles. Other Titles in Applied Mathematics. SIAM, Philadelphia (2014). ISBN 9781611973525. https://books.google.com/books?id=29CgBAAAQBAJ MATHCrossRef

Brewer, D. Barenco, M., Callard, R., Hubank, M., Stark, J.: Fitting ordinary differential equations to short time course data. Philos. Trans. A 366 (1865), 519–544 (2008)MathSciNetMATHCrossRef

Brockett, P.L., Derrig, R.A., Golden, L.L., Levine, A., Alpert, M.: Fraud classification using principal component analysis of RIDITs. J. Risk Insur. 69 (3), 341–371 (2002). ISSN 1539-6975. doi:10.1111/1539-6975.00027. http://dx.doi.org/10.1111/1539-6975.00027

Brys, G., Hubert, M., Rousseeuw, P.J.: A robustification of independent component analysis. J. Chemometr. 19 (5–7), 364–375 (2005). ISSN 1099-128X. doi:10.1002/cem.940

Bunch, J.R., Hopcroft, J.E.: Triangular factorization and inversion by fast matrix multiplication. Math. Comput. 28 (125), 231–236 (1974)MathSciNetMATHCrossRef

Burges, C.J.C.: Geometric methods for feature extraction and dimensional reduction. In: Maimon, O., Rokach, L. (eds.) The Data Mining and Knowledge Discovery Handbook, 2nd edn., pp. 53–82. Springer, New York (2010)

Burkardt, J.: Hand-data. http://people.sc.fsu.edu/~jburkardt/m_src/hand_data/hand_data.html (2015)

Butcher, J.C.: The Numerical Analysis of Ordinary Differential Equations, 2nd edn. Wiley, Chichester (2008)MATHCrossRef

Chen, A., Bickel, P.J.: Efficient independent component analysis. Ann. Stat. 34 (6), 2825–2855 (2006). doi:10.1214/009053606000000939 MathSciNetMATHCrossRef

Chernov, N., Lesort, C.: Least squares fitting of circles. J. Math. Imaging Vision 23, 239–252 (2005)MathSciNetCrossRef

Cline, A.K., Dhillon, I.S.: Computation of the singular value decomposition. In: Hogben, L. (ed.) Handbook of Linear Algebra, pp. 45.1–45.13. Chapman & Hall/CRC, Boca Raton (2007)

Collange, S., Defour, D., Graillat, S., Iakymchuk, R.: Numerical reproducibility for the parallel reduction on multi- and many-core architectures. Parallel Comput. 49, 83–97 (2015). ISSN 0167-8191. doi:http://dx.doi.org/10.1016/j.parco.2015.09.001. http://www.sciencedirect.com/science/article/pii/S0167819115001155

Comon, P., Jutten, C. (eds.): Handbook of Blind Source Separation: Independent Component Analysis and Applications. Communications Engineering. Elsevier, Boston (2010). ISBN 978-0-12-374726-6

Conn, A.R., Scheinberg, K., Vicente, L.N.: Introduction to Derivative-Free Optimization. SIAM, Philadelphia (2009)MATHCrossRef

Cordero, A., Jordnn, C., Torregrosa, J.R.: One-point Newton-type iterative methods: a unified point of view. J. Comput. Appl. Math. 275, 366–374 (2015). ISSN 0377-0427. doi:http://dx.doi.org/10.1016/j.cam.2014.07.009. http://www.sciencedirect.com/science/article/pii/S0377042714003288

Costello, A.B., Osborne, J.W.: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 10 (7), 1–9 (2005). ISSN 1531-7714

Crandall, R, Pomerance, C.B.: Prime Numbers: A Computational Perspective, 2nd edn. Springer, New York (2010). ISBN 9780387289793MATH

Davis, P.J., Rabinowitz, P.: Methods of Numerical Integration. Dover, New York (2007). ISBN 9780486453392. https://books.google.com/books?id=gGCKdqka0HAC MATH

de Boor, C., Schoenberg, I.J.: Cardinal interpolation and spline functions VIII. The Budan-Fourier theorem for splines and applications. In: Bohmer, K., Meinardus, G., Schempp, W. (eds.) Spline Functions. Lecture Notes in Mathematics, vol. 501, pp. 1–79. Springer, Berlin (1976). ISBN 978-3-540-07543-1. doi:10.1007/BFb0079740CrossRef

de Dinechin, F., Defour, D., Lauter, C.: Fast correct rounding of elementary functions in double precision using double-extended arithmetic. Technical Report 2004-10, Laboratoire de l’Informatique du Parallelisme, March 2004

Demmel, J.W.: Applied Numerical Linear Algebra. SIAM, Philadelphia, PA (1997). ISBN 0-89871-389-7MATHCrossRef

Demmel, J., Hida, Y.: Accurate and efficient floating point summation. SIAM J. Sci. Comput. 25 (4), 1214–1248 (2004)MathSciNetMATHCrossRef

Demmel, J, Nguyen, H.D.: Fast reproducible floating-point summation. In: 21st IEEE Symposium on Computer Arithmetic (ARITH), April 2013, pp. 163–172 (2013). doi:10.1109/ARITH.2013.9

Dennis, J.E., Jr., Schnabel, R.B.: Numerical Methods for Unconstrained Optimization and Nonlinear Equations. SIAM, Philadelphia, PA (1996). ISBN 0898713641MATHCrossRef

Dongarra, J., Sullivan, F.: The top 10 algorithms. Comput. Sci. Eng. 2 (1), 22–23 (2000)CrossRef

Doukas, H., Papadopoulou, A., Savvakis, N., Tsoutsos, T., Psarras, J.: Assessing energy sustainability of rural communities using principal component analysis. Renew. Sust. Energ. Rev. 16 (4), 1949–1957 (2012). ISSN 1364-0321. doi:http://dx.doi.org/10.1016/j.rser.2012.01.018

Dussault, J.-P.: Solving trajectory optimization problems via nonlinear programming: the brachistochrone case study. Optim. Eng. 15, 1–17 (2014). ISSN 1389-4420. doi:10.1007/s11081-013-9244-4

Erdmann, U., Ebeling, W., Mikhailov, A.S.: Noise-induced transition from translational to rotational motion of swarms. Phys. Rev. E 71 (5), 051904 (2005)CrossRef

Evans, G.A., Webster, J.R.: A comparison of some methods for the evaluation of highly oscillatory integrals. J. Comput. Appl. Math. 112, 55–69 (1999). ISSN 0377-0427. doi:http://dx.doi.org/10.1016/S0377-0427(99)00213-7

Fabian, J.T., Elmar, W.L., Carlos, G.P.: A geometric algorithm for overcomplete linear ICA. Neurocomputing 56, 381–398 (2004). ISSN 0925-2312. doi:http://dx.doi.org/10.1016/j.neucom.2003.09.008

Ford, J.: The Fermi-Pasta-Ulam problem: paradox turns discovery. Phys. Rep. 213 (5), 271–310 (1992). ISSN 0370-1573. doi:http://dx.doi.org/10.1016/0370-1573(92)90116-H

Fourier, M.: Analyse des Équations Déterminées. Paris, Didot (1831). https://books.google.com/books?id=HIU_AAAAcAAJ

Gander, W., Gautschi, W.: Adaptive quadrature—revisited. BIT 40 (1), 84–101 (2000). ISSN 0006-3835. doi:10.1023/A:1022318402393

Gander, W., Golub, G.H., Strebel, R.: Least-squares fitting of circles and ellipses. BIT Numer. Math. 34 (4), 558–578 (1994). ISSN 0006-3835. doi:10.1007/BF01934268

GIMPS: Great Internet Mersenne Prime Search (2015). http://www.mersenne.org

Ginsberg, J., Mohebbi, M.H., Patel, R.S., Brammer, L., Smolinski, M.S., Brilliant, L.: Detecting influenza epidemics using search engine query data. Nature 457, 1012–1014 (2009). doi:10.1038/nature07634CrossRef

Giraud, L., Langou, J., Rozloznik, M.: The loss of orthogonality in the Gram-Schmidt orthogonalization process. Comput. Math. Appl. 50 (7), 1069–1075 (2005). ISSN 0898-1221

Gladwell, G.M.L.: Contact Problems in the Classical Theory of Elasticity. Sijthoff and Noordhoff, Germantown, MD (1980)MATHCrossRef

Goldberg, D.: What every computer scientist should know about floating-point arithmetic. ACM Comput. Surv. 23 (1), 5–48 (1991)CrossRef

Golub, G., Uhlig, F.: The QR algorithm: 50 years later its genesis by John Francis and Vera Kublanovskaya and subsequent developments. IMA J. Numer. Anal. 29 (3), 467–485 (2009). doi:10.1093/imanum/drp012. http://imajna.oxfordjournals.org/content/29/3/467.abstract MathSciNetMATHCrossRef

Golub, G.H., Van Loan, C.F.: Matrix Computations, 4th edn. Johns Hopkins University Press, Baltimore, MD (2013). ISBN 1421408597MATH

Golub, G.H., Welsch, J.H.: Calculation of Gauss quadrature rules. Math. Comput. 23 (106), 221–230 (1969). doi:10.3934/jcd.2014.1.391MathSciNetMATHCrossRef

Gonnet, P.: A review of error estimation in adaptive quadrature. ACM Comput. Surv. 44 (4), 22:1–22:36 (2012). ISSN 0360-0300. doi:10.1145/ 2333112.2333117

Google: Google flu trends. http://www.google.org/flutrends (2015)

Grasselli, M., Pelinovsky, D.: Numerical Mathematics. Jones and Bartlett Publishers, Sudbury, MA (2008)MATH

Greenan, G., Brangwynne, C.P., Jaensch, S., Gharakhani, J., Julicher, F., Hyman, A.A.: Centrosome size sets mitotic spindle length in Caenorhabditis elegans embryos. Curr. Biol. 20 (4), 353–358 (2010)CrossRef

Griffiths, D., Higham, D.J.: Numerical Methods for Ordinary Differential Equations. Springer, London (2010)MATHCrossRef

Gwinn, C.R., Johnson, M.D., Reynolds, J.E., Jauncey, D.L., Tzioumis, A.K., Dougherty, S., Carlson, B., Del Rizzo, D., Hirabayashi, H., Kobayashi, H., Murata, Y., Edwards, P.G., Quick, J.F.H., Flanagan, C.S., McCulloch, P.M.: Noise in the cross-power spectrum of the Vela pulsar. Astrophys. J. 758 (1), 6 (2012)CrossRef

Hagan, P.S., West, G.: Interpolation methods for curve construction. Appl. Math. Finance 13 (2), 89–129 (2006). ISSN 1350486X. http://search.ebscohost.com.libproxy.rpi.edu/login.aspx?direct=true&db=buh&AN=21645450&site=ehost-live&scope=site

Hairer, E., Wanner, G.: Solving Ordinary Differential Equations II, 2nd edn. Springer, Berlin (2002)MATH

Hairer, E., Lubich, C., Wanner, G.: Geometric numerical integration illustrated by the Stormer–Verlet method. Acta Numer. 12, 399–450 (2003). ISSN 1474-0508. doi:10.1017/S0962492902000144

Halko, N., Martinsson, P.-G., Shkolnisky, Y., Tygert, M.: An algorithm for the principal component analysis of large data sets. SIAM J. Sci. Comput. 33 (5), 2580–2594 (2011). ISSN 1064-8275. doi:10.1137/100804139

Hall, C.A., Meyer, W.W.: Optimal error bounds for cubic spline interpolation. J. Approx. Theory 16 (2), 105–122 (1976). ISSN 0021-9045. doi:http://dx.doi.org/10.1016/0021-9045(76)90040-X

Hanrot, G., Lefevre, V., Stehle, D., Zimmermann, P.: Worst cases of a periodic function for large arguments. In: 18th IEEE Symposium on Computer Arithmetic, 2007 (ARITH ’07), pp. 133–140 (2007). doi:10.1109/ARITH. 2007.37

Harrison, J., Kubaska, T., Story, S., Tang, P.: The computation of transcendental functions on the IA-64 architecture. Intel Technol. J. 4, 234–251 (1999)

Higham, N.J.: The accuracy of floating point summation. SIAM J. Sci. Comput. 14, 783–799 (1993)MathSciNetMATHCrossRef

Higham, N.J.: Accuracy and Stability of Numerical Algorithms, 2nd edn. SIAM, Philadelphia, PA (2002). ISBN 0-89871-521-0MATHCrossRef

Hojjati, A., Zhao, G.-B., Pogosian, L., Silvestri, A., Crittenden, R., Koyama, K.: Cosmological tests of general relativity: a principal component analysis. Phys. Rev. D 85, 043508 (2012). doi:10.1103/PhysRevD.85.043508CrossRef

Holladay, J.C.: A smoothest curve approximation. Math. Tables Aids Comput. 11 (60), 233–243 (1957)MathSciNetMATHCrossRef

Holmes, M.H.: Introduction to Numerical Methods in Differential Equations. Springer, New York (2007)MATHCrossRef

Holmes, M.H.: Introduction to the Foundations of Applied Mathematics. Springer, New York (2009)MATHCrossRef

Holmes, M.H.: Introduction to Perturbation Methods, 2nd edn. Springer, New York (2013)MATHCrossRef

Holmes, M.H.: Connections between cubic splines and quadrature rules. Am. Math. Mon. 121 (7), 661–662 (2014)MathSciNetMATH

Huss-Lederman, S., Jacobson, E.M., Johnson, J.R., Tsao, A., Turnbull, T.: Implementation of Strassen’s algorithm for matrix multiplication. In: Proceedings of the 1996 ACM/IEEE Conference on Supercomputing, pp. 9–6 (1996)

Huynh, H.T.: Accurate monotone cubic interpolation. SIAM J. Numer. Anal. 30 (1), 57–100 (1993)MathSciNetMATHCrossRef

Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley-Interscience. Wiley, New York (2001). ISBN 047140540XCrossRef

Iooss, G., James, G.: Localized waves in nonlinear oscillator chains. Chaos 15 (1), 015113 (2005)MathSciNetMATHCrossRef

Iriarte-Díaz, J.: Differential scaling of locomotor performance in small and large terrestrial mammals. J. Exp. Biol. 205 (18), 2897–2908 (2002). http://jeb.biologists.org/content/205/18/2897.abstract

Isaacson, E., Keller, H.B.: Analysis of Numerical Methods. Dover Publications, New York (1994). ISBN 9780486680293. https://books.google.com/books?id=y77n2ySMJHUC MATH

Iserles, A., Nørsett, S.P., Olver, S.: Highly oscillatory quadrature: the story so far. In: de Castro, A.B., Gomez, D., Quintela, P., Salgado, P. (eds.) Numerical Mathematics and Advanced Applications, pp. 97–118. Springer, Berlin (2006). ISBN 978-3-540-34287-8. doi:10.1007/978-3-540-34288-5_6 CrossRef

Jackson, D.A.: Stopping rules in principal components analysis: a comparison of heuristical and statistical approaches. Ecology 74 (8), 2204–2214 (1993)CrossRef

James, G., Kevrekidis, P.G., Cuevas, J.: Breathers in oscillator chains with Hertzian interactions. Phys. D 251, 39–59 (2013). ISSN 0167-2789. doi:http://dx.doi.org/10.1016/j.physd.2013.01.017

Jameson, A., Vassberg, J.: Studies of alternate numerical optimization methods applied to the brachistochrone problem. CFD J. 9 (3), 281–296 (2001)

Johnson, K.A., Goody, R.S.: The original Michaelis constant: translation of the 1913 Michaelis-Menten paper. Biochemistry 50 (39), 8264–8269 (2011)CrossRef

Josse, J., Husson, F.: Selecting the number of components in principal component analysis using cross-validation approximations. Comput. Stat. Data Anal. 56 (6), 1869–1879 (2012). ISSN 0167-9473. doi:http://dx.doi.org/10.1016/j.csda.2011.11.012. http://www.sciencedirect.com/science/article/pii/S0167947311004099

Jung, B.C., Choi, S.I., Du, A.X., Cuzzocreo, J.L., Geng, Z.Z., Ying, H.S., Perlman, S.L., Toga, A.W., Prince, J.L., Ying, S.H.: Principal component analysis of cerebellar shape on MRI separates SCA types 2 and 6 into two archetypal modes of degeneration. Cerebellum 11 (4), 887–895 (2012). ISSN 1473-4222. doi:10.1007/s12311-011-0334-6

Kahan, W.M.: Numerical linear algebra. Can. Math. Bull. 9, 757–801 (1966)MATHCrossRef

Kershaw, D.: A note on the convergence of interpolatory cubic splines. SIAM J. Numer. Anal. 8 (1), 67–74 (1971)MathSciNetMATHCrossRef

Khan, J., Wei, J.S., Ringner, M., Saal, L.H., Ladanyi, M., Westermann, F., Berthold, F., Schwab, M., Antonescu, C.R., Peterson, C., Meltzer, P.S.: Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nat. Med. 7 (6), 673–679 (2001) ISSN 10788956

Knoll, D.A., Keyes, D.E.: Jacobian-free Newton-Krylov methods: a survey of approaches and applications. J. Comput. Phys. 193 (2), 357–397 (2004). ISSN 0021-9991. doi:10.1016/j.jcp.2003.08.010

Knuth, D.E.: The Art of Computer Programming: Seminumerical Algorithms, vol. 2, 3rd edn. Addison-Wesley Longman Publishing Co., Boston, MA (1997). ISBN 0-201-89684-2

Kollerstrom, N.: Thomas Simpson and ‘Newton’s method of approximation’: an enduring myth. Br. J. Hist. Sci. 25, 347–354 (1992). ISSN 1474-001X. doi:10.1017/S0007087400029150. http://journals.cambridge.org/article_S0007087400029150

Kondrat, S., Perez, C.R., Presser, V., Gogotsi, Y., Kornyshev, A.A.: Effect of pore size and its dispersity on the energy storage in nanoporous supercapacitors. Energy Environ. Sci. 5, 6474–6479 (2012). doi:10.1039/C2EE03092F. http://dx.doi.org/10.1039/C2EE03092F CrossRef

Korats, G., Le Cam, S., Ranta, R., Hamid, M.: Applying ICA in EEG: choice of the window length and of the decorrelation method. In: Gabriel, J., Schier, J., Van Huffel, S., Conchon, E., Correia, C., Fred, A., Gamboa, H. (eds.) Biomedical Engineering Systems and Technologies. Communications in Computer and Information Science, vol. 357, pp. 269–286. Springer, Berlin (2013). ISBN 978-3-642-38255-0. doi:10.1007/978-3-642-38256-7_18. http://dx.doi.org/10.1007/978-3-642-38256-7_18 CrossRef

Kuczyński, J., Woźniakowski, H.: Estimating the largest eigenvalue by the power and Lanczos algorithms with a random start. SIAM J. Matrix Anal. Appl. 13 (4), 1094–1122 (1992). doi:10.1137/0613066 MathSciNetMATHCrossRef

Lagarias, J.C., Reeds, J.A., Wright, M.H., Wright, P.E.: Convergence properties of the Nelder-Mead simplex method in low dimensions. SIAM J. Optim. 9, 112–147 (1998)MathSciNetMATHCrossRef

Lai, K.-L., Crassidis, J.L.: Extensions of the first and second complex-step derivative approximations. J. Comput. Appl. Math. 219 (1), 276–293 (2008). ISSN 0377-0427. doi:http://dx.doi.org/10.1016/j.cam.2007.07.026

Lambert, J.D.: Numerical Methods for Ordinary Differential Systems: The Initial Value Problem. Wiley, Chichester (1991)MATH

Lazer, D., Kennedy, R., King, G., Vespignani, A.: The parable of Google flu: traps in big data analysis. Science 343 (6176), 1203–1205 (2014). doi:10.1126/science.1248506. http://www.sciencemag.org/content/343/6176/1203.short CrossRef

Leutbecher, M., Palmer, T.N.: Ensemble forecasting. J. Comput. Phys. 227 (7), 3515–3539 (2008). ISSN 0021-9991. doi:http://dx.doi.org/10.1016/j.jcp.2007.02.014. http://www.sciencedirect.com/science/article/pii/S0021999107000812. Predicting weather, climate and extreme events

Levin, Y., Nediak, M., Ben-Israel, A.: A direct Newton method for calculus of variations. J. Comput. Appl. Math. 139 (2), 197–213 (2002). ISSN 0377-0427. doi:http://dx.doi.org/10.1016/S0377-0427(01)00427-7

Liu, J.: The multifrontal method for sparse matrix solution: theory and practice. SIAM Rev. 34 (1), 82–109 (1992). doi:10.1137/1034004MathSciNetMATHCrossRef

Loffeld, J., Tokman, M.: Comparative performance of exponential, implicit, and explicit integrators for stiff systems of ODEs. J. Comput. Appl. Math. 241, 45–67 (2013). ISSN 0377-0427. doi:http://dx.doi.org/10.1016/j.cam.2012.09.038

Love, C.H.: Abscissas and Weights for Gaussian Quadrature for n=2 to 100, and n=125, 150, 175, and 200. National Bureau of Standards, U.S. Government Printing Office, Washington, DC (1966)MATH

Marsden, M.J.: Quadratic spline interpolation. Bull. Am. Math. Soc. 80 (5), 903–906, (1974)MathSciNetMATHCrossRef

Martins, J.R.R.A., Sturdza, P., Alonso, J.J.: The complex-step derivative approximation. ACM Trans. Math. Softw. 29 (3), 245–262 (2003)MathSciNetMATHCrossRef

Mei, L., Figl, M., Darzi, A., Rueckert, D., Edwards, P.: Sample sufficiency and PCA dimension for statistical shape models. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) Computer Vision—ECCV 2008. Lecture Notes in Computer Science, vol. 5305, pp. 492–503. Springer, Berlin (2008). ISBN 978-3-540-88692-1. doi:10.1007/978-3-540-88693-8_36. http://dx.doi.org/10.1007/978-3-540-88693-8_36 CrossRef

Michel, J.-B., Shen, Y.K., Aiden, A.P., Veres, A., Gray, M.K., The Google Books Team, Pickett, J.P., Hoiberg, D., Clancy, D., Norvig, P., Orwant, J., Pinker, S., Nowak, M.A., Aiden, E.L.: Quantitative analysis of culture using millions of digitized books. Science 331 (6014), 176–182 (2011). doi:10.1126/science.1199644

Morin, A., Urban J., Adams, P.D., Foster, I., Sali, A., Baker, D., Sliz, P.: Shining light into black boxes. Science 336 (6078), 159–160 (2012). doi:10.1126/science.1218263. http://www.sciencemag.org/content/336/6078/159.short CrossRef

Mortenson, M.E.: Geometric Modeling, 2nd edn. Wiley, New York (1997)

Muller, J.-M.: Elementary Functions: Algorithms and Implementation, 2nd edn. Birkhauser, Boston (2005)

Muller, J.-M., Brisebarre, N., de Dinechin, F., Jeannerod, C.-P., Lefèvre, V., Melquiond, G., Revol, N., Stehlé, D., Torres, S.: Handbook of Floating-Point Arithmetic. Birkhäuser, Boston (2010)MATHCrossRef

Nakatsukasa, Y., Higham, N.: Stable and efficient spectral divide and conquer algorithms for the symmetric eigenvalue decomposition and the SVD. SIAM J. Sci. Comput. 35 (3), A1325–A1349 (2013). doi:10.1137/120876605MathSciNetMATHCrossRef

NCEI: Daily summary for Albany, NY. In: National Centers for Environmental Information, Climate Data Online. Washington, DC. http://www.ncdc.noaa.gov/cdo-web/search?datasetid=GHCND (2015)

Nelder, J.A.: This week’s citation classic. Citation Classics Commentaries April 9 (15), 22 (1979)

Nelder, J.A., Mead, R.: A simplex method for function minimization. Comput. J. 7 (4), 308–313 (1965)MATHCrossRef

Nenad, U., Roberts, A.J.: A corrected quadrature formula and applications. ANZIAM J. 45, E41–E56 (2008)MathSciNetMATH

Nguyen, T.V., Patra, J.C.: A simple ICA-based digital image watermarking scheme. Digital Signal Process. 18 (5), 762–776 (2008). ISSN 1051-2004. doi:http://dx.doi.org/10.1016/j.dsp.2007.10.004

Nocedal, J., Wright, S.: Numerical Optimization. Springer Series in Operations Research and Financial Engineering. Springer, New York (2006). ISBN 9780387303031MATH

Nordhausen, K., Ollila, E., Oja, H.: On the performance indices of ICA and blind source separation. In: IEEE 12th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), June 2011, pp. 486–490 (2011). doi:10.1109/SPAWC.2011.5990458

Olver, F.W.J., Lozier, D.W., Boisvert, R.F., Clark, C.W.: NIST Handbook of Mathematical Functions. Cambridge University Press, Cambridge (2010)MATH

Onton, J., Makeig, S.: Information-based modeling of event-related brain dynamics. In: Neuper, C., Klimesch, W. (eds.) Event-Related Dynamics of Brain Oscillations. Progress in Brain Research, vol. 159, pp. 99–120. Elsevier, Amsterdam (2006). doi:http://dx.doi.org/10.1016/S0079-6123(06)59007-7. http://www.sciencedirect.com/science/article/pii/S0079612306590077

Oprea, J.: Differential Geometry and Its Applications. Mathematical Association of America, Washington, DC (2007). ISBN 9780883857489MATH

Overton, M.L.: Numerical Computing with IEEE Floating Point Arithmetic. SIAM, Philadelphia, PA (2001)MATHCrossRef

Pantazis, R.D., Szyld, D.B.: Regions of convergence of the Rayleigh quotient iteration method. Numer. Linear Algebra Appl. 2 (3), 251–269 (1995). ISSN 1099-1506. doi:10.1002/nla.1680020307

Parente, A., Sutherland, J.C.: Principal component analysis of turbulent combustion data: data pre-processing and manifold sensitivity. Combust. Flame 160 (2), 340–350 (2013). ISSN 0010-2180. doi:http://dx.doi.org/10.1016/j.combustflame.2012.09.016

Parlett, B.N.: The Rayleigh quotient iteration and some generalizations for nonnormal matrices. Math. Comput. 28, 679–693 (1974)MathSciNetMATHCrossRef

Parlett, B.N.: The Symmetric Eigenvalue Problem. SIAM, Philadelphia, PA (1998). doi:10.1137/1.9781611971163MathSciNetMATH

Peckham, M.: RIKEN plans exascale supercomputer ‘30 times faster’ than today’s fastest in six years. Time, 30 Dec 2013

Peng, R.D.: Reproducible research in computational science. Science 334 (6060), 1226–1227 (2011). doi:10.1126/science.1213847CrossRef

Peres-Neto, P.R., Jackson, D.A., Somers, K.M.: How many principal components? Stopping rules for determining the number of non-trivial axes revisited. Comput. Stat. Data Anal. 49 (4), 974–997 (2005). ISSN 0167-9473. doi:http://dx.doi.org/10.1016/j.csda.2004.06.015. http://www.sciencedirect.com/science/article/pii/S0167947304002014

Persson, A.H., Bondesson, L., Borlin, N.: Estimation of polygons and areas. Scand. J. Stat. 33 (3), 541–559 (2006). ISSN 1467-9469. doi:10.1111/j. 1467-9469.2006.00507.x

Peters, G., Wilkinson, J.H.: Inverse iteration, ill-conditioned equations and Newton’s method. SIAM Rev. 21 (3), 339–360 (1979). ISSN 00361445. http://www.jstor.org/stable/2029572

Raghavan, R., Kelkar, Y.D., Ochman, H.: A selective force favoring increased g+c content in bacterial genes. Proc. Natl. Acad. Sci. U. S. A. 109 (36), 14504–14507 (2012). doi:10.1073/pnas.1205683109. http://www.pnas.org/content/109/36/14504.abstract CrossRef

Ralston, A.: Runge-Kutta methods with minimum error bounds. Math. Comput. 16,431–437 (1962)MathSciNetMATHCrossRef

Ramsay, J.O., Hooker, G., Campbell, D., Cao, J.: Parameter estimation for differential equations: a generalized smoothing approach. J. R. Stat. Soc. B 69 (5), 741–796 (2007). ISSN 1467-9868

Raphson, J.: Analysis Aequationum Universalis. London (1690). http://books.google.com/books?id=JM4ZuQAACAAJ

Rokhlin, V., Szlam, A., Tygert, M.: A randomized algorithm for principal component analysis. SIAM J. Matrix Anal. Appl. 31 (3), 1100–1124 (2010). doi:10.1137/080736417MathSciNetMATHCrossRef

Rosser, J.B., Lanczos, C., Hestenes, M.R., Karush, W.: Separation of close eigenvalues of a real symmetric matrix. J. Res. Natl. Bur. Stand. 47 (4), 291–297 (1951)MathSciNetCrossRef

Rump, S., Ogita, T., Oishi, S.: Accurate floating-point summation part I: faithful rounding. SIAM J. Sci. Comput. 31 (1), 189–224 (2008). doi:10.1137/050645671MathSciNetMATHCrossRef

Salomon, D.: Curves and Surfaces for Computer Graphics. Springer, New York (2006)MATH

Sandor, J., Debnath, L.: On certain inequalities involving the constant e and their applications. J. Math. Anal. Appl. 249 (2), 569–582 (2000). ISSN 0022-247X. doi:http://dx.doi.org/10.1006/jmaa.2000.6911. http://www.sciencedirect.com/science/article/pii/S0022247X00969117

Santillana, M., Zhang, D., Althouse, B.M.: What can digital disease detection learn from (an external revision to) Google flu trends? Am. J. Prev. Med. 47 (3), 341–347 (2014). doi:10.1016/j.amepre.2014.05.020CrossRef

Särelä, J., Vigário, R.: Overlearning in marginal distribution-based ICA: analysis and solutions. J. Mach. Learn. Res. 4, 1447–1469 (2003). ISSN 1532-4435. doi:10.1162/jmlr.2003.4.7-8.1447. http://dx.doi.org/10.1162/jmlr.2003.4.7-8.1447

Schneider, T., Griffies, S.M.: A conceptual framework for predictability studies. J. Climate 12 (10), 3133–3155 (1999). doi:10.1175/1520-0442(1999)012〈3133:ACFFPS〉2.0.CO;2CrossRef

Shure, L.: Comparing single-threaded vs. multithreaded floating point calculations. In: MATLAB Central, Loren on the Art of MATLAB (2009). http://blogs.mathworks.com/loren/2009/12/04/comparing-single-threaded-vs-multithreaded-floating-point-calculations/

Singh, S.: The Simpsons and Their Mathematical Secrets. Bloomsbury, New York (2013)

Smith, J.A., Wilson, L., Azarenko, O., Zhu, X., Lewis, B.M., Littlefield, B.A., Jordan, M.A.: Eribulin binds at microtubule ends to a single site on tubulin to suppress dynamic instability. Biochemistry 49 (6), 1331–1337 (2010)CrossRef

Stadlbauer, A., Ganslandt, O., Buslei, R., Hammen, T., Gruber, S., Moser, E., Buchfelder, M., Salomonowitz, E., Nimsky, C.: Gliomas: histopathologic evaluation of changes in directionality and magnitude of water diffusion at diffusion-tensor MR imaging. Radiology 240 (3), 803–810 (2006)CrossRef

Strassen, V.: Gaussian elimination is not optimal. Numer. Math. 13 (4), 354–356 (1969). ISSN 0029-599X. doi:10.1007/BF02165411

Stuart, A., Humphries, A.R.: Dynamical Systems and Numerical Analysis. Cambridge University Press, Cambridge (1998)MATH

Süli, E., Mayers, D.F.: An Introduction to Numerical Analysis. Cambridge University Press, Cambridge (2003)MATHCrossRef

Teh, Y.W., Welling, M., Osindero, S., Hinton, G.E.: Energy-based models for sparse overcomplete representations. J. Mach. Learn. Res. 4, 1235–1260 (2003). ISSN 1532-4435. http://dl.acm.org/citation.cfm?id=945365.964304

Tissot, G., Cordier, L., Benard, N., Noack, B.R.: Model reduction using dynamic mode decomposition. C.R. Mec. 342 (6–7), 410–416 (2014) ISSN 1631-0721. doi:http://dx.doi.org/10.1016/j.crme.2013.12.011. http://www.sciencedirect.com/science/article/pii/S163107211400103X

Traub, J.F.: Iterative Methods for the Solution of Equations. AMS Chelsea Publishing Series. Chelsea, New Jersey (1982). ISBN 9780828403122. http://books.google.com/books?id=se3YdgFgz4YC MATH

Trefethen, L.N.: Is gauss quadrature better than Clenshaw–Curtis? SIAM Rev. 50 (1), 67–87 (2008). doi:10.1137/060659831. http://dx.doi.org/10.1137/060659831 MathSciNetMATHCrossRef

Trefethen, L.N.: Approximation Theory and Approximation Practice. SIAM, Philadelphia, PA (2012). ISBN 1611972396, 9781611972399

Trefethen, L.N., Bau, D.: Numerical Linear Algebra. SIAM, Philadelphia, PA (1997). ISBN 0898713617MATHCrossRef

Trefethen, L.N., Weideman, J.A.C.: The exponentially convergent trapezoidal rule. SIAM Rev. 56 (3), 385–458 (2014). doi:10.1137/130932132MathSciNetMATHCrossRef

Tu, J.H., Rowley, C.W., Luchtenburg, D.M., Brunton, S.L., Kutz, J.N.: On dynamic mode decomposition: theory and applications. J. Comput. Dyn. 1 (2), 391–421 (2014). ISSN 2158-2491. doi:10.3934/jcd.2014.1.391. http://aimsciences.org/journals/displayArticlesnew.jsp?paperID=10631

U.S. Census Bureau: Crime rates by type: selected large cities. In: Statistical Abstract of the United States: 2012, 131st edn. Washington, DC (2012)

van den Berg, R.A., Hoefsloot, H.C.J., Westerhuis, J.A., Smilde, A.K., van der Werf, M.: Centering, scaling, and transformations: improving the biological information content of metabolomics data. BMC Genomics 7 (1), 142 (2006). doi:10.1186/1471-2164-7-142CrossRef

van der Maaten, L.J.P., Postma, E.O., van den Herik, H.J.: Dimensionality Reduction: A Comparative Review. Technical report, Tilburg University (2009). http://homepage.tudelft.nl/19j49/Matlab_Toolbox_for_Dimensionality_Reduction_files/TR_Dimensiereductie.pdf

Varah, J.: A spline least squares method for numerical parameter estimation in differential equations. SIAM J. Sci. Stat. Comput. 3 (1), 28–46 (1982). doi:10.1137/0903003MathSciNetMATHCrossRef

Varga, R.S.: Gershgorin and His Circles. Springer Series in Computational Mathematics. Springer, Berlin (2004)MATHCrossRef

Voglis, N.: Waves derived from galactic orbits. In: Galaxies and Chaos. Lecture Notes in Physics. vol. 626, pp. 56–74. Springer, Berlin (2003)

Waldvogel, J.: Towards a general error theory of the trapezoidal rule. In: Gautschi, W., Mastroianni, G., Rassias, T.M. (eds.) Approximation and Computation. Springer Optimization and Its Applications, vol. 42, pp. 267–282. Springer, New York (2011)

Wallis, J.: Operum Mathematicorum. Number v. 2. Typis Leon, Oxford (1699). http://books.google.com/books?id=dhetMBKF4gkC

Watkins, D.S.: The QR algorithm revisited. SIAM Rev. 50 (1), 133–145 (2008). ISSN 0036-1445. doi:10.1137/060659454

Watson, G.A.: A Levenberg-Marquardt method for estimating polygonal regions. J. Comput. Appl. Math. 208 (2), 331–340 (2007). ISSN 0377-0427. doi:http://dx.doi.org/10.1016/j.cam.2006.10.001

Weideman, J.A.C.: Numerical integration of periodic functions: a few examples. Am. Math. Mon. 109 (1), 21–36 (2002). ISSN 00029890. http://www.jstor.org/stable/2695765

Weinstock, R.: Calculus of Variations: With Applications to Physics and Engineering. Dover, New York (1974). ISBN 9780486630694MATH

White, F.M.: Viscous Fluid Flow. McGraw Hill Series in Mechanical Engineering, 3rd edn. McGraw-Hill, New York (2005)

Wilkins, G., Gu, M.: A modified Brent’s method for finding zeros of functions. Numer. Math. 123 (1), 177–188 (2013). ISSN 0029-599X. doi:10.1007/s00211-012-0480-x. http://dx.doi.org/10.1007/s00211-012-0480-x

Williams, V.V.: Multiplying matrices faster than Coppersmith-Winograd. In: Proceedings of the 44th Annual ACM Symposium on Theory of Computing, STOC’12, pp. 887–898. ACM, New York, NY (2012). ISBN 978-1-4503-1245-5. doi:10.1145/2213977.2214056. http://doi.acm.org/10.1145/2213977.2214056

Wu, J., Brigham, K.G., Simon, M.A., Brigham, J.C.: An implementation of independent component analysis for 3D statistical shape analysis. Biomed. Signal Process. Control 13, 345–356 (2014). ISSN 1746-8094. doi:http://dx.doi.org/10.1016/j.bspc.2014.06.003

Xue, H., Miao, H., Wu, H.: Sieve estimation of constant and time-varying coefficients in nonlinear ordinary differential equation models by considering both numerical error and measurement error. Ann. Stat. 38 (4), 2351–2387 (2010). doi:10.1214/09-AOS784MathSciNetMATHCrossRef

Yamazaki, I., Li, X.S.: New scheduling strategies and hybrid programming for a parallel right-looking sparse LU factorization algorithm on multicore cluster systems. In: IEEE 26th International Parallel Distributed Processing Symposium (IPDPS), May 2012, pp. 619–630 (2012). doi:10. 1109/IPDPS.2012.63

Ypma, T.J.: Historical development of the Newton-Raphson method. SIAM Rev. 37 (4), 531–551 (1995). ISSN 0036-1445. doi:10.1137/1037125. http://dx.doi.org/10.1137/1037125

Zenil, H.: A Computable Universe: Understanding and Exploring Nature as Computation. World Scientific, Singapore (2012)CrossRef

Zhang, H., Cheng, Z.: The performance evaluation of classic ICA algorithms for blind separation of fabric defects. J. Fiber Bioeng. Inform. 7, 377–386 (2014)

Zhao, Q., Okada, K., Rosenbaum, K., Kehoe, L., Zand, D.J., Sze, R., Summar, M., Linguraru, M.G.: Digital facial dysmorphology for genetic screening: hierarchical constrained local model using ICA. Med. Image Anal. 18 (5), 699–710 (2014). ISSN 1361-8415. doi:http://dx.doi.org/10.1016/j.media.2014.04.002

Title: Introduction to Scientific Computing
Author: Mark H. Holmes
Publisher: Springer International Publishing
Book: Introduction to Scientific Computing and Data Analysis
Print ISBN: 978-3-319-30254-6

Electronic ISBN: 978-3-319-30256-0

Copyright Year: 2016
DOI: https://doi.org/10.1007/978-3-319-30256-0_1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner