skip to main content
10.1145/1048935.1050202acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
Article

High Resolution Forward And Inverse Earthquake Modeling on Terascale Computers

Authors Info & Claims
Published:15 November 2003Publication History

ABSTRACT

For earthquake simulations to play an important role in the reduction of seismic risk, they must be capable of high resolution and high fidelity. We have developed algorithms and tools for earthquake simulation based on multiresolution hexahedral meshes. We have used this capability to carry out 1 Hz simulations of the 1994 Northridge earthquake in the LA Basin using 100 million grid points. Our wave propagation solver sustains 1.21 teraflop/s for 4 hours on 3000 AlphaServer processors at 80% parallel efficiency. Because of uncertainties in characterizing earthquake source and basin material properties, a critical remaining challenge is to invert for source and material parameter fields for complex 3D basins from records of past earthquakes. Towards this end, we present results for material and source inversion of high-resolution models of basins undergoing antiplane motion using parallel scalable inversion algorithms that overcome many of the difficulties particular to inverse heterogeneous wave propagation problems.

References

  1. {1} R. ACAR AND C. R. VOGEL, Analysis of bounded variation penalty methods for ill-posed problems, Inverse Problems, 10 (1994), pp. 1217-1229.Google ScholarGoogle ScholarCross RefCross Ref
  2. {2} B. ADAMS, R. DAVIS, AND J. BERRILL, Modeling site effects in the Lower Hutt Valley, New Zealand, in 12th World Conference on Earthquake Engineering, Auckland, NZ, 2000.Google ScholarGoogle Scholar
  3. {3} V. AKÇELIK, G. BIROS, AND O. GHATTAS, Parallel multiscale Gauss-Newton-Krylov methods for inverse wave propagation, in Proceedings of IEEE/ACM SC2002 Conference, Baltimore, MD, Nov. 2002. SC2002 Best Technical Paper Award. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. {4} O. AXELSSON, Iterative Solution Methods, Cambridge Press, 1994. Google ScholarGoogle ScholarCross RefCross Ref
  5. {5} S. BALAY, K. BUSCHELMAN, W. D. GROPP, D. KAUSHIK, M. KNEPLEY, L. C. MCINNES, B. F. SMITH, AND H. ZHANG, PETSc home page. http://www.mcs.anl.gov/petsc, 2001.Google ScholarGoogle Scholar
  6. {6} H. BAO, J. BIELAK, O. GHATTAS, L. F. KALLIVOKAS, D. R. O'HALLARON, J. R. SHEWCHUK, AND J. XU, Earthquake ground motion modeling on parallel computers, in Supercomputing '96, Pittsburgh, Pennsylvania, Nov. 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. {7} H. BAO, J. BIELAK, O. GHATTAS, L. F. KALLIVOKAS, D. R. O'HALLARON, J. R. SHEWCHUK, AND J. XU, Large-scale simulation of elastic wave propagation in heterogeneous basins on parallel computers, Computer Methods in Applied Mechanics and Engineering, 152 (1998), pp. 85-102.Google ScholarGoogle ScholarCross RefCross Ref
  8. {8} R. BAYER AND E. M. MCCREIGHT, Organization and maintenance of large ordered indices, Acta Informatica, 1 (1972), pp. 173-189.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. {9} J. BIELAK, Y. HISADA, H. BAO, AND O. GHATTAS, One- vs two- or three-dimensional effects in sedimentary valleys, in Proc. 12th World Conference on Earthquake Engineering, Aukland, New Zealand, 2000.Google ScholarGoogle Scholar
  10. {10} J. BIELAK, L. KALLIVOKAS, J. XU, AND R. MONOPOLI, Finite element absorbing boundary for the wave equation in a halfplane with an application to engineering seismology, in Proc. of the Third International Conference on Mathematical and Numerical Aspects of Wave Propogation, Mandelieu-la-Napule, France, Apr. 1995, INRIA-SIAM, pp. 489-498.Google ScholarGoogle Scholar
  11. {11} J. BIELAK, K. LOUKAKIS, Y. HISADA, AND C. YOSHIMURA, Domain reduction method for three-dimensional earthquake modeling in localized regions, part I: Theory, Bulletin of the Seismological Society of America, (2003). In press.Google ScholarGoogle ScholarCross RefCross Ref
  12. {12} J. BIELAK, J. XU, AND O. GHATTAS, Earthquake ground motion and structural response in alluvial valleys, Journal of Geotechnical and Geoenvironmental Engineering, 125 (1999), pp. 413-423.Google ScholarGoogle ScholarCross RefCross Ref
  13. {13} G. BIROS AND O. GHATTAS, Parallel Lagrange-Newton-Krylov-Schur methods for PDE constrained optimization. Part I: The Krylov-Schur solver, SIAM Journal on Scientific Computing, (2003). Under revision. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. {14} G. BIROS AND O. GHATTAS, Parallel Lagrange-Newton-Krylov-Schur methods for PDE constrained optimization. Part II: The Lagrange-Newton solver, SIAM Journal on Scientific Computing, (2003). Under revision. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. {15} C. BUNKS, F. M. SALECK, S. ZALESKI, AND G. CHAVENT, Multiscale seismic waveform inversion, Geophysics, 50 (1995).Google ScholarGoogle Scholar
  16. {16} G. CHAVENT, F. CLÉMENT, AND S. GÒMEZ, Waveform inversion by MBTT formulation, in Proceedings of the 3rd International Conference on Mathematical and Numerical Aspects of Wave Propagation, Philadelphia, 1995, SIAM, pp. 713-722.Google ScholarGoogle Scholar
  17. {17} D. COMER, The ubiquitous B-Tree, ACM Computing Surveys, 11 (1979), pp. 121-137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. {18} S. M. DAY, PEER/SCEC validation and verification study of ground motion simulation codes, tech. report, SCEC Annual Meeting, Oxnard, California, September 2002.Google ScholarGoogle Scholar
  19. {19} I. GARGANTINI, An effecive way to represent quadtrees, Communicatoins of the ACM, 25 (1982), pp. 905- 910. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. {20} J. GRAY AND A. REUTER, Transaction Processing: Concepts and Techniques, Morgan Kaufmann Publishers, Sep 1992, ch. 15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. {21} A. GRIEWANK, Achieving logarithmic growth of temporal and spatial complexity in reverse automatic differentiation , Optimization Methods and Software, 1 (1992), pp. 35-54.Google ScholarGoogle ScholarCross RefCross Ref
  22. {22} Y. HISADA, H. BAO, J. BIELAK, O. GHATTAS, AND D. O'HALLARON, Simulations of long-period ground motions during the 1995 Hyogoken-Nanbu (Kobe) earthquake using 3D finite element method, in 2nd International Symposium on Effect of Surface Geology on Seismic Motion, Special Volume on Simultaneous Simulation for Kobe, K. Irikura, H. Kawase, and T. Iwata, eds., Yokohama, Japan, Dec. 1998, pp. 59-66.Google ScholarGoogle Scholar
  23. {23} G. KARYPIS, K. SCHLOEGEL, AND V. KUMAR, ParMETIS 3.0. http://www-users.cs.umn.edu/ ~karypis/metis/parmetis.Google ScholarGoogle Scholar
  24. {24} E. KIM, J. BIELAK, AND O. GHATTAS, Large-scale Northridge Earthquake simulation using octree-based multiresolution mesh method, in Proceedings of the 16th ASCE Engineering Mechanics Conference, Seattle, Washington, July 2003.Google ScholarGoogle Scholar
  25. {25} E. KIM, J. BIELAK, O. GHATTAS, AND J. WANG, Octree-based finite element method for large-scale earthquake ground motion modeling in heterogeneous basins, Eos Transactions AGU, 83 (2002). Fall Meet. Suppl., Abstract S12B-1221.Google ScholarGoogle Scholar
  26. {26} J. L. MORALES AND J. NOCEDAL, Automatic preconditioning by limited memory quasi-Newton updating, SIAM Journal on Optimization, 10 (2000), pp. 1079-1096. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. {27} G. M. MORTON, A computer oriented geodetic data base and a new technique in file sequencing, tech. report, IBM, Ottawa, Canada, 1966.Google ScholarGoogle Scholar
  28. {28} K. NAKAJIMA, Three-level hybrid vs. flat MPI on the Earth Simulator: Parallel iterative solvers for finite-element method, Applied Numerical Mathematics, (2003). Submitted. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. {29} K. NAKAJIMA AND H. OKUDA, Parallel iterative solvers for finite-element methods using a hybrid programming model on SMP cluster architectures, SIAM Journal on Scientific Computing, (2003). Submitted. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. {30} J. NOCEDAL AND S. J. WRIGHT, Numerical Optimization, Springer, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  31. {31} A. PAPALOU AND J. BIELAK, Seismic elastic response of earth dams with canyon interaction, Journal of Geotechnical Engineering, 127 (2001), pp. 446-453.Google ScholarGoogle ScholarCross RefCross Ref
  32. {32} F. J. SANCHEZ-SESMA, R. BENTES, AND J. BIELAK, The assessment of strong ground motion: What lies ahead?, in Proceedings of the 11th World Conference on Earthquake Engineering, Acapulco, Mexico, 1996. Paper No. 2014.Google ScholarGoogle Scholar
  33. {33} A. SILBERSCHATZ, H. F. KORTH, AND S. SUDARSHAN, Database system concepts, McGrill Hill Companies, Inc., third ed., 1997, ch. 11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. {34} W. W. SYMES, Velocity inversion: A case study in infinite-dimensional optimization, Mathematical Programming, 48 (1990), pp. 71-102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. {35} W. W. SYMES AND J. J. CARAZZONE, Velocity inversion by differential semblance optimization, Geophysics, 56 (1991), pp. 654-663.Google ScholarGoogle ScholarCross RefCross Ref
  36. {36} A. TARANTOLA, Inversion of seismic reflection data in the acoustic approximation, Geophysics, 49 (1984), pp. 1259-1266.Google ScholarGoogle ScholarCross RefCross Ref
  37. {37} T. TU, D. O'HALLARON, AND J. LOPEZ, Etree: A database-oriented method for generating large octree meshes, in Proceedings of the Eleventh International Meshing Roundtable, Ithaca, NY, Sep 2002, pp. 127-138.Google ScholarGoogle Scholar
  38. {38} C. R. VOGEL AND M. E. OMAN, Iterative methods for total variation denoising, SIAM Journal on Scientific Computing, 17 (1996), pp. 227-238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. {39} J. XU, J. BIELAK, O. GHATTAS, AND J. WANG, Large-scale modeling of earthquake ground motion in elastoplastic basins, Physics of the Earth and Planetary Interiors, (2003). In press.Google ScholarGoogle Scholar
  40. {40} C. YOSHIMURA, J. BIELAK, Y. HISADA, AND A. FERNANDEZ, Domain reduction method for three-dimensional earthquake modeling in localized regions, part II: Verification and applications, Bulletin of the Seismological Society of America, (2003). In press.Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing
    November 2003
    859 pages
    ISBN:1581136951
    DOI:10.1145/1048935

    Copyright © 2003 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 15 November 2003

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • Article

    Acceptance Rates

    SC '03 Paper Acceptance Rate60of207submissions,29%Overall Acceptance Rate1,516of6,373submissions,24%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader