skip to main content
research-article

SNOBFIT -- Stable Noisy Optimization by Branch and Fit

Published:01 July 2008Publication History
Skip Abstract Section

Abstract

The software package SNOBFIT for bound-constrained (and soft-constrained) noisy optimization of an expensive objective function is described. It combines global and local search by branching and local fits. The program is made robust and flexible for practical use by allowing for hidden constraints, batch function evaluations, change of search regions, etc.

References

  1. Anderson, E. J. and Ferris, M. C. 2001. A direct search algorithm for optimization of expensive functions by surrogates. SIAM J. Optim. 11, 837--857. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Booker, A. J., Dennis, Jr., J. E., Frank, P. D., Serafini, D. B., Torczon, V., and Trosset, M. W. 1999. A rigorous framework for optimization of expensive functions by surrogates. Structural Optim. 17, 1--13.Google ScholarGoogle ScholarCross RefCross Ref
  3. Carter, R. G., Gablonsky, J. M., Patrick, A., Kelley, C. T., and Eslinger, O. J. 2001. Algorithms for noisy problems in gas transmission pipeline optimization. Optim. Eng. 2, 139--157.Google ScholarGoogle ScholarCross RefCross Ref
  4. Choi, T. D. and Kelley, C. T. 2000. Superlinear convergence and implicit filtering. SIAM J. Optim. 10, 1149--1162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Conn, A. R., Scheinberg, K., and Toint, P. L. 1997. Recent progress in unconstrained nonlinear optimization without derivatives. Math. Program. 79B, 397--414. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Dallwig, S., Neumaier, A., and Schichl, H. 1997. GLOPT -- A program for constrained global optimization. In Developments in Global Optimization, I. M. Bomze et al., eds. Nonconvex Optimization and its Applications, vol. 18. Kluwer, Dordrecht, 19--36.Google ScholarGoogle Scholar
  7. Deuflhard, P. and Heindl, G. 1979. Affine invariant convergence theorems for Newton's method and extensions to related methods. SIAM J. Numer. Anal. 16, 1--10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Elster, C. and Neumaier, A. 1995. A grid algorithm for bound constrained optimization of noisy functions. IMA J. Numer. Anal. 15, 585--608.Google ScholarGoogle ScholarCross RefCross Ref
  9. Fiacco, A. and McCormick, G. P. 1990. Sequential Unconstrained Minimization Techniques. Classics in Applied Mathematics, vol. 4. SIAM, Philadelphia, PA.Google ScholarGoogle Scholar
  10. Guratzsch, R. F. 2007. Sensor placement optimization under uncertainty for structural health monitoring systems of hot aerospace structures. Ph.D. thesis, Department of Civil Engineering, Vanderbilt University, Nashville, TN.Google ScholarGoogle Scholar
  11. Hirsch, M. J., Meneses, C. N., Pardalos, P. M., and Resende, M. G. C. 2007. Global optimization by continuous grasp. Optim. Lett. 1, 201--212.Google ScholarGoogle ScholarCross RefCross Ref
  12. Hock, W. and Schittkowski, K. 1981. Test Examples for Nonlinear Programming. Lecture Notes in Economics and Mathematical Systems, vol. 187. Springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Huyer, W. and Neumaier, A. 1999. Global optimization by multilevel coordinate search. J. Global Optim. 14, 331--355. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jones, D. R. 2001. A taxonomy of global optimization methods based on response surfaces. J. Global Optim. 21, 345--383. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jones, D. R., Perttunen, C. D., and Stuckman, B. E. 1993. Lipschitzian optimization without the Lipschitz constant. J. Optim. Theory Appl. 79, 157--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jones, D. R., Schonlau, M., and Welch, W. J. 1998. Efficient global optimization of expensive black-box functions. J. Global Optim. 13, 455--492. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. McKay, M. D., Beckman, R. J., and Conover, W. J. 1979. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21, 239--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Nocedal, J. and Wright, S. J. 1999. Numerical Optimization. Springer Series in Operations Research. Springer.Google ScholarGoogle Scholar
  19. Owen, A. B. 1992. Orthogonal arrays for computer experiments, integration and visualization. Statistica Sinica 2, 439--452.Google ScholarGoogle Scholar
  20. Owen, A. B. 1994. Lattice sampling revisited: Monte Carlo variance of means over randomized orthogonal arrays. Ann. Stat. 22, 930--945.Google ScholarGoogle ScholarCross RefCross Ref
  21. Powell, M. J. D. 1998. Direct search algorithms for optimization calculations. Acta Numerica 7, 287--336.Google ScholarGoogle ScholarCross RefCross Ref
  22. Powell, M. J. D. 2002. UOBYQA: Unconstrained optimization by quadratic approximation. Math. Program. 92B, 555--582.Google ScholarGoogle ScholarCross RefCross Ref
  23. Sacks, J., Welch, W. J., Mitchell, T. J., and Wynn, H. P. 1989. Design and analysis of computer experiments. With comments and a rejoinder by the authors. Statist. Sci. 4, 409--435.Google ScholarGoogle ScholarCross RefCross Ref
  24. Scheinberg, K. 2003. Manual for Fortran software package DFO v2.0. https://projects.coin-or.org/Dfo/browser/trunk/manual2_0.ps.Google ScholarGoogle Scholar
  25. Schonlau, M. 1997. Computer experiments and global optimization. Ph.D. thesis, University of Waterloo, Waterloo, Ontario, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Schonlau, M. 1997--2001. SPACE Stochastic Process Analysis of Computer Experiments. http://www.schonlau.net.Google ScholarGoogle Scholar
  27. Schonlau, M., Welch, W. J., and Jones, D. R. 1998. Global versus local search in constrained optimization of computer models. In New Developments and Applications in Experimental Design, N. Flournoy et al., eds. Institute of Mathematical Statistics Lecture Notes -- Monograph Series 34. Institute of Mathematical Statistics, Hayward, CA, 11--25.Google ScholarGoogle Scholar
  28. Tang, B. 1993. Orthogonal array-based Latin hypercubes. J. Amer. Statist. Assoc. 88, 1392--1397.Google ScholarGoogle ScholarCross RefCross Ref
  29. Trosset, M. W. and Torczon, V. 1997. Numerical optimization using computer experiments. Tech. Rep. 97-38, ICASE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Vanden Berghen, F. and Bersini, H. 2005. CONDOR, a new parallel, constrained extension of Powell's UOBYQA algorithm: Experimental results and comparison with the DFO algorithm. J. Comput. Appl. Math. 181, 157--175. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Welch, W. J., Buck, R. J., Sacks, J., Wynn, H. P., Mitchell, T., and Morris, M. D. 1992. Screening, predicting, and computer experiments. Technometrics 34, 15--25. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. SNOBFIT -- Stable Noisy Optimization by Branch and Fit

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Mathematical Software
        ACM Transactions on Mathematical Software  Volume 35, Issue 2
        July 2008
        144 pages
        ISSN:0098-3500
        EISSN:1557-7295
        DOI:10.1145/1377612
        Issue’s Table of Contents

        Copyright © 2008 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 July 2008
        • Accepted: 1 November 2007
        • Revised: 1 July 2007
        • Received: 1 March 2004
        Published in toms Volume 35, Issue 2

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader