skip to main content
article

A calculus for probabilistic languages

Published:18 January 2003Publication History
Skip Abstract Section

Abstract

As probabilistic computation plays an increasing role in diverse fields in computer science, researchers have designed new languages to facilitate the development of probabilistic programs. In this paper, we develop a probabilistic calculus by extending the traditional lambda calculus. In our calculus, every expression denotes a probability distribution yet evaluates to a regular value. The most notable feature of our calculus is that it is founded upon sampling functions, which map the unit interval to probability domains. As a consequence, we achieve a unified representation scheme for all types of probability distributions. In order to support an efficient implementation of the calculus, we also develop a refinement type system which is capable of distinguishing expressions denoting regular values from expressions denoting probability distributions. We use a novel formulation of the intuitionistic modal logic S4 with an intersection connective in the refinement type system. We present preliminary evidence that a probabilistic language based upon our calculus is viable in applications involving massive probabilistic computation.

References

  1. P. Bratley, B. Fox, and L. Schrage. A guide to simulation. Springer Verlag, 2nd edition, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. Davies and F. Pfenning. Intersection types and computational effects. In ICFP-00, pages 198--208. ACM Press, 2000. Google ScholarGoogle Scholar
  3. R. Davies and F. Pfenning. A modal analysis of staged computation. Journal of the ACM, 48(3), 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. A. Edalat and P. J. Potts. A new representation for exact real numbers. In Electronic Notes in Theoretical Computer Science, volume 6. Elsevier Science Publishers, 2000.Google ScholarGoogle Scholar
  5. D. Fox, W. Burgard, F. Dellaert, and S. Thrun. Monte carlo localization: Efficient position estimation for mobile robots. In AAAI-99, pages 343--349. AAAI/MIT Press, 1999. Google ScholarGoogle Scholar
  6. J. Gill. Computational complexity of probabilistic Turing machines. SIAM Journal on Computing, 6(4):675--695, 1977.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. V. Gupta, R. Jagadeesan, and P. Panangaden. Stochastic processes as concurrent constraint programs. In 26th ACM POPL, pages 189--202. ACM Press, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. H. Jazwinski. Stochastic Processes and Filtering Theory. Academic Press, New York, 1970.Google ScholarGoogle Scholar
  9. C. Jones. Probabilistic Non-Determinism. PhD thesis, Department of Computer Science, University of Edinburgh, 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. D. Koller, D. McAllester, and A. Pfeffer. Effective Bayesian inference for stochastic programs. In AAAI-97/IAAI-97, pages 740--747. AAAI Press, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. D. Kozen. Semantics of probabilistic programs. Journal of Computer and System Sciences, 22(3):328--350, 1981.Google ScholarGoogle ScholarCross RefCross Ref
  12. J. Maraist, M. Odersky, and P. Wadler. The call-by-need lambda calculus. Journal of Functional Programming, 8(3):275--317, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Pfeffer. IBAL: A probabilistic rational programming language. In IJCAI-01, pages 733--740. Morgan Kaufmann Publishers, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. F. Pfenning and R. Davies. A judgmental reconstruction of modal logic. Mathematical Structures in Computer Science, 11(4):511--540, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. D. Pless and G. Luger. Toward general analysis of recursive probability models. In UAI-01, pages 429--436. Morgan Kaufmann Publishers, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. N. Ramsey and A. Pfeffer. Stochastic lambda calculus and monads of probability distributions. In 29th ACM POPL, pages 154--165. ACM Press, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. N. Saheb-Djahromi. Probabilistic LCF. In Proceedings of the 7th Symposium on S. Thrun.18. Probabilistic algorithms in robotics. AI Magazine, 21(4):93--109, 2000.Google ScholarGoogle Scholar
  18. S. Thrun. Towards programming tools for robots that integrate probabilistic computation and learning. In ICRA-00. IEEE, 2000.Google ScholarGoogle Scholar

Index Terms

  1. A calculus for probabilistic languages

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM SIGPLAN Notices
          ACM SIGPLAN Notices  Volume 38, Issue 3
          March 2003
          134 pages
          ISSN:0362-1340
          EISSN:1558-1160
          DOI:10.1145/640136
          Issue’s Table of Contents
          • cover image ACM Conferences
            TLDI '03: Proceedings of the 2003 ACM SIGPLAN international workshop on Types in languages design and implementation
            January 2003
            144 pages
            ISBN:1581136498
            DOI:10.1145/604174

          Copyright © 2003 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 18 January 2003

          Check for updates

          Qualifiers

          • article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader