Skip to main content

2017 | OriginalPaper | Buchkapitel

The Variational Principles of Action

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter provides a theoretical perspective on action and the control of movement from the point of view of the free-energy principle. This variational principle offers an explanation for neuronal activity and ensuing behavior that is formulated in terms of dynamical systems and attracting sets. We will see that the free-energy principle emerges when considering the ensemble dynamics of biological systems like ourselves. When we look closely what this principle implies for the behavior of systems like the brain, one finds a fairly straightforward explanation for many aspects of action and perception; in particular, their (approximately Bayesian) optimality. Within the Bayesian brain framework, the ensuing dynamics can be separated into those serving perceptual inference, learning and behavior. Variational principles play a key role in what follows; both in understanding the nature of self-organizing systems but also in explaining the adaptive nature of neuronal dynamics and plasticity in terms of optimization—and the process theories that mediate optimal inference and motor control. A special focus of this chapter is the pre-eminent role of heteroclinic cycles in providing deep and dynamic (generative) models of the sensorium; particularly the sensations that we generate ourselves through action. In what follows, we will briefly rehearse the basic theory and illustrate its implications using simulations of action (handwriting)—and its observation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
We have used italics to distinguish action (integral of energy) from action (enacted by the agent).
 
Literatur
1.
Zurück zum Zitat W.R. Ashby, Principles of the self-organizing dynamic system. J. Gen. Psychol. 37, 125–128 (1947)CrossRef W.R. Ashby, Principles of the self-organizing dynamic system. J. Gen. Psychol. 37, 125–128 (1947)CrossRef
2.
Zurück zum Zitat D.H. Ballard, D. Kit, C.A. Rothkopf, B. Sullivan, A hierarchical modular architecture for embodied cognition. Multisensory Res. 26, 177 (2013)CrossRef D.H. Ballard, D. Kit, C.A. Rothkopf, B. Sullivan, A hierarchical modular architecture for embodied cognition. Multisensory Res. 26, 177 (2013)CrossRef
3.
Zurück zum Zitat F.P. Battaglia, G.R. Sutherland, B.L. McNaughton, Local sensory cues and place cell directionality: additional evidence of prospective coding in the hippocampus. J. Neurosci. 24(19), 4541–4550 (2004)CrossRef F.P. Battaglia, G.R. Sutherland, B.L. McNaughton, Local sensory cues and place cell directionality: additional evidence of prospective coding in the hippocampus. J. Neurosci. 24(19), 4541–4550 (2004)CrossRef
4.
Zurück zum Zitat C. Bernard, Lectures on the phenomena common to animals and plants. Trans Hoff HE, Guillemin R, Guillemin L, Springfield (IL): Charles C Thomas (1974). ISBN 978-0398028572 C. Bernard, Lectures on the phenomena common to animals and plants. Trans Hoff HE, Guillemin R, Guillemin L, Springfield (IL): Charles C Thomas (1974). ISBN 978-0398028572
5.
Zurück zum Zitat G. Buason, N. Bergfeldt, T. Ziemke, Brains, bodies, and beyond: competitive co-evolution of robot controllers, morphologies, and environments. Genet. Program. Evolvable Mach. 6(1), 25–51 (2005)CrossRef G. Buason, N. Bergfeldt, T. Ziemke, Brains, bodies, and beyond: competitive co-evolution of robot controllers, morphologies, and environments. Genet. Program. Evolvable Mach. 6(1), 25–51 (2005)CrossRef
6.
Zurück zum Zitat N. Burgess, C. Barry, J. O’Keefe, An oscillatory interference model of grid cell firing. Hippocampus 17(9), 801–812 (2007)CrossRef N. Burgess, C. Barry, J. O’Keefe, An oscillatory interference model of grid cell firing. Hippocampus 17(9), 801–812 (2007)CrossRef
7.
Zurück zum Zitat R.L. Carhart-Harris, K.J. Friston, The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas. Brain 133(Pt 4), 1265–1283 (2010)CrossRef R.L. Carhart-Harris, K.J. Friston, The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas. Brain 133(Pt 4), 1265–1283 (2010)CrossRef
8.
Zurück zum Zitat C.F. Camerer, Behavioural studies of strategic thinking in games. Trends Cogn. Sci. 7(5), 225–231 (2003)CrossRef C.F. Camerer, Behavioural studies of strategic thinking in games. Trends Cogn. Sci. 7(5), 225–231 (2003)CrossRef
9.
Zurück zum Zitat A. Clark, Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36, 181–204 (2013)CrossRef A. Clark, Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36, 181–204 (2013)CrossRef
10.
Zurück zum Zitat J.D. Cohen, S.M. McClure, A.J. Yu, Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos. Trans. R Soc. Lond. B Biol. Sci. 362(1481), 933–942 (2007)CrossRef J.D. Cohen, S.M. McClure, A.J. Yu, Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos. Trans. R Soc. Lond. B Biol. Sci. 362(1481), 933–942 (2007)CrossRef
11.
Zurück zum Zitat F. Colas, J. Diard, P. Bessiere, Common Bayesian models for common cognitive issues. Acta Biotheoretica 58, 191–216 (2010)CrossRef F. Colas, J. Diard, P. Bessiere, Common Bayesian models for common cognitive issues. Acta Biotheoretica 58, 191–216 (2010)CrossRef
12.
Zurück zum Zitat N.D. Daw, K. Doya, The computational neurobiology of learning and reward. Current Opinion Neurobiol. 16(2), 199–204 (2006)CrossRef N.D. Daw, K. Doya, The computational neurobiology of learning and reward. Current Opinion Neurobiol. 16(2), 199–204 (2006)CrossRef
13.
Zurück zum Zitat P. Dayan, G.E. Hinton, R.M. Neal, The Helmholtz machine. Neural Comput. 7, 889–904 (1995)CrossRef P. Dayan, G.E. Hinton, R.M. Neal, The Helmholtz machine. Neural Comput. 7, 889–904 (1995)CrossRef
14.
Zurück zum Zitat G. Di Pellegrino, L. Fadiga, L. Fogassi, V. Gallese, G. Rizzolatti, Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176–80 (1992)CrossRef G. Di Pellegrino, L. Fadiga, L. Fogassi, V. Gallese, G. Rizzolatti, Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176–80 (1992)CrossRef
15.
Zurück zum Zitat G. Dragoi, G. Buzsáki, Temporal encoding of place sequences by hippocampal cell assemblies. Neuron 50(1), 145–157 (2006)CrossRef G. Dragoi, G. Buzsáki, Temporal encoding of place sequences by hippocampal cell assemblies. Neuron 50(1), 145–157 (2006)CrossRef
16.
Zurück zum Zitat D.J. Evans, A non-equilibrium free-energy theorem for deterministic systems. Mol. Phys. 101, 1551–1554 (2003)CrossRef D.J. Evans, A non-equilibrium free-energy theorem for deterministic systems. Mol. Phys. 101, 1551–1554 (2003)CrossRef
17.
Zurück zum Zitat H. Feldman, K.J. Friston, Attention, uncertainty, and free-energy. Front Hum. Neurosci. 4, 215 (2010)CrossRef H. Feldman, K.J. Friston, Attention, uncertainty, and free-energy. Front Hum. Neurosci. 4, 215 (2010)CrossRef
18.
Zurück zum Zitat M. Ferro, D. Ognibene, G. Pezzulo, V. Pirrelli, Reading as active sensing: a computational model of gaze planning during word recognition. Front. Neurorobotics 4, 1 (2010) M. Ferro, D. Ognibene, G. Pezzulo, V. Pirrelli, Reading as active sensing: a computational model of gaze planning during word recognition. Front. Neurorobotics 4, 1 (2010)
19.
Zurück zum Zitat R.P. Feynman, Statistical Mechanics (Benjamin, Reading, 1972) R.P. Feynman, Statistical Mechanics (Benjamin, Reading, 1972)
20.
Zurück zum Zitat T.H. FitzGerald, P. Schwartenbeck, M. Moutoussis, R.J. Dolan, K. Friston, Active inference, evidence accumulation, and the urn task. Neural Comput. 27, 306–328 (2015)CrossRef T.H. FitzGerald, P. Schwartenbeck, M. Moutoussis, R.J. Dolan, K. Friston, Active inference, evidence accumulation, and the urn task. Neural Comput. 27, 306–328 (2015)CrossRef
21.
Zurück zum Zitat L. Fogassi, P.F. Ferrari, B. Gesierich, S. Rozzi, F. Chersi, G. Rizzolatti, Parietal lobe: from action organization to intention understanding. Science 308, 662–667 (2005)CrossRef L. Fogassi, P.F. Ferrari, B. Gesierich, S. Rozzi, F. Chersi, G. Rizzolatti, Parietal lobe: from action organization to intention understanding. Science 308, 662–667 (2005)CrossRef
22.
Zurück zum Zitat K.J. Friston, A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 815–836 (2005)CrossRef K.J. Friston, A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 815–836 (2005)CrossRef
23.
Zurück zum Zitat K. Friston, The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11(2), 127–138 (2010)CrossRef K. Friston, The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11(2), 127–138 (2010)CrossRef
24.
Zurück zum Zitat K. Friston, Life as we know it. J. R. Soc. Interface 10, 20130475 (2013)CrossRef K. Friston, Life as we know it. J. R. Soc. Interface 10, 20130475 (2013)CrossRef
25.
Zurück zum Zitat K. Friston, J. Daunizeau, S. Kiebel, Active inference or reinforcement learning? PLoS One 4(7), e6421 (2009)CrossRef K. Friston, J. Daunizeau, S. Kiebel, Active inference or reinforcement learning? PLoS One 4(7), e6421 (2009)CrossRef
26.
Zurück zum Zitat K.J. Friston, J. Daunizeau, J. Kilner, S.J. Kiebel, Action and behavior: a free-energy formulation. Biol. Cybern. 102(3), 227–260 (2010)CrossRef K.J. Friston, J. Daunizeau, J. Kilner, S.J. Kiebel, Action and behavior: a free-energy formulation. Biol. Cybern. 102(3), 227–260 (2010)CrossRef
28.
Zurück zum Zitat K. Friston, R. Adams, R. Montague, What is value-accumulated reward or evidence? Front. Neurorobotics 6, 11 (2012)CrossRef K. Friston, R. Adams, R. Montague, What is value-accumulated reward or evidence? Front. Neurorobotics 6, 11 (2012)CrossRef
29.
Zurück zum Zitat K. Friston, R.A. Adams, L. Perrinet, M. Breakspear, Perceptions as hypotheses: saccades as experiments. Front. Psychol. 3, 151 (2012) K. Friston, R.A. Adams, L. Perrinet, M. Breakspear, Perceptions as hypotheses: saccades as experiments. Front. Psychol. 3, 151 (2012)
30.
Zurück zum Zitat K. Friston, P. Schwartenbeck, T. FitzGerald, M. Moutoussis, T. Behrens, J. Raymond, R.J. Dolan, The anatomy of choice: active inference and agency. Front. Hum. Neurosci. 7, 598 (2013)CrossRef K. Friston, P. Schwartenbeck, T. FitzGerald, M. Moutoussis, T. Behrens, J. Raymond, R.J. Dolan, The anatomy of choice: active inference and agency. Front. Hum. Neurosci. 7, 598 (2013)CrossRef
31.
Zurück zum Zitat K. Friston, M. Levin, B. Sengupta, G. Pezzulo, Knowing one’s place: a free-energy approach to pattern regulation. J. R. Soc. Interface 12 (2015) K. Friston, M. Levin, B. Sengupta, G. Pezzulo, Knowing one’s place: a free-energy approach to pattern regulation. J. R. Soc. Interface 12 (2015)
32.
Zurück zum Zitat K. Friston, F. Rigoli, D. Ognibene, C. Mathys, T. Fitzgerald, G. Pezzulo, Active inference and epistemic value. Cogn. Neurosci. 1–28 (2015) K. Friston, F. Rigoli, D. Ognibene, C. Mathys, T. Fitzgerald, G. Pezzulo, Active inference and epistemic value. Cogn. Neurosci. 1–28 (2015)
33.
Zurück zum Zitat V. Gallese, A. Goldman, Mirror-neurons and the simulation theory of mind reading. Trends Cogn. Sci. 2, 493–501 (1998)CrossRef V. Gallese, A. Goldman, Mirror-neurons and the simulation theory of mind reading. Trends Cogn. Sci. 2, 493–501 (1998)CrossRef
34.
Zurück zum Zitat R.L. Gregory, Perceptions as hypotheses. Phil. Trans. R. Soc. Lond. B 290, 181–197 (1980)CrossRef R.L. Gregory, Perceptions as hypotheses. Phil. Trans. R. Soc. Lond. B 290, 181–197 (1980)CrossRef
36.
Zurück zum Zitat H. Haken, Synergetics: An Introduction. Non-Equilibrium Phase Transition and Self-Organization in Physics, Chemistry and Biology, 3rd edn. (Springer, Heidelberg, 1983)CrossRefMATH H. Haken, Synergetics: An Introduction. Non-Equilibrium Phase Transition and Self-Organization in Physics, Chemistry and Biology, 3rd edn. (Springer, Heidelberg, 1983)CrossRefMATH
37.
Zurück zum Zitat C.M. Harris, D.M. Wolpert, Signal-dependent noise determines motor planning. Nature 394, 780–784 (1998)CrossRef C.M. Harris, D.M. Wolpert, Signal-dependent noise determines motor planning. Nature 394, 780–784 (1998)CrossRef
38.
Zurück zum Zitat G.E. Hinton, D. van Cramp, Keeping neural networks simple by minimizing the description length of weights, in Proceedings of COLT-93 (1993), pp. 5–13 G.E. Hinton, D. van Cramp, Keeping neural networks simple by minimizing the description length of weights, in Proceedings of COLT-93 (1993), pp. 5–13
39.
Zurück zum Zitat J. Hohwy, The Self-Evidencing Brain. Noûs (2014) J. Hohwy, The Self-Evidencing Brain. Noûs (2014)
40.
Zurück zum Zitat G. Huang, Is this a unified theory of the brain? New Sci. Mag. (2658) (2008) G. Huang, Is this a unified theory of the brain? New Sci. Mag. (2658) (2008)
41.
Zurück zum Zitat S. Ishii, W. Yoshida, J. Yoshimoto, Control of exploitation-exploration meta-parameter in reinforcement learning. Neural Netw. 15(4–6), 665–687 (2002)CrossRef S. Ishii, W. Yoshida, J. Yoshimoto, Control of exploitation-exploration meta-parameter in reinforcement learning. Neural Netw. 15(4–6), 665–687 (2002)CrossRef
42.
Zurück zum Zitat S. Kauffman, The Origins of Order: Self-Organization and Selection in Evolution (Oxford University Press, Oxford, 1993) S. Kauffman, The Origins of Order: Self-Organization and Selection in Evolution (Oxford University Press, Oxford, 1993)
43.
Zurück zum Zitat D. Kersten, P. Mamassian, A. Yuille, Object perception as Bayesian inference. Annu. Rev. Psychol. 55, 271–304 (2004)CrossRef D. Kersten, P. Mamassian, A. Yuille, Object perception as Bayesian inference. Annu. Rev. Psychol. 55, 271–304 (2004)CrossRef
44.
Zurück zum Zitat S.J. Kiebel, K. von Kriegstein, J. Daunizeau, K.J. Friston, Recognizing sequences of sequences. PLoS Comput. Biol. 5, e1000464 (2009) S.J. Kiebel, K. von Kriegstein, J. Daunizeau, K.J. Friston, Recognizing sequences of sequences. PLoS Comput. Biol. 5, e1000464 (2009)
45.
Zurück zum Zitat D. Kirsh, Adapting the environment instead of oneself. Adapt. Behavr. 4(3/4), 415–452 (1996)CrossRef D. Kirsh, Adapting the environment instead of oneself. Adapt. Behavr. 4(3/4), 415–452 (1996)CrossRef
46.
Zurück zum Zitat D.C. Knill, A. Pouget, The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27(12), 712–719 (2004)CrossRef D.C. Knill, A. Pouget, The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27(12), 712–719 (2004)CrossRef
47.
Zurück zum Zitat D. Kropotova, D. Vetrovb, General solutions for information-based and Bayesian approaches to model selection in linear regression and their equivalence. Pattern Recognit. Image Anal. 19(3), 447–455 (2009)CrossRef D. Kropotova, D. Vetrovb, General solutions for information-based and Bayesian approaches to model selection in linear regression and their equivalence. Pattern Recognit. Image Anal. 19(3), 447–455 (2009)CrossRef
48.
Zurück zum Zitat O. Lebeltel, P. Bessière, Basic concepts of Bayesian programming, in Probabilistic Reasoning and Decision Making in Sensory-Motor Systems (Springer, 2008), pp. 19–48 O. Lebeltel, P. Bessière, Basic concepts of Bayesian programming, in Probabilistic Reasoning and Decision Making in Sensory-Motor Systems (Springer, 2008), pp. 19–48
49.
Zurück zum Zitat E.M. Lifshitz, L.P. Pitaevskii, Physical Kinetics (Pergamon, London, 1981) E.M. Lifshitz, L.P. Pitaevskii, Physical Kinetics (Pergamon, London, 1981)
50.
Zurück zum Zitat D.J.C. MacKay, Free-energy minimization algorithm for decoding and cryptoanalysis. Electron. Lett. 31, 445–447 (1995)CrossRef D.J.C. MacKay, Free-energy minimization algorithm for decoding and cryptoanalysis. Electron. Lett. 31, 445–447 (1995)CrossRef
51.
Zurück zum Zitat M. Moutoussis, N.J. Trujillo-Barreto, W. El-Deredy, R.J. Dolan, K.J. Friston, A formal model of interpersonal inference. Front. Hum. Neurosci. 8, 160 (2014)CrossRef M. Moutoussis, N.J. Trujillo-Barreto, W. El-Deredy, R.J. Dolan, K.J. Friston, A formal model of interpersonal inference. Front. Hum. Neurosci. 8, 160 (2014)CrossRef
52.
Zurück zum Zitat D. Mumford, On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol. Cybern. 66, 241–51 (1992)CrossRef D. Mumford, On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol. Cybern. 66, 241–51 (1992)CrossRef
53.
Zurück zum Zitat R.M. Neal, G.E. Hinton, A view of the EM algorithm that justifies incremental, sparse, and other variants’, in Learning in Graphical Models, ed. by M.I. Jordan (Kluwer Academic Publishers, Dordrecht, 1998), pp. 355–368CrossRef R.M. Neal, G.E. Hinton, A view of the EM algorithm that justifies incremental, sparse, and other variants’, in Learning in Graphical Models, ed. by M.I. Jordan (Kluwer Academic Publishers, Dordrecht, 1998), pp. 355–368CrossRef
54.
Zurück zum Zitat G. Nicolis, I. Prigogine, Self-Organization in Non-Equilibrium Systems (Wiley, New York, 1977)MATH G. Nicolis, I. Prigogine, Self-Organization in Non-Equilibrium Systems (Wiley, New York, 1977)MATH
55.
Zurück zum Zitat D.W. North, A tutorial introduction to decision theory. IEEE Trans. Syst. Sci. Cybern. 4(3), 200–210 (1968)CrossRef D.W. North, A tutorial introduction to decision theory. IEEE Trans. Syst. Sci. Cybern. 4(3), 200–210 (1968)CrossRef
56.
Zurück zum Zitat J. O’Keefe, Do hippocampal pyramidal cells signal non-spatial as well as spatial information? Hippocampus 9(4), 352–364 (1999)CrossRef J. O’Keefe, Do hippocampal pyramidal cells signal non-spatial as well as spatial information? Hippocampus 9(4), 352–364 (1999)CrossRef
57.
Zurück zum Zitat R.P. Rao, D.H. Ballard, Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects. Nat. Neurosci. 2, 79–87 (1998)CrossRef R.P. Rao, D.H. Ballard, Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects. Nat. Neurosci. 2, 79–87 (1998)CrossRef
58.
Zurück zum Zitat R.A. Rescorla, A.R. Wagner, A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement, in Classical Conditioning II: Current Research and Theory, ed. by A.H. Black, W.F. Prokasy (Appleton Century Crofts, New York, 1972), pp. 64–99 R.A. Rescorla, A.R. Wagner, A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement, in Classical Conditioning II: Current Research and Theory, ed. by A.H. Black, W.F. Prokasy (Appleton Century Crofts, New York, 1972), pp. 64–99
59.
Zurück zum Zitat M. Rabinovich, R. Huerta, G. Laurent, Neuroscience. Transient dynamics for neural processing. Science 321, 48–50 (2008)CrossRef M. Rabinovich, R. Huerta, G. Laurent, Neuroscience. Transient dynamics for neural processing. Science 321, 48–50 (2008)CrossRef
60.
Zurück zum Zitat G. Rizzolatti, L. Craighero, The mirror-neuron system. Ann. Rev. Neurosci. 27, 169–192 (2004)CrossRef G. Rizzolatti, L. Craighero, The mirror-neuron system. Ann. Rev. Neurosci. 27, 169–192 (2004)CrossRef
61.
Zurück zum Zitat P. Schwartenbeck, T.H. FitzGerald, C. Mathys, R. Dolan, K. Friston, The dopaminergic midbrain encodes the expected certainty about desired outcomes. Cereb. Cortex 25, 3434–3445 (2015)CrossRef P. Schwartenbeck, T.H. FitzGerald, C. Mathys, R. Dolan, K. Friston, The dopaminergic midbrain encodes the expected certainty about desired outcomes. Cereb. Cortex 25, 3434–3445 (2015)CrossRef
62.
Zurück zum Zitat P. Schwartenbeck, T.H. FitzGerald, C. Mathys, R. Dolan, M. Kronbichler, K. Friston, Evidence for surprise minimization over value maximization in choice behavior. Sci. Rep. 5, 16575 (2015)CrossRef P. Schwartenbeck, T.H. FitzGerald, C. Mathys, R. Dolan, M. Kronbichler, K. Friston, Evidence for surprise minimization over value maximization in choice behavior. Sci. Rep. 5, 16575 (2015)CrossRef
63.
Zurück zum Zitat P. Schwartenbeck, T.H. FitzGerald, C. Mathys, R. Dolan, F. Wurst, M. Kronbichler, K. Friston, Optimal inference with suboptimal models: addiction and active Bayesian inference. Med. Hypotheses 84, 109–117 (2015)CrossRef P. Schwartenbeck, T.H. FitzGerald, C. Mathys, R. Dolan, F. Wurst, M. Kronbichler, K. Friston, Optimal inference with suboptimal models: addiction and active Bayesian inference. Med. Hypotheses 84, 109–117 (2015)CrossRef
64.
Zurück zum Zitat G. Sella, A.E. Hirsh, The application of statistical physics to evolutionary biology. Proc. Natl. Acad. Sci. USA 102(27), 9541–9546 (2005)CrossRef G. Sella, A.E. Hirsh, The application of statistical physics to evolutionary biology. Proc. Natl. Acad. Sci. USA 102(27), 9541–9546 (2005)CrossRef
65.
Zurück zum Zitat A.K. Seth, Interoceptive inference, emotion, and the embodied self. Trends Cogn. Sci. 17, 565–573 (2013)CrossRef A.K. Seth, Interoceptive inference, emotion, and the embodied self. Trends Cogn. Sci. 17, 565–573 (2013)CrossRef
66.
Zurück zum Zitat W.E. Skaggs, B.L. McNaughton, M.A. Wilson, C.A. Barnes, Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 6, 149–172 (1996) W.E. Skaggs, B.L. McNaughton, M.A. Wilson, C.A. Barnes, Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 6, 149–172 (1996)
67.
Zurück zum Zitat S.M. Sherman, R.W. Guillery, Exploring the Thalamus and its Role in Cortical Function (MIT Press, Cambridge, 2006) S.M. Sherman, R.W. Guillery, Exploring the Thalamus and its Role in Cortical Function (MIT Press, Cambridge, 2006)
68.
Zurück zum Zitat R.S. Sutton, A.G. Barto, Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 88(2), 135–170 (1981)CrossRef R.S. Sutton, A.G. Barto, Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 88(2), 135–170 (1981)CrossRef
69.
Zurück zum Zitat C. Thornton, Some puzzles relating to the free-energy principle: comment on Friston. Trends Cogn. Sci. 14(2), 53–54 (2010); author reply 54–55 C. Thornton, Some puzzles relating to the free-energy principle: comment on Friston. Trends Cogn. Sci. 14(2), 53–54 (2010); author reply 54–55
70.
Zurück zum Zitat M. Tsodyks, Attractor neural network models of spatial maps in hippocampus. Hippocampus 9(4), 481–489 (1999)CrossRef M. Tsodyks, Attractor neural network models of spatial maps in hippocampus. Hippocampus 9(4), 481–489 (1999)CrossRef
71.
Zurück zum Zitat H. von Helmholtz, Concerning the perceptions in general, in Treatise on physiological optics, vol. III, 3rd edn. (1866) (translated by J.P.C. Southall, 1925 Opt. Soc. Am. Section 26, reprinted New York: Dover, 1962) H. von Helmholtz, Concerning the perceptions in general, in Treatise on physiological optics, vol. III, 3rd edn. (1866) (translated by J.P.C. Southall, 1925 Opt. Soc. Am. Section 26, reprinted New York: Dover, 1962)
72.
Zurück zum Zitat Y. Weiss, Correctness of local probability propagation in graphical models with loops. Neural Comput. 12, 1–41 (2000)CrossRef Y. Weiss, Correctness of local probability propagation in graphical models with loops. Neural Comput. 12, 1–41 (2000)CrossRef
73.
Zurück zum Zitat R.H. Wurtz, K. McAlonan, J. Cavanaugh, R.A. Berman, Thalamic pathways for active vision. Trends Cogn. Sci. 5, 177–184 (2011)CrossRef R.H. Wurtz, K. McAlonan, J. Cavanaugh, R.A. Berman, Thalamic pathways for active vision. Trends Cogn. Sci. 5, 177–184 (2011)CrossRef
74.
Zurück zum Zitat T. Ziemke, Introduction to the special issue on situated and embodied cognition. Cogn. Systs. Res. 3(3), 271–274 (2002)CrossRef T. Ziemke, Introduction to the special issue on situated and embodied cognition. Cogn. Systs. Res. 3(3), 271–274 (2002)CrossRef
Metadaten
Titel
The Variational Principles of Action
verfasst von
Karl Friston
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-51547-2_10

Neuer Inhalt