nach oben

Erschienen in:

2013 | OriginalPaper | Buchkapitel

2. Foundations and Formalizations of Self-Organization

verfasst von : Daniel Polani

Erschienen in: Advances in Applied Self-Organizing Systems

Verlag: Springer London

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In view of the various streams and directions of the field of self-organization, it is beyond the present introductory chapter to review all the currents of research in the field. Rather, the aim of the present section is to address some of the points judged as most relevant and to provide a discussion of suitable candidate formalisms for the treatment of self-organization. In the author’s opinion, discussing formalisms is not just a vain exercise, but allows one to isolate the essence of the notion one wishes to develop. Thus even if one disagrees with the path taken (as is common in the case of not yet universally agreed upon formal notions), starting from operational formalisms helps to serve as a compass guiding one towards notions suitable for one’s purposes. This is the philosophy of the present chapter. The chapter is structured as follows: in Sect. 2.2, we will present several central conceptual issues relevant in the context of self-organization. Some historical remarks about related relevant work are then done in Sect. 2.3. To illustrate the setting, a brief overview over some classical examples for self-organizing processes is given in Sect. 2.4. In Sects. 2.5 and 2.6, introduces the two main information-theoretic concepts of self-organization that the present chapter aims to discuss. One concept, based on the ϵ-machine formalism by Crutchfield and Shalizi, introduces self-organization as an increase of (statistical) complexity with time. The other concept will suggest measuring self-organization as an increase of mutual correlations (measured by multiinformation) between different components of a system. In Sect. 2.7, finally, important properties of these two measures as well as their distinctive characteristics (namely their power to identify temporal versus compositional self-organization) will be discussed, before Sect. 2.8 gives some conclusive remarks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Design Versus Self-Organization

Nächstes Kapitel Self-Organizing Traffic Lights: A Realistic Simulation

Nur mit Berechtigung zugänglich

Emergence is briefly discussed in Sects. 2.5.2 and 2.6.1.

As an example, the energy balance of real biological computation process will operate at the ATP metabolism level and respect its restrictions—but this is still far off the Landauer limit.

Here we ignore technical details necessary to properly define the dynamics.

Note that, in general, the construction of an ϵ-machine from the visible process variables X is not necessarily possible, and the reader should be aware that the Shalizi/Crutchfield model is required to fulfil suitable properties for the reconstruction to work. I am indebted to Nihat Ay and Wolfgang Löhr for pointing this out to me.

This is a generalization of Eq. (3) from Tononi et al. (1994) for the bipartite case to the multipartite case.

This property is related to a property that can be proven for graphical models, see e.g. Proposition 2.1 in Slonim et al. (2001).

Adami, C. (1998). Introduction to artificial life. New York: Springer. MATHCrossRef

Ashby, W. R. (1947). Principles of the self-organizing dynamic system. The Journal of General Psychology, 37, 125–128. CrossRef

Ay, N., & Krakauer, D. C. (2007). Geometric robustness theory and biological networks. Theory in Biosciences, 125(2), 93–121.

Ay, N., & Polani, D. (2008). Information flows in causal networks. Advances in Complex Systems, 11(1), 17–41. MathSciNetMATHCrossRef

Ay, N., & Wennekers, T. (2003). Dynamical properties of strongly interacting Markov chains. Neural Networks, 16(10), 1483–1497. CrossRef

Baas, N. A., & Emmeche, C. (1997). On emergence and explanation. Intellectica, 2(25), 67–83.

Bar-Yam, Y. (1997). Dynamics of complex systems. Studies in nonlinearity. Boulder: Westview Press.

Bennett, C. H., & Landauer, R. (1985). The fundamental limits of computation. Scientific American, 253(1), 48–56. CrossRef

Bertschinger, N., Olbrich, E., Ay, N., & Jost, J. (2006). Autonomy: an information theoretic perspective. In Proc. workshop on artificial autonomy at Alife X, Bloomington, Indiana (pp. 7–12).

Comon, P. (1991). Independent component analysis. In Proc. intl. signal processing workshop on higher-order statistics, Chamrousse, France (pp. 111–120).

Crutchfield, J. P. (1994). The calculi of emergence: computation, dynamics, and induction. Physica D, 11–54.

Crutchfield, J. P., & Young, K. (1989). Inferring statistical complexity. Physical Review Letters, 63, 105–108. MathSciNetCrossRef

Emmeche, C., Køppe, S., & Stjernfelt, F. (2000). Levels, emergence, and three versions of downward causation. In P. B. Andersen, C. Emmeche, N. O. Finnemann, & P. V. Christiansen (Eds.), Downward causation. minds, bodies and matter (pp. 13–34). Århus: Aarhus University Press.

Golubitsky, M., & Stewart, I. (2003). The symmetry perspective. Basel: Birkhäuser.

Grassberger, P. (1986). Toward a quantitative theory of self-generated complexity. International Journal of Theoretical Physics, 25, 907–938. MathSciNetMATHCrossRef

Haken, H. (1983). Advanced synergetics. Berlin: Springer. MATH

Harvey, I. (2000). The 3 Es of artificial life: emergence, embodiment and evolution. Invited talk at Artificial Life VII, 1–6 August, Portland, Oregon.

Helbing, D., Buzna, L., Johansson, A., & Werner, T. (2005). Self-organized pedestrian crowd dynamics: experiments, simulations, and design solutions. Transportation Science, 39(1), 1–24. CrossRef

Hoyle, R. (2006). Pattern formation. Cambridge: Cambridge University Press. MATHCrossRef

Jetschke, G. (1989). Mathematik der Selbstorganisation. Braunschweig: Vieweg. MATHCrossRef

Klyubin, A. S., Polani, D., & Nehaniv, C. L. (2004). Organization of the information flow in the perception-action loop of evolved agents. In Proceedings of 2004 NASA/DoD conference on evolvable hardware (pp. 177–180). Los Alamitos: IEEE Computer Society. CrossRef

Klyubin, A. S., Polani, D., & Nehaniv, C. L. (2005). Empowerment: a universal agent-centric measure of control. In Proc. IEEE congress on evolutionary computation (CEC 2005), Edinburgh, Scotland, 2–5 September 2005 (pp. 128–135). New York: IEEE. CrossRef

Landauer, R. (1961). Irreversibility and heat generation in the computing process. IBM Journal of Research and Development, 5, 183–191. MathSciNetMATHCrossRef

Mees, A. I. (1981). Dynamics of feedback systems. New York: Wiley. MATH

Meinhardt, H. (1972). A theory of biological pattern formation. Kybernetik, 12, 30–39. CrossRef

Meinhardt, H. (1982). Models of biological pattern formation. San Diego: Academic Press.

Pask, G. (1960). The natural history of networks. In M. C. Yovits & S. Cameron (Eds.), Computer science and technology and their application. Self-organizing systems—proceedings of an interdisciplinary conference, 5–6 May 1959 (pp. 5–6). New York: Pergamon.

Polani, D. (2003). Measuring self-organization via observers. In W. Banzhaf, T. Christaller, J. Ziegler, P. Dittrich, J. T. Kim, H. Lange, T. Martinetz, & F. Schweitzer (Eds.), Advances in artificial life. Proc. 7th European conference on artificial life, Dortmund, 14–17 September. Berlin: Springer.

Polani, D. (2004). Defining emergent descriptions by information preservation. InterJournal Complex Systems, 1102.

Polani, D. (2006). Emergence, intrinsic structure of information, and agenthood. InterJournal Complex Systems, 1937.

Prigogine, I., & Nicolis, G. (1977). Self-organization in non-equilibrium systems: from dissipative structures to order through fluctuations. New York: Wiley.

Prokopenko, M., Gerasimov, V., & Tanev, I. (2006). Evolving spatiotemporal coordination in a modular robotic system. In S. Nolfi, G. Baldassarre, R. Calabretta, J. C. T. Hallam, D. Marocco, J.-A. Meyer, O. Miglino, & D. Parisi (Eds.), Lecture notes in computer science: Vol. 4095. From animals to animats 9: 9th international conference on the simulation of adaptive behavior (SAB 2006), Rome, Italy (pp. 558–569). Berlin: Springer. CrossRef

Rasmussen, S., Baas, N., Mayer, B., Nilsson, M., & Olesen, M. W. (2001). Ansatz for dynamical hierarchies. Artificial Life, 7, 329–353. CrossRef

Reichl, L. (1980). A modern course in statistical physics. Austin: University of Texas Press.

Shalizi, C. R. (2001). Causal architecture, complexity and self-organization in time series and cellular automata. PhD thesis, University of Wisconsin-Madison.

Shalizi, C. R., & Crutchfield, J. P. (2002). Information bottlenecks, causal states, and statistical relevance bases: how to represent relevant information in memoryless transduction. Advances in Complex Systems, 5(1), 91–95. MATHCrossRef

Shalizi, C. R., Shalizi, K. L., & Haslinger, R. (2004). Quantifying self-organization with optimal predictors. Physical Review Letters, 93(11), 118701. CrossRef

Slonim, N., Friedman, N., & Tishby, T. (2001). Agglomerative multivariate information bottleneck. In Neural information processing systems (NIPS 01), La Jolla (pp. 929–936).

Slonim, N., Atwal, G. S., Tkačik, G., & Bialek, W. (2005). Estimating mutual information and multi-information in large networks. arXiv:cs.IT/0502017.

Spitzner, A., & Polani, D. (1998). Order parameters for self-organizing maps. In L. Niklasson, M. Bodén, & T. Ziemke (Eds.), Proc. of the 8th int. conf. on artificial neural networks (ICANN 98), Skövde, Sweden (Vol. 2, pp. 517–522). Berlin: Springer.

Tishby, N., Pereira, F. C., & Bialek, W. (1999). The information bottleneck method. In Proc. 37th annual Allerton conference on communication, control and computing, Urbana-Champaign, IL.

Tononi, G., Sporns, O., & Edelman, G. M. (1994). A measure for brain complexity: relating functional segregation and integration in the nervous system. Proceedings of the National Academy of Sciences of the United States of America, 91, 5033–5037. CrossRef

Turing, A. M. (1952). The chemical basis of morphogenesis. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 327, 37–72. CrossRef

Walter, W. G. (1951). A machine that learns. Scientific American, 185(2), 60–63.

Yovits, M. C. & Cameron, S. (Eds.) (1960). Computer science and technology and their application. Self-organizing systems—proceedings of an interdisciplinary conference, 5–6 May 1959. New York: Pergamon. MATH

Titel: Foundations and Formalizations of Self-Organization
verfasst von: Daniel Polani
Verlag: Springer London
Buch: Advances in Applied Self-Organizing Systems
Print ISBN: 978-1-4471-5112-8

Electronic ISBN: 978-1-4471-5113-5

Copyright-Jahr: 2013
DOI: https://doi.org/10.1007/978-1-4471-5113-5_2

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner