Skip to main content
Top
Published in:
Cover of the book

2021 | OriginalPaper | Chapter

‘If Only I Would Have Done that…’: A Controlled Adaptive Network Model for Learning by Counterfactual Thinking

Authors : Raj Bhalwankar, Jan Treur

Published in: Artificial Intelligence Applications and Innovations

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper counterfactual thinking is addressed based on literature mainly from Neuroscience and Psychology. A detailed literature review was conducted in identifying processes, neural correlates and theories related to counterfactual thinking from different disciplines. A familiar scenario with respect to counterfactual thinking was identified. Based on the literature, an adaptive self-modeling network model was designed. This model captures the complex process of counterfactual thinking and the learning and control involved.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Barbey, A.K., Krueger, F., Grafman, J.: Structured event complexes in the medial prefrontal cortex support counterfactual representations for future planning. Philos. Trans. R. Soc. B: Biol. Sci. 364(1521), 1291–1300 (2009)CrossRef Barbey, A.K., Krueger, F., Grafman, J.: Structured event complexes in the medial prefrontal cortex support counterfactual representations for future planning. Philos. Trans. R. Soc. B: Biol. Sci. 364(1521), 1291–1300 (2009)CrossRef
2.
go back to reference Bhalwankar, R., Treur, J.: Modeling the development of internal mental models by an adaptive network model. In: Proceedings of the 11th Annual International Conference on Brain-Inspired Cognitive Architectures for AI, BICA*AI’20. Procedia Computer Science, Elsevier (2021) Bhalwankar, R., Treur, J.: Modeling the development of internal mental models by an adaptive network model. In: Proceedings of the 11th Annual International Conference on Brain-Inspired Cognitive Architectures for AI, BICA*AI’20. Procedia Computer Science, Elsevier (2021)
3.
go back to reference Bhalwankar, R., Treur, J.: A second-order adaptive network model for learner-controlled mental model learning processes. In: Benito, R.M., Cherifi, C., Cherifi, H., Moro, E., Rocha, L.M., Sales-Pardo, M. (eds.) COMPLEX NETWORKS 2020 2020. SCI, vol. 944, pp. 245–259. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-65351-4_20CrossRef Bhalwankar, R., Treur, J.: A second-order adaptive network model for learner-controlled mental model learning processes. In: Benito, R.M., Cherifi, C., Cherifi, H., Moro, E., Rocha, L.M., Sales-Pardo, M. (eds.) COMPLEX NETWORKS 2020 2020. SCI, vol. 944, pp. 245–259. Springer, Cham (2021). https://​doi.​org/​10.​1007/​978-3-030-65351-4_​20CrossRef
4.
go back to reference Byrne, R.M.J.: Mental models and counterfactual thoughts about what might have been. Trends Cognit. Sci. 6(10), 426–431 (2002)CrossRef Byrne, R.M.J.: Mental models and counterfactual thoughts about what might have been. Trends Cognit. Sci. 6(10), 426–431 (2002)CrossRef
5.
go back to reference Byrne, R.M.J.: The Rational Imagination: How People Create Alternatives to Reality. MIT Press, Cambridge (2005) Byrne, R.M.J.: The Rational Imagination: How People Create Alternatives to Reality. MIT Press, Cambridge (2005)
6.
go back to reference Byrne, R.M.J.: Precis of ‘the rational imagination: how people create alternatives to reality’. Behav. Brain Sci. 30(5–6), 439–453 (2007)CrossRef Byrne, R.M.J.: Precis of ‘the rational imagination: how people create alternatives to reality’. Behav. Brain Sci. 30(5–6), 439–453 (2007)CrossRef
7.
go back to reference Byrne, R.M.J.: Counterfactual thought. Annu. Rev. Psychol. 67, 135–157 (2016)CrossRef Byrne, R.M.J.: Counterfactual thought. Annu. Rev. Psychol. 67, 135–157 (2016)CrossRef
8.
go back to reference De Brigard, F., Hanna, E., St Jacques, P.L., Schacter, D.L.: How thinking about what could have been affects how we feel about what was. Cognit. Emot. 33, 646–659 (2019)CrossRef De Brigard, F., Hanna, E., St Jacques, P.L., Schacter, D.L.: How thinking about what could have been affects how we feel about what was. Cognit. Emot. 33, 646–659 (2019)CrossRef
9.
go back to reference Epstude, K., Roese, N.J.: The functional theory of counterfactual thinking. Pers. Soc. Psychol. Rev. 12(2), 168–192 (2008)CrossRef Epstude, K., Roese, N.J.: The functional theory of counterfactual thinking. Pers. Soc. Psychol. Rev. 12(2), 168–192 (2008)CrossRef
10.
go back to reference Fortin, N.J., Agster, K.L., Eichenbaum, H.B.: Critical role of the hippocampus in memory for sequences of events. Nat. Neurosci. 5(5), 458–462 (2002)CrossRef Fortin, N.J., Agster, K.L., Eichenbaum, H.B.: Critical role of the hippocampus in memory for sequences of events. Nat. Neurosci. 5(5), 458–462 (2002)CrossRef
11.
go back to reference Kahneman, D., Miller, D.T.: Norm theory: comparing reality to its alternatives. Psychol. Rev. 93(2), 136 (1986)CrossRef Kahneman, D., Miller, D.T.: Norm theory: comparing reality to its alternatives. Psychol. Rev. 93(2), 136 (1986)CrossRef
12.
go back to reference Markman, K.D., Gavanski, I., Sherman, S.J., McMullen, M.N.: The mental simulation of better and worse possible worlds. J. Exp. Soc. Psychol. 29(1), 87–109 (1993)CrossRef Markman, K.D., Gavanski, I., Sherman, S.J., McMullen, M.N.: The mental simulation of better and worse possible worlds. J. Exp. Soc. Psychol. 29(1), 87–109 (1993)CrossRef
13.
go back to reference Roese, N.J.: The functional basis of counterfactual thinking. J. Pers. Soc. Psychol. 66(5), 805 (1994)CrossRef Roese, N.J.: The functional basis of counterfactual thinking. J. Pers. Soc. Psychol. 66(5), 805 (1994)CrossRef
14.
go back to reference Russell, J.A.: Core affect and the psychological construction of emotion. Psychol. Rev. 110(1), 145 (2003)CrossRef Russell, J.A.: Core affect and the psychological construction of emotion. Psychol. Rev. 110(1), 145 (2003)CrossRef
15.
go back to reference Sanna, L.J., Schwarz, N., Small, E.M.: Accessibility experiences and the hindsight bias: I knew it all along versus it could never have happened. Mem. Cognit. 30(8), 1288–1296 (2002)CrossRef Sanna, L.J., Schwarz, N., Small, E.M.: Accessibility experiences and the hindsight bias: I knew it all along versus it could never have happened. Mem. Cognit. 30(8), 1288–1296 (2002)CrossRef
16.
go back to reference Starr, W.B.: Conditional and counterfactual logic. In: Knauff, M., Spohn, W. (eds.) The Handbook of Rationality. MIT Press, Cambridge (2020) Starr, W.B.: Conditional and counterfactual logic. In: Knauff, M., Spohn, W. (eds.) The Handbook of Rationality. MIT Press, Cambridge (2020)
17.
go back to reference Timberlake, B.: The effects of counterfactual comparison on learning and reasoning (Doctoral dissertation, University of Trento) (2019) Timberlake, B.: The effects of counterfactual comparison on learning and reasoning (Doctoral dissertation, University of Trento) (2019)
20.
go back to reference Treur, J.: An Adaptive Network Model Covering Metacognition to Control Adaptation for Multiple Mental Models. Cognit. Syst. Res. 67, 18–27 (2021)CrossRef Treur, J.: An Adaptive Network Model Covering Metacognition to Control Adaptation for Multiple Mental Models. Cognit. Syst. Res. 67, 18–27 (2021)CrossRef
21.
go back to reference Tulving, E., Markowitsch, H.J.: Episodic and declarative memory: role of the hippocampus. Hippocampus 8(3), 198–204 (1998)CrossRef Tulving, E., Markowitsch, H.J.: Episodic and declarative memory: role of the hippocampus. Hippocampus 8(3), 198–204 (1998)CrossRef
22.
go back to reference Van Hoeck, N., Watson, P.D., Barbey, A.K.: Cognitive neuroscience of human counterfactual reasoning. Front. Hum. Neurosci. 9, 420 (2015) Van Hoeck, N., Watson, P.D., Barbey, A.K.: Cognitive neuroscience of human counterfactual reasoning. Front. Hum. Neurosci. 9, 420 (2015)
23.
go back to reference Wang, Y., Wan, Y., Zhang, C., Bai, L., Cui, L., Yu, P.: Competitive multi-agent deep reinforcement learning with counterfactual thinking. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 1366–1371. IEEE (2019) Wang, Y., Wan, Y., Zhang, C., Bai, L., Cui, L., Yu, P.: Competitive multi-agent deep reinforcement learning with counterfactual thinking. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 1366–1371. IEEE (2019)
24.
go back to reference Wilson, R.C., Collins, A.G.: Ten simple rules for the computational modeling of behavioral data. Elife 8, (2019)CrossRef Wilson, R.C., Collins, A.G.: Ten simple rules for the computational modeling of behavioral data. Elife 8, (2019)CrossRef
Metadata
Title
‘If Only I Would Have Done that…’: A Controlled Adaptive Network Model for Learning by Counterfactual Thinking
Authors
Raj Bhalwankar
Jan Treur
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-79150-6_1

Premium Partner