Skip to main content
Top
Published in: Cognitive Computation 3/2012

01-09-2012

Autonomy and Desire in Machines and Cognitive Agent Systems

Authors: Kevin Magill, Yasemin J. Erden

Published in: Cognitive Computation | Issue 3/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The development of cognitive agent systems relies on theories of agency, within which the concept of desire is key. Indeed, in the quest to develop increasingly autonomous cognitive agent systems, desire has had a significant role. We argue, however, that insufficient attention has been given to analysis and clarification of desire as a complex concept. Accordingly, in this paper, we will draw on some key philosophical accounts of the nature of desire, including what distinguishes it from other mental and motivational states, in order to identify some key characteristics of desire as a complex concept. We will then draw on these in order to investigate the role, definition and adequacy of concepts of desire within applied theoretical models of agency and agent systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
There are of course other models: for example, the Soar (cognitive architecture) project, which offers more of a cognitive psychology approach, in contrast to the philosophical grounding of BDI. Nevertheless, since these do not differ from BDI models in tending to equate desires with goals, we take BDI models as representative and confine our analysis to those.
 
2
Note: as described by Turing, the interrogator has no judgment to make about whether the machine thinks: he or she takes it for granted that both respondents are thinking humans.
 
3
Indeed, when desires are acted upon, whether immediately or following deliberation and decision, our conception of rational action, in which beliefs and desires provide reasons for acting, is one in which action follows a judgement in favour of the reasons for undertaking it. One possible implication of this is that while desires are causally antecedent to the actions that realise them, they are not necessarily, so to speak, the immediate or direct causes of actions. The position—immediate or mediated—of desires in the causal ancestry of actions is clearly relevant to an understanding of agency and presumably also therefore of potential relevance to agent systems, but is not an issue we can pursue in this paper.
 
4
Elsewhere higher-order desires are discussed as the basis of a related, but arguably quite different, capacity for ‘fully human agency’ [9, 10].
 
5
To borrow an idea from Wittgenstein, the notion of desire in this context would be idle.
 
6
See also the discussion of fantastical desires below.
 
7
Morillo, in [12], for example, argues that actions are caused, conjointly with beliefs (neurologically conceived), by pleasure events in the brain, from which it is said to follow, since this is the causal role of desires, that desires are such pleasure events. See Strawson [13] for a rather different set of arguments for the pleasure-directedness of desire.
 
8
Although some philosophers have argued that desire might be a special category of belief: see [14] and [15].
 
9
‘The world as it was’ and ‘as it will be’ in respect of past- and future-directed beliefs.
 
10
Admittedly in relation to quite a different notion of the intentional content of desire from what is discussed in this paper.
 
11
It might still be argued, implausibly in our view, that regardless of whatever distress or pain it may occasion or be accompanied by, desire is characterised by intrinsic feelings of anticipatory pleasure. Something like this appears to be Morillo’s [12] view. Alternatively, it might be argued that it is possible to desire something only to the extent that one regards its satisfaction as pleasing. This would treat the belief that the object or satisfaction of desire is or would be pleasing as a necessary condition of desiring rather than being intrinsic to the content of desire. Opponents of the claim have urged putative counterexamples. We would take the view that the account of desire we go on to develop will serve to demotivate the claim.
 
12
We therefore reject the position we considered in an earlier version of this paper [11] that desire can be understood in part as having an intentional content in which the object of desire is thought of or regarded as pleasing.
 
13
Not feeling in the sense often expressed by screen characters, for example, ‘I’ve got a feeling that something’s wrong’, where feeling is typically a synonym for sense, indicating something one can’t put one’s finger on, perhaps something disturbing peripheral awareness.
 
14
Desires for continuation of what is already taking place seem to present a counterexample to the idea that desire involves a feeling of the object of desire as lacking. If I want an experience I am enjoying to continue, I could not very easily feel it to be lacking. However, the object of desire in that case would not be what I am currently experiencing, but rather its continuation beyond the present. There need be no dissonance between an experience one is having and a feeling of lack in relation to its continuation: a feeling that would be assuaged by its continuation.
 
15
See [2] for discussion of a range of issues relating to such judgements.
 
16
Recalling Bentham’s famous judgement on what our grounds should be for the moral consideration of animals: ‘The question is not, Can they reason? nor, Can they talk? but, Can they suffer?’ [18].
 
17
The notion of a machine capable of intentional action might be thought to present considerable further challenges.
 
18
For contemporary analysis of the latter, cf. Dong et al [19].
 
19
Setting aside the issue of whether what we are talking about is really action as opposed to behaviour, as discussed above.
 
20
There are, of course, other approaches. Dastani and van der Torre [23], for example, note the problems engendered by the unification of desires and goals into a single motivational attitude and instead offer an approach that distinguishes between them. This is not, however, the most common approach. Cf. Schroeder [24], who, though not specifically dealing with a goal/desire distinction, does present a linear materialist view of desire as determined by reward systems in the brain.
 
21
The authors hold different positions on this matter and about how far this relates to wishing or desire.
 
22
The fact that we might not be aware of certain desires may or may not play a role in they effect they have on our behaviour and intentions, or indeed our sense of what we find pleasant or unpleasant, but as we have noted already, this is not to say that the significance of such desires can be easily dismissed from our conception of human autonomy.
 
23
Multi-agent systems (MAS) are systems of multiple interacting intelligent agents, which enable surveyability of, for example, large systems and rely on the autonomy of each individual agent; see Brazier et al [31]. Notions of desire are therefore thought to play a significant role in ensuring not only the autonomy of each agent, but also to ensure that each agent works towards achieving different but overlapping or complementary ends.
 
24
There are of course some issues with these definitions. For instance, intentions would more naturally be thought of as often being produced by or following from a process of reasoning. We do not have the space to consider these objections here, but they should not be neglected in the application of BDI, and related, models.
 
25
See discussion in earlier sections on multiple goals in relation to the Turing machine, where we show that even a multiplicity of goals does not automatically create a role for desire.
 
26
Embodiment might also play a role in this, although this view remains speculative at present and as such is somewhat outside the scope of this paper.
 
Literature
1.
2.
go back to reference Davidson D. Actions reasons, and causes. In: Essays on actions and events. 2nd ed. Oxford: Oxford University Press; 1980. Davidson D. Actions reasons, and causes. In: Essays on actions and events. 2nd ed. Oxford: Oxford University Press; 1980.
3.
go back to reference Aristotle. Nichomachean Ethics (W. D. Ross, trans). Oxford: Clarendon Press; 1908, p. 1139a35-b4. Aristotle. Nichomachean Ethics (W. D. Ross, trans). Oxford: Clarendon Press; 1908, p. 1139a35-b4.
4.
go back to reference Hume DA Treatise on human nature. 2nd ed. In: Selby-Bigge LA, editor. Oxford: Clarendon; 1978. Bk II, Section III, p. 413. Hume DA Treatise on human nature. 2nd ed. In: Selby-Bigge LA, editor. Oxford: Clarendon; 1978. Bk II, Section III, p. 413.
5.
go back to reference Anscombe E. Intention. 2nd ed. Cambridge, MA: Harvard University Press; 2000. Anscombe E. Intention. 2nd ed. Cambridge, MA: Harvard University Press; 2000.
6.
go back to reference Ryle G. The concept of mind. Chicago: New University of Chicago Press; 1949. Ryle G. The concept of mind. Chicago: New University of Chicago Press; 1949.
8.
go back to reference Frankfurt H. Freedom of the will and the concept of a person. J Philos. 1971;LXVIII(1):5–20. Frankfurt H. Freedom of the will and the concept of a person. J Philos. 1971;LXVIII(1):5–20.
9.
10.
go back to reference Magill K. Freedom and experience: self-determination without illusions. London: Macmillan; 1997. Chapter 2. Magill K. Freedom and experience: self-determination without illusions. London: Macmillan; 1997. Chapter 2.
11.
go back to reference Magill K, Erden YJ. Autonomy and desire in machines and cognitive agent systems. Paper presented at: third symposium on computing and philosophy, Convention of the society for the study of artificial intelligence and simulation of behaviour (AISB) 2011 April 4–7; University of York, UK. Magill K, Erden YJ. Autonomy and desire in machines and cognitive agent systems. Paper presented at: third symposium on computing and philosophy, Convention of the society for the study of artificial intelligence and simulation of behaviour (AISB) 2011 April 4–7; University of York, UK.
12.
13.
go back to reference Strawson G. Mental reality. Cambridge, MA: MIT Press; 1994. Strawson G. Mental reality. Cambridge, MA: MIT Press; 1994.
14.
go back to reference Costa HA, Collins J, Levi I. Desire-as-belief implies opinionation or indifference. Analysis. 1995;55(1):2–5.CrossRef Costa HA, Collins J, Levi I. Desire-as-belief implies opinionation or indifference. Analysis. 1995;55(1):2–5.CrossRef
15.
go back to reference Bradley R, List C. Desire-as-belief revisited. Analysis. 2009;69(1):31–7.CrossRef Bradley R, List C. Desire-as-belief revisited. Analysis. 2009;69(1):31–7.CrossRef
16.
17.
go back to reference Cheney JE. The Intentionality of desire and the intentions of people. Mind. 1978;LXXXVII (4):517–32. Cheney JE. The Intentionality of desire and the intentions of people. Mind. 1978;LXXXVII (4):517–32.
18.
go back to reference Bentham J. Introduction to the principles of morals and legislation. 2nd ed. Oxford: Clarendon; 1823. Chapter 17: fn. 122. Bentham J. Introduction to the principles of morals and legislation. 2nd ed. Oxford: Clarendon; 1823. Chapter 17: fn. 122.
19.
go back to reference Dong J, Yang H-I, Oyama K, Chang CK. Human Desire inference process based on affective computing. 34th annual computer software and applications conference; 2010. p. 347–50. Dong J, Yang H-I, Oyama K, Chang CK. Human Desire inference process based on affective computing. 34th annual computer software and applications conference; 2010. p. 347–50.
20.
go back to reference Park J, Fullam KK, Han DC, Barber KS. Agent technology for coordinating UAV target tracking. In: Khosla R, Howlett RJ, Jain LC, editors. Knowledge based intelligent information and engineering systems. Berlin: Springer; 2005. Park J, Fullam KK, Han DC, Barber KS. Agent technology for coordinating UAV target tracking. In: Khosla R, Howlett RJ, Jain LC, editors. Knowledge based intelligent information and engineering systems. Berlin: Springer; 2005.
21.
go back to reference Lang J, van der Torre L, Weydert E. Utilitarian desires. J Auton Agent Multi Agent Syst. 2002;5(3):329–63.CrossRef Lang J, van der Torre L, Weydert E. Utilitarian desires. J Auton Agent Multi Agent Syst. 2002;5(3):329–63.CrossRef
22.
go back to reference Ishikawa M, Hagiwara T, Yamamoto N, Kiriake F. Brain-inspired emergence of behaviors. In: Mobile robots by reinforcement learning with internal rewards. Eighth international conference on hybrid intelligent systems; 2008. p. 138–43. Ishikawa M, Hagiwara T, Yamamoto N, Kiriake F. Brain-inspired emergence of behaviors. In: Mobile robots by reinforcement learning with internal rewards. Eighth international conference on hybrid intelligent systems; 2008. p. 138–43.
23.
go back to reference Dastani M, van der Torre L. Specifying the merging of desires into goals in the context of beliefs. EURASIA-ICT, information and communication technology. Lect Notes Comput Sci. 2002;2002(2510):824–31.CrossRef Dastani M, van der Torre L. Specifying the merging of desires into goals in the context of beliefs. EURASIA-ICT, information and communication technology. Lect Notes Comput Sci. 2002;2002(2510):824–31.CrossRef
25.
go back to reference Bratman ME. What is intention? In: Cohen PR, Morgan JL, Pollack ME, editors. Intentions in communication, chapter 2. Cambridge, MA: MIT Press; 1990. Bratman ME. What is intention? In: Cohen PR, Morgan JL, Pollack ME, editors. Intentions in communication, chapter 2. Cambridge, MA: MIT Press; 1990.
26.
go back to reference Bratman ME. Intentions, plans, and practical reason. Cambridge, MA: Harvard University Press; 1987. Bratman ME. Intentions, plans, and practical reason. Cambridge, MA: Harvard University Press; 1987.
28.
go back to reference Broersen J, Dastani M, van der Torre L. Beliefs, obligations, intentions, and desires as components in an agent architecture. Int J Intell Syst. 2005;20(9):893–919.CrossRef Broersen J, Dastani M, van der Torre L. Beliefs, obligations, intentions, and desires as components in an agent architecture. Int J Intell Syst. 2005;20(9):893–919.CrossRef
29.
go back to reference Su K, Luo X, Sattar A, Orgun MA. The interpreted system model of knowledge, belief, desire and intention. In: Proceedings of the fifth international joint conference on Autonomous agents and multi agent systems (AAMAS ‘06); NY, USA; 2006. p. 220–22. Su K, Luo X, Sattar A, Orgun MA. The interpreted system model of knowledge, belief, desire and intention. In: Proceedings of the fifth international joint conference on Autonomous agents and multi agent systems (AAMAS ‘06); NY, USA; 2006. p. 220–22.
Metadata
Title
Autonomy and Desire in Machines and Cognitive Agent Systems
Authors
Kevin Magill
Yasemin J. Erden
Publication date
01-09-2012
Publisher
Springer-Verlag
Published in
Cognitive Computation / Issue 3/2012
Print ISSN: 1866-9956
Electronic ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-012-9140-9

Other articles of this Issue 3/2012

Cognitive Computation 3/2012 Go to the issue

Premium Partner