Skip to main content

2018 | OriginalPaper | Buchkapitel

Task Analysis for Teaching Cumulative Learners

verfasst von : Jordi E. Bieger, Kristinn R. Thórisson

Erschienen in: Artificial General Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A generally intelligent machine (AGI) should be able to learn a wide range of tasks. Knowledge acquisition in complex and dynamic task-environments cannot happen all-at-once, and AGI-aspiring systems must thus be capable of cumulative learning: efficiently making use of existing knowledge during learning, supporting increases in the scope of ability and knowledge, incrementally and predictably — without catastrophic forgetting or mangling of existing knowledge. Where relevant expertise is at hand the learning process can be aided by curriculum-based teaching, where a teacher divides a high-level task up into smaller and simpler pieces and presents them in an order that facilitates learning. Creating such a curriculum can benefit from expert knowledge of (a) the task domain, (b) the learning system itself, and (c) general teaching principles. Curriculum design for AI systems has so far been rather ad-hoc and limited to systems incapable of cumulative learning. We present a task analysis methodology that utilizes expert knowledge and is intended to inform the construction of teaching curricula for cumulative learners. Inspired in part by methods from knowledge engineering and functional requirements analysis, our strategy decomposes high-level tasks in three ways based on involved actions, features and functionality. We show how this methodology can be used for a (simplified) arrival control task from the air traffic control domain, where extensive expert knowledge is available and teaching cumulative learners is required to facilitate the safe and trustworthy automation of complex workflows.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Negative transfer of training may also occur, where pre-existing knowledge interferes with learning something new — e.g. a racquetball player may take longer to get used to the way a squash ball bounces than somebody who never played racquetball. An optimal curriculum would mitigate negative transfer as much as possible.
 
2
However this is measured, we expect at a minimum the ‘learning cycle’ (alternating learning and non-learning periods) to be free from designer intervention at runtime. Given that, the smaller those periods become (relative to the shortest perception-action cycle, for instance), to the point of being considered virtually or completely continuous, the better the “learning always on” requirement is being met.
 
3
For instance, they typically require up-front full data disclosure (final data set up-front), all-at-once training (to train on the final data set from the very beginning) and learning-free deployment (the need to turn off learning before deployment to avoid unpredictable drift; cf. [15]).
 
4
The ADDIE model for instructional design consists of (1) analysis of the learner, learning goals, and teaching constraints, (2) design of the lesson plan or curriculum, which involves subject matter/task analysis, (3) development or assembly of the actual training materials, (4) implementation of the instruction with the learner (i.e. the actual teaching/training/learning), and (5) evaluation of learning outcomes.
 
5
Due to space limitations we only describe a highly simplified version of arrival control here. A more elaborate version can be found in our tech report: http://​www.​ru.​is/​faculty/​thorisson/​RUTR18001_​ArrivalControl.​pdf.
 
6
Isavia is Iceland’s aviation authority, managing air traffic in an area measuring 5.4 million square kilometers.
 
7
A lot has even been written on task analysis for ATC (cf. https://​www.​eurocontrol.​int/​articles/​atco-task-analysis), but we still need a new method for designing curricula for non-human cumulative learners.
 
8
A more elaborate version can be found in our tech report: http://​www.​ru.​is/​faculty/​thorisson/​RUTR18001_​ArrivalControl.​pdf.
 
Literatur
1.
Zurück zum Zitat Amodei, D., Olah, C., Steinhardt, J., Christiano, P.F., Schulman, J., Mané, D.: Concrete problems in AI safety. CoRR abs/1606.06565 (2016) Amodei, D., Olah, C., Steinhardt, J., Christiano, P.F., Schulman, J., Mané, D.: Concrete problems in AI safety. CoRR abs/1606.06565 (2016)
2.
Zurück zum Zitat Barry, A.: A hierarchical XCS for long path environments. In: Proceedings of GECCO-2001 (2001) Barry, A.: A hierarchical XCS for long path environments. In: Proceedings of GECCO-2001 (2001)
3.
Zurück zum Zitat Bengio, Y., Louradour, J., Collobert, R., Weston, J.: Curriculum learning. In: Proceedings of ICML-26 (2009) Bengio, Y., Louradour, J., Collobert, R., Weston, J.: Curriculum learning. In: Proceedings of ICML-26 (2009)
4.
Zurück zum Zitat Bieger, J.: Artificial pedagogy: a proposal. In: HLAI 2016 Doctoral Consortium, New York, NY (2016) Bieger, J.: Artificial pedagogy: a proposal. In: HLAI 2016 Doctoral Consortium, New York, NY (2016)
7.
Zurück zum Zitat Branson, R.K., Rayner, G.T., Cox, J.L., Furman, J.P., King, F.J.: Interservice Procedures for Instructional Systems Development: Phase 4 and 5. Florida State University, Technical report (1975) Branson, R.K., Rayner, G.T., Cox, J.L., Furman, J.P., King, F.J.: Interservice Procedures for Instructional Systems Development: Phase 4 and 5. Florida State University, Technical report (1975)
8.
Zurück zum Zitat Burke, L.A., Hutchins, H.M.: Training transfer: an integrative literature review. Hum. Resour. Dev. Rev. 6(3), 263–296 (2007) Burke, L.A., Hutchins, H.M.: Training transfer: an integrative literature review. Hum. Resour. Dev. Rev. 6(3), 263–296 (2007)
9.
Zurück zum Zitat Hasselmo, M.E.: Avoiding catastrophic forgetting. Trends Cognit. Sci. 21(6), 407–408 (2017)CrossRef Hasselmo, M.E.: Avoiding catastrophic forgetting. Trends Cognit. Sci. 21(6), 407–408 (2017)CrossRef
11.
Zurück zum Zitat Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A.: Overcoming catastrophic forgetting in neural networks. PNAS 114(13), 3521–3526 (2017)MathSciNetCrossRef Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A.: Overcoming catastrophic forgetting in neural networks. PNAS 114(13), 3521–3526 (2017)MathSciNetCrossRef
12.
Zurück zum Zitat Lake, B., Salakhutdinov, R., Gross, J., Tenenbaum, J.: One shot learning of simple visual concepts. In: Proceedings of CogSci 2011, vol. 33 (2011) Lake, B., Salakhutdinov, R., Gross, J., Tenenbaum, J.: One shot learning of simple visual concepts. In: Proceedings of CogSci 2011, vol. 33 (2011)
13.
Zurück zum Zitat Looks, M.: Competent program evolution. Ph.D. thesis, Washington University (2006) Looks, M.: Competent program evolution. Ph.D. thesis, Washington University (2006)
14.
Zurück zum Zitat Lu, J., Behbood, V., Hao, P., Zuo, H., Xue, S., Zhang, G.: Transfer learning using computational intelligence: a survey. Knowl. Based Syst. 80, 14–23 (2015)CrossRef Lu, J., Behbood, V., Hao, P., Zuo, H., Xue, S., Zhang, G.: Transfer learning using computational intelligence: a survey. Knowl. Based Syst. 80, 14–23 (2015)CrossRef
15.
Zurück zum Zitat Marcus, G.: Deep learning: a critical appraisal. CoRR abs/1801.00631 (2018) Marcus, G.: Deep learning: a critical appraisal. CoRR abs/1801.00631 (2018)
16.
Zurück zum Zitat Nivel, E., Thórisson, K.R., Steunebrink, B.R., Dindo, H., Pezzulo, G., Rodriguez, M., Hernandez, C., Ognibene, D., Schmidhuber, J., Sanz, R., Helgason, H.P., Chella, A., Jonsson, G.K.: Bounded recursive self-improvement. Technical RUTR-SCS13006, Reykjavik University, Reykjavik, Iceland (2013) Nivel, E., Thórisson, K.R., Steunebrink, B.R., Dindo, H., Pezzulo, G., Rodriguez, M., Hernandez, C., Ognibene, D., Schmidhuber, J., Sanz, R., Helgason, H.P., Chella, A., Jonsson, G.K.: Bounded recursive self-improvement. Technical RUTR-SCS13006, Reykjavik University, Reykjavik, Iceland (2013)
17.
Zurück zum Zitat Pollock, J.L.: Defeasible reasoning and degrees of justification. Argum. Comput. 1(1), 7–22 (2010)CrossRef Pollock, J.L.: Defeasible reasoning and degrees of justification. Argum. Comput. 1(1), 7–22 (2010)CrossRef
18.
Zurück zum Zitat Schreiber, G.: Knowledge Engineering and Management: The Common KADS Methodology. MIT Press, Cambridge (2000) Schreiber, G.: Knowledge Engineering and Management: The Common KADS Methodology. MIT Press, Cambridge (2000)
19.
Zurück zum Zitat Silver, D.L., Yang, Q., Li, L.: Lifelong machine learning systems: beyond learning algorithms. In: AAAI Spring Symposium: Lifelong Machine Learning (2013) Silver, D.L., Yang, Q., Li, L.: Lifelong machine learning systems: beyond learning algorithms. In: AAAI Spring Symposium: Lifelong Machine Learning (2013)
20.
Zurück zum Zitat Skinner, B.F.: The Behavior of Organisms: An Experimental Analysis. Appleton-Century-Crofts Inc., New York (1938) Skinner, B.F.: The Behavior of Organisms: An Experimental Analysis. Appleton-Century-Crofts Inc., New York (1938)
21.
Zurück zum Zitat Steunebrink, B.R., Koutník, J., Thórisson, K.R., Nivel, E., Schmidhuber, J.: Resource-bounded machines are motivated to be effective, efficient, and curious. In: Kühnberger, K.-U., Rudolph, S., Wang, P. (eds.) AGI 2013. LNCS (LNAI), vol. 7999, pp. 119–129. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39521-5_13CrossRef Steunebrink, B.R., Koutník, J., Thórisson, K.R., Nivel, E., Schmidhuber, J.: Resource-bounded machines are motivated to be effective, efficient, and curious. In: Kühnberger, K.-U., Rudolph, S., Wang, P. (eds.) AGI 2013. LNCS (LNAI), vol. 7999, pp. 119–129. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-39521-5_​13CrossRef
23.
Zurück zum Zitat Teague, R.C., Gittelman, S.S., Park, O.c.: A review of the literature on part-task and whole-task training and context dependency. Technical report, ARI, US (1994) Teague, R.C., Gittelman, S.S., Park, O.c.: A review of the literature on part-task and whole-task training and context dependency. Technical report, ARI, US (1994)
24.
Zurück zum Zitat Teh, Y.W., Bapst, V., Czarnecki, W.M., Quan, J., Kirkpatrick, J., Hadsell, R., Heess, N., Pascanu, R.: Distral: robust multitask reinforcement learning. CoRR abs/1707.04175 (2017) Teh, Y.W., Bapst, V., Czarnecki, W.M., Quan, J., Kirkpatrick, J., Hadsell, R., Heess, N., Pascanu, R.: Distral: robust multitask reinforcement learning. CoRR abs/1707.04175 (2017)
26.
Zurück zum Zitat Vygotsky, L.S.: Interaction between learning and development. In: Cole, M., John-Steiner, V., Scribner, S., Souberman, E. (eds.) Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978) Vygotsky, L.S.: Interaction between learning and development. In: Cole, M., John-Steiner, V., Scribner, S., Souberman, E. (eds.) Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978)
27.
Zurück zum Zitat Wood, D., Bruner, J.S., Ross, G.: The role of tutoring in problem solving. J. Child Psychol. Psychiatry 17(2), 89–100 (1976)CrossRef Wood, D., Bruner, J.S., Ross, G.: The role of tutoring in problem solving. J. Child Psychol. Psychiatry 17(2), 89–100 (1976)CrossRef
28.
Zurück zum Zitat Zhan, Y., Taylor, M.E.: Online transfer learning in reinforcement learning domains. CoRR abs/1507.00436 (2015) Zhan, Y., Taylor, M.E.: Online transfer learning in reinforcement learning domains. CoRR abs/1507.00436 (2015)
Metadaten
Titel
Task Analysis for Teaching Cumulative Learners
verfasst von
Jordi E. Bieger
Kristinn R. Thórisson
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-97676-1_3