Skip to main content
SpringerLink
Log in

Plan Recognition and Evaluation for On-line Critiquing

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

The Traum-AID system is a tool for assisting physicians during the management of patients with severe injuries. Originally, Traum-AID was conceived as a rule-based expert system combined with a planner. After this architecture had been implemented, we began to face the issue of how Traum-AID could communicate its plans to physicians in order to influence their behavior and have a positive effect on patient outcome. This paper describes Trauma-TIQ – the critiquing interface for Traum-AID – which examines the actions the physician intends to carry out and produces a critique in response to those intentions. Trauma-TIQ's two main components are a plan recognizer that uses the context of the case to disambiguate plans, and a plan evaluator that identifies errors and calculates their significance in order to determine an appropriate response. Unlike previously developed reminder systems, Trauma-TIQ evaluates the physician's proposed plan and attempts to intervene before problems occur. And unlike previous critiquing systems, it is able to provide ongoing decision support during the planning and delivery of care. In the context of time-critical patient management it is, therefore, a more appropriate means of interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allen, J. F. and Perrault, C. R.: 1980, ‘Analyzing Intention in Utterances’. Artificial Intelligence 15, 143-178.

    Google Scholar 

  • Anderson, J., Jay, S., Schweer, H. and Anderson, M.: 1986, ‘Why Doctors Don't Use Computers: Some Empirical Findings’. Journal of the Royal Society of Medicine 79, 142-144.

    Google Scholar 

  • Bauer, M.: 1995, ‘A Dempster-Shafer Approach to Modeling Agent Preferences for Plan Recognition’. User Modeling and User-Adapted Interaction. To appear.

  • Carberry, S.: 1988, ‘Modeling the User's Plans and Goals’. Computational Linguistics 14(3), 23-37.

    Google Scholar 

  • Carberry, S.: 1990, ‘Incorporating Default Inferences into Plan Recognition’. In: Proceedings of the8th National Conference on Artificial Intelligence. Boston, MA, 471-478.

  • Charniak, E. and Goldmanj, R. P.: 1993, ‘A Bayesian Model of Plan Recognition’. Artificial Intelligence 64, 53-79.

    Google Scholar 

  • Clancey, W. J. and Letsinger, R.: 1981, ‘NEOMYCIN: Reconfiguring a Rule-Based Expert System for Application to Teaching’. In: Proceedings of the Seventh International Joint Conference on Artificial Intelligence. Vancouver, 829-836.

  • Clancey, W. J. and Shortliffe, E. H. (eds.): 1984, Readings in Medical Artificial Intelligence: the first decade. Reading: Addison-Wesley.

    Google Scholar 

  • Clarke, J. R., Rymon, R., Webber, B. L., Hayward, C., Santora, T., Wagner, D. and Ruffin, A.: 1993,’ The Importance of Planning in the Provision of Medical Care’. Medical Decision Making 13(4), 383. Abstract.

    Google Scholar 

  • Fraser, J. M. and Smith, P. J.: 1992, ‘A Catalog of Errors’. International Journal of Man-Machine Studies 37, 265-307.

    Google Scholar 

  • Gertner, A. S.: 1994, ‘Responding to Users' Informational Needs in Time-Critical Situations’. In: Proceedings of the Fourth International Conference on User Modeling.

  • Gertner, A. S.: 1995, ‘Critiquing: Effective Decision Support in Time-Critical Domains’. Ph.D. thesis, University of Pennsylvania, Philadelphia, Pennsylvania.

    Google Scholar 

  • Gertner, A. S. and Webber, B. L.: 1996, ‘A Bias towards Relevance: Recognizing Plans where Goal Minimization Fails’. In: Proceedings of the 13th National Conference on Artificial Intelligence.

  • Gertner, A. S., Webber, B. L. and Clarke, J. R.: 1994, ‘Upholding the Maxim of Relevance during Patient-Centered Activities’. In: Proceedings of the Fourth International conference on Applied Natural Language Processing, 125-131.

  • Gertner, A. S., Webber, B. L. and Clarke, J. R.: 1995, ‘Recognizing and Evaluating Plans with Diagnostic Actions’. In: Working notes of the IJCAI-95 Workshop on Plan Recognition.

  • Gertner, A. S., Webber, B. L. and Clarke, J. R.: 1997, ‘On-Line Quality Assurance in the Initial Definitive Management of Multiple Trauma’. Artificial Intelligence in Medicine. To appear.

  • Goodman, B.A. and Litman, D. J.: 1992, ‘On the Interaction between Plan Recognition and Intelligent Interfaces’. User Modeling and User-Adapted Interaction 2(1-2), 55-82.

    Google Scholar 

  • Grosz, B. J. and Sidner, C. L.: 1986, ‘Attentions, Intentions and the Structure of Discourse’. Computational Linguistics 12, 175-204.

    Google Scholar 

  • Hill, R.W. and Johnson, W. L.: 1995, ‘Situated Plan Attribution’. Journal of Artificial Intelligence in Education 6(1), 35-66.

    Google Scholar 

  • Hollnagel, E.: 1991, ‘The Phenotype of Erroneous Actions: Implications for HCI Design’. In: G. R. S. Weir and J. L. Alty (eds.): Human-Computer Interaction and Complex Systems. London: Academic Press Ltd.

    Google Scholar 

  • Hollnagel, E.: 1993, ‘The Phenotype of Erroneous Actions’. International Journal of Man-Machine Studies 39, 1-32.

    Google Scholar 

  • Huff, K. E. and Lesser, V. R.: 1993, ‘Integrating Plausible Reasoning in an Incremental Plan Recognizer’. Technical Report 93-72, University of Massachusetts, Amherst.

    Google Scholar 

  • Kahneman, D., Slovic, P. and Tversky A. (eds.): 1982, Judgement under uncertainty: Heuristics and biases. Cambridge: Cambridge University Press.

    Google Scholar 

  • Langlotz, C. P. and Shortliffe, E. H.: 1983, ‘Adapting a Consultation System to Critique User Plans’. International Journal of Man-Machine Studies 19, 479-496.

    Google Scholar 

  • Litman, D. and Allen, J.: 1989, ‘Discourse Processing and Commonsense Plans’. In: J. M. Philip Cohen and J. Allen (eds.): Intentions in Communication. MIT Press.

  • London, R.: 1992, ‘Student Modeling to Support Multiple Instructional Approaches’. User Modeling and User-Adapted Interaction 2(1-2), 117-154.

    Google Scholar 

  • London, R. and Clancey, W. J.: 1982, ‘Plan Recognition Strategies in Student Modelling: Prediction and Description’. In: Proceedings of the American Association for Artificial Intelligence. Pittsburgh, 335-338.

  • Miller, P. L.: 1986, Expert Critiquing Systems: Practice-Based Medical Consultation by Computer. New York: Springer-Verlag.

    Google Scholar 

  • Rankin, I.: 1989, ‘The Deep Generation of Text in Expert Critiquing Systems’. Licentitate Thesis no.184, Linköping University.

  • Reason, J. T.: 1990, Human Error. Cambridge: Cambridge University Press.

    Google Scholar 

  • Rouse, W. B., Geddes, N. D. and Curry, R. E.: 1987-1988, ‘An Architecture for Intelligent Interfaces: Outline of an Approach to Supporting Operators of Complex Systems’. Human-Computer Interaction 3, 87-122.

    Google Scholar 

  • Rymon, R.: 1993, ‘Diagnostic Reasoning and Planning in Exploratory-Corrective Domains’. Ph.D. thesis, Department of Computer & Information Science, University of Pennsylvania. Appears as Technical Report MS-CIS-93-84.

  • Shafer, G. and Pearl, J. (eds.): 1990, Readings in Uncertain Reasoning. San Mateo, Calif: Morgan Kaufman.

    Google Scholar 

  • Shahar, Y. and Musen, M. A.: 1995, ‘Plan Recognition and Revision in Support of Guideline-Based Care’. In: Working notes of the AAAI Spring Symposium on Representing Mental States and Mechanisms. Stanford, CA, 118-126.

  • Sidner, C.: 1985, ‘Plan Parsing for intended response recognition in discourse’. Computational Intelligence 1.

  • Silverman, B. G.: 1991, ‘Expert Critics: Operationalizing the Judgement/Decisionmaking Literature as a Theory of ‘bugs’ and repair strategies’. Knowledge Acquisition 3, 175-214.

    Google Scholar 

  • Silverman, B. G.: 1992a, Critiquing Human Error. London, England: Academic Press Ltd.

    Google Scholar 

  • Silverman, B. G.: 1992b, ‘Survey of Expert Critiquing Systems: Practical and theoretical frontiers’. Communications of the ACM 35(4), 106-127.

    Google Scholar 

  • Spejewski, B.: 1997, ‘Observational Studies of a Trauma Care Team in Support of Interface Design’. In: Proceedings of the American Medical Informatics Association Fall Symposium. Submitted.

  • Teach, R. L. and Shortliffe, E. H.: 1981, ‘An Analysis of Physician Attitudes Regarding Computer-Based Clinical Consultation Systems’. Computers and Biomedical Research 14, 542-558.

    Google Scholar 

  • van Beek, P., Cohen, R. and Schmidt, K.: 1993, ‘From Plan Critiquing to Clarification Dialogue for Cooperative Response Generation’. Computational Intelligence 9(2), 132-154.

    Google Scholar 

  • Webber, B. L., Rymon, R. and J. R. Clarke: 1992, ‘Flexible Support for Trauma Management through Goal-Directed Reasoning and Planning’. Artificial Intelligence in Medicine 4(2), 145-163.

    Google Scholar 

  • Wilensky, R.: 1983, Planning and Understanding: A computational approach to human reasoning. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Wilensky, R., Chin, D., Luria, M., Martin, J., Mayfield, J. and Wu, D.: 1988, ‘The Berkeley UNIX Consultant Project’. Computational Linguistics 14(4), 35-84.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Learning Research and Development Center, University of Pittsburgh, Pittsburgh, PA, 15260, USA

    Abigail S. Gertner

Authors
  1. Abigail S. Gertner
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gertner, A.S. Plan Recognition and Evaluation for On-line Critiquing. User Modeling and User-Adapted Interaction 7, 107–140 (1997). https://doi.org/10.1023/A:1008220013693

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008220013693

Search

Navigation