Domain-Specific Knowledge and Task Characteristics in Decision Making

doi:10.1006/obhd.1995.1107

Organizational Behavior and Human Decision Processes

Volume 64, Issue 3, December 1995, Pages 294-306

https://doi.org/10.1006/obhd.1995.1107 Get rights and content

Abstract

Recent theory and research has highlighted the importance of domain-specific knowledge in allowing superior performance. Previous studies have shown that task characteristics affect decision making performance, yet few (if any) studies have varied task characteristics in the context of knowledge differences. In this study, two task characteristics (the labeling of alternatives and the structure of the decision) were identified and hypothesized to interact with decision-maker knowledge level in affecting information acquisition and decision accuracy. A computerized information board study using high and low knowledge individuals in the domain of basketball found that both task characteristics interacted with knowledge level to affect information acquisition and decision accuracy. High knowledge individuals were significantly more accurate than low knowledge individuals on well-structured decisions but not on ill-structured decisions. Further, high knowledge individuals reduced information search when decisions were well-structured and when alternatives were descriptively labeled, and acquired considerably more contextual information than low knowledge individuals across all conditions. On the other hand, low knowledge information acquisition appeared to be largely unaffected by decision structure or descriptive labeling. The discussion highlights the need to view superior performance as a complex function of existing knowledge, task demands and information search.

References (0)

Cited by (79)

A multi-dimensional approach for analyzing risk-related decision problems to enhance decision making and prevent accidents
2024, Journal of Loss Prevention in the Process Industries
Risk-related decision problems are the problems that influence the risk of accidents. In most cases, the probability of major accidents is very low, but their consequences can be extreme, resulting in numerous fatalities and extensive environmental damage. An example is the Deepwater Horizon disaster in the Gulf of Mexico in 2010. Decision making under such circumstances (i.e., under high stake and complexity) is challenging, where expected utility calculations typically are not sufficient to provide a robust foundation. This article focuses on this specific category of risk-related decision problems, aiming to develop a decision analysis approach to enhance decision makers’ understanding on the features of their decision problems. This can in turn form the basis for tailoring the information needed for decision making. The proposed approach is a multi-dimensional approach, which includes seven dimensions: criticality, uniqueness, structuredness, complicatedness, dynamic, residual uncertainty, and problem trigger. Real-life examples are analyzed to illustrate and assess the proposed multi-dimensional approach. Overall, an improved understanding of risk-related decisions problem can be aided by the proposed approach, which indirectly helps to prevent accidents and maintain safety by predicting the human decision-making process, potential decision-making errors, and identifying decision support requirements.
Learnersourcing in the age of AI: Student, educator and machine partnerships for content creation
2023, Computers and Education: Artificial Intelligence
Engaging students in creating novel content, also referred to as learnersourcing, is increasingly recognised as an effective approach to promoting higher-order learning, deeply engaging students with course material and developing large repositories of content suitable for personalised learning. Despite these benefits, some common concerns and criticisms are associated with learnersourcing (e.g., the quality of resources created by students, challenges in incentivising engagement and lack of availability of reliable learnersourcing systems), which have limited its adoption. This paper presents a framework that considers the existing learnersourcing literature, the latest insights from the learning sciences and advances in AI to offer promising future directions for developing learnersourcing systems. The framework is designed around important questions and human-AI partnerships relating to four key aspects: (1) creating novel content, (2) evaluating the quality of the created content, (3) utilising learnersourced contributions of students and (4) enabling instructors to support students in the learnersourcing process. We then present two comprehensive case studies that illustrate the application of the proposed framework in relation to two existing popular learnersourcing systems.
Leveraging research within a pedagogical protocol for enhanced integrated-competency student learning
2021, Journal of Accounting Education
Citation Excerpt :
The literature has identified the importance of domain knowledge/expertise of the decision-maker as an area of interest for improving organizational decision-making. Researchers have linked domain knowledge/expertise with multiple frameworks for cognitive processing and decision modeling (see Steiner, Nussbaumer, Neville, & Albert, 2017; Devine & Kozlowski, 1995). Previous research has delineated domain knowledge into three subcategories of task, theory, and tool knowledge (Marshall, Byrd, Gardiner, & Rainer, 2002).
This research presents a case-based pedagogical protocol, including an experiment, designed to maximize the utility of the integrated-competency framework in accounting. The study involves a rich learning exercise protocol requiring integrated competencies that fairly represent, in content and context, the experience of a professional engagement. The pedagogical protocol focuses on communications in the accounting industry, where research suggests potential communication disconnects. The study includes a laboratory experiment investigating how audit department communications (experimental treatment), individual attitudes, and task domain knowledge (task recall) interact to influence project participants’ perspectives of project viability and their intention to continue project development. In accordance with the pedagogical protocol, we discuss experiment findings identifying significant factors influencing decision behavior with the students in a debriefing session for self-awareness and mindfulness. The debriefing session, focusing on introspection and empathy, expands the competencies generally addressed by accounting learning exercises. The experiment findings suggest the importance that the accounting profession identify the need for and complexities of effective communications across organizational units. We present the pedagogical protocol and design methodology, including leveraging social science research, as models for other educators/researchers to develop learning exercises based on the integrated-competency model to better educate and prepare our students for their future successes.
Who is an expert for foresight? A review of identification methods
2020, Technological Forecasting and Social Change
Citation Excerpt :
The repetitive structure of performance-based models is crucial. As researchers highlight, the maximal adaptation to task constraints is essential for the performance of experts (Devine and Kozlowski, 1995; Ericsson and Lehmann, 1996; Shanteau, 1992), which renders this method of selection particularly applicable to repetitive tasks. However, selection based on past performance should attend to the circumstances of previous judgments, such as whether an accurate forecast truly evolves from a person's expertise or in effect of luck or irrational choice.
While decision research tends to treat the question of expertise with suspicion, the capacity of experts within the wider, applied field of foresight often remains unquestioned. In this review of expert identification methods, we share the positive assessment of expert judgment for exploring plausible conditions of the future. However, given the contested status of expertise, it is crucial to know how a particular mode of recruitment, or (more often) a combination of diverse methods, seeks to secure the expert status of a person. Our review is motivated by the conviction that foresight researchers should not only assume value in expertise, but defend this value from scientific viewpoints. Based on an introduction to sociological, behavioral and cognitive perspectives on expertise, we trace the epistemological premises guiding different modes of selection. We list eight expert identification methods and explore their core assumptions, strengths, weaknesses and domain examples. Developing such linkages between priorities in expert selection and the arguments underlying them is the major contribution of this article. A second contribution lies in providing an overview of expert selection methods, ranging from simple and low-cost to more complex and combined methodologies.
Adaptive expertise and creative thinking: A synthetic review and implications for practice
2020, Thinking Skills and Creativity
Citation Excerpt :
Sternberg and Frensch (1992) also pointed out how easily people can fall into mental routines and ruts in thinking because of the automaticity of processing in expert domains. While expert knowledge allows people to react more quickly and accurately in well-structured environments that respect established patterns of the domain, the knowledge does not always carry over into ill-structured problem spaces (Devine & Kozlowski, 1995). Sometimes domain rules can change as a result of external stimuli, and when that happens, experts have varying levels of adaptability to the new situation (Bransford et al., 2000).
To thrive in a rapidly changing society, university graduates need flexible thinking skills. Such skills have been explored in diverse bodies of literature, with different names, through different lenses. This article presents a critical review and synthesis of theories in two distinct bodies of the research literature: adaptive expertise and creative thinking. Based on our analysis, we propose that the two constructs overlap as “applied creative thinking”, denoting the kind of creativity that occurs when learned knowledge or acquired expertise is used adaptively and creatively. Implications for teaching and learning in higher education achievement settings are discussed, and directions for future research are suggested to better understand factors influencing the skills and competencies needed by graduates in an innovation society.
Exploration-exploitation tradeoffs and information-knowledge gaps in self-regulated learning: Implications for learner-controlled training and development
2019, Human Resource Management Review
Citation Excerpt :
However, like purely exploratory approaches, an overemphasis on exploitation can also be problematic. Research shows that people who possess routine expertise tend to struggle when characteristics of the problem domain change (Devine & Kozlowski, 1995; Sternberg & Frensch, 1992). Similarly, Stanislaw et al. (1994) found that when operating in adaptive contexts, programmers who favored a broader variety of languages outperformed individuals who specialized in a single language because they were better able to select and adapt the appropriate language to suit the problem.
Learning in modern organizations often involves managing a tradeoff between exploration (i.e., knowledge expansion) and exploitation (i.e., knowledge refinement). In this paper, we consider the implications of this tradeoff in the context of learner-controlled training and development. We then propose a model that integrates research on control theory, curiosity, and skill acquisition to explain how information knowledge gaps (i.e., gaps between what learners believe they know and what they desire to know) guide resource allocation decisions throughout the learning process. Using this model, we present testable propositions regarding (a) the different approaches learners take when resolving exploration-exploitation tradeoffs, (b) how systematic changes in learner perceptions translate into changes in systematic learner behavior, and (c) how common biases in key learner perceptions can undermine the functioning of self-regulated learning in training and development contexts. We finish with a discussion of the model's implications for the science and practice of training and development.

View all citing articles on Scopus

View full text

Regular ArticleDomain-Specific Knowledge and Task Characteristics in Decision Making

Abstract

Regular Article
Domain-Specific Knowledge and Task Characteristics in Decision Making