Print version

Research

Cognitive Task Analysis refers to a range of methods designed to elicit, describe and explain the mental processes underlying task performance. These methods aim to enable researchers to understand how workers make judgements, plans and decisions, interpret situations, and use cognitive skills to perform work tasks. This knowledge can then be used to design systems, training and work competency tests, for instance, to support the requirements of the task (Klein & Militello, 2001; Chipman, Schraagen & Shalin, 2000).

The Critical Decision Method is an example of a method for Cognitive Task Analysis. The Critical Decision Method is an interview technique that can be used to elicit knowledge from expert operators about their decision-making and problem-solving processes during non-routine incidents (Klein, Calderwood & MacGregor, 1989). The method involves the use of probing questions to uncover the kinds of knowledge and experience on which decisions are based. The technique allows interviewers to gradually shift operators from an overall operational account of an incident to a description of their problem solving processes during the incident.

Briefly, the operator is asked to provide a general description of the incident followed by a more detailed account of the sequence of events that occurred. The interviewer and the operator then establish a timeline for the incident and identify the critical points at which decisions were required. Following that, the interviewer uses a number of probes to elicit more detailed information from the operator about the problem-solving processes at each of these points.

The Critical Decision Method has been used in the development and performance evaluation of expert systems, in assisting and supporting decision-making, and in research about expert decision-making processes. It has also been used to improve training by identifying new training requirements and uncovering tacit knowledge that is not included in the formal training procedures. In addition, the Critical Decision Method generates information on nonroutine incidents that can be used to train operators in situational assessment and prepare them to deal with unexpected events (Klein, Calderwood & MacGregor, 1989; Hoffman, Crandall & Shadbolt, 1998).

Useful references:

• Klein, G. A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man and Cybernetics, 19(3), 462-472.
  (This article provides a useful introduction to the Critical Decision Method technique)
  
• Hoffman, R. R., Crandall, B., & Shadbolt, N. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. The Journal of the Human Factors and Ergonomics Society, 40(2), 254-276.
  (This article uses the Critical Decision Method as a case study for examining Cognitive Task Analysis. It provides a useful description of the method and its applications)
  
• Chipman, S. E., Schraagen, J. M., & Shalin, V. L. (2000). Introduction to cognitive task analysis. In J. M. Schraagen, S. E. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 3-23). Mahwah, NJ: Lawrence Erlbaum Associates.
  (This chapter provides a useful introduction to Cognitive Task Analysis. The book highlights various methods of Cognitive Task Analysis and their applications within various domains)
  
• Klein, G., & Militello, L. (2001). Some guidelines for conducting a cognitive task analysis. In E. Salas (Ed.), Advances in human performance and cognitive engineering research: Vol. 1 (pp. 163-199). Oxford: Elsevier Science/JAI Press.
  (This chapter provides guidance for conducting Cognitive Task Analysis methods. It also discusses definitions of Cognitive Task Analysis, how this differs from traditional task analysis and the criteria for success in CTA.)