Modeling individual and collaborative problem-solving in medical problem-based learning

Today a great many medical schools have turned to a problem-based learning (PBL) approach to teaching as an alternative to traditional didactic medical education to teach clinical-reasoning skills at the early stages of medical education. While PBL has many strengths, effective PBL tutoring is time-intensive and requires the tutor to provide a high degree of personal attention to the students, which is difficult in the current academic environment of increasing demands on faculty time. This paper describes the student modeling approach used in the COMET intelligent tutoring system for collaborative medical PBL. To generate appropriate tutorial actions, COMET uses a model of each student's clinical reasoning for the problem domain. In addition, since problem solving in group PBL is a collaborative process, COMET uses a group model that enables it to do things like focus the group discussion, promote collaboration, and suggest peer helpers. Bayesian networks are used to model individual student knowledge and activity, as well as that of the group. The validity of the modeling approach has been tested with student models in the areas of head injury, stroke, and heart attack. Receiver operating characteristic (ROC) curve analysis shows that the models are highly accurate in predicting individual student actions. Comparison with human tutors shows that the focus of group activity determined by the model agrees with that suggested by the majority of the human tutors with a high degree of statistical agreement (McNemar test, p = 0.774, Kappa= 0.823).