Kluge, Annette:
Performance assessments with microworlds and their difficulty
2008
In: Applied Psychological Measurement, Jg. 32 (2008), Heft Heft 2, S. 156 - 180
Artikel/Aufsatz in Zeitschrift / Fach: Angewandte Kognitionswissenschaft
Titel:
Performance assessments with microworlds and their difficulty
Autor(in):
Kluge, Annette
Erscheinungsjahr
2008
Erschienen in:
Applied Psychological Measurement, Jg. 32 (2008), Heft Heft 2, S. 156 - 180
ISSN
WWW URL

Abstract:

The use of microworlds (MWs), or complex dynamic systems, in educational testing and personnel selection is hampered by systematic measurement errors because these new and innovative item formats are not adequately controlled for their difficulty. This empirical study introduces a way to operationalize an MW's difficulty and demonstrates the strong effects of variations in it. A rationale for predicting an MW's difficulty (number and quality of relationships between the same number of variables) is tested for difficulty's impact on assessed performance. As the number of relationships increases, control performance, acquired knowledge, and self-efficacy as moderating variables decrease. Analysis of knowledge types (qualitative and quantitative) shows that system difficulty affects quantitative knowledge more than it does qualitative knowledge.