Raven, J. (2006, September 15). Lessons Learned while Developing a Romanian Version of the Mill Hill Vocabulary Test. WebPsychEmpiricist. Retrieved September 15, 2006, from http://wpe.info/papers_table.html

Whereas Raven’s Progressive Matrices tests have repeatedly been shown to have impeccable test properties in many different cultures, it has proved remarkably difficult to develop a range of Mill Hill Vocabulary tests for cross cultural use. This has more implications for the use of tests on a cross-cultural basis than might at first sight appear since, on the face of it, nothing could be simpler than generating Whereas Raven’s Progressive Matrices tests have repeatedly been shown to have impeccable test properties in many different cultures, it has proved remarkably difficult to develop a range of Mill Hill Vocabulary tests for cross-cultural use. This has more implications for the use of tests on a cross-cultural basis than might at first sight appear since, on the face of it, nothing could be simpler than generating equivalent sets of words for use in different cultures. The present paper shows that even generating parallel versions of the same IRT-based test, in open-ended and multiple-choice formats, is fraught with difficulties. For example, the introduction of apparently acceptable distractors into multiple-choice versions of items which function effectively in open-ended format can destroy them. The relative merits of alternative computer programs for carrying out the requisite analyses are assessed, and most found wanting.

Download the pdf