Original Research

Revisiting validity in cross-cultural psychometric-test development: A systems-informed shift towards qualitative research designs

Isabelle Swanepoel, Christa Kruger
South African Journal of Psychiatry | Vol 17, No 1 | a250 | DOI: https://doi.org/10.4102/sajpsychiatry.v17i1.250 | © 2011 Isabelle Swanepoel, Christa Kruger | This work is licensed under CC Attribution 4.0
Submitted: 31 March 2010 | Published: 01 March 2011

About the author(s)

Isabelle Swanepoel, Dept of Psychiatry, Univ of Pretoria, South Africa
Christa Kruger, Dept of Psychiatry, Univ of Pretoria, South Africa

Full Text:

PDF (122KB)

Abstract

Background: The problem of enhancing validity in cross-cultural psychometric-test development in the field of clinical psychology has been perpetuated by several factors. Societal biases and value judgements, a positivistic paradigm, and challenges associated with multiculturalism continually spill over into cross-cultural research methodology. An overemphasis on quantitative methods and insufficient exploration of the meaning of the concepts to be measured tend to threaten construct validity.

Objectives and Methods: This article tracks some of the progress in the field of clinical cross-cultural psychometric-test development – prior to and since the International Test Commission Guidelines, and including the complex South African situation – to give support to the perspective that previous cross-cultural research inadequately equips contemporary researchers to develop valid tests for multicultural clinical contexts.

Results: A systems-informed paradigm shift is proposed, which involves the application of systemic concepts such as circularity, relationality, neutrality, and a concern with process issues. Ideally, multidisciplinary, multicultural test-developing teams that include members of the target-cultural group should consult and collaborate with the target groups before embarking on test-adaptation or test-development activities. Such teamwork would help to ensure that the meaning of the relevant concept/s is captured in a valid way for each cultural group. Furthermore, such collaboration should form a part of using qualitative research designs more frequently in clinical cross-cultural psychometric-test development.

Conclusions: The emphasis should be on building theory and generating hypotheses, in order to pursue a deeper understanding of the constructs under investigation, and to advance theoretical developments in the field of clinical cross-cultural psychometric-test development.


Keywords

Psychometric testing; validity; cross-cultural; systems theory

Metrics

Total abstract views: 3117
Total article views: 3360

 

Crossref Citations

1. Cultural and Practice Perspectives on the Classroom Assessment Scoring System: Voices From American Indian and Alaska Native Head Start Programs
Jessica V. Barnes-Najor, Nicole L. Thompson, Ann F. Cameron, Teresa M. Smith, Mavany Calac Verdugo, Patricia Lee Brown, Michelle C. Sarche
Journal of Research in Childhood Education  vol: 35  issue: 1  first page: 162  year: 2021  
doi: 10.1080/02568543.2020.1723749