Comparing Failure Base Rates on the TOMM-1 and Rey-15 in Romanian and Canadian Disability Applicants

Authors: Iulia Crisan

Abstract:

Objective: The present study investigates the cross-cultural validity of three North-American performance validity indicators (PVTs) by comparing base rates of failure (BRF) in Romanian and Canadian disability applicants. Methods: Three PVTs (Test of Memory Malingering Trial 1 [TOMM-1], Rey Fifteen Item Test free recall [Rey-15 FR], and Rey FR+Recognition [Rey COMB]) were administered to a heterogeneous Romanian clinical sample (N Ro =54) and a similar Canadian sample (N Can = 52). Patients were referred for assessment to determine the severity of their cognitive deficits. Results: We compared the BRF in both samples at various cutoffs. BRF on TOMM-1 at ≤ 43 was similar (Ro = 33.3% vs. Can = 40.4%); at ≤40, Ro = 22.2% vs. Can = 25.0%. Likewise, comparable BRF were observed on Rey-15 FR at ≤ 8 (Ro = 7.4% vs. Can = 11.5%) and ≤ 11 (Ro = 27.8% vs. Can = 23.1%). However, the Romanian sample produced significantly higher failure rates on the Rey COMB at variable cutoffs (p <.05), possibly because Romanian patients were significantly older than the Canadian sample. Conclusion: Our findings offer proof of concept for the cross-cultural validity of the TOMM and Rey-15 FR. At the same time, they serve as a reminder that the generalizability of PVT cutoffs to different populations should not be assumed but verified empirically. Employing the TOMM as a criterion measure for newly developed PVTs is discussed.

Keywords: performance validity indicators, cross-cultural validity, failure base rates, clinical samples, cognitive dysfunction, TOMM-1, Rey-15, Rey COMB