Scale Adaptation in Organizational Science Research: A Review and Best-Practice Recommendations
Material type: TextDescription: 2596–2627 pSubject(s): In: DEBORAH E. RUPP JOURNAL OF MANAGEMENTSummary: In describing measures used in their research, authors frequently report having adapted a scale, indicating that they changed something about it. Although such changes can raise concerns about validity, there has been little discussion of this practice in our literature. To estimate the prevalence and identify key forms of scale adaptation, we conducted two studies of the literature. In Study 1, we reviewed the descriptions of all scales (N = 2,088) in four top journals over a 2-year period. We found that 46% of all scales were reported by authors as adapted and that evidence to support the validity of the adapted scales was presented in 23% of those cases. In Study 2, we chose six scales and examined their use across the literature, which allowed us to identify unreported adaptations. We found that 85% of the administrations of these scales had at least one form of adaptation and many had multiple adaptations. In Study 3, we surveyed editorial board members and a select group of psychometricians to evaluate the extent to which particular adaptations raised concerns about validity and the kinds of evidence needed to support the validity of the adapted scales. To provide guidance for authors who adapt scales and for reviewers and editors who evaluate papers with adapted scales, we present discussions of several forms of adaptations regarding potential threats to validity and recommendations for the kinds of evidence that might best support the validity of the adapted scale (including a reviewer checklist).Item type | Current library | Call number | Vol info | Status | Notes | Date due | Barcode | Item holds | |
---|---|---|---|---|---|---|---|---|---|
Journal Article | Main Library | Vol 45, Issue 6/ 55510864JA12 (Browse shelf(Opens below)) | Available | 55510864JA12 | |||||
Journals and Periodicals | Main Library On Display | JRNL/GEN/Vol 45, Issue 6/55510864 (Browse shelf(Opens below)) | Vol 45, Issue 6 (01/07/2019) | Not for loan | July, 2019 | 55510864 |
Browsing Main Library shelves Close shelf browser (Hides shelf browser)
No cover image available | No cover image available | No cover image available | No cover image available | No cover image available | No cover image available | No cover image available | ||
Vol 45, Issue 5/ 55510586JA9 Unveiling the Microfoundations of Absorptive Capacity: A Study of Coleman’s Bathtub Model | Vol 45, Issue 6/ 555108648JA8 Why Abusive Supervision Impacts Employee OCB and CWB: A Meta-Analytic Review of Competing Mediating Mechanisms | Vol 45, Issue 6/ 55510864JA10 Board Independence and Corporate Misconduct: A Cross-National Meta-Analysis | Vol 45, Issue 6/ 55510864JA12 Scale Adaptation in Organizational Science Research: A Review and Best-Practice Recommendations | Vol 45, Issue 6/ 55510864JA2 State Ownership and Political Connections | Vol 45, Issue 6/ 55510864JA3 It’s Not Personal: A Review and Theoretical Integration of Research on Vicarious Workplace Mistreatment | Vol 45, Issue 6/ 55510864JA4 Issues and Trends in Causal Ambiguity Research: A Review and Assessment |
In describing measures used in their research, authors frequently report having adapted a scale, indicating that they changed something about it. Although such changes can raise concerns about validity, there has been little discussion of this practice in our literature. To estimate the prevalence and identify key forms of scale adaptation, we conducted two studies of the literature. In Study 1, we reviewed the descriptions of all scales (N = 2,088) in four top journals over a 2-year period. We found that 46% of all scales were reported by authors as adapted and that evidence to support the validity of the adapted scales was presented in 23% of those cases. In Study 2, we chose six scales and examined their use across the literature, which allowed us to identify unreported adaptations. We found that 85% of the administrations of these scales had at least one form of adaptation and many had multiple adaptations. In Study 3, we surveyed editorial board members and a select group of psychometricians to evaluate the extent to which particular adaptations raised concerns about validity and the kinds of evidence needed to support the validity of the adapted scales. To provide guidance for authors who adapt scales and for reviewers and editors who evaluate papers with adapted scales, we present discussions of several forms of adaptations regarding potential threats to validity and recommendations for the kinds of evidence that might best support the validity of the adapted scale (including a reviewer checklist).
There are no comments on this title.