The accuracy of dominance analysis as a metric to assess relative importance: The joint impact of sampling error variance and measurement unreliability

J Appl Psychol. 2019 Apr;104(4):593-602. doi: 10.1037/apl0000361. Epub 2018 Oct 15.

Abstract

Dominance analysis (DA) has been established as a useful tool for practitioners and researchers to identify the relative importance of predictors in a linear regression. This article examines the joint impact of two common and pervasive artifacts-sampling error variance and measurement unreliability-on the accuracy of DA. We present Monte Carlo simulations that detail the decrease in the accuracy of DA in the presence of these artifacts, highlighting the practical extent of the inferential mistakes that can be made. Then, we detail and provide a user-friendly program in R (R Core Team, 2017) for estimating the effects of sampling error variance and unreliability on DA. Finally, by way of a detailed example, we provide specific recommendations for how researchers and practitioners should more appropriately interpret and report results of DA. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

MeSH terms

  • Adult
  • Behavioral Research / methods*
  • Behavioral Research / standards
  • Data Interpretation, Statistical*
  • Humans
  • Models, Statistical*
  • Monte Carlo Method*
  • Psychology, Applied / methods*
  • Psychology, Applied / standards
  • Selection Bias