Looking for Validity or Testing It? The Perils of Stepwise Regression, Extreme-Scores Analysis, Heteroscedasticity, and Measurement Error

Détails

Ressource 1Télécharger: BIB_C442A0C8EDFC.P001.pdf (398.75 [Ko])
Etat: Serval
Version: de l'auteur
ID Serval
serval:BIB_C442A0C8EDFC
Type
Article: article d'un périodique ou d'un magazine.
Collection
Publications
Titre
Looking for Validity or Testing It? The Perils of Stepwise Regression, Extreme-Scores Analysis, Heteroscedasticity, and Measurement Error
Périodique
Personality and Individual Differences
Auteur(s)
Antonakis J., Dietz J.
ISSN
0191-8869
Statut éditorial
Publié
Date de publication
02/2011
Peer-reviewed
Oui
Volume
50
Numéro
3
Pages
409-415
Langue
anglais
Résumé
When researchers introduce a new test they have to demonstrate that it is valid, using unbiased designs and suitable statistical procedures. In this article we use Monte Carlo analyses to highlight how incorrect statistical procedures (i.e., stepwise regression, extreme scores analyses) or ignoring regression assumptions (e.g., heteroscedasticity) contribute to wrong validity estimates. Beyond these demonstrations, and as an example, we re-examined the results reported by Warwick, Nettelbeck, and Ward (2010) concerning the validity of the Ability Emotional Intelligence Measure (AEIM). Warwick et al. used the wrong statistical procedures to conclude that the AEIM was incrementally valid beyond intelligence and personality traits in predicting various outcomes. In our re-analysis, we found that the reliability-corrected multiple correlation of their measures with personality and intelligence was up to .69. Using robust statistical procedures and appropriate controls, we also found that the AEIM did not predict incremental variance in GPA, stress, loneliness, or well-being, demonstrating the importance for testing validity instead of looking for it.
Mots-clé
emotional intelligence, general intelligence, personality, validity, errors-in-variables, heteroscedasticity, truncation, Monte Carlo
Web of science
Création de la notice
10/09/2010 21:47
Dernière modification de la notice
03/03/2018 21:13
Données d'usage