On doing relevant and rigorous experiments: Review and recommendations

Détails

Ressource 1Télécharger: JOpsM_manuscript SERVAL 2018.pdf (910.48 [Ko])
Etat: Public
Version: de l'auteur⸱e
Licence: Non spécifiée
ID Serval
serval:BIB_C55BB4D70D11
Type
Article: article d'un périodique ou d'un magazine.
Collection
Publications
Institution
Titre
On doing relevant and rigorous experiments: Review and recommendations
Périodique
Journal of Operations Management
Auteur⸱e⸱s
Lonati S., Quiroga B.F., Zehnder C., Antonakis J.
ISSN
0272-6963
1873-1317
Statut éditorial
Publié
Date de publication
11/2018
Peer-reviewed
Oui
Volume
64
Numéro
1
Pages
19-40
Langue
anglais
Résumé
Although experiments are the gold standard for establishing causality, several threats can undermine the internal validity of experimental findings. In this article, we first discuss these threats, which include the lack of consequential decisions and outcomes, deception, demand effects and unfair comparisons, as well as issues concerning statistical validity (e.g., minimum sample size per cell, estimating variance correctly). We expose each problem, show potential solutions, and bring to the fore issues of relevance of the findings (i.e., external and ecological validity). Thereafter, we take stock of the state-of-the-science regarding validity threats using a representative sample of 468 recent experiments from 258 articles published in top-tier journals. We compare research practices in three fields of study—management, social psychology, and economics, which regularly use experimental research—to operations management, which has recently begun to use the experimental paradigm. Our results underscore the importance for journals and authors to follow what we identify to be best-practice methodological suggestions (i.e., the “ten commandments” of experimental research). We show that—on average—markers of methodological rigor and generalizability positively and significantly predict the citations received by published articles. Finally, given that experiments are infeasible in some settings, we conclude with a brief review of often overlooked quasi-experimental designs, which are useful for generating strong counterfactuals and hence allow making causal claims in the field.
Mots-clé
Management Science and Operations Research, Strategy and Management, Industrial and Manufacturing Engineering
Web of science
Création de la notice
19/10/2018 13:42
Dernière modification de la notice
20/08/2019 15:40
Données d'usage