About statistical significance, and the lack thereof.
Détails
ID Serval
serval:BIB_359A59002DA9
Type
Article: article d'un périodique ou d'un magazine.
Collection
Publications
Institution
Titre
About statistical significance, and the lack thereof.
Périodique
Laboratory animals
ISSN
1758-1117 (Electronic)
ISSN-L
0023-6772
Statut éditorial
Publié
Date de publication
10/2024
Peer-reviewed
Oui
Volume
58
Numéro
5
Pages
448-452
Langue
anglais
Notes
Publication types: Journal Article
Publication Status: ppublish
Publication Status: ppublish
Résumé
Absence of statistical significance (i.e., p > 0.05) in the results of a frequentist test comparing two samples is often used as evidence of absence of difference, or absence of effect of a treatment, on the measured variable. Such conclusions are often wrong because absence of significance may merely result from a sample size that is too small to reveal an effect. To conclude that there is no meaningful effect of a treatment/condition, it is necessary to use an appropriate statistical approach. For frequentist statistics, a simple tool for this goal is the 'two one-sided t-test,' a form of equivalence test that relies on the a priori definition of a minimal difference considered to be relevant. In other words, the smallest effect size of interest should be established in advance. We present the principles of this test and give examples where it allows correct interpretation of the results of a classical t-test assuming absence of difference. Equivalence tests are also very useful in probing whether certain significant results are also biologically meaningful, because when comparing large samples it is possible to find significant results in both an equivalence test and in a two-sample t-test, assuming no difference as the null hypothesis.
Mots-clé
Animals, Data Interpretation, Statistical, Research Design, Sample Size, Equivalence test, animal behavior, effect size, statistical significance
Pubmed
Web of science
Création de la notice
26/08/2024 9:32
Dernière modification de la notice
19/10/2024 6:09