About statistical significance, and the lack thereof.
Details
Serval ID
serval:BIB_359A59002DA9
Type
Article: article from journal or magazin.
Collection
Publications
Institution
Title
About statistical significance, and the lack thereof.
Journal
Laboratory animals
ISSN
1758-1117 (Electronic)
ISSN-L
0023-6772
Publication state
Published
Issued date
10/2024
Peer-reviewed
Oui
Volume
58
Number
5
Pages
448-452
Language
english
Notes
Publication types: Journal Article
Publication Status: ppublish
Publication Status: ppublish
Abstract
Absence of statistical significance (i.e., p > 0.05) in the results of a frequentist test comparing two samples is often used as evidence of absence of difference, or absence of effect of a treatment, on the measured variable. Such conclusions are often wrong because absence of significance may merely result from a sample size that is too small to reveal an effect. To conclude that there is no meaningful effect of a treatment/condition, it is necessary to use an appropriate statistical approach. For frequentist statistics, a simple tool for this goal is the 'two one-sided t-test,' a form of equivalence test that relies on the a priori definition of a minimal difference considered to be relevant. In other words, the smallest effect size of interest should be established in advance. We present the principles of this test and give examples where it allows correct interpretation of the results of a classical t-test assuming absence of difference. Equivalence tests are also very useful in probing whether certain significant results are also biologically meaningful, because when comparing large samples it is possible to find significant results in both an equivalence test and in a two-sample t-test, assuming no difference as the null hypothesis.
Keywords
Animals, Data Interpretation, Statistical, Research Design, Sample Size, Equivalence test, animal behavior, effect size, statistical significance
Pubmed
Web of science
Create date
26/08/2024 9:32
Last modification date
19/10/2024 6:09