The probability of probability and research truths

Daniel M. Fatovich, Michael Phillips

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)


The foundation of much medical research rests on the statistical significance of the P-value, but we have fallen prey to the seductive certainty of significance. Other scientific disciplines work to a different standard. This may partly explain why medical reversal is an increasing phenomenon, whereby new studies (based on the 0.05 standard) overturn previous significant findings. This has generated a crisis in the rigour of evidence-based medicine, as many people erroneously believe that a P < 0.05 means the treatment effect is clinically important. However, statistics are not facts about the world. Nor should they be based on an arbitrary threshold that arose for historical reasons. This arbitrary threshold encourages an unthinking automatic response that contributes to industry's influence on medical research. Examples from emergency medicine practice illustrate these themes. Study replication needs to be valued as much as discovery. Careful and thoughtful unbiased thinking about the results we do have is undervalued.

Original languageEnglish
Pages (from-to)242-244
JournalEMA - Emergency Medicine Australasia
Issue number2
Publication statusPublished - 1 Apr 2017


Dive into the research topics of 'The probability of probability and research truths'. Together they form a unique fingerprint.

Cite this