The probability of probability and research truths

Daniel M. Fatovich, Michael Phillips

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The foundation of much medical research rests on the statistical significance of the P-value, but we have fallen prey to the seductive certainty of significance. Other scientific disciplines work to a different standard. This may partly explain why medical reversal is an increasing phenomenon, whereby new studies (based on the 0.05 standard) overturn previous significant findings. This has generated a crisis in the rigour of evidence-based medicine, as many people erroneously believe that a P < 0.05 means the treatment effect is clinically important. However, statistics are not facts about the world. Nor should they be based on an arbitrary threshold that arose for historical reasons. This arbitrary threshold encourages an unthinking automatic response that contributes to industry's influence on medical research. Examples from emergency medicine practice illustrate these themes. Study replication needs to be valued as much as discovery. Careful and thoughtful unbiased thinking about the results we do have is undervalued.

Original languageEnglish
Pages (from-to)242-244
JournalEMA - Emergency Medicine Australasia
Volume29
Issue number2
DOIs
Publication statusPublished - 1 Apr 2017

Fingerprint

Biomedical Research
Emergency Medicine
Evidence-Based Medicine
Research
Industry

Cite this

@article{051acbda7eb243949fa6d607dc7e3cc0,
title = "The probability of probability and research truths",
abstract = "The foundation of much medical research rests on the statistical significance of the P-value, but we have fallen prey to the seductive certainty of significance. Other scientific disciplines work to a different standard. This may partly explain why medical reversal is an increasing phenomenon, whereby new studies (based on the 0.05 standard) overturn previous significant findings. This has generated a crisis in the rigour of evidence-based medicine, as many people erroneously believe that a P < 0.05 means the treatment effect is clinically important. However, statistics are not facts about the world. Nor should they be based on an arbitrary threshold that arose for historical reasons. This arbitrary threshold encourages an unthinking automatic response that contributes to industry's influence on medical research. Examples from emergency medicine practice illustrate these themes. Study replication needs to be valued as much as discovery. Careful and thoughtful unbiased thinking about the results we do have is undervalued.",
keywords = "P-value, Medical reversal, Probability, Replication, Statistical significance",
author = "Fatovich, {Daniel M.} and Michael Phillips",
year = "2017",
month = "4",
day = "1",
doi = "10.1111/1742-6723.12740",
language = "English",
volume = "29",
pages = "242--244",
journal = "Emergency Medicine",
issn = "1742-6723",
publisher = "John Wiley & Sons",
number = "2",

}

The probability of probability and research truths. / Fatovich, Daniel M.; Phillips, Michael.

In: EMA - Emergency Medicine Australasia, Vol. 29, No. 2, 01.04.2017, p. 242-244.

Research output: Contribution to journalArticle

TY - JOUR

T1 - The probability of probability and research truths

AU - Fatovich, Daniel M.

AU - Phillips, Michael

PY - 2017/4/1

Y1 - 2017/4/1

N2 - The foundation of much medical research rests on the statistical significance of the P-value, but we have fallen prey to the seductive certainty of significance. Other scientific disciplines work to a different standard. This may partly explain why medical reversal is an increasing phenomenon, whereby new studies (based on the 0.05 standard) overturn previous significant findings. This has generated a crisis in the rigour of evidence-based medicine, as many people erroneously believe that a P < 0.05 means the treatment effect is clinically important. However, statistics are not facts about the world. Nor should they be based on an arbitrary threshold that arose for historical reasons. This arbitrary threshold encourages an unthinking automatic response that contributes to industry's influence on medical research. Examples from emergency medicine practice illustrate these themes. Study replication needs to be valued as much as discovery. Careful and thoughtful unbiased thinking about the results we do have is undervalued.

AB - The foundation of much medical research rests on the statistical significance of the P-value, but we have fallen prey to the seductive certainty of significance. Other scientific disciplines work to a different standard. This may partly explain why medical reversal is an increasing phenomenon, whereby new studies (based on the 0.05 standard) overturn previous significant findings. This has generated a crisis in the rigour of evidence-based medicine, as many people erroneously believe that a P < 0.05 means the treatment effect is clinically important. However, statistics are not facts about the world. Nor should they be based on an arbitrary threshold that arose for historical reasons. This arbitrary threshold encourages an unthinking automatic response that contributes to industry's influence on medical research. Examples from emergency medicine practice illustrate these themes. Study replication needs to be valued as much as discovery. Careful and thoughtful unbiased thinking about the results we do have is undervalued.

KW - P-value

KW - Medical reversal

KW - Probability

KW - Replication

KW - Statistical significance

UR - http://www.scopus.com/inward/record.url?scp=85013276795&partnerID=8YFLogxK

U2 - 10.1111/1742-6723.12740

DO - 10.1111/1742-6723.12740

M3 - Article

VL - 29

SP - 242

EP - 244

JO - Emergency Medicine

JF - Emergency Medicine

SN - 1742-6723

IS - 2

ER -