Difference between revisions of "Theme:E0384a98-fbfd-4df9-9caa-3fe4afa95951"
From The Embassy of Good Science
Marc.VanHoof (talk | contribs) (Created page with "{{Theme |Theme Type=Misconduct & Misbehaviors |Title=Publication bias (positive results) |Is About=This article will present the definition, sources, and consequences as well...") |
|||
| (6 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
{{Theme | {{Theme | ||
|Theme Type=Misconduct & Misbehaviors | |Theme Type=Misconduct & Misbehaviors | ||
| + | |Has Parent Theme=Theme:48185295-9e1e-41fb-ab70-948596e588d5 | ||
|Title=Publication bias (positive results) | |Title=Publication bias (positive results) | ||
| − | |Is About=This article | + | |Is About=This article presents the definition, sources, and consequences as well as misconceptions in scientific understanding of data which result in publication bias in favor of positive results. |
| − | |Important Because=Publication bias is defined as a conscious or unconscious decision to publish or distribute a manuscript based on the study results . <ref>Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):1-193.</ref> Reviews of scientific literature point to the fact that papers with positive results are three times more likely to be published than the ones with negative results. Reasons for such practices are multiple. The most common one is that scientists simply do not submit studies with negative findings to journals. Unfortunately, a lot of negative findings are usually defined as those that do not reach the usual threshold of statistical significance of p<0.05. This issue was recently addressed in the American Statistical Association’s Statement on p value, which aims to steer future research away from p value as the most significant indicator. <ref>Yaddanapudi LN. The American Statistical Association statement on P-values explained: J Anaesthesiol Clin Pharmacol. 2016 Oct-Dec;32(4):421-423. doi: 10.4103/0970-9185.194772.</ref> Also, a part of responsibility lies with editors and scientometric criteria, which, by their nature, favor studies with positive results. Two dire consequences of publication bias are resource waste and negative impact on meta-analyses. The former is the result of scientists doing experiments which have already been conducted by others but never published (because they had no positive results), and the latter simply means that meta-analyses will be oversaturated with positive results and skew the conclusions . <ref>Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991;337(8746):867-72.</ref> <ref>Dickersin K, Min YI. NIH clinical trials and publication bias. Online J Curr Clin Trials. 1993(50).</ref> <ref>Taragin MI. Learning from negative findings. Isr J Health Policy Res. 2019;8(1):019-0309.</ref> | + | |Important Because=Publication bias is defined as a conscious or unconscious decision to publish or distribute a manuscript based on the study results . <ref>Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):1-193.</ref> Reviews of scientific literature point to the fact that papers with positive results are three times more likely to be published than the ones with negative results. Reasons for such practices are multiple. The most common one is that scientists simply do not submit studies with negative findings to journals. Unfortunately, a lot of negative findings are usually defined as those that do not reach the usual threshold of statistical significance of p<0.05. This issue was recently addressed in the American Statistical Association’s Statement on p value, which aims to steer future research away from p value as the most significant indicator. <ref>Yaddanapudi LN. The American Statistical Association statement on P-values explained: J Anaesthesiol Clin Pharmacol. 2016 Oct-Dec;32(4):421-423. doi: 10.4103/0970-9185.194772.</ref>Also, a part of responsibility lies with editors and scientometric criteria, which, by their nature, favor studies with positive results. Two dire consequences of publication bias are resource waste and negative impact on meta-analyses. The former is the result of scientists doing experiments which have already been conducted by others but never published (because they had no positive results), and the latter simply means that meta-analyses will be oversaturated with positive results and skew the conclusions . <ref>Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991;337(8746):867-72.</ref> <ref>Dickersin K, Min YI. NIH clinical trials and publication bias. Online J Curr Clin Trials. 1993(50).</ref> <ref>Taragin MI. Learning from negative findings. Isr J Health Policy Res. 2019;8(1):019-0309.</ref> |
| + | <references /> | ||
|Important For=Students; PhD students; Researchers; Supervisors; Postdocs; Journal editors; Junior researchers; Senior researchers | |Important For=Students; PhD students; Researchers; Supervisors; Postdocs; Journal editors; Junior researchers; Senior researchers | ||
|Has Best Practice=Everybody who ever performed research probably experienced the sadness of getting a p value bigger than 0.05. Instead of critically looking at the data and results in the light of present knowledge and trying to figure out the impact of results, the hypothesis usually gets abandoned and another set of experiments gets initiated. There is some effort to change the existing practice. A new course in editorial policy for publication, which is considering only the methodological rigor, and not the direction of results, was set by PLOS some 20 years ago. Another praise worthy initiative is Journal of Negative Results which also considers methodological rigor as the only criteria for the publication of a manuscript. | |Has Best Practice=Everybody who ever performed research probably experienced the sadness of getting a p value bigger than 0.05. Instead of critically looking at the data and results in the light of present knowledge and trying to figure out the impact of results, the hypothesis usually gets abandoned and another set of experiments gets initiated. There is some effort to change the existing practice. A new course in editorial policy for publication, which is considering only the methodological rigor, and not the direction of results, was set by PLOS some 20 years ago. Another praise worthy initiative is Journal of Negative Results which also considers methodological rigor as the only criteria for the publication of a manuscript. | ||
}} | }} | ||
| − | {{Related To}} | + | {{Related To |
| − | {{Tags}} | + | |Related To Resource=Resource:A0df9be7-401a-43ba-af41-245019119182;Resource:B044b353-a9cb-4a39-9069-79b114497331;Resource:38cabc43-2b53-4c98-80ea-89b97ef5107d;Resource:Aea9471a-e48b-4fe0-8df4-8013763c4b08 |
| + | |Related To Theme=Theme:26631aa0-18f0-4635-b71b-80a6f4e58d33;Theme:24e87492-7020-4fc0-ab37-dd88bcf9f637 | ||
| + | |Related To Instruction=Instruction:312681e3-96e5-4ebe-85f7-6fa2947d1f4a | ||
| + | }} | ||
| + | {{Tags | ||
| + | |Has Virtue And Value=Accountability; Honesty; Objectivity; Precision; Reliability; Responsibility; Transparency | ||
| + | |Has Good Practice And Misconduct=Bias; Non-publication; Publication ethics | ||
| + | }} | ||
Latest revision as of 10:42, 27 March 2021
ThemesPublication bias (positive results)
What is this about?
This article presents the definition, sources, and consequences as well as misconceptions in scientific understanding of data which result in publication bias in favor of positive results.
Why is this important?
Publication bias is defined as a conscious or unconscious decision to publish or distribute a manuscript based on the study results . [1] Reviews of scientific literature point to the fact that papers with positive results are three times more likely to be published than the ones with negative results. Reasons for such practices are multiple. The most common one is that scientists simply do not submit studies with negative findings to journals. Unfortunately, a lot of negative findings are usually defined as those that do not reach the usual threshold of statistical significance of p<0.05. This issue was recently addressed in the American Statistical Association’s Statement on p value, which aims to steer future research away from p value as the most significant indicator. [2]Also, a part of responsibility lies with editors and scientometric criteria, which, by their nature, favor studies with positive results. Two dire consequences of publication bias are resource waste and negative impact on meta-analyses. The former is the result of scientists doing experiments which have already been conducted by others but never published (because they had no positive results), and the latter simply means that meta-analyses will be oversaturated with positive results and skew the conclusions . [3] [4] [5]
- ↑ Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):1-193.
- ↑ Yaddanapudi LN. The American Statistical Association statement on P-values explained: J Anaesthesiol Clin Pharmacol. 2016 Oct-Dec;32(4):421-423. doi: 10.4103/0970-9185.194772.
- ↑ Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991;337(8746):867-72.
- ↑ Dickersin K, Min YI. NIH clinical trials and publication bias. Online J Curr Clin Trials. 1993(50).
- ↑ Taragin MI. Learning from negative findings. Isr J Health Policy Res. 2019;8(1):019-0309.
For whom is this important?
StudentsPhD studentsResearchersSupervisorsPostdocsJournal editorsJunior researchersSenior researchers
What are the best practices?
Everybody who ever performed research probably experienced the sadness of getting a p value bigger than 0.05. Instead of critically looking at the data and results in the light of present knowledge and trying to figure out the impact of results, the hypothesis usually gets abandoned and another set of experiments gets initiated. There is some effort to change the existing practice. A new course in editorial policy for publication, which is considering only the methodological rigor, and not the direction of results, was set by PLOS some 20 years ago. Another praise worthy initiative is Journal of Negative Results which also considers methodological rigor as the only criteria for the publication of a manuscript.
The Embassy Editorial team, Iris Lechner, Natalie Evans, Eleni Spyrakou, Rosie Hastings, Benjamin Benzon contributed to this theme. Latest contribution was Mar 27, 2021
