Questionable Research Practices in Analysis and Reporting
Integrity in analysis and reporting of results is important to fully understand your data. Misbehaviors related to analysis and reporting include: #Report on data driven hypotheses without disclosure [‘HARKing’ ‐ Hypothesizing After Results are Known ‐ typically with a view to make results appear more spectacular (‘Chrysalis effect’)] #Delete data before performing data analysis without disclosure #Selectively delete data, modify data or add fabricated data after performing initial data‐analyses [in other words: falsification or fabrication of data] #Perform data‐analyses not stated in the study protocol without disclosure [or in predefined data‐analysis plan – also called ‘Significance chasing’, ‘P-hacking’, ‘data dredging’, ‘fishing expedition’ or explorative subgroup analyses] #Report an incorrect downwardly rounded p‐value [e.g. by reporting a p value of .054 as being less than .05] #Not report all study protocol‐stipulated results [in the aggregate of all published reports on the study at issue] #Not publish a valid ‘negative’ study [in a form that is publicly available or accessible behind a paywall (article, report, website etc.)] #Report an unexpected finding as having been hypothesized from the start #Conceal results that contradict your earlier findings or convictions #Not report clearly relevant details of study methods #Not report replication problems #Selectively cite to enhance your own findings or convictions #Selectively cite to please editors, reviewers or colleagues #Selectively cite or cite your own work to improve citation metrics [e.g. Impact Factor, H‐index] #Let your convictions influence the conclusions substantially #Insufficiently report study flaws and limitations #Spread study results over more papers than needed [‘salami slicing’] #Duplicate publication without disclosure #Re‐use of previously published data without disclosure [which may lead to double counting in meta‐analyses] #Modify the results or conclusions of a study due to pressure of a sponsor [commercial or not‐for‐profit funder of the study] #Failure to disclose a sponsor of the study #Failure to disclose a relevant financial or intellectual conflict of interest [in publications, when reviewing grant proposals, or evaluating persons or institutions] #Handle existing conflicts of interest inadequately #Communicate results to the general public before a peer reviewed publication is available #Deliberately communicate findings inaccurately in the media or during presentations #Make no clear distinction between personal views and professional comments (List from Bouter et al 2016'"`UNIQ--ref-00000002-QINU`"') '"`UNIQ--references-00000003-QINU`"'
In a list of major and minor research misbehaviours collaboratively developed by a group of research integrity experts, the research phase ‘Reporting’ (which describes analysis and publication of results jointly) contains the most items.'"`UNIQ--ref-00000000-QINU`"' Needless to say, the potential for misbehaviors in this phase is exacerbated by the vast number of decisions researchers must take during the course of analysis and reporting. '"`UNIQ--references-00000001-QINU`"'
Questionable Research Practices in Analysis and Reporting# QUERY69987df5338a1b0b20d9ca32eac85d9c
Questionable Research Practices in Analysis and Reporting# QUERY24d915bd23e0453879332bd260c5c091
Communicate results to the general public before a peer reviewed publication is available
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Communicate results to the general public before a peer reviewed publication is available
Data driven hypotheses without disclosure (‘HARKing’)
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Data driven hypotheses without disclosure (‘HARKing’)
Duplicate publications and secondary publications
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Duplicate publications and secondary publications
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Funding (Sponsorship) bias
Hypothesizing after the results are known (HARKing)
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Hypothesizing after the results are known (HARKing)
Improper data use (a bias distorting research results)
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Improper data use (a bias distorting research results)
Inaccurate representation of results in the media
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Inaccurate representation of results in the media
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Inferring from P-values
Insufficiently reported study flaws and limitations
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Insufficiently reported study flaws and limitations
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Non-reporting of negative findings
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Outcome reporting bias
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]P-value hacking
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Publication bias (positive results)
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Salami publication
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Selective citation
[[:Property:Display Title|Display Title]]: [[:Questionable Research Practices in Analysis and Reporting|Questionable Research Practices in Analysis and Reporting]]Spin of research results
[[:Property:Display Title|Display Title]]: [[:Protecting research subjects|Protecting research subjects]]Clarifying the aims of a research study
Is there an overall theme which already addresses some relevant points?