Difference between revisions of "Theme:88b73549-fec0-4fb9-99f6-fe1055d6b76a"
From The Embassy of Good Science
| Line 7: | Line 7: | ||
Examples of improper data use include: | Examples of improper data use include: | ||
| − | * '''Massaging''': … extensive transformations or other maneuvers to make inconclusive data appear … conclusive | + | *'''Massaging''': … extensive transformations or other maneuvers to make inconclusive data appear … conclusive |
| − | * '''Extrapolating''': … predicting future trends based on unsupported assumptions … | + | *'''Extrapolating''': … predicting future trends based on unsupported assumptions … |
| − | * '''Smoothing''': discarding data points too far removed from expected … values | + | *'''Smoothing''': discarding data points too far removed from expected … values |
| − | * '''Slanting''': … selecting certain trends in the data, … discarding others which do not fit … | + | *'''Slanting''': … selecting certain trends in the data, … discarding others which do not fit … |
| − | * '''Fudging''': creating data points to augment incomplete data sets … | + | *'''Fudging''': creating data points to augment incomplete data sets … |
| − | * '''Manufacturing''': creating entire data sets de novo, … <ref>Sindermann C. J. “Winning the games scientists play” (Plenum Press, NY, 1982)</ref> | + | *'''Manufacturing''': creating entire data sets de novo, … <ref>Sindermann C. J. “Winning the games scientists play” (Plenum Press, NY, 1982)</ref> |
Data dredging is looking for too many possible associations in a dataset to see of any of them are statistically significant. Data dredging results in false positive results. | Data dredging is looking for too many possible associations in a dataset to see of any of them are statistically significant. Data dredging results in false positive results. | ||
| Line 43: | Line 43: | ||
}} | }} | ||
{{Related To | {{Related To | ||
| − | |Related To Resource= | + | |Related To Resource=Resource:47bfd883-c518-4a97-98fb-86b5cf442d3e;Resource:5aefe751-0a20-4597-98a5-a59bf06a987a;Resource:8354ff67-9da4-4325-8395-d16e30059fb2;Resource:6ee4f37d-aa55-45c9-93ae-86831a37ca17;Resource:226c89f1-a061-4bb0-8ec4-79583de2ddf0;Resource:1b777e40-9d7f-4ef4-a601-6be70c9e386a;Resource:369d2eb6-90ef-4198-8268-a95e51a307d0;Resource:6bcb5216-4e02-470f-85e7-abd492d47134 |
|Related To Theme=Theme:6b584d4e-2c9d-4e27-b370-5fbdb983ab46;Theme:26631aa0-18f0-4635-b71b-80a6f4e58d33 | |Related To Theme=Theme:6b584d4e-2c9d-4e27-b370-5fbdb983ab46;Theme:26631aa0-18f0-4635-b71b-80a6f4e58d33 | ||
}} | }} | ||
Revision as of 15:35, 27 May 2020
ThemesImproper data use (a bias distorting research results)
What is this about?
Researchers may handle data in a number of ways that can influence the results to become misleading.
Why is this important?
Improper data use undermines the ethos of science and the corresponding misleading results can misguide and distort the production of knowledge.
Examples of improper data use include:
- Massaging: … extensive transformations or other maneuvers to make inconclusive data appear … conclusive
- Extrapolating: … predicting future trends based on unsupported assumptions …
- Smoothing: discarding data points too far removed from expected … values
- Slanting: … selecting certain trends in the data, … discarding others which do not fit …
- Fudging: creating data points to augment incomplete data sets …
- Manufacturing: creating entire data sets de novo, … [1]
Data dredging is looking for too many possible associations in a dataset to see of any of them are statistically significant. Data dredging results in false positive results.
“When a large number of associations can be looked at in a dataset where only a few real associations exist, a P value of 0.05 is compatible with the large majority of findings still being false positives.” [2]
Origin: "Data Dredging" (Selvin & Stuart, 1966); "Data Fishing" (Grover & Mehra, 2008), “Data Snooping,” “P-hacking”
For whom is this important?
What are the best practices?
Related tools
By Jensen (2000) [1]
- New data and cross-validation
- Sidak, Bonferroni, and other adjustments
- Resampling and randomization techniques
By Glenn & Cormier (2015) [2]
- Performing own reviews of the sources of data,
- Checking for retractions and corrections,
- Requiring full disclosure of methods,
- Acquiring original data and reanalyzing it,
- Avoiding secondary sources,
- Avoiding unreplicated studies or studies that are not concordant with related studies, and
- Checking for funding or investigator biases.
Related cases
Convenience, dichotomization, stratification, regression to the mean, impact of sample size, competing risks, immortal time and survivor bias, management of missing values . [3] [4]
- ↑ Jensen, David. "Data Snooping, Dredging and Fishing: The Dark Side of Data Mining, A SIGKDD99 Panel Report." SIGKDD Explorations 1.2 (2000): 52-54.
- ↑ Suter, Glenn W., and Susan M. Cormier. "The problem of biased data and potential solutions for health and environmental assessments." Human and Ecological Risk Assessment: An International Journal 21.7 (2015): 1736-1752.
- ↑ armona-Bayonas A, Jimenez-Fonseca P, Fernandez-Somoano A, et al. Top ten errors of statistical analysis in observational studies for cancer research. Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico. 2018;20(8):954-965.
- ↑ Reanalysis: Ebrahim S, Sohani Z, Montoya L, et al. Reanalyses of randomized clinical trial data. JAMA 2014;312:1024-32
The Embassy Editorial team, The Embassy editorial team, Iris Lechner, Natalie Evans, Bjørn Hofmann contributed to this theme. Latest contribution was Feb 01, 2021
