Skip to Main Content

Systematic & Evidence Synthesis Reviews: Data Extraction/Quality/Bias Tools

Basic information on types of "knowledge syntheses"/systematic reviews to help users plan the best review type, team, methods and have a clear sense of the expectations/responsibilities of performing these comprehensive literature review projects.

Data extraction tools

Rayyan free

Covidence: UF users may sign up for an account

DistillerSR by subscription only

SR Tool Box

Research Reporting Standards

Bias instruments and articles

Sources of bias in clinical trials: Cochrane Handbook Part II General methods for Cochrane reviews, Section 8 “Assessing Risk of bias in included studies”,  Introduction to sources of bias in clinical trials 

BMJ article about Cochrane Risk of Bias Tool and appendix to same

AHRQ ’12 Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions, Appendix A

GRADE pub bias article

ROBINS-I (Risk of Bias in Non-randomized studies of Interventions) tool

RoB2.0 tool 

Risk of bias tool list

Types of Bias

Quality assessment

Below are tools and articles about tools for assessing quality of research. We recommend you investigate what tools have been used in other reviews on your subject/in your discipline.

Jadad tool for assessing quality of clinical trials

Newcastle-Ottawa Scale assesses the quality of non-randomised studies in systematic reviews and meta-analyses

GRADE Grading of Recommendations Assessment, Development and Evaluation. Tool to assess quality (or certainty) of evidence and strength of recommendations. Considered the standard in guideline development

Mixed Methods Appraisal Tool (MMTS) appraises methodological quality of five categories to studies: qualitative research, randomized controlled trials, non-randomized studies, quantitative descriptive studies, and mixed methods studies

Critical Appraisal Skills Programme (CAPS) set of 8 critical appraisal tools for Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic Evaluations, Diagnostic Studies, Qualitative studies and Clinical Prediction Rule.

Effective Public Health Practice Project Quality Assessment Tool for Quantitative Studies (2009) assessment tool for quantittative studies. Looks at  selection bias, study design, confounders, blinding, data collection methods, withdrawals/dropouts, intervention integrity, and analyses.

Consensus on Health Economic Criteria (CHEC)  asssesses methodological quality of economic evaluations in systematic reviews

The Delphi list for randomized controlled trials (RCTs)


University of Florida Home Page

This page uses Google Analytics - (Google Privacy Policy)

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.