Critical appraisal

Critical appraisal in evidence synthesis is the systematic evaluation of the methodological quality and external validity in each included study, focusing more on the methods used rather than just the results.

This process helps determine the reliability and validity of the evidence by identifying potential flaws or biases in study design, conduct, or reporting.

Critical appraisal is essential for establishing the trustworthiness of the evidence and informing the synthesis and interpretation of results.

Level descriptors

Expand all

Understands that study design can affect the results of primary studies, presenting a risk of bias, and these risks of bias can be assessed using an appropriate tool.

Recognizes potential sources of bias in research studies.

Aware of and applies one or more standardized critical appraisal tools to appraise research quality with supervision/guidance.

Aware of and can apply multiple critical appraisal tools to appraise research quality with a greater level of independence.

Evaluates the outputs of teams’ critical appraisals.

Drafts summaries of the critical appraisal for the final report.

Designs and/or delivers training programmes on critical appraisal within evidence synthesis.

Evaluates and promotes critical appraisal methods and provide input across your organization.

Leads and promotes the development of critical appraisal methods on a national and international basis.

Download entire framework

Critical appraisal

Level descriptors

Level 1 - Follow

Level 2 - Assist

Level 3 - Apply

Level 4 - Enable

Level 5 - Ensure, advise

Level 6 - Initiate, influence

Level 7 - Set strategy, inspire, mobilize

Feedback