How we evaluate guidelines

Learn about our process to evaluate guidelines using the AGREE II Instrument, the gold standard in guideline critical appraisal.

The Partnership rates records in the Cancer Guidelines Database using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument.

The AGREE II is used internationally by both guideline developers and users. It provides a framework to:

  • Assess the methodological rigour and transparency in which a guideline is developed
  • Provide a methodological strategy for the development of guidelines
  • Inform what information ought to be reported in guidelines and how

How does the AGREE II work?

The AGREE II consists of 23 items targeting various aspects of practice guideline quality across six quality domains:

  1. Scope and Purpose
  2. Stakeholder Involvement
  3. Rigour of Development
  4. Clarity and Presentation
  5. Applicability
  6. Editorial Independence

Higher domain scores (percentiles) reflect greater guideline reporting quality. The AGREE II does not generate a global aggregate score. Each domain score is available in the Cancer Guideline Database for all guidelines that met the inclusion criteria.

For a guideline to receive high scores, there must be a clear link between the proper collection and use of research evidence by an appropriate and representative guideline panel, that uses a transparent and replicable process to develop recommendations and implementation considerations made in the guideline. The higher the AGREE II scores, the more confident you can be that the guideline developers used an evidence-based approach to reach their recommendations.

What AGREE II criteria are used for the Cancer Guidelines Database?

We evaluate guidelines proposed for inclusion in the Cancer Guidelines Database using the eight items in the Rigour of Development domain of the AGREE II. Those scoring 60% or above will be assessed using the full AGREE II Instrument. Guidelines scoring between 50% and 60% will receive an additional appraisal to confirm that the 60% cut-off is appropriate and is not unfairly excluding guidelines of reasonable quality.

The 60% threshold is based on the following sources:

How can I use the AGREE II to develop guidelines?

Developing a guideline in accordance with the standards outlined in the AGREE II ensures that all the important aspects of guideline development have been performed and are explicitly reported.
If a guideline contains information from each domain, it should be helpful to end users. For more information please visit the AGREE Trust website.

How do you evaluate guidelines from organizations?

In addition to the guidelines that we search, filter and appraise, we evaluate guidelines developed by key Canadian and provincial cancer-focused organizations (identified by the Partnership) that satisfy the formal inclusion criteria. They undergo the Cancer Guideline Database’s full quality appraisal process, including evaluation using the AGREE II domain Rigour of Development, and full AGREE II appraisal if they meet the 60% Rigour of Development threshold.

In the records for these guidelines, we indicate:

  • AGREE II scores are available. These are guidelines that meet the inclusion criteria and have achieved the threshold of 60% (37 and above) for Rigour of Development.
  • AGREE II scores are not available.
    1. These guidelines either do not meet the threshold of 60% in the AGREE II rigour domain, or
    2. They are Canadian guidelines that do not meet the inclusion criteria.

View the database’s complete inclusion and evaluation criteria.