Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Aug 22:8:94.
doi: 10.1186/1748-5908-8-94.

Strategies to assess the validity of recommendations: a study protocol

Laura Martínez García  1 , Andrea Juliana Sanabria, Ignacio Araya, Jennifer Lawson, R Brian Haynes, David Rigau, Ivan Solà, Petra Díaz Del Campo, Maria Dolors Estrada, Itziar Etxeandia-Ikobaltzeta, Elvira García Álvarez, Javier Gracia, Anna Kotzeva, Arturo Louro-González, Flavia Salcedo-Fernandez, Maria Mar Trujillo-Martín, Pablo Alonso-Coello
Affiliations

Strategies to assess the validity of recommendations: a study protocol

Laura Martínez García et al. Implement Sci. .

Abstract

Background: Clinical practice guidelines (CPGs) become quickly outdated and require a periodic reassessment of evidence research to maintain their validity. However, there is little research about this topic. Our project will provide evidence for some of the most pressing questions in this field: 1) what is the average time for recommendations to become out of date?; 2) what is the comparative performance of two restricted search strategies to evaluate the need to update recommendations?; and 3) what is the feasibility of a more regular monitoring and updating strategy compared to usual practice?. In this protocol we will focus on questions one and two.

Methods: The CPG Development Programme of the Spanish Ministry of Health developed 14 CPGs between 2008 and 2009. We will stratify guidelines by topic and by publication year, and include one CPG by strata.We will develop a strategy to assess the validity of CPG recommendations, which includes a baseline survey of clinical experts, an update of the original exhaustive literature searches, the identification of key references (reference that trigger a potential recommendation update), and the assessment of the potential changes in each recommendation.We will run two alternative search strategies to efficiently identify important new evidence: 1) PLUS search based in McMaster Premium LiteratUre Service (PLUS) database; and 2) a Restrictive Search (ReSe) based on the least number of MeSH terms and free text words needed to locate all the references of each original recommendation.We will perform a survival analysis of recommendations using the Kaplan-Meier method and we will use the log-rank test to analyse differences between survival curves according to the topic, the purpose, the strength of recommendations and the turnover. We will retrieve key references from the exhaustive search and evaluate their presence in the PLUS and ReSe search results.

Discussion: Our project, using a highly structured and transparent methodology, will provide guidance of when recommendations are likely to be at risk of being out of date. We will also assess two novel restrictive search strategies which could reduce the workload without compromising rigour when CPGs developers check for the need of updating.

PubMed Disclaimer

Similar articles

  • Efficiency of pragmatic search strategies to update clinical guidelines recommendations.
    Martínez García L, Sanabria AJ, Araya I, Lawson J, Solà I, Vernooij RW, López D, García Álvarez E, Trujillo-Martín MM, Etxeandia-Ikobaltzeta I, Kotzeva A, Rigau D, Louro-González A, Barajas-Nava L, Díaz del Campo P, Estrada MD, Gracia J, Salcedo-Fernandez F, Haynes RB, Alonso-Coello P; Updating Guidelines Working Group. Martínez García L, et al. BMC Med Res Methodol. 2015 Jul 31;15:57. doi: 10.1186/s12874-015-0058-2. BMC Med Res Methodol. 2015. PMID: 26227021 Free PMC article.
  • The validity of recommendations from clinical guidelines: a survival analysis.
    Martínez García L, Sanabria AJ, García Alvarez E, Trujillo-Martín MM, Etxeandia-Ikobaltzeta I, Kotzeva A, Rigau D, Louro-González A, Barajas-Nava L, Díaz Del Campo P, Estrada MD, Solà I, Gracia J, Salcedo-Fernandez F, Lawson J, Haynes RB, Alonso-Coello P; Updating Guidelines Working Group. Martínez García L, et al. CMAJ. 2014 Nov 4;186(16):1211-9. doi: 10.1503/cmaj.140547. Epub 2014 Sep 8. CMAJ. 2014. PMID: 25200758 Free PMC article.
  • Strategies for monitoring and updating clinical practice guidelines: a systematic review.
    Martínez García L, Arévalo-Rodríguez I, Solà I, Haynes RB, Vandvik PO, Alonso-Coello P; Updating Guidelines Working Group. Martínez García L, et al. Implement Sci. 2012 Nov 19;7:109. doi: 10.1186/1748-5908-7-109. Implement Sci. 2012. PMID: 23164220 Free PMC article. Review.
  • The future of Cochrane Neonatal.
    Soll RF, Ovelman C, McGuire W. Soll RF, et al. Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
  • Updating Systematic Reviews.
    Shojania KG, Sampson M, Ansari MT, Ji J, Garritty C, Rader T, Moher D. Shojania KG, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2007 Sep. Report No.: 07-0087. Rockville (MD): Agency for Healthcare Research and Quality (US); 2007 Sep. Report No.: 07-0087. PMID: 20734512 Free Books & Documents. Review.
See all similar articles

Cited by

  • Efficiency of pragmatic search strategies to update clinical guidelines recommendations.
    Martínez García L, Sanabria AJ, Araya I, Lawson J, Solà I, Vernooij RW, López D, García Álvarez E, Trujillo-Martín MM, Etxeandia-Ikobaltzeta I, Kotzeva A, Rigau D, Louro-González A, Barajas-Nava L, Díaz del Campo P, Estrada MD, Gracia J, Salcedo-Fernandez F, Haynes RB, Alonso-Coello P; Updating Guidelines Working Group. Martínez García L, et al. BMC Med Res Methodol. 2015 Jul 31;15:57. doi: 10.1186/s12874-015-0058-2. BMC Med Res Methodol. 2015. PMID: 26227021 Free PMC article.
  • Updated recommendations: an assessment of NICE clinical guidelines.
    Martínez García L, McFarlane E, Barnes S, Sanabria AJ, Alonso-Coello P, Alderson P. Martínez García L, et al. Implement Sci. 2014 Jun 11;9:72. doi: 10.1186/1748-5908-9-72. Implement Sci. 2014. PMID: 24919856 Free PMC article.
  • The validity of recommendations from clinical guidelines: a survival analysis.
    Martínez García L, Sanabria AJ, García Alvarez E, Trujillo-Martín MM, Etxeandia-Ikobaltzeta I, Kotzeva A, Rigau D, Louro-González A, Barajas-Nava L, Díaz Del Campo P, Estrada MD, Solà I, Gracia J, Salcedo-Fernandez F, Lawson J, Haynes RB, Alonso-Coello P; Updating Guidelines Working Group. Martínez García L, et al. CMAJ. 2014 Nov 4;186(16):1211-9. doi: 10.1503/cmaj.140547. Epub 2014 Sep 8. CMAJ. 2014. PMID: 25200758 Free PMC article.

References

    1. IOM (Institute of Medicine) Clinical Practice Guideline We Can Trust. Washington, DC: The National Academies Press; 2011.
    1. Scottish Intercollegiate Guidelines Network. Guidelines by topic [Web] Edinburgh: Scottish Intercollegiate Guidelines Network - Healthcare Improvement Scotland; 2001. [last modified 15/04/13; access 22/04/13]. http://www.sign.ac.uk/guidelines/published/index.html.
    1. Alonso-Coello P, Martínez García L, Carrasco JM, Solà I, Qureshi S, Burgers JS. Updating Guidelines Working Group. The updating of clinical practice guidelines: insights from an international survey. Implement Sci. 2011;6:107. doi: 10.1186/1748-5908-6-107. - DOI - PMC - PubMed
    1. Ansari S, Rashidian A. Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One. 2012;7(11):e49864. doi: 10.1371/journal.pone.0049864. - DOI - PMC - PubMed
    1. Vernooij R, Sanabria AJ, Solà I, Alonso-Coello P, Martínez García L. The updating process guidance in clinical practice guidelines handbooks: a systematic review. G-I-N Conference: 10th G-I-N Conference. San Francisco, USA; 2013. http://www.gin2013.net/ [accepted]

Publication types

LinkOut - more resources