In search of controlled evidence for health care quality improvement
- PMID: 9172067
- DOI: 10.1023/a:1022887224126
In search of controlled evidence for health care quality improvement
Abstract
The purpose of this study was to measure the efficiency of simple searches in retrieving controlled evidence about specific primary health care quality improvement interventions and their effects. Searches were conducted to retrieve evidence on seven interventions and seven effect variables. Specific words and the closest Medical Subject Headings (MeSH) recommended by professional librarians were used to search the MEDLINE database. Searches were restricted to the MeSH publication type "randomized controlled trial." Two reviewers independently judged retrieved citations for relevancy to the selected interventions and effects. In selecting MeSH terms, the average agreement among librarians was 64.3% (+/-26.1) for interventions and 57.1% (+/-19.9) for effects. Analysis of the 755 retrieved reports showed that MeSH term searches had an overall recall rate of 58% while the same rate for textword searches was significantly lower (11%, p < .001). The difference in overall precision rates was nonsignificant (26% versus 33%, p = .15). In the group of MeSH searches, overall precision and recall was significantly lower for effects than for interventions (12% versus 52%, p < .001 and 41% versus 69%, p < .001). Two textwords appeared in more than 25% of the benchmark collection: reminder (25.7%) and cost (25.0%). The results of this study indicate that information needs for health care quality improvement cannot be met by simple literature searches. Certain MeSH terms and combinations of textwords yield moderately efficient recall and precision in literature searches for health care quality improvement. Clinicians and physician executives gaining direct access to bibliographic database could probably be better served by structured indexing of critical aspects of randomized controlled clinical trials: design, sample, interventions, and effects.
Similar articles
-
OvidSP Medline-to-PubMed search filter translation: a methodology for extending search filter range to include PubMed's unique content.BMC Med Res Methodol. 2013 Jul 2;13:86. doi: 10.1186/1471-2288-13-86. BMC Med Res Methodol. 2013. PMID: 23819658 Free PMC article.
-
Comparison of Medical Subject Headings and text-word searches in MEDLINE to retrieve studies on sleep in healthy individuals.J Med Libr Assoc. 2004 Jul;92(3):349-53. J Med Libr Assoc. 2004. PMID: 15243641 Free PMC article.
-
The effect of abbreviations on MEDLINE searching.Acad Emerg Med. 1999 Apr;6(4):292-6. doi: 10.1111/j.1553-2712.1999.tb00392.x. Acad Emerg Med. 1999. PMID: 10230980
-
Developing efficient search strategies to identify reports of adverse effects in MEDLINE and EMBASE.Health Info Libr J. 2006 Mar;23(1):3-12. doi: 10.1111/j.1471-1842.2006.00634.x. Health Info Libr J. 2006. PMID: 16466494 Review.
-
Spinal palpation: The challenges of information retrieval using available databases.J Manipulative Physiol Ther. 2003 Jul-Aug;26(6):374-82. doi: 10.1016/S0161-4754(03)00076-9. J Manipulative Physiol Ther. 2003. PMID: 12902966 Review.
Cited by
-
Developing optimal search strategies for detecting clinically sound causation studies in MEDLINE.AMIA Annu Symp Proc. 2003;2003:719-23. AMIA Annu Symp Proc. 2003. PMID: 14728267 Free PMC article.
-
Robustness of empirical search strategies for clinical content in MEDLINE.Proc AMIA Symp. 2002:904-8. Proc AMIA Symp. 2002. PMID: 12463956 Free PMC article.
-
Search filter precision can be improved by NOTing out irrelevant content.AMIA Annu Symp Proc. 2011;2011:1506-13. Epub 2011 Oct 22. AMIA Annu Symp Proc. 2011. PMID: 22195215 Free PMC article.
-
Developing optimal search strategies for detecting clinically sound prognostic studies in MEDLINE: an analytic survey.BMC Med. 2004 Jun 9;2:23. doi: 10.1186/1741-7015-2-23. BMC Med. 2004. PMID: 15189561 Free PMC article.
-
Identifying quality improvement intervention publications--a comparison of electronic search strategies.Implement Sci. 2011 Aug 1;6:85. doi: 10.1186/1748-5908-6-85. Implement Sci. 2011. PMID: 21806808 Free PMC article.
References
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Miscellaneous