Which of the following characteristics of clinical practice guidelines is the best indicator that the recommendations are truly evidence-based?

1. National Health and Medical Research Council. (2009). [Hierarchy of Evidence]. Retrieved 2 July, 2014 from: https://www.nhmrc.gov.au/

2. Hoffman, T., Bennett, S., & Del Mar, C. (2013). Evidence-Based Practice: Across the Health Professions (2nd ed.). Chatswood, NSW: Elsevier.

3. Kendall, S. (2008). Evidence-based resources simplified. Canadian Family Physician, 54, 241-243

4. Davidson, M., & Iles, R. (2013). Evidence-based practice in therapeutic health care. In, Liamputtong, P. (ed.). Research Methods in Health: Foundations for Evidence-Based Practice (2nd ed.). South Melbourne: Oxford University Press.

5. Cook, D., Mulrow, C., & Haynes, R. (1997). Systematic reviews: synthesis of best evidence for clinical decisions. Annals of Internal Medicine, 126, 376–80.

1. Chinese proverbs quotes. [Accessed 4/12/09]. http://www.thinkexist.com/.

2. Rosenfeld RM, Shiffman RN. Clinical practice guidelines: a manual for developing evidence-based guidelines to facilitate performance measurement and quality improvement. Otolaryngol Head Neck Surg. 2006;135 Suppl:S1–S28. [PubMed] [Google Scholar]

3. Rosenfeld RM, Brown L, Cannon CR, et al. Acute otitis externa clinical practice guideline. Otolaryngol Head Neck Surg. 2006;134 Suppl:S4–S23. [PubMed] [Google Scholar]

4. Rosenfeld RM, Andes D, Bhattacharyya N, et al. Clinical practice guideline: adult sinusitis. Otolaryngol Head Neck Surg. 2007;137 Suppl:S1–S31. [PubMed] [Google Scholar]

5. Roland PS, Smith TL, Schwartz SR, et al. Clinical practice guideline: cerumen impaction. Otolaryngol Head Neck Surg. 2008;139 Suppl:S1–S21. [PubMed] [Google Scholar]

6. Bhattacharrya N, Baugh RF, Orvidas L, et al. Clinical practice guideline: benign paroxysmal positional vertigo. Otolaryngol Head Neck Surg. 2008;139 Suppl:S47–S81. [PubMed] [Google Scholar]

7. Schwartz SR, Cohen SM, Dailey SH. Clinical practice guideline: hoarseness. Otolaryngol Head Neck Surg. 2009 In press. [PubMed] [Google Scholar]

8. Eden J, Wheatley B, McNeil B, Sox H, editors. Institute of Medicine of the National Academies. Washington, DC: National Academies Press; 2008. Knowing What Works in Health Care. A Roadmap for the Nation. [Google Scholar]

9. Shiffman RN, Marcuse EK, Moyer VA, et al. Toward transparent clinical policies. Pediatrics. 2008;121:643–646. [PubMed] [Google Scholar]

10. Field MJ, Lohr KN, editors. Institute of Medicine. Washington, DC: National Academies Press; 1990. Clinical Practice Guidelines: Directions for a New Program. [PubMed] [Google Scholar]

11. Turner T, Misso M, Harris C, Green S. Development of evidence-based clinical practice guidelines CPGs): comparing approaches. Implement Sci. 2008;3(45):1–8. [PMC free article] [PubMed] [Google Scholar]

12. Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318:527–530. [PMC free article] [PubMed] [Google Scholar]

13. The AGREE Collaboration. Appraisal of Guidelines for Research & Evaluation AGREE) Instrument. [Accessed 4/14/09]. http://www.agreecollaboration.org/.

14. Shiffman RN, Shekelle P, Overhage M, et al. Standardized reporting of clinical practice guidelines: A proposal from the conference on guideline standardization. Ann Intern Med. 2003;139:493–498. [PubMed] [Google Scholar]

15. National Guideline Clearinghouse. Inclusion criteria. [Accessed 4/1/09]. http://www.ngc.gov/submit/inclusion.aspx.

16. AAP Steering Committee on Quality Improvement and Management. Policy statement: classifying recommendations for clinical practice guidelines. Pediatrics. 2004;114:874–877. [PubMed] [Google Scholar]

17. Shekelle PG, Woolf SH, Eccles M, Grimshaw J. Clinical guidelines: developing guidelines. BMJ. 1999;18:593–596. [PMC free article] [PubMed] [Google Scholar]

18. Guyatt G, Gutterman D, Baumann MH, et al. Grading strength of recommendations and quality of evidence in clinical guidelines. Report from an American College of Chest Physicians Task Force. Chest. 2006;129:174–181. [PubMed] [Google Scholar]

19. American Academy of Otolaryngology – Head and Neck Surgery. Quality improvement and patient safety information. [Accessed 4/14/09]. http://www.entnet.org/Practice/quality.cfm.

20. National Institute for Health and Clinical Excellence. The Guidelines Manual. London: National Institute for Health and Clinical Excellence; Apr, 2007. Available from: www.nice.org.uk. [Google Scholar]

21. Scottish Intercollegiate Guidelines Network. SIGN 50. A Guideline Developer’s Handbook. Edinburgh: Scottish Intercollegiate Guidelines Network; Jan, 2008. Available from: www.sign.ac.uk. [Google Scholar]

22. U.S. Cochrane Center. Consumers United for Evidence-based Healthcare (CUE) [Accessed 1/3/09]. http://apps1.jhsph.edu/cochrane/uscccc.htm.

23. Tricoci PT, Allen JM, Kramer JM, Califf RM, Smith SC., Jr Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA. 2009;310:831–841. [PubMed] [Google Scholar]

24. Moher D, Cook DJ, Eastwood S, et al. Improving the quality of reports of meta-analyses of randomized controlled trials: the QUOROM statement. Lancet. 1999;354:1896–1900. [PubMed] [Google Scholar]

25. Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. JAMA. 2000;283:2008–2012. [PubMed] [Google Scholar]

26. Rosenfeld RM, Singer M, Wasserman JM, Stinett SS. Systematic review of antimicrobial therapy for acute otitis externa. Otolaryngol Head Neck Surg. 2006;134 Suppl:S24–S48. [PubMed] [Google Scholar]

27. Rosenfeld RM, Singer M, Jones S. Systematic review of antimicrobial therapy in patients with acute rhinosinusitis [PubMed] [Google Scholar]

28. Montori VM, Wilczynski NL, Morgan, et al. Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005;330:68. [PMC free article] [PubMed] [Google Scholar]

29. Rosenfeld RM, Culpepper L, Doyle KJ, et al. Clinical practice guideline: otitis media with effusion. Otolaryngol Head Neck Surg. 2004;130:S95–S118. [PubMed] [Google Scholar]

30. Choudhry NK, Stelfox HT, Detsky AS. Relationships between authors of clinical practice guidelines and the pharmaceutical industry. JAMA. 2002;287:612–617. [PubMed] [Google Scholar]

31. Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions, version 5.0.1 (updated September 2008) The Cochrane Collaboration. 2008. section 6.4.11.1. Available from www.cochrane-handbook.org.

32. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Controll Clin Trials. 1996;17:1–12. [PubMed] [Google Scholar]

33. Jüni P, Altman DG, Egger M. Assessing the quality of controlled clinical trials. BMJ. 2001;323:42–46. [PMC free article] [PubMed] [Google Scholar]

34. Wharam JF, Sulmasy D. Improving the quality of health care: who is responsible for what? JAMA. 2009;301:215–217. [PubMed] [Google Scholar]

35. Hussain T, Michael G, Shiffman RN. The Yale Guideline Recommendation Corpus: a representative sample of the knowledge content of guidelines. Int J Med Informat. 2009;78:354–363. [PubMed] [Google Scholar]

36. Essaihi A, Michel G, Shiffman RN. Comprehensive categorization of guideline recommendations: creating an action palate for implementers. AMIA Symposium Proceedings. 2003:220–224. [PMC free article] [PubMed] [Google Scholar]

37. Codish S, Shiffman RN. A model of ambiguity and vagueness in clinical practice guideline recommendations. AMIA Symposium Proceedings. 2005:146–150. [PMC free article] [PubMed] [Google Scholar]

38. Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Making. 2007;7:16. [PMC free article] [PubMed] [Google Scholar]

39. U.S. Preventive Services Task Force. Evidence grade definitions. [Accessed 4/12/09]. at: www.ahrq.gov/clinic/upstf/grades.htm.

40. Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–926. [PMC free article] [PubMed] [Google Scholar]

41. Grading or Recommendations, Assessment, Development and Evaluation (GRADE) [Accessed 2/23/09]. www.gradeworkinggroup.org.

42. Lomotan E, Michel G, Lin Z, Shiffman RN. How “should” we write guideline recommendationa? Interpretation of deontic terminology in clinical practice guidelines: survey of the health services community. Qual Safety Healthcare. 2009 In press. [PMC free article] [PubMed] [Google Scholar]

43. Society for Medical Decision Making Committee on Standardization of Clinical Algorithms. Proposal for clinical algorithm standards. Med Dec Making. 1992;12:149–154. [PubMed] [Google Scholar]

44. Hadorn, David C. Use of algorithms in clinical guideline development in Clinical Practice Guideline Development: Methodology Perspectives. Rockville, MD: Agency for Health Care Policy and Research; Jan, 1995. pp. 93–104. AHCPR Pub. No. 95-0009. [Google Scholar]

45. Shiffman RN, Michel G, Essaihi A, Thornquist E. Bridging the guideline implementation gap: a systematic, document-centered approach to guideline implementation. J Am Med Inform Assoc. 2004;11:418–426. [PMC free article] [PubMed] [Google Scholar]

46. Shiffman RN, Dixon J, Brandt C, et al. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Informatics Decis Making. 2005. pp. 23–31. (available from: http://www.biomedcentral.com/1472-6947/5/23) [PMC free article] [PubMed]

47. Sniderman AD, Furberg CD. Why guideline-making requires reform. JAMA. 2009;301:429–431. [PubMed] [Google Scholar]

48. Shekelle P, Eccles MP, Grimshaw M, et al. When should clinical guidelines be updated? BMJ. 2001;323:155–157. [PMC free article] [PubMed] [Google Scholar]


Page 2

Timetable for guideline development

MonthActivityGoals
0PlanningDefine topic; identify leadership, partner organizations,
and working group members
0–1Stage 1 literature searchIdentify existing guidelines and systematic reviews
2Conference call #1Define purpose, timeline, and scope; discuss conflicts of
interest; plan stage 2 literature search
2–3Stage 2 literature searchIdentify randomized controlled trials
3Conference call #2Refine scope and definitions; generate a draft topic list of
opportunities for quality improvement
4In-person meeting #1Construct a “straw man” guideline of key actionstatements based on topic priorities; outline supporting

text for key statements; discuss writing assignments

4–5Stage 3 literature searchIdentifying best evidence to facilitate writing assignments
for specific action statements
4–5Writing assignmentsWrite the amplifying text for key action statements; chair
collates into guideline draft
6In-person meeting #2Refine the key, action statements; review amplifying text,
assign evidence profiles; grade recommendations
6–7Writing assignmentsRevise and polish the draft guideline
7Appraising draft guideline
implementability
Appraisal of draft guideline clarity, quality, and ability to
be successfully implemented
8Conference call #3Review guideline appraisal report; remedy deficiencies
9Pre-release peer reviewExternal review of draft guideline by representatives of
target audience and practice settings
10Organizational board reviewInternal review and approval of final guideline by the
board or directors of the sponsoring organization(s)
11–12PublicationFinal guideline submitted for publication