Reading and Keeping Up with the Medical Literature
Olakunle B. Akintemi
Kenneth B. Roberts
Many studies have documented a decline in the medical knowledge of physicians after residency and their failure to keep abreast of advances in diagnosis and therapy. Maintaining clinical competence and keeping up with advances in medicine are clearly uphill tasks. Currently, more than 25,000 biochemical journals are in print, with an estimated 6,000 new articles appearing every day and an archive of 6 million articles. To keep up with the medical literature, it is imperative to seek proper balance between browsing, “background” reading, and reading for individualized patient-care decision making (problem solving).
This balanced reading requires clinical information-management and evidence-based medicine (EBM) skills—skills that are important to lifelong, self-directed learning and continuous professional development.
EVIDENCE-BASED MEDICINE
EBM is defined as “the conscientious, explicit and judicious use of the current best evidence in making decisions about the care of individual patients.” Essentially, EBM is a method of making clinical decisions by integrating clinical expertise, patient’s preferences, circumstances and values, and judicious application of the best available research evidence.
The steps involved in EBM are: (a) formulating a focused and answerable clinical question; (b) identifying the “best evidence” (articles, studies) to answer the question; (c) appraising (reading and analyzing) the studies critically; and (d) integrating the evidence with clinical expertise, patient’s (parents’) values, preferences, and circumstances.
Background questions (why, what, when, how, who) ask about the general knowledge of a disease and can be answered using textbooks and classical review articles. An example of a background question is “What are the complications of gastroesophageal reflux disease?” Foreground questions, however, are answered using EBM skills. The four essential components of foreground questions have been given the acronym PICO: Patient and/or problem (P), the intervention (I), comparison intervention (if relevant) (C), and clinical outcomes (O). The outcomes should be “patient-oriented outcomes that matter” rather than “disease-oriented outcomes.” An example of a foreground question is “In a 6-month-old infant with gastro-esophageal reflux, do prokinetic agents reduce the frequency of vomiting?”
Clinical foreground questions fall into four categories: therapy (intervention), harm (etiology), diagnosis, and prognosis. A hierarchical classification of evidence according to its strength has been proposed: For example, the hierarchy of evidence regarding therapy questions ranges from unsystematic clinical observations at the bottom (weakest) to systematic reviews at the top (strongest).
The type of question, the topic, and the time available determine the selection of an evidence source. To answer general background clinical questions, a well-referenced and regularly updated textbook is recommended. However, for focused fore-ground therapy questions, prefiltered, evidence-based resources (e.g., Clinical Evidence, Cochrane Library) are preferred.
Until recently, EBM was a technical, time consuming, and labor intensive endeavor that few physicians had the interest, skills, and will to pursue. But today, with new technologies, many excellent EBM resources are available on the Internet, making EBM more accessible and “doable” in daily medical practice (Box 4.1).
READING CRITICALLY
Because the volume of material is large and time is limited, a method is necessary to identify which articles are worth screening and which among those screened are worth appaising critically. The two major types of studies reported in the medical literature are (a) primary or analytic and (b) secondary or integrative. Primary studies, which can be observational, experimental, or interventional, report original research. Box 4.2 depicts the classification of research designs in primary studies. Secondary (integrative) studies summarize or draw conclusions from the original research (systematic reviews, meta-analyses, clinical guidelines).
A number of formats, guides, questions, checklists, and resources are available for critically appraising the medical literature (Boxes 4.3, 4.4 and 4.5 and Table 4.1). One of the more user-friendly and popular is the Users’ Guides to the Medical Literature, developed by Haynes, Sackett, and Tugwell at McMaster University, Canada. These guides, initially published in The Journal of the American Medical Association, have been revised and compiled in a textbook. Other formats include the traditional pre-EBM journal club method and the “How to Read a Paper” series by Greenhalgh, initially published in The British Medical Journal and now compiled in a textbook. The Consolidated Standards of Reporting Trials (CONSORT) statement is a checklist for writing, reviewing, and evaluating reports of parallel-group randomized clinical trials. Recently, the Quality of Reports of Meta-analyses (QUOROM) statement was developed and published to improve the quality of the reporting of meta-analyses of randomized controlled trials.
The basic structure of a medical journal article is shown in Box 4.6. Critical appraisal, an essential component of EBM, is a method of assessing the validity, results, and relevance of a medical journal article. The following is offered as one approach to reading the medical literature, based on a series of questions.
Is This Article Worth Reading?
If the title is interesting and relevant, most readers then scan the abstract’s introduction and conclusion. The abstract states the purpose of the study, major methods and procedures, findings, and conclusions. Journals increasingly are using structured abstracts to provide information about objectives, study design,
methods, results, and conclusions in separate paragraphs. If the conclusion is intriguing, helpful, applicable, or provocative (e.g., contrary to expectation, experience, or knowledge), pause and think of reasons why the conclusion may be correct and why it may not.
methods, results, and conclusions in separate paragraphs. If the conclusion is intriguing, helpful, applicable, or provocative (e.g., contrary to expectation, experience, or knowledge), pause and think of reasons why the conclusion may be correct and why it may not.
BOX 4.1 Selected EBM Resources Available on the Internet
Journals
ACP journal club http://www.acpjc.org
Evidence-based medicine http://www.ebm.bmjjournals.com.easyaccess1.lib.cuhk.edu.hk
Bandolier http://www.jr2.ox.ac.uk/bandolier
Evidence-based Practice http://www.ebponline.net
Evidence Summaries
Clinical Evidence http://www.clinicalevidence.com.easyaccess1.lib.cuhk.edu.hk
The Cochrane Database of Systematic Reviews http://www.cochrane.org/cochrane/revabstr/mainindex.htm
DynaMed http://www.dynamicmedical.com
FirstConsult http://www.firstconsult.com
InfoRetriever http://www.infopoems.com
SUMSearch http://www.sumsearch.uthscsa.edu/
TRIP Database (Turning Research Into Practice) http://www.tripdatabase.com
The York Database of Abstracts of Reviews of Effects (DARE) http://www.york.ac.uk/inst/crd/darehp.htm
EBM Guidelines. Evidence-based Medicine. http://www.ebm-guidelines.com
Clinical Guidelines
Institute for Clinical Systems Improvement (ICSI) http://www.icsi.org/knowledge
National Guideline Clearinghouse http://www.guidelines.gov
US Preventive Services Task Force (USPSTF) Recommendations http://www.ahrq.gov/clinic/uspstfix.htm
Other Useful Sites
Netting the Evidence http://www.shef.ac.uk/∼scharr/ir/netting
Centre for Evidence-Based Medicine http://www.cebm.utoronto.ca
Centre for Evidence-Based Medicine (Oxford) http://www.cebm.net
Peer-review is a cursory screen for quality, but not a guarantee. Examples of flawed studies in well-respected journals abound, but the chances are greater that a higher-quality journal will contain higher quality articles.
Review the list of authors. Do they have a proven track record? Do they seem appropriate to do the study? Finally, do the authors or funding source have a vested interest in the outcome of the study? In most journal articles, authors are required to state sources of funding.
What Is the Purpose of This Article?
If the title and abstract suggest a relevant, interesting study worth reading, the next task is to determine the why the study was done; what hypothesis the authors were testing; what is
already known and what new information the study provides; what type of study (primary or secondary) was conducted; what broad field of research the study covers, and whether the study design and methods were appropriate. The purpose of the article (study) can be found by reading the introduction, methods, and the first paragraph of the discussion. Each of the five major clinical categories of research in primary studies (therapy, diagnosis, screening, prognosis, and causation/etiology) has a particular study design.
already known and what new information the study provides; what type of study (primary or secondary) was conducted; what broad field of research the study covers, and whether the study design and methods were appropriate. The purpose of the article (study) can be found by reading the introduction, methods, and the first paragraph of the discussion. Each of the five major clinical categories of research in primary studies (therapy, diagnosis, screening, prognosis, and causation/etiology) has a particular study design.
BOX 4.2 Study Designs of Primary Studies
Observational
Descriptive
Case reports
Case series
Cross-sectional studies
Longitudinal studies
Analytic
Prospective cohort
Retrospective cohort
Nested case-control
Multiple cohort
Case-control
Experimental
Randomized control trial
Factorial design
Randomization of matched pairs
Group or cluster randomization
Nonrandomized between groups design
Within-group designs
Cross-over designs
BOX 4.3 Resources for Critical Appraisal of Journal Articles
Books
Guyatt G, Rennie D. Users’ guides to the medical literature. Chicago: AMA Press, 2002.
Greenhalgh T. How to read a paper, London: BMJ Books, 2001.
Gehlbach SH. Interpreting the medical literature, New York: McGraw-Hill Publishing, 2002.
Dawson B, Trapp RG. Basic and clinical biostatistics, New York: Lange Medical Books, 2004.
Sackett DL, Strauss SE, Richardson WS, et al. Evidence-based medicine. Edinburgh: Churchill Livingstone, 2000.
Badenoll D, Henegan C. Evidence-based medicine toolkit. London: BMJ Books, 2002.
Journals
Journal of the American Medical Association (JAMA) series, 1993–2000: “User’s Guides to the Medical Literature.”
British Medical Journal (Br Med J) series, 1997: “How to Read a Paper.”
Web sites
Centers for Health Evidence http://www.cche.net
Introduction to Evidence-based Medicine http://www.hsl.unc.edu/lm/ebm/index.htm
Critical Appraisal and Using the Literature http://www.shef.ac.uk/sharr/ir/units/critapp/index/htm
Bandolier–Critical Assessment Skills Program (CASP) http://www.jr2.ox.ac.uk/Bandolier
BOX 4.4 Traditional Pre-EBM Journal Club Framework for Evaluating Journal Articles
Title
Is the title succinct and descriptive of the article content?
Is it clinically relevant to your practice?
Authors
What are the authors’ academic background?
Are they experts in the subject area?
Are they based at well-established academic centers?
Abstract
Is the topic of the study important and worth knowing about?
What is the aim of the study?
What is the main outcome of the study?
Is the population of patients relevant to your practice?
If results are “statistically significant,” are they also clinically meaningful?
Introduction
What research has already been done on this topic, and what outcomes were reported?
Methods
1. Is the appropriate study design used?
2. Does the study cover an adequate period of time? Is the follow-up period long enough?
3. Are the criteria for inclusion and exclusion of subjects clear?
4. Were subjects randomly assigned? Was the randomization method described?
5. What were the outcome measures?
6. Are statistical methods outlined Are they appropriate
7(a). In a clinical trial:
How were subjects recruited?
Are the patients in the study similar to mine?
Are all the patients who entered the study properly accounted for at its conclusion?
Were patients analyzed in the group to which they wereinitially randomized (intention to treat analysis)?
Is the study “blind”? Was everyone involved in thestudy (participants and investigators) “blind” to thetreatment (double blind)?Stay updated, free articles. Join our Telegram channel
Full access? Get Clinical Tree