|
|
||||||||
1 The Center for Family Medicine Science, Department of Family and Community Medicine, University of Missouri-Columbia, Columbia, Mo
2 AAFP National Research Network, American Academy of Family Physicians, Leawood, Kan
CORRESPONDING AUTHOR: Daniel C. Vinson, MD, MSPH, The Center for Family Medicine Science, Department of Family and Community, Medicine, M231 Health Sciences, University of Missouri-Columbia, Columbia, MO 65212, VinsonD{at}health.missouri.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS The study was a crossover, cluster-randomized clinical trial with 31 clinicians in Missouri and 13 in the American Academy of Family Physicians (AAFP) National Network for Family Practice and Primary Care Research; 2,800 patients provided data. The clinician was the unit of randomization. Clinicians decided whether to screen each patient; if they chose to screen, they used the screening approach assigned for that block of patients. The clinician and patient separately completed questionnaires immediately after the office visit to assess each ones comfort with screening (and any ensuing discussion) and the patients engagement in change.
RESULTS Missouri clinicians screened more patients when assigned the single question (81%) than the CAGE (69%, P = .001 in weighted analysis). There was no difference among AAFP network clinicians (96% of patients screened with the CAGE, 97% with the single question). Eighty percent to 90% of clinicians and 70% of patients reported being comfortable with screening and the ensuing discussion, with no difference between approaches in either network. About one third of patients who were identified as problem drinkers reported thinking about or planning to change their drinking behavior, with no difference in engagement between screening approaches.
CONCLUSIONS Clinicians and patients reported similar comfort with the CAGE questions and the single-question screening tools for problem drinking, and the 2 instruments were equal in their ability to engage the patient. In Missouri, the single question was more likely to be used.
Key Words: Drinking behavior alcohol drinking alcohol-induced disorders/diagnosis mass screening patient acceptance of health care
| INTRODUCTION |
|---|
|
|
|---|
Alcohol problemsdefined in this report as hazardous drinking7 and/or current alcohol abuse or dependence2meet the criteria for a condition for which routine screening is appropriate.8 Many screening tests are available,9 including the CAGE questions10 and a recently validated single question (Table 1
),11 which are similar in sensitivity and specificity.
|
Comfort for the clinician is a legitimate issue, but when the screening test addresses a health-related behavior, a more important issue is the ability of the test to engage the patient in moving toward change. The questions used in screening can set the tone of the ensuing conversation, which might make change by the patient more (or less) likely. In support of this argument, several studies have shown that the clinicians approach affects the patients likelihood of behavioral change. For example, a patient-centered approach in primary medical care settings was associated with greater changes in self-care (and improved clinical outcomes) in chronic disease,17 and a nonconfrontational approach to counseling problem drinkers in a psychology clinic led to greater reductions in consumption.18 We are aware of no studies, however, comparing different alcohol-screening instruments on their ability to engage the patient in the processes of change.
If asked first, questions about the quantity of drinking made patients in one study less likely to answer the CAGE questions affirmatively.19 This study did not directly address the question of the patients engagement in change, for a patient who denied the CAGE items might still be prompted to move toward change. The study, however, does raise concerns that the single question, with its focus on quantity, might be less effective in engaging problem drinkers. On the other hand, another study found that reversing the order of questions about the pattern of drinking and the CAGE questions had no effect on overall answers to either set.20
Previous research in screening for alcohol problems has focused almost exclusively on the relative sensitivity and specificity of different screening instruments. Sensitivity and specificity are clearly important, but if a less sensitive instrument is more acceptable to clinicians and therefore used with more patients, a greater proportion of problem drinkers could be identified. The features of a screening instrument that might affect its acceptability to clinicians include its ease of use, brevity, comfort for the clinician, and comfort for patients. Patient comfort may affect clinician acceptance, because a screening tool that is uncomfortable for patients might provoke resistance on their part, leading clinicians to be less inclined to use it again. Importantly, screening approaches might differ in how effectively they engage problem drinkers in moving toward change. A more engaging instrument, even if less sensitive or specific, might help a greater proportion of problem drinkers change their behavior than a more sensitive and specific, but less engaging, instrument. We designed the current study to address these issues.
| METHODS |
|---|
|
|
|---|
Family physicians, physician assistants, and nurse-practitioners were recruited from Missouri practices; 31 participated. Most worked at University of Missouri-Columbia clinics, including Student Health, or at university-affiliated rural practices. Two other residency programs in Missouri participated, Cox in Springfield and Baptist Lutheran in Kansas City. Eight invited physicians declined to participate. Of 174 clinicians in the American Academy of Family Physicians (AAFP) National Network for Family Practice and Primary Care Research, 13 participated. Clinicians who participated had been in their current practice longer (13.5 years) than clinicians who did not (8.2 years, P = .01), but there were no other significant differences in demographic or practice characteristics.
A response to the single-question screening tool (Table 1
) was considered to be positive if the patient answered with any time in the last 3 months. A response to the CAGE was considered to be positive if 1 or more answers were affirmative, choosing a threshold that would maximize sensitivity.10 The 4 CAGE questions can be focused on the past year or a lifetime reference can be assumed,21 which was its original design.22 In the Missouri network, we used a lifetime frame of reference (herein labeled "ever" positive). In the AAFP national network, clinicians asked patients who had a positive CAGE response, "Has this occurred during the past year?" allowing us to examine separately those patients who had a positive response in the past year on the CAGE questionnaire from those who were ever had a positive response.
Each clinician was randomized to use one screening approach (CAGE or single question), then the other. In Missouri each approach was used for 2 days. In the AAFP network, each was used for 30 consecutive patient encounters. Patients 18 years old and older who gave oral informed consent were eligible to participate. Patients were excluded if they were severely ill, cognitively impaired, or were unable to read English. The patient questionnaire was available in Spanish if requested by the clinician, but none did. Patient literacy was not tested.
During each encounter with a participating patient, clinicians provided whatever care they would ordinarily have provided. In addition, they decided whether to screen for problem drinking. The mere presence of the data forms encouraged them to screen, but they were asked to use their clinical judgment when deciding whether to screen. If screening was conducted, the clinician used the assigned approach and recorded the patients answers on the clinician questionnaire, an 8.5 x 3.7-in card. Immediately after the visit, the clinician answered an additional 6 questions on the card, including the length of the alcohol discussion, the clinicians comfort and patients openness during the discussion, and what the clinician did if the response to the screening test was positive.
The patient completed a separate questionnaire immediately after the encounter regardless of whether screening occurred and whether alcohol was mentioned. The patient questionnaire asked about the patients comfort with screening and any ensuing alcohol-related discussion, their estimate of how long that discussion (if any) lasted, their plans (if any) for changing their drinking, and the 10-item Alcohol Use Disorders Identification Test (AUDIT),23 a screening instrument we used in this study as a self-reported criterion standard to identify hazardous or harmful drinking. AUDIT scores range from 0 to 40. The standard threshold for identifying problem drinking is a score of 8 or greater,23 though thresholds as low as 5 have been used.24 Clinicians did not see patients questionnaire answers, nor did they know the patients AUDIT scores.
Patients were clustered by clinician. If we assumed that patients had been selected by simple random sampling, the variance could be substantially underestimated.25 To account for that clustering, we used the hierarchical modeling commands in Stata, using the clinician as the primary sampling unit.26 Because the frequency of screening was not normally distributed across clinicians, we used nonparametric analyses, including Spearman
correlation coefficients and the Mann-Whitney U test to compare continuous variables across groups.
Study approval was obtained from the institutional review boards of the University of Missouri Health Science Center and other participating centers. Clinicians not affiliated with an institutional review board were approved through the University of Missouri as unaffiliated investigators. All patient data were anonymous; the clinician and patient questionnaires from a given office visit were linked by a study identification number and not by patient name.
| RESULTS |
|---|
|
|
|---|
|
Patient and Clinician Comfort
Patients and clinicians rated the comfort of the 2 screening approaches and ensuing discussions similarly in both networks (Table 3
). On an ordinal scale in which 1 is "very uncomfortable" and 5 is "very comfortable," patients in both networks rated their comfort as 4.2 with either screening approach. The 95% confidence intervals (CIs) were the same for both approaches in a given network, 4.14.4 in the AAFP network, 4.14.3 in Missouri, with adjustment for clustering by clinician.
|
0.18, P <.001). Patients with a positive AUDIT score averaged 4.0 on a 5-point scale in both networks with either screening approach.
Clinicians assessments of their own comfort and their patients openness to discussing alcohol were also inversely correlated with the patients AUDIT score (P
.02). The correlation coefficients, however, were small, with values of Spearman
of 0.09 to 0.11 for both comparisons in each network.
Duration of Alcohol-Related Discussions
As reported by the clinicians, the duration of the alcohol-related conversations (screening, if done, plus ensuing discussion, if any) was similar with the 2 approaches. In both networks, the conversations were shorter with the single question than with the CAGE questions, but the difference was small and not statistically significant when clustering by clinician was taken into account. On an ordinal 5-point scale (less than 30 seconds, 30 to 60 seconds, 1 to 2 minutes, 2 to 4 minutes, longer than 4 minutes), the mean among AAFP clinicians (adjusted for clustering) was 1.5 minutes with the CAGE (95% CI, 1.31.7 minutes) and 1.4 minutes with the single question (95% CI, 1.21.6 minutes). In Missouri, the mean rating of duration for the CAGE was 1.7 minutes (95% CI, 1.61.9 minutes); for the single question it was 1.7 minutes (95% CI, 1.51.9 minutes). The proportion of alcohol-related discussions that lasted less than 60 seconds was similar within each network: 94% with the CAGE and 93% with the single question in the AAFP network; and 83% and 82%, respectively, in Missouri.
Clinicians spent more time talking about alcohol with patients who had a positive response to the screening test than those who had a negative response, but most alcohol-related discussions were still short. Clinicians reported that the discussion was less than 1 minute with 67% of patients who had a positive screening test response in the AAFP network and with 57% of such patients in Missouri, with no significant difference between screening approaches in either network.
As reported by patients, the duration of the alcohol-related conversations was slightly longer with the CAGE than with the single question, 1.7 vs 1.6 minutes, using the same ordinal scale that clinicians used, in both networks. This difference was significant in the Missouri network, adjusted for clustering.
Prevalence of a Positive Screening Test Response
Of patients screened with the CAGE in the AAFP network, 8% had a positive response using the past-year time frame and 16% had a positive response using a lifetime frame; of those screened with the single question, 14% had a positive response. In Missouri, 22% of the patients had a positive response with either approach, using a lifetime frame of reference for the CAGE.
Using an AUDIT score of 5 or greater to identify patients who might have alcohol problems, the prevalence was 12% in the AAFP network and 17% in Missouri. The 2 screening approaches had similar sensitivity and specificity in both networks. In the AAFP network, the sensitivity and specificity were 70% and 90%, respectively, for the lifetime CAGE, 42% and 98%, respectively, for the past-year CAGE, and 63% and 94%, respectively, for the single question. In Missouri, the sensitivity and specificity were 60% and 88%, respectively, for the lifetime CAGE, and 76% and 91%, respectively, for the single question.
Clinician Intervention and Patients Engagement in Change
Clinicians reported "doing something (anything) about the patients drinking problem" with 20% of those who had a positive CAGE response and with 27% who had a positive single question response in Missouri, and with 24% and 38%, respectively, in the AAFP network. Combining the 2 networks, clinicians addressed the issue with 21% of patients with an AUDIT of 5 or greater and 30% of those with an AUDIT of 8 or greater.
On the patient questionnaire, completed after the encounter, patients were asked to "Circle the [answer] that best describes what you will do in the next month with regard to alcohol use." Among patients with an AUDIT score of 5 or greater, about one third reported planning to "think about my drinking pattern," cut down, or quit drinking (Table 4
). There was no significant difference between screening approaches in this response in either network.
|
| DISCUSSION |
|---|
|
|
|---|
Neither screening approach was superior to the other in self-reported patient or clinician comfort. Most patients, including most of those with possible alcohol problems (judging by a positive AUDIT finding), were comfortable with either approach. Furthermore, clinicians did not sense any difference between approaches in how open patients were to discussing alcohol.
More than 80% of the alcohol-related discussions lasted less than 1 minute. Although less time was spent when the single question rather than the CAGE screening tool was used, the difference was neither clinically nor statistically significant. Compared with patients without alcohol problems, clinicians spent more time discussing alcohol with problem drinkers, but again the difference was small. Even with problem drinkers, most alcohol-related discussions lasted less than 1 minute.
The 2 screening approaches were equally engaging for problem drinkers. With either approach, about one half of the patients with an AUDIT score of 5 or greater did not see their drinking as a problem, but one third of them were contemplating or planning change. We have only self-reported plans, not self-reported drinking outcomes, and it is unlikely that all those who reported such plans followed through with them. Some patients who were not screened reported plans for change. We therefore cannot conclude that either screening approach moved patients toward change, but only that the 2 approaches are similar in this regard. That a substantial minority is considering change, however, may help alleviate the concern about imposing an alcohol discussion when its not on the patients agenda.16
Determining the sensitivity and specificity of the 2 screening approaches was not a primary aim of the study, and the criterion standard we used in our analyses was another screening instrument (the AUDIT). We chose the AUDIT because of its suitability for quick, anonymous self-reporting. Its sensitivity and specificity may be higher than those of other screening instruments.24 In comparison with the AUDIT, the performance of the CAGE and the single question was similar in our study. When focused on just the past year, the sensitivity of the CAGE questions was less than when the frame of reference was lifetime (42% vs 70%), and the specificity was higher (98% vs 90%). Bradley and her colleagues found a similar pattern, with sensitivities of 57% and 77% and specificities of 82% and 59% with past-year and lifetime frames of reference, respectively.21
Although the number of encounters was large (2,800), clinicians (N = 44) were the unit of randomization. Cluster-randomized trials have less statistical power than the number of individual patients involved suggests.25 The differences between screening approaches were small, however, and the 95% confidence intervals generally excluded a clinically meaningful difference.
Clinicians intervened in some way with fewer than 30% of the identified problem drinkers. We did not define what constituted an appropriate intervention, and some clinicians may have helped some patients move toward change without realizing they were providing an intervention. Had clinicians provided a longer intervention, however, patients self-reported engagement in thinking about or planning to change their alcohol use might have differed more between the 2 screening approaches. Longer interventions would not necessarily have helped more patients move toward change, but with longer interventions, one screening approach might have been associated with greater self-reported interest in change by patients.
Participating clinicians volunteered for the study. They may have had special interest in alcohol issues or health behavior more broadly. The results, therefore, might not apply to all clinicians or practice settings. Even so, the results do suggest that both screening approaches are equally comfortable and engaging from the patients perspective, leaving the choice of screening approach open to the clinician. Furthermore, a substantial minority of problem drinkers reported planning to think about or change their drinking behavior, suggesting that routine screening in primary care practice may be beneficial.
| ACKNOWLEDGMENTS |
|---|
Study participants. Missouri: Jeffrey Belden, MD; Carole Silney, MD; Bridget Early, MD; Andrew Quint, MD; Robert Buffaloe, MD; William Rice, DO; Edith Daniel, RNCS-FNP; Jim Elam, MD; Dennis Handley, MD; Robert Koch, MD; Deborah Johnoff, RNCS-FNP; Cynthia Ruffolo, MD; Monika Prost, MD; Rebecca Kelley, MD; William Kimlinger, MD; Kenneth Ogawa, M; Julie Wood, MD; Joseph Quaranto, DO; Abbe Sudvarg, MD. University of Missouri-Columbia: Robert Bynum, DO; Sarah McElroy, MD; Lynn Wung, MD; Joseph Beckmann, MD; Paul Schoephoerster, MD; Tony Cook, FNP, and colleagues; James Stevermer, MD, and colleagues; Susan Even, MD, and colleagues; Anne Fitzsimmons, MD, and colleagues; Larry Rues, MD, and colleagues.
| FOOTNOTES |
|---|
Funding support: Funded by grants from the Alcoholic Beverage Medical Research Foundation and from the American Academy of Family Physicians Foundation.
Received for publication April 7, 2003. Revision received July 8, 2003. Accepted for publication August 8, 2003.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
D. G. Graham, M. S. Spano, T. V. Stewart, E. W. Staton, A. Meers, and W. D. Pace Strategies for Planning and Launching PBRN Research Studies: A Project of the Academy of Family Physicians National Research Network (AAFP NRN) J Am Board Fam Med, March 1, 2007; 20(2): 220 - 228. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. AGABIO, M. NIOI, C. SERRA, P. VALLE, and G. L. GESSA ALCOHOL USE DISORDERS IN PRIMARY CARE PATIENTS IN CAGLIARI, ITALY Alcohol Alcohol., May 1, 2006; 41(3): 341 - 344. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. C. Stange In this Issue: The Patient-Clinician Relationship and Practice-Based Network Research Ann. Fam. Med, September 1, 2004; 2(5): 386 - 387. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |