|
This information is for reference purposes only. It was current when produced and may now be outdated. Archive material is no longer maintained, and some links may not work. Persons with disabilities having difficulty accessing this information should contact us at: https://info.ahrq.gov. Let us know the nature of the problem, the Web address of what you want, and your contact information.
Please go to www.ahrq.gov for current information.
Evaluation of ARRA Comparative Effectiveness Research Dissemination Contract Efforts
Appendix P: Consumer Survey Longitudinal Results
Appendix Q contains the detailed results tables for the longitudinal analysis of all of the main outcome variables from the consumer survey (waves 1 and 2). This is a supplement to the findings reported in Section 5 of the report. The results tables are organized according to three main outcomes: (1) awareness, (2) attitudes/perceived benefits, and (3) behavior/use.
For each outcome variable we analyzed, we tested whether there was a statistically significant increase between survey waves (wave 2 minus wave 1) at the p<0.05 level using a one-sided test (go to Section 2.5.1 Analytic Methodology of Consumer Survey for details). The tables include key information such as: (1) wave-specific point estimates; (2) two-sided 95% confidence intervals for each wave-specific point estimate; (3) the estimate for the differences between survey waves, e.g., "Diff (2-1)"; and (4) one-sided 95% confidence intervals for the difference estimates.
Exhibit P.1. Longitudinal Findings of Consumer Awareness of CER, AHRQ, and EHC Program
Q1: Awareness of the concept of comparing health care treatments with your clinician
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.608 |
0.0269 |
|
|
(0.554, 0.660) |
| 2 |
948 |
0.653 |
0.0286 |
|
|
(0.597, 0.709) |
| Diff (2-1) |
|
0.046 |
0.0394 |
|
|
(-0.019, 1) |
| |
|
under Ho: |
|
1.162295 |
0.1226 |
|
Q5: Awareness of research that helps you compare treatment options
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.184 |
0.0224 |
|
|
(0.140, 0.228) |
| 2 |
948 |
0.207 |
0.0257 |
|
|
(0.157, 0.257) |
| Diff (2-1) |
|
0.023 |
0.0343 |
|
|
(-0.036, 1) |
| |
|
under Ho: |
|
0.0669 |
0.2517 |
|
Q9: Awareness of research on the evaluation of treatment options for specific medical conditions
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
172 |
0.729 |
0.0694 |
|
|
(0.592, 0.865) |
| 2 |
174 |
0.855 |
0.0517 |
|
|
(0.753, 0.957) |
| Diff (2-1) |
|
0.126 |
0.0891 |
|
|
(-0.020, 1) |
| |
|
under Ho: |
|
1.4177 |
0.0785 |
|
Q10: Awareness of AHRQ
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.043 |
0.0082 |
|
|
(0.026, 0.059) |
| 2 |
948 |
0.107 |
0.0224 |
|
|
(0.063, 0.151) |
| Diff (2-1) |
|
0.065 |
0.0238 |
|
|
(0.0257, 1) |
| |
|
under Ho: |
|
2.7271 |
0.0003 |
|
Q11: Awareness of the EHC Program
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.040 |
0.0100 |
|
|
(0.020, 0.059) |
| 2 |
948 |
0.073 |
0.0188 |
|
|
(0.359, 0.110) |
| Diff (2-1) |
|
0.033 |
0.0213 |
|
|
(-0.0019, 1) |
| |
|
under Ho: |
|
1.5548 |
0.0601 |
|
Exhibit P.2. Longitudinal Findings of Consumer Attitudes and Perceived Benefits
Q34: Interest in learning more about evaluating treatment options for specific medical conditions
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.374 |
0.0272 |
|
|
(0.320, 0.427) |
| 2 |
948 |
0.506 |
0.0312 |
|
|
(0.445, 0.567) |
| Diff (2-1) |
|
0.132 |
0.0416 |
|
|
(0.0636, 1) |
| |
|
under Ho: |
|
3.1747 |
0.0008 |
|
Q35: Interest in learning more about the EHC Program
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.444 |
0.0282 |
|
|
(0.389, 0.499) |
| 2 |
948 |
0.584 |
0.0306 |
|
|
(0.524, 0.644) |
| Diff (2-1) |
|
0.140 |
0.0418 |
|
|
(0.070, 1) |
| |
|
under Ho: |
|
3.1152 |
0.0004 |
|
Q36: Interest in evaluating treatment options before making medical decisions
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.688 |
0.0258 |
|
|
(0.638, 0.739) |
| 2 |
948 |
0.742 |
0.0275 |
|
|
(0.688, 0.796) |
| Diff (2-1) |
|
0.054 |
0.0378 |
|
|
(-0.008, 1) |
| |
|
under Ho: |
|
1.4260 |
0.077 |
|
Exhibit P.3. Longitudinal Findings of Consumer Behavior Change and Use
Q37: Intention to use AHRQ's consumer summaries or other studies that evaluate treatment options to prepare for a medical visit or make medical decisions
| Wave |
N |
Proportion Awareness |
Std. Err. |
t-value |
P-value1 |
95% Conf. Interval |
| 1 |
1005 |
0.388 |
0.0285 |
|
|
(0.332, 0.444) |
| 2 |
948 |
0.452 |
0.0314 |
|
|
(0.391, 0.514) |
| Diff (2-1) |
|
0.064 |
0.0427 |
|
|
(-0.006, 1) |
| |
|
under Ho: |
|
1.501 |
0.067 |
|
1 One sided p-value using normal approximation to the binomial. Tests null hypothesis of no difference in wave 2 and wave 1 proportions versus the alternative that wave 2 is bigger.
Return to Contents
Proceed to Next Section
Page last reviewed October 2013
Page originally created December 2014
Internet Citation: Evaluation of ARRA Comparative Effectiveness Research Dissemination Contract Efforts. Content last reviewed October 2013. Agency for Healthcare Research and Quality, Rockville, MD. https://archive.ahrq.gov/research/findings/final-reports/arracer/arracer-app.html | |
5600 Fishers Lane Rockville, MD 20857