Health Education Research, Vol. 13, No. 2, 239-250, 1998
© 1998 Oxford University Press
research-article |
How best to measure implementation of school health curricula: a comparison of three measures
Rollins School of Public Health, Emory University 1518 Clifton Road NE, Atlanta, GA 30322, USA
The impact of school health education programs is often attenuated by inadequate teacher implementation. Using data from a school-based nutrition education program delivered in a sample of fifth graders, this study examines the discriminant and predictive validity of three measures of curriculum implementation: classroom observation of fidelity, and two measures of completeness, teacher self-report questionnaire and post-implementation interview. A fourth measure, obtained during teacher observations, that assessed student and teacher interaction and student receptivity to the curriculum (labeled Rapport) was also obtained. Predictive validity was determined by examining the association of implementation measures with three study outcomes; health knowledge, asking behaviors related to fruit and vegetables, and fruit and vegetable intake, assessed by 7-day diary. Of the 37 teachers observed, 21 were observed for two sessions and 16 were observed once. Implementation measures were moderately correlated, an indication of discriminant validity. Predictive validity analyses indicated that the observed fidelity, Rapport and interview measures were significantly correlated with post-test student knowledge. The association between health knowledge and observed fidelity (based on dual observation only), Rapport and interview measures remained significant after adjustment for pre-test knowledge values. None of the implementation variables were significantly associated with student fruit and vegetable intake or asking behaviors controlling for pre-test values. These results indicate that the teacher self-report questionnaire was not a valid measure of implementation completeness in this study. Post-implementation completeness interviews and dual observations of fidelity and Rapport appear to be more valid, and largely independent methods of implementation assessment.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  M. Wind, M. Bjelland, C. Perez-Rodrigo, S. J. te Velde, C. Hildonen, E. Bere, K.-I. Klepp, and J. Brug Appreciation and implementation of a school-based intervention are associated with changes in fruit and vegetable intake in 10- to 13-year old schoolchildren--the Pro Children study Health Educ. Res., December 1, 2008; 23(6): 997 - 1007. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. R. Young, A. Steckler, S. Cohen, C. Pratt, G. Felton, S. G. Moe, J. Pickrel, C. C. Johnson, M. Grieser, L. A. Lytle, et al. Process evaluation results from a school- and community-linked intervention: the Trial of Activity for Adolescent Girls (TAAG) Health Educ. Res., December 1, 2008; 23(6): 976 - 986. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. T. W. Leurs, K. Bessems, H. P. Schaalma, and H. de Vries Focus points for school health promotion improvements in Dutch primary schools Health Educ. Res., February 1, 2007; 22(1): 58 - 69. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. P. Saunders, M. H. Evans, and P. Joshi Developing a Process-Evaluation Plan for Assessing Health Promotion Program Implementation: A How-To Guide Health Promot Pract, April 1, 2005; 6(2): 134 - 147. [Abstract] [PDF]
|
|
|
|
 |
|
 Z. Yin, J. Hanes Jr., J. B. Moore, P. Humbles, P. Barbeau, and B. Gutin An After-School Physical Activity Program for Obesity Prevention in Children: The Medical College of Georgia FitKid Project Eval Health Prof, March 1, 2005; 28(1): 67 - 89. [Abstract] [PDF]
|
|
|
|
|
|
J. D. Fluhr, R. F. Oman, J. R. Allen, M. G. Lanphier, and K. R. McLeroy A Collaborative Approach to Program Evaluation of Community-Based Teen Pregnancy Prevention Projects Health Promot Pract, April 1, 2004; 5(2): 127 - 137. [Abstract] [PDF]
|
|
|
|
|
|
N. Harre and A. Coveney School-based scalds prevention: reaching children and their families Health Educ. Res., April 1, 2000; 15(2): 191 - 202. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. Baranowski and G. Stables Process Evaluations of the 5-a-Day Projects Health Educ Behav, April 1, 2000; 27(2): 157 - 166. [Abstract] [PDF]
|
|
|
|
|
|
T. Baranowski, M. Davis, K. Resnicow, J. Baranowski, C. Doyle, L. S. Lin, M. Smith, and D. T. Wang Gimme 5 Fruit, Juice, and Vegetables for Fun and Health: Outcome Evaluation Health Educ Behav, February 1, 2000; 27(1): 96 - 111. [Abstract] [PDF]
|
|