Health Education Research, Vol. 19, No. 3, 290-305,
June 1, 2004
© 2004 Oxford University Press
The effectiveness of an interactive multimedia program to influence eating habits
1 Oregon Center for Applied Science Inc., 1839 Garden Avenue, Eugene, OR 97401, 2 Nalco Chemical Co., One Nalco Center, Naperville, IL 60563 and 3 Penrose-St Francis, Health Learning Center, 1644 Medical Center Point, Colorado Springs, CO 80907, USA 4 Correspondence to: A. B. Irvine; e-mail: birvine{at}orcasinc.com
| Abstract |
|---|
|
|
|---|
An interactive multimedia program to encourage individuals to decrease their dietary fat consumption and to increase consumption of fruits and vegetables was developed and evaluated at two worksites. The program presented content tailored to the user by gender, content interests, race, and age group. It was tested using a randomized treatment and wait list control design (n = 517). Repeated-measures ANOVAs indicated significant intervention effects after 30 days for self-reported consumption of fat and of fruits and vegetables, for stage of change to adopt a low-fat diet, for intention and self-efficacy to reduce dietary fat, and for attitude toward the importance of diet. In addition, 60-day follow-up of the treatment subjects found that program effects were maintained on all measures. Within- subject analyses showed that program effects were replicated with the wait list group at 30 days. These results demonstrate the potential for short-exposure interactive programs to positively impact eating habits of employee populations.
| Introduction |
|---|
|
|
|---|
Poor eating habits may lead to increased risk of chronic disease (US Department of Health and Human Services, 1988
A number of research interventions have tried to decrease consumption of dietary fat. Programs have been conducted in schools, in communities, at worksites, and at Health Maintenance Organizations (see review by Glanz, 1999
). Worksites are an especially promising venue for dietary change programs because employees return repeatedly to the same site and on-going worksite health promotion programs are often already in place [e.g. (Pelletier, 1993
, 1996
)]. The efficacy of worksite programs, however, is still in doubt because of a lack of rigorous research (Harden et al., 1999
). The most effective worksite dietary intervention strategies have used theoretically based intervention strategies (Glanz, 1999
), including Stage of Change (Prochaska and DiClemente, 1983, 1984
) as adapted for dietary interventions [e.g. (Curry et al. 1992
; Glanz et al., 1994
; Kristal et al., 1999
)], the Theory of Reasoned Action (Fishbein and Ajzen, 1975
; Ajzen and Fishbein, 1979
, 1980
) and Social Cognitive Theory (Bandura, 1977
, 1986
). Research suggests that multifaceted dietary change programs are most effective, apparently because different program components appeal to the diverse needs and issues of the groups being studied [e.g. (Glanz, 1999
; Kristal et al., 2000
)]. Components shown to be effective include presentations, audiovisual materials, counseling, dietary assessment and behavioral feedback, self-help manuals and tailored written materials, mailings, and telephone counseling and support (Glanz, 1999
; Kristal et al., 2000
). The most efficacious components or combinations of components, however, have yet to be identified.
A key part of the success of multicomponent dietary interventions appears to be the ability to individualize a generalized intervention approach in multiple ways for different individuals [e.g. (Campbell et al., 1994
; Brug et al., 1999a
,b
)]. Kreuter and Skinner (Kreuter and Skinner, 2000
) suggest the term tailoring be used to describe messages designed for individuals and targeting be used to describe messages destined for groups (e.g. gender, race/ethnicity). Tailored print communication (TPC) has been shown to be effective [see reviews by (Brug et al., 1999a
; Skinner et al., 1999
)]. For TPC, computers are used to sort available information and produce mailings tailored to specified criteria such as an individuals gender, risk factors, motivations or stage of change. Multiple studies show TPCs are more likely to be noticed and read than non-tailored print messages (Campbell et al., 1994
, 1998
; Strecher et al., 1994
; Brug et al., 1996
, 1999a
,b
). TPCs are also more likely to influence health behavior change than non-tailored print messages (Brinberg and Axelson, 1990
; Campbell et al., 1994
; Skinner et al., 1994
; Brug et al., 1996
, 1998
, 1999a
). TPCs demonstrate the promise of using computer tailoring to change health behaviors and this potential may well increase as technology improves (Kreuter et al., 2000
).
The trend toward multicomponent dietary intervention research in some ways reflects how programs would be developed in an individualized treatment intervention. Based on a clients needs, a trained dietician would recommend a personalized program to change eating habits. Ideally, the recommendations would target the clients motivation and interests, and use behaviorally based approaches (e.g. stage of change, behavioral intention, self-efficacy). While such individualized treatment often is not cost-effective, the same computer technology that allows component sorting and delivery of TPCs can be used to mimic one-on-one-counseling (Noell and Glasgow, 1999
; Kreuter et al., 2000
). Interactive systems (e.g. Internet or intranet) that provide individualized treatment are a potentially attractive option because this approach can be used in situations in which professional counselors are not available or affordable. A small non- randomized study using a CD-ROM that provided text-based nutritional screening and counseling showed the promise of this approach (Block et al., 2000
).
Interactive multimedia (IMM) programming, which combines audio, video, graphics and printout, is appealing as a substitute for an individualized counseling program for several reasons in addition to its cost-effectiveness. IMM can create the sense of a personalized television program. The targeting and tailoring capabilities of the computer allow the program to assess user characteristics and interests, and make user-specific recommendations. An IMM video counselor and motivational elements can be demographically matched to the user (e.g. by age, race and gender). If the program is skillfully developed, it can use behaviorally based strategies to improve attitudes, boost self-efficacy, and create the intention and commitment to make changes. An IMM approach should be particularly effective for individuals with poor reading skills, a group not well suited for TPC interventions. For users with adequate reading skills, a tailored summary printout can reinforce program messages and remind the user of commitments made in the program. An IMM intervention also provides quality control: the intervention is presented exactly as designed every time.
An IMM approach is not without some potential risks. Video programs are expensive to develop and are not easily updated if they become outdated. Interventions may sometimes be more appropriately delivered by an experienced professional. For instance, complex topics may require qualitative assessment and treatment, or the intervention target may be afraid of computers or may benefit from interpersonal contact because of language difficulties or for other reasons. Finally, an interactive intervention program is potentially vulnerable if the user does not attend to the program elements that most effectively promote the programs objectives.
While research into the impact of IMM programs is still in its infancy, Campbell et al. (Campbell et al., 1999
) suggest that tailored IMM programs may effectively reach under-served populations and that audiovisual elements are more effective than print for those with limited literacy skills. We were unable to find other research testing the impact of IMM interventions on dietary behaviors.
Our research looked at the impact of an IMM program designed to help individuals decrease their consumption of fat. Several research questions were examined:
Did exposure to the program lead to changes in variables theoretically associated with behavior change, including stage of change, attitude, self-efficacy and intention to change?
Were changes maintained a month after initial exposure?
Were these results replicable with another sample of study participants?
| Methods |
|---|
|
|
|---|
Program development
For this research we developed an IMM worksite intervention program to help employees decrease their fat consumption. Our underlying assumption was that participants would choose to view parts of the IMM program that were of personal interest and ignore topics that were perceived to be unappealing or of little interest. Program material was shaped by several theoretical constructs discussed below.
Stage of change
Following the Transtheoretical Model of Prochaska and DiClemente (Prochaska and DiClemente, 1983
), which has been tested on a number of health behaviors (Prochaska and Velicer, 1997
), the Stage of Change construct suggests that readiness to make dietary changes may be assessed along a continuum (Kristal et al., 1999
): precontemplation (no plans to change), contemplation (indeterminate plans to change, no change attempts), preparation (plan to change, have made attempts), action (having eaten a low-fat diet for less than 6 months) and maintenance (have eaten a low-fat diet for 6 months or longer). We assumed an individual would not choose program options for which s/he was a precontemplator. Program elements were written to encourage users in the contemplation and preparation stages to make an attempt to change (progress to the action stage), and to do so in small steps to encourage success and long-term adoption. Testimonial support to overcome barriers to changing behaviors was included. We expected individuals in the action or maintenance stage to find content to support their current behaviors and to seek out topics in areas where they were still in the contemplation or preparation stage. Opportunities to commit to specific new behaviors (move from preparation to action) were offered by asking users to identify up to four recommended behaviors to do in the next 2 weeks. When users identified recommended behaviors in which they were already engaged, the program provided support (action and maintenance stages).
Attitudes
Attitudes about eating habits for self and family were targeted with testimonials and modeling vignettes to normalize perceptions of healthy eating behavior. The importance and health benefits of eating less dietary fat were stressed.
Intentions
The Theory of Reasoned Action posits that attitudes and behavioral intentions predict behavior (Ajzen and Fishbein, 1979
, 1980
). Video testimonials offered encouragement to try recommended behaviors. Commitments to try new behaviors were supported and they were prominently displayed on each users tailored printout.
Self-efficacy
The concept of self-efficacy involves the personal conviction that one can successfully execute the behavior required to produce a desired outcome. A change in ones belief about his/her ability to successfully execute a given behavior will mediate the initiation and maintenance of change in that behavior (Bandura, 1977
, 1986
). Social Cognitive Theory (Bandura, 1977
, 1986
) and Health Communication Theory (Witte, 1995
) suggest that messages from perceived peers will resonate more strongly with the user who hears and sees the message. Our IMM program delivered positive self-efficacy messages via video modeling vignettes, supportive testimonials and testimonials about overcoming barriers to changing behaviors. Actors were demographically matched to each viewer to promote message salience.
Summary
Our IMM program was designed to combine theoretical approaches. Positive attitudes and self-efficacy were promoted by peer models to encourage intention to advance to the action stage of change. Support was provided for those in the action and maintenance stages. Intention to change was promoted with encouragement to make commitments to specific behaviors, which were supported on tailored printouts. Barriers to change were addressed with supportive testimonials designed to build self-efficacy. Throughout the program, video narrators targeted to the users demographics offered guidance and support, while modeling videos and testimonials encouraged positive behavioral change and boosted self-efficacy.
Subject recruitment
This research was conducted at a large hospital system in Colorado and at the headquarters of an international corporation in Illinois. The Colorado site (n = 229 subjects) consisted of a main 500 bed hospital, two associated hospitals, and additional ancillary clinics and facilities (n = 4000 employees). Recruitment targeted the main hospital, but volunteers were accepted from other facilities. The Illinois site (n = 288 subjects) employed about 1200 employees in a single building, but was in the midst of downsizing to about 1000 employees. At both sites, participant recruiting occurred over a 3-month period. Because we anticipated that less-educated employees would be more difficult to enroll in a project that required filling out questionnaires, the first 3 weeks focused on recruiting low-wage workers (e.g. clerical staff, food workers). Announcements were made at staff meetings, and flyers were posted and distributed by our liaisons at each worksite. When recruiting was opened to the general employee population, additional recruiting strategies employed newsletter articles, E-mail messages, staffed tables at Health Fairs and word of mouth. In Illinois, a letter from the corporate Medical Director to all employees that promoted the program appeared to be linked to an increase from 68 to 148 recruits in a 2-week period, but no other single technique was obviously as effective. Any employee who volunteered was invited to participate in the study,
Research design
The study was a randomized trial with a wait list control (Figure 1). Volunteers at each site were mailed a packet containing an informed consent form, a questionnaire (T1), a stamped return mailer and a $10 cash incentive. The recipients were asked to sign the informed consent, fill out the T1 questionnaire and return both items in the mailer. They were informed that the money was theirs to keep. When the return packets were received, the employees were blocked based on gender, age (over 40 versus under 40 years of age), ethnic/racial self-identification (African-American, Hispanic and Caucasian/other) and worksite. Subjects were paired within these blocks and then randomly assigned to either an immediate treatment (IT) or a wait list (WL) condition. IT subjects were scheduled to use the program; WL subjects were told they would receive access in 1 month. One month after the IT member of each randomized pair viewed the IMM program, both pair members were mailed a follow-up questionnaire (T2) with a stamped return mailer and another $10 cash incentive. Following the return of the T2 questionnaire, subjects in the WL group were scheduled to use the program. Neither IT nor WL group participants were given financial incentives for using the program. One month after the T2 assessments were mailed, the IT group was mailed a third packet containing another assessment (T3), a stamped return mailer, and another $10 bill. This T3 questionnaire for the IT subjects provided a 2-month follow-up after initial use of the program. One month after each WL group member used the program, s/he was mailed an identical T3 packet.
|
IMM program use procedures
The IMM intervention software ran on an inexpensive personal computer (200 MHz; 64 Mb RAM; sound card). Three computers, a server and a printer were shipped to each site, and remained available for repeated use by participants during the course of the study. The computer stations were situated to protect the privacy of the user from over-the-shoulder observers and each was equipped with earphones. In Colorado, the computers were located in a temporary cubicle in the main hospitals cafeteria; in Illinois, they were located in adjoining cubicles next to the company store.
Users interacted with the program using a mouse to click on buttons on the screen. No keyboarding skills were needed. Most of the on-screen graphics were narrated to assist poor readers. Narration and testimonial scripts (see below) were analyzed by Microsoft Word and had a FleschKincade grade level of 5.3. On screen text had a 1.5 grade level, while articles in the Information Center were written at a Grade 8 reading level.
Because repeat visits to use the IMM computer program were encouraged, each user was initially prompted to develop a password to protect his/her privacy. The password permitted the computer to access a users previous data entries as needed (e.g. to compare assessment results across visits). A welcome by the program host, television personality and internationally recognized chef Graham Kerr, followed the login/password sequence. The user then answered a series of mandatory questions that allowed the program to provide a narrator/guide matched on race and gender. The narrator encouraged the user to allow him/her to be a guide through the program. Users who opted to not be guided through the program were routed to the Main Menu and allowed to explore from there.
For those who agreed to a guided tour, the narrator offered an on-screen eating habits assessment adapted from the work of Glanz, Kristal and colleagues [e.g. (Glanz et al., 1994
, 1998
; Kristal et al., 2000
)]. Based on this assessment, the program took the user to the Eating Strategies section (see Figure 2), which recommended a low-fat dietary strategy appropriate for that user. Because the program was interactive, each user had the option of exploring different parts of the recommended strategy or moving elsewhere in the program. At any time, users could change pathways within a strategy or go to the Main Menu to explore other program components.
|
Program navigation was designed to be intuitive for the user, but in reality the program is quite complex. Because content is tailored by user demographic characteristics, program recommendations and user choices, there are literally millions of unique combinations of program elements available to each user (see Figure 2).
As an overview, the program sections accessible from the first level Main Menu included: Eating Strategies, Recipes, Barriers to Eating Healthy, Eating Habits Assessment, Information Center and Quick Tips. The Recipes, Barriers to Eating Healthy and Eating Habits Assessment sections could also be accessed through the Eating Strategies section, as described below.
The Eating Strategies (see Figure 2, second level) were based on established recommendations to decrease dietary fat [e.g. (Bal and Foerster, 1991
; US Department of Health and Human Services, 1991
)]: (1) Reducing Fats as Flavorings, (2) Making Low-Fat Food Choices, (3) Adding Fruits, Vegetables and Fiber, and (4) Modifying Meat Use. Each strategy had multiple subpathways. For instance, as shown in Figure 2, the Adding Fruits, Vegetables, and Fiber pathway included three third-level choices: At Home, At Work and Dining Out. If the user selected At Home, the fourth-level set of choices were Shopping, Food Preparation, At the Table and Snacking. Had the user selected a different third-level choice, the interactive options in the fourth level would have differed also. If the user selected Shopping, two pathways, Buying Food and Reading Labels, were available at the fifth level. The sixth level provided educational information relevant to the chosen topic from the fifth level.
On-screen text was delivered in short bulleted statements, usually explained by the demographically tailored narrator, followed by a modeling video and then two to three tailored video testimonials designed to motivate acceptance of the just-presented strategy recommendations. Text recommendations were small practical steps (e.g. add fruit and veggies when you pack your lunch), while video elements modeled simple changes (e.g. a short personal testimonial with the statement so, I started ordering salad dressing on the side).
In each content area, the user was asked to identify which recommended behaviors s/he was already doing and to commit to the behaviors that s/he was willing to try in the next week. Following this, the user was asked to identify potential barriers to fulfilling the commitments just made from a total of 24 potential barriers (e.g. dealing with temptations and cravings; dont have enough time). For chosen barriers, video models delivered short testimonials describing how they overcame the selected barrier. From the Barriers pathway, the user was routed back to the previous Eating Strategies pathway. Users could browse the Eating Strategies section until they made a total of six commitments. Then they saw a review and support for making commitments to change followed by a testimonial from the program host. Next, users were routed to a menu with an audio recommendation to visit the Recipe section and then to the Main Menu to browse the program at will.
Program video elements consisted of (1) more than 700 short testimonials providing tips, advice and encouragement, (2) 24 vignettes modeling recommended eating behaviors (e.g. the fork-dip method, ordering low-fat menu items), (3) about 240 min of short video segments of six narrators (matching users on gender and race) providing guidance and support, and (4) approximately 60 min total of voice-over narration explaining individual content screens. The video testimonials and modeling vignettes ranged from 20 to 45 s long. Video segments of narrators ranged from 5 to 60 s. Voice-over audio clips accompanying content screens were 540 s in length. The modeling vignettes were enacted by a multicultural cast. Video testimonials were usually presented as a sequence of two to three related video clips. In the first video clip of a sequence, the actor was fully matched to the three demographic parameters of the user (i.e. gender, race and age). The actor in the second testimonial was matched on at least two of the three. If a third testimonial was presented, it was matched on at least one of the three.
The Recipe section of the program contained over 1500 low-fat recipes, which could be printed out. The recipes were developed by Graham Kerr and by Micro Cookbook, 5.0 (IMSI Software, Novato, CA). Recipe selection was facilitated with four pop-up selection criteria: recipe category (30 categories), meal type (12), main ingredient (20) and cuisine type (12). For example, a user might specify the recipe category as casserole, meal type as main dish, main ingredient as chicken and cuisine type as Italian. The recipes meeting the criteria would then be displayed and could be printed. The Information Center had six second-level choices that branched into three or four more levels providing educational articles, dietary information and resource referral to national organizations. The Quick Tips section contained five second-level choices that branched to short content lists in the third or fourth levels.
Upon leaving the program, each user automatically received a printout. It included a list of the users four behavior change commitments, summaries of program selected content from eating strategy pathways, and user-selected content screens and recipes.
Measures
With the exception of six demographic questions on the T1 questionnaire, each participant completed the same questionnaire at T1, T2, and T3. It consisted of 42 items, with 23 of the items first asking if a specific behavior or attitude was relevant and, if so, a Likert scale subpart followed. Pilot testing indicated that the questionnaire could be completed in 1015 min.
Fat eating habits/behaviors
The 21-item diet habits questionnaire (DHQ) was adapted from an instrument designed to assess food preparation patterns associated with adoption of a low-fat diet (Kristal et al., 1990
). It has been modified to measure dietary change in the previous month (Kristal et al., 1992
, 2000
; Glasgow et al., 1996
; Shannon et al., 1997
; Neuhouser et al., 1999
). The DHQ assesses five dimensions of low-fat dietary habits including substitute, modify meats, avoid fried foods, avoid fats as flavorings, and replace fatty foods with fruits and vegetables. Twenty of the items ask about the relevance of a behavior (e.g. Did you eat snacks between meals?, Did you use mayonnaise?). If the response is positive, a subpart asked about the frequency with which the behavior was part of a low-fat strategy (e.g. snacks: How often did you eat low-fat snacks or fresh fruit?; mayonnaise: How often did you use a low-fat or non-fat type?). Frequency is rated on a four-point scale: usually or always, often, sometimes and rarely or never. The last item of the 21-item scale asks participants to rate how often they eat two or more vegetables at dinner or their main meal using the same four-point frequency scale. The DHQ summary scale is the mean score on the four-point scale across the 21 behavioral items. The psychometric properties of this scale differ only modestly across studies [e.g. (Kristal et al., 1990
, 2000
; Shannon et al., 1997
)]. The internal consistency (Cronbachs
) of the summary scale ranges from 0.63 to 0.67. Testre-test reliability for the summary score is consistently above 0.70. Correlations of the DHQ summary scale with percent energy from fat measured by a food-frequency questionnaire range from 0.53 to 0.68. Confirmatory factor analysis of the pre-test data in the current study yielded a solid comparative fit index for the five dimensions of the DHQ equal to 0.91,
2 (156, N = 417) = 234.47, P < 0.001.
Fruit and vegetable consumption
Fruit and vegetable intake was assessed with the same approach used in the 5-a-day for better health studies (Subar et al., 1995
). The items ask about the frequency of consumption of fruit juice, fruit, green salad, non-fried potatoes, and servings of vegetables not including potatoes and salad. The frequency choices were 9- or 10-point scales ranging from none/never to five servings per day. Fruit intake was the sum of fruit juice and fruit, not counting juice. Vegetable intake is calculated as the sum of non-fried potatoes, salads and vegetables not including salad and potatoes. This approach of summing the foods consumed has moderate validity compared to multiple 24-hour dietary recalls and food records, although it underestimates total vegetable consumption, probably due to not counting vegetables consumed in mixed dishes (Kristal et al., 1998
).
Program recommended behaviors (program specific)
A total of seven items were developed to measure the impact of program recommendations on specific healthy eating behaviors. Each item began In the past month, how often have you...?, followed by one of seven topics: tried to pick healthier food while grocery shopping?, tried to pick low-fat foods while grocery shopping?, chosen a new food because you had heard it was healthy?, tried to use less fat when preparing a meal (e.g. broiling instead of frying, baking with low-fat recipes)?, tried to eat less fat at home (e.g. using less salad dressing, using less or no butter on bread)?, ordered healthier food when eating out?, tried to eat less fat when eating out?. Responses to each item were on a 6-point Likert scale with responses ranging from never to frequently. Principal components factor analysis yielded a single-component solution accounting for 60.5% of the variance in these items. This single factor score, called Program Recommended Behaviors, represented this set of healthy diet behaviors in our analysis. In the current study the pre-test Cronbachs
was r = 0.89.
Stage of change
The five-item stage of change instrument to assess adoption of a low-fat diet developed by Kristal and colleagues (Kristal et al., 1999
) was used for this study. It was validated in the Working Well Trial (Glanz et al., 1998
). One month test re-test reliability (T1 to T2) among our WL subjects was r = 0.69.
Attitudes
Two attitudinal items previously developed by Kristal et al. were used to predict dietary change (Patterson et al., 1995
, 1996
). One item measured the respondents reaction to a statement about the importance of what is eaten to health on a five-point scale (strongly agree, agree, dont know, disagree and strongly disagree). The other item asked whether what one eats is related to heart disease, with three responses possible (dont know, no, and yes). Those responding yes were asked to rate the strength of the relationship on a four-point scale (strong, moderate, weak and dont know). One month testre-test reliabilities (T1 to T2) among WL subjects were r = 0.39.
Behavioral intention
To assess the constructs of the theory of reasoned action (Fishbein and Ajzen, 1975
; Ajzen and Fishbein, 1980
), a single questionnaire item was developed to assess participant intention to lower the fat in their diet in the next month, using a four-point Likert Scale with responses of not likely, somewhat likely, quite likely and extremely likely. One month testre-test reliability (T1 to T2) among our WL subjects was r = 0.52.
Behavioral self-efficacy
Following social cognitive theory (Bandura, 1977
, 1986
), participants self-efficacy to decrease dietary fat intake was assessed with a single item which asked If you wanted to lower the fat in your diet, how confident are you that you could do it?. This rating was on a 5-point scale of very confident, somewhat confident, not confident and dont know. One month testre-test reliability (T1 to T2) among WL subjects was r = 0.61.
| Results |
|---|
|
|
|---|
Subjects
Table I provides descriptive information about the sample of 517 participating employees. They averaged 43 years of age, and were predominately Caucasian (85%) and female (73%). Almost 90% of the participants had some college education and only 3.5% of them had family incomes below $20 000 per year. Eighty-six percent of the participants were full-time employees. There were no significant differences between the worksites by gender, race/ethnicity or age. Attrition from the study was low. Of the 517 individuals who completed T1 surveys, 484 (94%) completed T2 assessment, and 463 (90%) completed the T3 assessment.
|
Program use
The average time IT subjects spent using the program on their first visit was 35.75 min (SD = 15.75). The WL group at their first session used the program for an average of 32.09 min (SD = 15.70). None of the WL subjects used the program early (before their T2 assessment). Only 14.7% of the IT group (average use time: 27.5 min; SD = 25.0) and 12.07% of the WL group (average use time: 20.2 min; SD = 13.0) returned to use the program a second time. Only 7.5% of the IT subjects and 1.7% of the WL subjects returned for a third time (average use time: 28.6 min; SD = 27.5 and 17.3 min; SD = 15.9, respectively).
Data on the number of recipes printed, a possible indicator of intent to use low-fat recipes, were collected at the initial visit for the WL group. Among the WL subjects, 133 (57.33%) chose to have recipes printed with an average of 12.22 (SD = 33.74) recipes printed. One subject printed 367 recipes, suggesting that it might be appropriate to have a limit. Data on recipes printed at the IT subjects initial visits are not available. However, IT subjects did print an average of 5.5 recipes at the repeat-visit sessions.
Efficacy of program
Randomized trial
Analysis of variance yielded no significant pre-test differences on any of the demographic variables between the IT and WL subjects. The relationship between experimental condition and each of the outcome measures was examined using repeated-measures analysis of variance (pre-test to post-test). As shown in Table II, the condition by time interaction was significant for every one of the outcome measures, indicating that the IT group showed significantly enhanced scores over that of the WL group at 1-month follow-up on each of the seven measures. In addition, the effect sizes were not statistically trivial. The treatment group improving, on average, about one-third of a standard deviation. Of particular interest was the IT group reduction in self-reported fat consumption (i.e. DHQ), a decrease of nearly 0.5 SD. Similarly, IT subjects reported significant increases in the consumption of fruits and vegetables, and on program-recommended healthy eating behaviors. Lastly, each of the four mediating constructs derived from theoretical models of health behavior change (i.e. stage of change, attitude, behavioral intention and self-efficacy) consistently supported the efficacy of the intervention with statistically significant improvement in the IT group. The consistency of program effects across all seven outcome measures is notable.
|
Maintenance of program effects
To determine if treatment effects were maintained at the 60-day follow-up, within-subject T1T3 data from the IT group was examined. As shown in Table II, paired t-test analyses indicate highly significant effects at 60-day follow-up across every one of the seven outcome measures.
Within-subject replication
The wait list design of the study allowed examination of within-subject program effects with the IT group (T1T2) and with a later replication sample involving the WL group (T2T3). The results of the randomized trial above demonstrated significant program effects on the IT subjects and the within-subject analyses presented in Table III indicate that those effects replicated well with the WL sample. For all three behavioral constructs (i.e. fat eating habits/behaviors, fruits and vegetables consumption, and program recommended behaviors) and for all four of the theory-driven mediating constructs, the significant gains of the IT sample were replicated in the WL sample.
|
Program content viewed
Having determined that the program had significant effects, an analysis of subject exposure to program components was undertaken. This analysis is necessarily limited by the variation in pathways chosen by the program users.
The four eating strategies promoted in the program included: Adding Fruits, Vegetables and Fiber; Making Low-Fat Food Choices; Reducing Fats as Flavorings; and Modifying Meat Use. As shown in Table IV, there was high interest in Adding Fruits, Vegetables and Fiber (42%); solid interest in Making Low-Fat Food Choices (25%); and somewhat lower interest in Reducing Fats as Flavorings (17%) and Modifying Meat Use (15%). The average subject explored 2.2 different content pathways. Table V presents the 10 most visited content pathways of the interactive program within the four strategies. Again, highest interest was in the Adding Fruits, Vegetables and Fiber pathways, with eight of the top 10 pathways occurring in this strategy.
|
|
At the end of each content path, the user was asked to make up to four specific commitments to changing eating behaviors (e.g. use the fork-dip method, pick low-fat menu items when eating out) and identify perceived barriers to the commitments just made (e.g. dealing with temptations and cravings; dont have enough time). Table VI presents the 10 most frequently viewed barriers. Program users were most interested in learning about ways to deal with three kinds of temptations (327), three issues related to eating out (228) and two items related to low-fat food tasting bad (163).
|
| Discussion |
|---|
|
|
|---|
The results of this study are noteworthy for several reasons. First, statistically significant effects were observed at 1-month follow-up both in the randomized trial comparison and in the within-subjects replication. Second, the results were obtained utilizing a fully-automated computerized intervention at worksites; no personal contact was required. Third, this research found significant intervention effects with minimal user exposure (less than 36 min) to an IMM program. Fourth, such IMM interventions can be disseminated broadly over the Internet or via intranet systems at worksites or via CD-ROM. Such broad utilization can result in significant public health impact even if intervention effects on individual behavior are clinically modest. Fifth, this project represents a rare attempt to demonstrate the efficacy of a video-based IMM program to change self-reported behavior, which is unusual because much of the interactive health communication research to date has involved tailored print messages [e.g. (Brug et al., 1999a
Limitations
Several limitations of this study should be noted. First, the data are all self-reported measures, not observed behavior. Because there is not a one-to-one correspondence between self-reports of behavior and observed behavior, it is somewhat difficult to precisely ascertain the extent to which statistically significant changes in psycho-social constructs and self-reported behaviors found in this study represent actual changes in eating behaviors. Consequently, additional research that utilizes measures of directly observed behavior would strengthen the findings of this study. Additionally, follow-up intervals of more than 30 days might clarify the duration of program effects. While the results appear to be maintained at the 60-day follow-up for the IT group, this was not verified with a randomized comparison in this study. Future studies with 6- and 12-month follow-ups would be instructive. Because the subjects in this study were predominantly Caucasian females and most were college educated, they were not representative of the US workforce. Future research might seek to determine program effects on other demographic groups and on users with limited reading or language skills. Lastly, this study was not designed to determine the relative efficacy of the intervention components. Because this intervention has millions of possible combinations of video, audio, graphic, and content elements that a viewer might experience, a components analysis may prove somewhat challenging, as it has been in other multicomponent dietary interventions [e.g. (Glanz, 1999
; Kristal et al., 2000
)].
| Acknowledgements |
|---|
We are indebted to a large cast of people who helped with different stages of the project. The program development team included Steve Andress, Natasha Beauchamp, Gretchen Boutin, Kimberly Donahey, Malinke Elliot, Brian Johnson, Diana Robson, Denise Sevigny, and Will Doolittle and Ralph Conradt of Moving Images Productions Inc. Special thanks to Graham Kerr, who volunteered his time to be in the program. Thanks to Gretchen Boutin for video editing, and to Diana Robson and Turlif Vilbrant for programming. Alan R. Kristal provided instruments and guidance in preparing to evaluate the program. The evaluation teams included Jessica Jackson, Brian Johnson, Laura Philips and Diana Robson from ORCAS, Jacque Farnaus and Karen Geraghty from Nalco Chemical Co., and Max Morton, Don Tucker and Jay Wood from Penrose-St Francis Health Learning Center. Jeff Gau and John Seeley conducted the SPSS data analysis. Thanks to Sara Wyant, John Noell, Laura Philips, Sheramy Barry and Mary Grove for editorial comments on the manuscript. This research was supported by a grant from the National Heart Lung Blood Institute (R44 HL50949).
| References |
|---|
|
|
|---|
Ajzen, I. and Fishbein, M. (1979) Attitudebehavior relations: a theoretical analysis and review of empirical research. Psychological Review, 84, 888918.
Ajzen, I. and Fishbein, M. (1980) Understanding Attitudes and Predicting Social Behavior. Prentice-Hall, Englewood Cliffs, NJ.
Bal, D.G. and Foerster, S.B. (1991) Changing the American diet. Impact on cancer prevention policy recommendations and policy implications for the American Cancer Society. Cancer, 67, 26712680.[CrossRef][Web of Science][Medline]
Bandura, A. (1977) Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84, 191215.[CrossRef][Web of Science][Medline]
Bandura, A. (1986) Social Foundations of Thought and Action: A Social Cognitive Approach. Prentice-Hall, Englewood Cliffs, NJ.
Bandura, A. (1997) Self-efficacy: The Exercise of Control. Freeman, New York.
Bernhardt, J.M. (2001) Tailoring messages and design in a web-based skin cancer prevention intervention. International Electronic Journal of Health Education, 4, 290297. Available: http://www.idejhe.org; retrieved 20 November 2001.
Block, G., Miller, M., Harnack, L., Kayman, S., Mandel, S. and Cristofar, S. (2000) An interactive CD-ROM for nutrition screening and counseling. American Journal of Public Health, 90, 781785.
Brinberg, D. and Axelson, M.L. (1990) Increasing the consumption of dietary fiber: a decision theory analysis. Health Education Research, 5, 409420.
Brug, J., Steenhuis, I., van Assema, P. and De Vries, H. (1996) The impact of a computer-tailored nutrition intervention. Preventive Medicine, 25, 236242.[CrossRef][Web of Science][Medline]
Brug, J., Glanz, K., van Assema, P., Kok, G. and van Breukelen, B. (1998) The impact of computer-tailored feedback on fat, fruit and vegetable intake. Health Education and Behavior, 25, 517531.[Abstract]
Brug, J., Campbell, M. and Van Assema, P. (1999a) The application and impact of computer-generated personalized nutrition education: a review of the literature. Patient Education and Counseling, 36, 145156.[CrossRef][Web of Science][Medline]
Brug, J., Steenhuis, I., van Assema, P., Glanz, K. and De Vries, H. (1999b) Computer-tailored nutrition education: differences between two interventions. Health Education Research, 14, 249256.
Campbell, M.K., DeVellis, B.M., Strecher, V.J., Ammerman, A.S., DeVellis, R.F. and Sandler, R.S. (1994) Improving dietary behavior: the effectiveness of tailored messages in primary care settings. American Journal of Public Health, 84, 783787.
Campbell, M.K., Honess-Morreale, L., Farrell, D., Carbone, E. and Brasure, M. (1999) A tailored multimedia nutrition education pilot program for low-income women receiving food assistance. Health Education Research, 14, 257267.
Curry, S.J., Kristal, A.R. and Bowen, D.J. (1992) An application of the stage model of behavior change to dietary fat reduction. Health Education Research, 7, 97105.
Fishbein, M. and Ajzen, I. (1975) Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research. Addison-Wesley, Reading, MA.
Glanz, K. (1999) Progress in dietary behavior change. American Journal of Health Promotion, 14, 112117.[Web of Science][Medline]
Glanz, K., Patterson, R.E., Kristal, A.R., DiClemente, C.C., Heimendinger, J., Linnan, L. and McLerran, D.F. (1994) Stages of change in adopting healthy diets: fat, fiber and correlates of nutrient intake. Health Education Quarterly, 21, 499519.[Web of Science][Medline]
Glanz, K., Patterson, R.E. Kristal, A.R., Feng, Z., Linnan, L., Heimendinger, J. and Hebert, J.R. (1998) Impact of work site health promotion on stages of dietary change: the working well trial. Health Education and Behavior, 25, 448463.[Abstract]
Glasgow, R., Perry, J.D., Toobert, D.J. and Hollis, J.F. (1996) Brief assessments of dietary behavior in field settings. Addictive Behaviors, 21, 239247.[CrossRef][Web of Science][Medline]
Harden, A., Peersman, G., Oliver, S., Mauther, M. and Oakley, A. (1999) A systematic review of the effectiveness of health promotion interventions in the workplace. Occupational Medicine, 49, 540548.
Kreuter, M.W. and Skinner, C.S. (2000) Tailoring: whats in a name? Health Education Research, 15, 14.
Kreuter, M., Farrell, D., Olevitch, L. and Brennan, L. (2000) Tailoring Health Messages: Customizing Communications with Computer Technology. Lawrence Erlbaum, Mahwah, NJ.
Kristal, A.R., Shattuck, A.L. and Henry, H.J. (1990) Patterns of dietary behavior associated with selecting diets low in fat: reliability and validity of a behavioral approach to dietary assessment. Journal of the American Dietary Association, 90, 214220.
Kristal, A.R., White, E., Shattuck, A.L, Curry, S., Anderson, G.L., Fowler, A. and Urban N. (1992) Long-term maintenance of a low fat diet: durability of fat-related dietary habits in the womens health trial. Journal of the American Dietetic Association, 92, 553559.[Web of Science][Medline]
Kristal, A.R., Patterson, R.E., Simmons, N.C., Shattuck, A.L. and Beresford, S.A.A. (1998) Precision and bias of food frequency questionnaire measures of fruit and vegetable intakes. European Journal of Clinical Nutrition, 52, S46.
Kristal, A.R., Glanz, K., Curry, S.J. and Patterson, R.E. (1999) How can stages of change be best used in dietary interventions? Journal of the American Dietetic Association, 99, 679684.[CrossRef][Web of Science][Medline]
Kristal, A.R., Curry, S.J., Shattuck, A.L., Feng, Z. and Li, S. (2000) A randomized trial of a tailored, self-help dietary intervention: the Puget sound eating patterns study. Preventive Medicine, 31, 380389.[CrossRef][Web of Science][Medline]
Marcus, B.H., Emmons, K.M., Simkin-Silverman, L.R., Linnan, L.A., Taylor, E.R., Bock, B.C., Roberts, M.B., Rossi, J.S. and Abrams, D.-B. (1998) Evaluation of motivationally tailored vs. standard self-help physical activity interventions at the workplace. American Journal of Health Promotion, 12, 246253.[Web of Science][Medline]
National Research Council Committee on Diet and Health (1989) Diet and Health: Implications for Reducing Chronic Disease Risk. National Academy Press, Washington, DC.
Neuhouser, M.L., Kristal, A.R. and Patterson, R.E. (1999) Use of nutrition labels is associated with lower fat intake. Journal of the American Dietary Association, 99, 4550.[CrossRef]
Noel, J. and Glasgow, R.E. (1999) Interactive technology applications for behavioral counseling: issues and opportunities for health care settings. American Journal of Preventive Medicine, 17, 269274.[CrossRef][Web of Science][Medline]
Patterson, R.E., Kristal, A.R., Lynch, J.C. and White, E. (1995) Diet-cancer related beliefs, knowledge, norms and their relationship to healthful diets. Journal of Nutritional Education, 27, 8692.
Patterson, R.E., Kristal, A.R. and White, E. (1996) Do beliefs, knowledge and perceived norms about diet and cancer predict dietary change? American Journal of Public Health, 86, 13941400.
Pelletier, K.R. (1993) A review and analysis of the health and cost-effective outcome studies of comprehensive health promotion and disease prevention programs at the worksite: 19911993 update. American Journal of Health Promotion, 8, 5062.[Medline]
Pelletier, K.R. (1996) A review and analysis of the health and cost-effective outcome studies of comprehensive health promotion and disease prevention programs at the worksite: 19931995 update. American Journal of Health Promotion, 10, 380388.[Web of Science][Medline]
Prochaska, J.O. and DiClemente, C.C. (1983) Stages and processes of self-change in smoking: toward an integrative model of change. Journal of Consulting and Clinical Psychology, 51, 390395[CrossRef][Web of Science][Medline]
Prochaska, J.O. and DiClemente, C.C. (1984) The Transtheoretical Approach: Crossing the Traditional Boundaries of Therapy. Dow-Jones/Irwin, Homewood, IL.
Prochaska, J.O. and Velicer, W.F. (1997) The transtheoretical model of health behavior change. American Journal of Health Promotion, 12, 3848.[Web of Science][Medline]
Science Panel on Interactive Communication and Health (1999) Wired for Health and Well-being: The Emergence of Interactive Health Communication. US Department of Health and Human Services, US Government Printing Office, Washington, DC. Available: http://www.scipich.org/pubs/finalreport.htm; retrieved 20 November 2001.
Shannon, J., Kristal, A.R., Curry, S.J. and Beresford, S.A. (1997) Application of a behavioral approach to measuring dietary change: the fat and fiber-related diet behavior questionnaire. Cancer Epidemiology, Biomarkers and Prevention, 6, 355361.[Abstract]
Skinner, C.S., Strecher, V.J. and Hospers, H.J. (1994) Physicians recommendation for mammography: do tailored messages make a difference? American Journal of Public Health. 84, 4349.
Skinner, C.S., Campbell, M.K., Rimer, B.K., Curry, S. and Prochaska, J.O. (1999) How effective is tailored print communication. Annals of Behavioral Medicine, 21, 290298.[Web of Science][Medline]
Strecher, V.J., Kreuter, M., DenBoer, D.J., Kobrin, S., Hospers, H.J. and Skinner, C.S. (1994) The effects of computer-tailored smoking cessation messages in family practice settings. Journal of Family Practice, 39, 262270.
Subar, A.F., Heimendinger, J., Patterson, B.H., Krebs-Smith, S.M., Pivonka, E. and Kessler, R. (1995) Fruit and vegetable intake in the United States: the baseline survey of the five a day for better health program. American Journal of Health Promotion, 9, 352360.[Web of Science][Medline]
US Department of Agriculture and US Department of Health and Human Services (1995) Nutrition and Your Health: Dietary Guidelines for Americans. US Government Printing Office, Washington, DC.
US Department of Health and Human Services (1988) The Surgeon Generals Report on Nutrition and Health. US Government Printing Office, Washington, DC.
US Department of Health and Human Services (1991) Healthy People 2000: National Health Promotion and Disease Prevention Objectives. USDHHS publ. no. 91-50213. US Government Printing Office, Washington, DC.
US Preventive Services Task Force (1996) Guide to Clinical Preventive Services, 2nd edn. International Medical Publishing, Alexandria, VA.
Witte, K. (1995) Fishing for success: using the persuasive health message framework to generate effective campaign messages. In Mailbach, E. and Parrot, R. (eds), Designing Health Messages: Approaches from Communication Theory and Public Health Practice. Sage, Thousand Oaks, CA, pp. 145166.
World Cancer Research Fund and American Institute for Cancer Research (1997) Food, Nutrition and the Prevention of Cancer: A Global Perspective. World Cancer Research Fund/American Institute for Cancer Research, Washington, DC.
Received on January 21, 2001; accepted on February 25, 2003
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
S. Chatterjee and A. Price Healthy Living with Persuasive Technologies: Framework, Issues, and Challenges J. Am. Med. Inform. Assoc., March 1, 2009; 16(2): 171 - 178. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. P. Lintonen, A. I. Konu, and D. Seedhouse Information technology in health promotion Health Educ. Res., June 1, 2008; 23(3): 560 - 566. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Thompson, T. Baranowski, K. Cullen, K. Watson, A. Canada, R. Bhatt, Y. Liu, and I. Zakeri Food, Fun and Fitness Internet program for girls: influencing log-on rate Health Educ. Res., April 1, 2008; 23(2): 228 - 237. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. W. Verheijden, M. P. Jans, and V. H. Hildebrandt Web-Based Tailored Lifestyle Programs: Exploration of the Target Group's Interests and Implications for Practice Health Promot Pract, January 1, 2008; 9(1): 82 - 92. [Abstract] [PDF] |
||||
![]() |
A. Lassen, M. Bruselius-Jensen, H. M. Sommer, A. V. Thorsen, and E. Trolle Factors influencing participation rates and employees' attitudes toward promoting healthy eating at blue-collar worksites Health Educ. Res., October 1, 2007; 22(5): 727 - 736. [Full Text] [PDF] |
||||
![]() |
H. Spittaels, I De Bourdeaudhuij, J Brug, and C Vandelanotte Effectiveness of an online computer-tailored physical activity intervention in a real-life setting Health Educ. Res., June 1, 2007; 22(3): 385 - 396. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Spittaels and I. De Bourdeaudhuij Implementation of an online tailored physical activity intervention for adults in Belgium Health Promot. Int., December 1, 2006; 21(4): 311 - 319. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||





