Skip Navigation

This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow E-letters: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when E-letters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (12)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Pankratz, M.
Right arrow Articles by Cho, H.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Pankratz, M.
Right arrow Articles by Cho, H.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Health Education Research, Vol. 17, No. 3, 315-326, June 2002
© 2002 Oxford University Press

Measuring perceptions of innovation adoption: the diffusion of a federal drug prevention policy

M. Pankratz, D. Hallfors1 and H. Cho1

Department of Health Behavior and Health Education, and 1 Department of Maternal and Child Health, School of Public Health, Rosenau Hall, University of North Carolina, Chapel Hill, NC 27599, USA


    Abstract
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 References
 
The purpose of this paper is to describe the testing of a new scale to assess the perceived attributes of a federal drug prevention policy. The 17-item scale was administered to 107 Safe and Drug Free Schools (SDFS) coordinators in 12 states as a part of a larger investigation examining the diffusion of a federal drug prevention policy. In developing this scale, the authors drew from theory, previously validated measures, expert review and pre-testing with SDFS coordinators. Factor analysis revealed three underlying constructs representing relative advantage/compatibility, complexity and observability. The constructs found were internally consistent with a Cronbach's {alpha} ranging from a high of 0.89 for relative advantage/compatibility to a low of 0.71 for observability. Each of these constructs was correlated with a district's adoption of the policy in predictable ways. The construct of relative advantage/compatibility appears to be especially useful in assessing policy adoption. This scale was developed to assess a specific innovation; however, we believe that it can be easily adapted to understand the adoption of other health education interventions.


    Introduction
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 References
 
As health education research has advanced it has become increasingly clear that there is a gap between what is known through research and what is done in practice (Parcel et al., 1989Go; Johnson et al., 1996Go; Nutbeam, 1996aGo,bGo; Brownson and Simoes, 1999Go; Arthur and Blitz, 2000Go; Learmonth, 2000Go). For example, within the realm of substance use prevention, several curricula have demonstrated the ability to produce behavioral outcomes, yet most of the substance use prevention curricula available and used in schools have either been proven ineffective or have not been evaluated (Hansen, 1992Go; Dusenbury et al., 1997Go; Silvia et al., 1997Go). If we are to diminish this gap, it is important to know not only why and how interventions work, but also how to encourage the adoption of effective interventions in practice.

Diffusion of innovation theory provides a useful framework for studying the adoption process. Diffusion studies have found that the way targeted adopters perceive the attributes of an innovation is critical and that these perceptions account for 49–87% of the variance in whether or not they adopt (Rogers, 1995Go). Perceived attributes of an innovation include:

  • Relative advantage—the degree to which an innovation is perceived as better than the idea it supersedes (p. 250). The higher the perceived relative advantage, the more likely the innovation will be adopted.
  • Compatibility—the degree to which an innovation is perceived as consistent with the existing values, past experiences and needs of potential adopters (p. 250). If the innovation is perceived as an extreme change, then it will not be compatible with past experiences and is less likely to be adopted.
  • Complexity—the degree to which an innovation is perceived as relatively difficult to understand and use (p. 250). Innovations that are perceived as complex are less likely to be adopted.
  • Observability—the degree to which the results of an innovation are visible to others (p. 251). If the observed effects are perceived to be small or non-existent, then the likelihood of adoption is reduced.
  • Trialability—the degree to which an innovation may be experimented with on a limited basis (p. 251). This may include trying out parts of a program or having the opportunity to watch others using a new program. Trialability is positively related to the likelihood of adoption.

This paper describes the testing of a new scale to assess the perceived attributes of a particular innovation, the Principles of Effectiveness. The Principles comprise a new federal policy which requires school districts, and other recipients of Safe and Drug Free Schools (SDFS) funds, to: (1) conduct a thorough assessment of the nature and extent of youth drug use and violence problems; (2) establish a set of measurable goals and objectives; (3) design and implement their programs for youth based on research or evaluation that provides evidence that the programs used prevent or reduce drug use, violence or disruptive behavior; and (4) evaluate their programs to refine, improve and strengthen them (Department of Education, 1998aGo). The Principles of Effectiveness were promulgated by the US Department of Education on 1 July 1998 and are designed to ensure that limited resources are used in the most effective way possible. Currently, the SDFS program provides funds for prevention and education to nearly every school district in the nation (Hantman and Crosse, 2000Go); however, school districts risk losing funding if they do not adopt the Principles of Effectiveness.

Despite the importance of innovation perception in adoption decision making, we found few measurement instruments in the public health research literature. This is not surprising since less than 1% of articles from 12 leading public health and health promotion journals were categorized as diffusion research (Oldenburg et al., 1999Go). Even among those studies classified as diffusion research, many have not addressed the perceived attributes of an innovation. Even fewer have assessed the diffusion of policy. We developed the current scale with items largely adapted from the diffusion research conducted by Brink et al. (Brink et al., 1995Go), Steckler et al. (Steckler et al., 1992Go), and Moore and Benbasat (Moore and Benbasat, 1991Go). Brink and Steckler's work focused on the diffusion of tobacco prevention curricula, while Moore and Benbasat focused on the adoption of information technology. Our goal was to develop a scale for measuring SDFS coordinator's perceptions about the Principles of Effectiveness, but we also believe that this scale can be adapted to measure the perceived attributes of other health education interventions.

There are at least two important uses for this type of scale. The first use is to determine the perceived attributes of a program before it is developed. With this information, a program developer could modify a program being developed so that it would be more likely to diffuse into practice. The second use is to determine the perceived attributes after the program is developed. With this information, those marketing the program could determine the most effective dissemination strategies. In doing this, they may choose to highlight attributes people perceive positively or to develop messages to improve perceptions that were negative. This can advance the field of health education by (1) developing new programs that are more easily diffused into widespread practice and (2) developing marketing strategies to diffuse effective programs based upon known predictors of program adoption.


    Method
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 References
 
Data were collected as a part of a multi-year study examining the diffusion of a new federal SDFS policy that requires school districts, and other recipients of SDFS funds, to adopt the Principles of Effectiveness. The overall study uses diffusion of innovation theory to evaluate the adoption of the Principles of Effectiveness. It includes two waves of district-level SDFS coordinator survey data.

The first survey was conducted in the fall of 1999 and focused on variables that have been found to affect the rate of adoption, including perceived attributes of the innovation, the type of innovation decision, the nature of the communication channels, extent of the change agents' promotion efforts and the nature of the social system. It also measured practices that related to the Principles of Effectiveness (e.g. programs implemented, evaluation activities completed), as well as indicators that sites are actively planning to adopt the Principles of Effectiveness.

The second survey contains items used to score the school district on the degree and quality of their adoption of the Principles of the Effectiveness. The present analysis uses data from these surveys to test whether the perception items are conceptually and internally consistent and whether they can predict adoption as would be expected theoretically.

Sample selection
SDFS coordinators were selected from two samples. In both cases, the district was selected and the SDFS coordinator was identified as the district respondent. The first was a convenience sample of SDFS coordinators from 104 school districts. These school districts were chosen because they resided in one of 60 communities designated as a Fighting Back (Saxe et al., 1997Go), Community Partnership (Kaftarian and Hansen, 1994Go) or national evaluation comparison site (for either project) in 12 states across the US. School districts had been previously contacted for archived school survey data for a meta-analysis to assess the effects of school- and community-based prevention, but few had actually participated in the community intervention beyond a peripheral role. Of these, 81 (78%) completed wave I, and 67 (64%) completed both wave I and wave II. The second sample includes a saturation sample of all 117 public school districts in North Carolina. Of these, 101 (86%) completed wave I, and 86 (74%) completed both wave I and wave II. Seven school districts were a part of both samples; therefore, there were 214 school districts total. One hundred seventy-five (82%) SDFS coordinators completed wave I, and 146 (68%) completed both wave I and wave II. The combined study sample had a higher proportion of large districts and urban districts than found in the nation overall (Department of Education, 1997–1998Go, 1999Go); however, school districts responding to the survey did not differ from non-respondents on either district size or urbanicity. Twenty-three percent of school districts completing both wave I and wave II were small (less than 2500 students), 40% were midsize (2500–10 000 students) and 38% were large (more than 10 000 students). In terms of urbanicity, 44% of responding school districts were rural, 30% were suburban and 26% were urban.

Each SDFS coordinator completing the wave I survey was asked whether they had received written or verbal information about the Principles of Effectiveness. Coordinators that had received information about the Principles at wave I completed additional questions regarding their perceptions of this policy. This paper reports data from the 107 SDFS coordinators who completed both surveys and reported receiving information about the Principles at wave I. The proportion of respondents who had received information about the Principles was similar for each of the two samples. Overall, larger districts and more urbanized districts were more likely to report that they had received information about the Principles. Eighteen percent of districts that reported receiving information about the Principles were small (less than 2500 students), 37% were midsize (2500–10 000 students) and 45% were large (more than 10 000 students). In terms of urbanicity, 38% of districts reporting receipt of information about the Principles were rural, 29% were suburban and 33% were urban.

Data collection procedures
All data were collected via a self-administered, mail questionnaire. SDFS coordinators were sent a pre-notification letter informing them of the study and requesting their participation. Approximately 10 days later, SDFS coordinators were mailed the questionnaire. The questionnaire mailing included a cover letter and pre-addressed, postage-paid envelope for returning the questionnaire. As an incentive, the national sample received a US$20 check with the questionnaire mailing and the North Carolina sample received a letter from the state SDFS director encouraging their participation. Two weeks after the first questionnaire mailing, SDFS coordinators were sent a postcard that both requested the participation of respondents that had not returned their questionnaire and thanked respondents that had returned the questionnaire. As a final attempt to reach non-respondents, we telephoned non-respondents to request that they complete the survey. When necessary, an additional questionnaire was mailed to the SDFS coordinator. All mailings were addressed to the SDFS coordinator by name, had a handwritten signature and used first class postage. The premise behind this methodology was that multiple contacts and personalization of contacts significantly increases mail survey response rates (Dillman, 2000Go). Similar data collection methods were used for wave I and wave II.

Measurement
Perceived attributes of the Principles of Effectiveness
The items for this scale were derived from previous diffusion research. Before writing items, instruments were collected from Steckler (Steckler, 1992), Brink (Brink, 1995), and Moore and Benbasat (Moore and Benbasat, 1991Go) as they contained examples of how the five perceived attributes (i.e. relative advantage, compatibility, complexity, observability and trialability) of an innovation could be operationalized. They were written using a Likert scale that ranged from 1 = `Strongly Disagree' to 5 = `Strongly Agree' and were intended to include at least two items for each attribute. Experts in diffusion research and substance use prevention then reviewed items. Those with expertise in diffusion research were asked to assess the degree to which individual items measured the intended attributes. Those with expertise in substance use prevention were familiar with both the respondents and the policy being assessed, and were asked to review items for accuracy in depicting the policy and relevancy to respondents. Based upon these reviews, the primary change made was to restate items so that they included both positive and negative direction. The survey was then pilot tested by using cognitive response interviews with SDFS coordinators outside of the study sample. Meeting one-on-one with a respondent, cognitive response interviews use a variety of techniques to ensure that questions are being interpreted and answered as intended (Sudman et al., 1996Go). After the cognitive response interviews were completed, eight items were dropped from the scale and minor changes were made to make them more conceptually relevant to SDFS coordinators. For example, the item `Using the Principles of Effectiveness will ensure that I continue to receive SDFS funding', was changed to `My school district will lose SDFS funding if we do not use the Principles of Effectiveness' after finding out SDFS coordinators were not able to answer the question as it was originally framed. The items used to form the perceived attributes scale used in this investigation are shown in Table IGo. For the analyses, all items were coded so that a score of five favored adoption. The perceived attributes of an innovation were measured at wave I.


View this table:
[in this window]
[in a new window]
 
Table I. Items for the perceived attributes of the Principles of Effectivenessa
 
Adoption of the Principles of Effectiveness
Eight items were used to measure adoption of the Principles of Effectiveness. They were derived from requirements set forth in Nonregulatory Guidance for Implementing the SDFSCA Principles of Effectiveness (Department of Education, 1998bGo). Respondents were asked, `which, if any of the following changes have been made to your substance use prevention program because of the Principles of Effectiveness?'. Items included:
  1. Conducted a needs assessment.
  2. Collected objective data for our needs assessment.
  3. Set goals and objectives so that we could measure progress towards achieving them.
  4. Chose our goals and objectives based upon needs assessment data.
  5. Looked at research when deciding upon new strategies for substance use prevention.
  6. Adopted new strategies because they were research-based.
  7. Dropped programs that did not have research evidence of their effectiveness.
  8. Conducted an evaluation of our program.

Response options included `Did before Principles enacted', `Changed because of the Principles' and `Have not done'. For the analyses, these items were dummy coded with the first two response options indicating adoption of the Principles and the third option indicating non-adoption. Items were then summed to create an overall score for adoption of the Principles of Effectiveness. Adoption of the Principles of Effectiveness was measured at Wave II.

Analyses
Perceived attributes
First, inter-item correlations, means and standard deviations were calculated for each item. Second, the perceived attributes items were factor analyzed to determine if the items clustered as expected by diffusion of innovation theory, thereby assessing factorial validity. For this factor analysis, the principal components method was used with two types of rotations. The first, a varimax rotation, is the most commonly used rotation in factor analyses. Second, a promax rotation was used to confirm the earlier findings. A promax rotation is designed to take into account the intercorrelated nature of many scales. Scree plots and eigenvalues were examined to ensure that resulting constructs were more explanatory than a single item. From the factor analysis results, three constructs were identified and a Cronbach's {alpha} was computed for each of the resulting constructs. This is a form of reliability assessment in that in determines if the items were measuring the same thing (Singleton et al., 1993Go).

Adoption of the Principles of Effectiveness
Measures of the perceived attributes of the Principles of Effectiveness were analyzed in relationship to adoption of the Principles. Analyses were conducted using the Pearson correlation coefficient, which allowed us to see the association between perceptions about the Principles and adoption of the Principles. This was done to assess construct validity: the stronger the correlation, the greater the validity of the scale being tested (Singleton et al., 1993Go).

All analyses were conducted using SAS 6.12.


    Results
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 References
 
Correlations and means of perceived attributes items
Correlations between the 17 items designed to assess the perceived attributes of the Principles of Effectiveness were computed (see Table IIGo). In general, items from within each construct had higher inter-item correlations than correlations between items from different constructs. For ease in comparisons, correlations are arranged by the constructs identified in the factor analysis described below.


View this table:
[in this window]
[in a new window]
 
Table II. Correlation matrix for the perceived attributes of the Principles of Effectiveness (n = 107)
 
Overall, perceptions regarding the Principles of Effectiveness were favorable towards adoption of the policy. Of the 17 items presented, all but two mean scores were either favorable or neutral towards adoption of the Principles of Effectiveness (see Table IIGo). The highest mean scores were found for items assessing relative advantage/compatibility. Moderate mean scores were found for the items assessing complexity and observability.

Factor analysis of perceived attributes items
The 17 items designed to assess the perceived attributes of the Principles of Effectiveness were subjected to a principle component factor analysis with a varimax rotation and a promax rotation. Results were similar for both rotations; therefore, only the varimax results are presented. Overall, items loaded within the intended constructs; however, there were three exceptions. First, three items (F, G and K) were eliminated from the factor analyses. Item F was eliminated because it loaded on the first factor, but did not belong conceptually with other items in that factor. After item F was removed, a four-factor solution resulted. The fourth factor (items G and K) had a poor internal inconsistency ({alpha} = 31) and its items were eliminated. Removal of these items resulted in a three-factor solution (see Table IIIGo). Second, the items created to assess relative advantage and compatibility loaded on the same factor, rather than as two distinct factors. Third, an item designed to assess compatibility (item C) and an item designed to assess relative advantage (item O) loaded on the same factor as the items designed to assess complexity.


View this table:
[in this window]
[in a new window]
 
Table III. Factor analysis (varimax rotation) of the perceived attributes items (n = 107)
 
The resulting factors appeared to be conceptually meaningful with the first factor encompassing items designed to assess relative advantage and compatibility (eight items), the second complexity (four items) and the third observability (two items). Cronbach's {alpha}s for the first and second factors were high (0.89 and 0.81, respectively), and for the third factor was moderate (0.71).

Correlations between perceived attributes and adoption of the Principles of Effectiveness
Table IVGo shows the correlations between the perceived attributes of the Principles of Effectiveness and adoption of the Principles. All correlations were in the expected direction and were significant at the P < 0.05 level. The strongest relationship with adoption of the Principles of Effectiveness was with relative advantage/compatibility (r = 0.312), followed by complexity (r = 248) and then observability (r = 0.239). Thus when coordinators perceived greater relative advantage/compatibility, less complexity or more observability, they were also likely to more fully adopt the Principles of Effectiveness. Adoption scores ranged from 0 to 8, with a mean of 6.8. Cronbach's {alpha} for this measure was 0.85.


View this table:
[in this window]
[in a new window]
 
Table IV. Correlations between perceived attributes of the Principles of Effectiveness and adoption of the Principles of Effectiveness (n = 107)
 

    Discussion
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 References
 
This paper describes a new scale to assess the perceived attributes of an innovation. Our findings suggest that the scale had several desirable properties: (1) it generally supports the idea of distinct constructs within innovation perceptions, (2) findings confirm the expected association between innovation perception and innovation adoption, and (3) it demonstrates that the perceived attributes of an innovation are potentially useful in studying policy adoption, as well as other types of innovation adoption.

Factor analysis revealed three, rather than the expected five, underlying constructs. Within this factor structure, the intended constructs of relative advantage and compatibility clustered into one factor, indicating that two distinct constructs were not found in this study. This finding is consistent with the work of Halloway who found no clear distinction between relative advantage and compatibility in his work with school principals (Halloway, 1977Go). Moreover, Rogers has noted that each construct is `somewhat empirically interrelated with the other four' (Rogers, 1995Go). At least one prior study combined all of the perceived attributes items into one index of favorability towards adoption since all the perceptions items were found to be moderately inter-related (Scheirer, 1990Go). In contrast, Goldman (Goldman, 1994Go) found that not only were each of the five constructs distinct, but that compatibility actually factored into two constructs: compatibility with organizational experience and compatibility with organizational needs. Because relatively few studies have used factor analytic methods to assess the perceived attributes, additional research is recommended to determine if these are five distinct constructs and, if so, to more precisely define the measurement of each.

The construct of relative advantage/compatibility appears to be especially strong in this study. Relative advantage, which addresses both the costs and benefits of adoption, has proven to be one of the best predictors of innovation adoption (Rogers, 1995Go). Within health education, relative advantage has been a significant predictor of adoption for a variety of interventions including a pediatric asthma management protocol (Mesters and Meertens, 1999Go), a tobacco curricula, (Brink et al., 1995Go; Parcel et al., 1995Go) and a nationwide campaign to improve prenatal care (Goldman, 1994Go). In each of these cases, the adopter is an organization, and organizations are likely to be motivated by perceived advantages such as improved job performance, increased quality of programs and increased likelihood of securing additional funds. For reasons such as these, relative advantage is likely to continue to be strongly associated with innovation adoption at the organizational level. The items used to assess relative advantage/ compatibility in this study were positively associated with adoption, internally consistent and could easily be adapted to examine the adoption of other health education interventions.

An important issue to consider in this study is that the innovation being studied is a policy with financial incentives for the targeted adopters. This is likely to be a strong incentive for policy adoption and, in fact, most districts had at least partially adopted the Principles of Effectiveness. Nonetheless, it is important to monitor not just the adoption of the Principles, but also the quality of adoption. Previous research has shown that incentives encourage adoption by those who normally would not adopt and can decrease the quality of adoption (Rogers, 1995Go). We believe that relative advantage is likely to be an even better predictor of adoption for innovations that do not have financial incentives.

As stated previously, the perceived attributes of compatibility and relative advantage appear to be one construct in this study. There are several potential reasons for this. First, it is possible that when thinking about the Principles, prevention coordinators first think about the changes they have to make and then think about the advantages for making those changes within their district. In this case, the two attributes are intertwined and prevention coordinators do not think about compatibility without also thinking about relative advantage. Second, it is possible that prevention coordinators believe that they will not have to make major changes in their prevention program in order to comply with the Principles. This may be accurate based upon communications with the state education agency or it may be inaccurate due to a simplistic view of the challenges involved in adopting the Principles. Third, prevention coordinators may not fully understand the requirements of the Principles of Effectiveness. For example, many coordinators have a limited understanding of what constitutes a research-based program and do not define research-based program in a way that is consistent with the Principles of Effectiveness (Hantman and Crosse, 2000Go). Furthermore, many curricula marketers promote a curriculum as research-based, even when there is no credible evidence of its effectiveness (Hallfors and Sporer, 2001Go). In this case, coordinators may believe that what they are doing is research-based, thereby creating the perception that the policy is compatible with current practices. Fourth, if all three items intended to assess compatibility loaded on the same construct, compatibility and relative advantage might have appeared as two distinct constructs; however, one compatibility item loaded with complexity items and two loaded with relative advantage items. When looking at the way the compatibility items split, it was clear that items assessing preferred working styles (i.e. items A and B) factored with relative advantage and that the item assessing the magnitude of changes required (i.e. item C) factored with complexity items. Although, compatibility was not a distinct construct in this study, this concept was important in understanding the adoption of the Principles. After determining that two of compatibility items factored with the relative advantage items, we conducted a sensitivity test to determine if these items (i.e. A and B) were predictive as a separate construct. In each case, when the items intended to assess compatibility were examined in relationship to adoption of the Principles, the relationship was significant.

Complexity also appears to be an important predictor of adoption in this study. Districts that perceived greater complexity were less likely to indicate that they had fully adopted the Principles of Effectiveness. This has been true for other health education studies as well. For example, Goldman (Goldman, 1994Go) found that, not only was complexity a significant predictor of adoption, but that it was the greatest predictor of adoption in her study of a nationwide campaign to improve prenatal care. It has also been found that perceived complexity was the greatest deterrent to adopting patient information sheets among pharmacists (Ascione et al., 1987Go). The items used to assess complexity in this study were associated with adoption, internally consistent and could easily be adapted to examine the adoption of other health education interventions.

The construct of observability was also an important predictor of adoption in this study. When coordinators perceived that teachers and parents would notice changes upon implementing the Principles of Effectiveness, they were more likely to fully adopt the Principles. Observability has not always been significantly associated with adoption in health education. In fact, the only other health education study found in which observability was an important predictor of adoption was Goldman's study of a nationwide campaign to improve prenatal care (Goldman, 1994Go). In that case, respondents were asked about the observability of prenatal care in relationship to birth outcomes, which, similar to policy, may be more readily observable than many prevention outcomes. We believe that construct of observability will be an important predictor for programs that provide very tangible outcomes. The items used to assess observability in this study were associated with adoption, moderately internally consistent and could be easily adapted to other health education interventions.

The innovation studied, the Principles of Effectiveness, is a somewhat more complicated innovation than those typically studied in diffusion research. The Principles are a cluster of inter-related innovations designed to be adopted sequentially. This is a new process for most school districts and it is one that requires a great deal of skill. The Principles are also being enacted at a time when most school districts are receiving fewer federal SDFS dollars then in previous years, thereby making it even more complicated (and less attractive) for districts to fully adopt the policy. Despite these challenges, the perceived attributes of relative advantage/compatibility, complexity and observability appear to be useful in determining adoption of the Principles of Effectiveness. This is important because it shows that the perceived attributes can be used to explain not only the adoption of simple, one-time innovations, but also the adoption of multi-component, long-term innovations.

The items intended to assess trialability were weak and did not produce a useable construct in this study. Trialability is rarely mentioned in the results of public health research. This may be because trialability variables are not often significant in health education research or that that it is a difficult construct to measure, particularly when assessing a process. We believe that trialability might be more useful construct when examining more concrete interventions. In the case of the Principles of Effectiveness, coordinators were asked about four discrete activities (i.e. needs assessment, setting goals and objectives, implementing programs that have been proven effective, and evaluation) as if they were one innovation; however, coordinators may perceive them differently. In many cases, coordinators follow the requirements of the state SDFS application process and may not even think about whether or not they can try out the Principles. In this case, coordinators are simply following the steps necessary to get funding and the SDFS application is typically the way states monitor compliance with policy. It is recommended that further exploratory work be done to assess items measuring trialability.

Although we believe our findings support earlier theoretical work showing the importance of perceptions in adoption decisions, there are a few limitations that should be considered. First, although the scale was effective in the present study, researchers will need to adapt items for their particular study. As with most other diffusion research, this scale was specific to the innovation studied. Because this was a school-based innovation, it will probably be easiest for those interested in school-based research to adapt these measures. Additional exploratory research will need to be done to develop appropriate items for trialability. Second, this sample is not nationally representative and one state is over-represented. State education agencies serve as the primary change agent for the diffusion of the Principles of Effectiveness and there is substantial variation in the dissemination strategies used by each state (Hallfors, 2001Go). This is not surprising, given that others have also found wide variation in how states interpret and disseminate information to the local level (McCormick and Tompkins, 1998Go). Despite this limitation, both samples had a similar proportion of coordinators who had received information about the policy, and the association between the perceived attributes and adoption remained when the over-represented state was removed from the analysis. Additionally, neither size nor urbanicity was significantly associated with adoption among coordinators who had received information about the Principles. Third, we relied on a relatively simple measure of adoption, in that coordinators indicated whether they had completed each of eight activities. We were concerned that this measure overestimated adoption of the Principles of Effectiveness; therefore, we examined correlations between the perceived attributes and a more complex measure of adoption. In each case, the perceived attributes were significantly associated with the more complex measure of adoption.

Despite these limitations, this study has important implications for health education practice. Consistent with earlier findings, we found that there is an association between perceptions and adoption. We believe that this scale could be modified to help others assess the perceived attributes of an innovation, and then to use that information to develop programs with the potential for widespread dissemination and to determine social marketing strategies for programs that have already been proven efficacious. For example, these results reveal that compatibility and relative advantage are strongly associated with adoption. Program developers may want to ask potential users what type of program they are currently using or what could be done to research-based programs to increase the advantages associated with using them. Social marketers may then choose to demonstrate the ways in which a new program is similar to those currently being used or to highlight the advantages of the new program. In either case, knowing about and assessing the perceived attributes of an innovation can be used to help close the gap between what is known by research and what is done in practice.


    Acknowledgments
 
The paper was prepared as a part of an ongoing study being conducted by the Department of Maternal and Child Health, School of Public Health, University of North Carolina at Chapel Hill. The Robert Wood Johnson Foundation Substance Abuse Policy Research Program, and the North Carolina Governor's Institute on Alcohol and Substance Abuse Public Policy Scholars Program supported the study. An earlier version of this paper was presented at the Society for Prevention Research Annual Meeting, Montreal, Canada, 1–3 June 2000.


    References
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 References
 
Arthur, M. W. and Blitz, C. (2000) Bridging the gap between science and practice in drug abuse prevention through needs assessment and strategic community planning. Journal of Community Psychology, 28, 241–255.[Web of Science]

Ascione, F. J., Kirking, D. M., Wenzloff, N. J., Foley, T. A. and Kwok, D. K. (1987) Effect of innovation characteristics on pharmacists' use of written medication information. Patient Education and Counseling, 9, 53–64.[Web of Science][Medline]

Brink, S. G., Basen-Engquist, K. M., O' Hara-Tompkins, N. M., Parcel, G. S., Gottlieb, N. H. and Lovato, C. Y. (1995) Diffusion of an effective tobacco prevention program: I. Evaluation of the dissemination phase. Health Education Research, 10, 283–295.[Abstract/Free Full Text]

Brownson, R. C. and Simoes, E. J. (1999) Measuring the impact of prevention research on public health practice. American Journal of Preventive Medicine, 72, 3S.

Department of Education (1997–98) Common Core of Data, Agency Universe. Department of Education, National Center for Education Statistics, Office of Educational and Research Improvement, Washington, DC.

Department of Education (1998a) Notice of final Principles of Effectiveness. Federal Register, 63, 29902–29906.

Department of Education (1998b) Nonregulatory Guidance for Implementing the SDFSCA Principles of Effectiveness. Department of Education, Office of Elementary and Secondary Education, Safe and Drug-Free Schools Program, Washington, DC.

Department of Education (1999) Overview of the Public Elementary and Secondary Schools and Districts: School Year 1997–1998. NCES 99-322. Department of Education, National Center for Education Statistics, Office of Educational and Research Improvement, Washington, DC.

Dillman, D. A. (2000) Mail and Internet Surveys: The Tailored Design Method, 2nd edn. Wiley, New York.

Dusenbury, L., Falco, M. and Lake, A. (1997) A review of the evaluation of 47 drug abuse prevention curricula available nationally. Journal of School Health, 67, 127–132.

Goldman, K. D. (1994) Perceptions of innovations as predictors of implementation levels: the diffusion of a nationwide health education campaign. Health Education Quarterly, 21, 433–445.[Medline]

Hallfors, D. (2001) Can policy bring research to practice? An evaluation of the Principles of Effectiveness. Paper presented at the Society for Prevention Research Annual Meeting, Washington, DC.

Hallfors, D. and Sporer, A. (2001) Update 2: A Consumer's Guide to Effective Prevention Programs. California Department of Education, Sacramento, CA.

Halloway, R. E. (1977) Perceptions of innovations: Syracuse University's Project Advance. Dissertation, Syracuse University, Syracuse, NY.

Hansen, W. B. (1992) School-based substance abuse prevention: a review of the state of the art in curriculum, 1980–1990. Health Education Research, 7, 403–430.[Abstract/Free Full Text]

Hantman, I. and Crosse, S. (2000) Progress in Prevention: Report on the National Study of the Study of Local Education Agency Activities under the Safe and Drug Free Schools and Community Act. Department of Education, Office of the Under Secretary, Planning and Evaluation Service, Washington, DC.

Johnson, J. L., Green, L. W., Frankish, C. J., MacLean, D. R. and Stachenko, S. (1996) A dissemination research agenda to strengthen health promotion and disease prevention. Canadian Journal of Public Health, 87 (Suppl. 2), S5–S10.

Kaftarian, S. J. and Hansen, W. B. (1994) Improving methodologies for the evaluation of community-based substance abuse prevention programs. Journal of Community Psychology, CSAP Special Issue, 3–5.

Learmonth, A. M. (2000) Utilizing research in practice and generating evidence from practice. Health Education Research, 15, 743–756.[Abstract/Free Full Text]

McCormick, L. and Tompkins, N. O. H. (1998) Diffusion of CDC's guidelines to prevent tobacco use and addiction. Journal of School Health, 68, 43–45.

Mesters, I. and Meertens, R. M. (1999) Monitoring the dissemination of an educational protocol on pediatric asthma in family practice: a test of associations between dissemination variables. Health Education and Behavior, 26, 103–120.[Abstract/Free Full Text]

Moore, G. C. and Benbasat, I. (1991) Development of an instrument to measure the perception of adopting an information technology innovation. Information Systems Research, 2, 192–222.[Abstract/Free Full Text]

Nutbeam, D. (1996a) Achieving `best practice' in health promotion: improving the fit between research and practice. Health Education Research, 11, 317–326.[Abstract/Free Full Text]

Nutbeam, D. (1996b) Improving the fit between research and practice in health promotion: overcoming structural barriers. Canadian Journal of Public Health, 87, S18–S23.

Oldenburg, B. F., Sallis, J. F., Ffrench, M. L. and Owen, N. (1999) Health promotion research and the diffusion and institutionalization of interventions. Health Education Research, 14, 121–130.[Abstract/Free Full Text]

Parcel, G., Taylor, W. C., Brink, S. G., Gottlieb, N., Enguist, K., O'Hara, N. M. and Eriksen, M. (1989) Translating theory into practice: intervention strategies for the diffusion of a health promotion innovation. Family and Community Health, 12, 1–13.[Medline]

Parcel, G. S., O' Hara Tompkins, N. M., Harrist, R. B., Basen-Engquist, K. M., McCormick, L. K., Gottlieb, N. H. and Ericksen, M. P. (1995) Diffusion of an effective tobacco prevention program. Part II: evaluation of the adoption phase. Health Education Research, 10, 297–307.[Abstract/Free Full Text]

Rogers, E. M. (1995) Diffusion of Innovations, 4th edn. Free Press, New York.

Saxe, L., Reber, E., Hallfors, D., Kadushin, C., Jones, D., Rindskopf, D. and Beveridge, A. (1997) Think globally, act locally: assessing the impact of community-based substance abuse prevention. Evaluation and Program Planning, 20, 357–366.

Scheirer, M. A. (1990) The life cycle of an innovation: adoption versus discontinuation of the Fluoride Mouth Rinse Program in schools. Journal of Health and Social Behavior, 31, 203–215.[Web of Science][Medline]

Silvia, E. S., Thorne, J. and Tashjian, C. A. (1997) School-based Drug Prevention Programs: A Longitudinal Study in Selected School Districts. Research Triangle Institute, Research Triangle Park, NC.

Singleton, R. A., Jr, Straits, B. C. and Straits, M. M. (1993) Measurement. In Singleton, R. A. Jr., Straits, B. C. and Straits, M. M. (eds), Approaches to Social Research, 2nd edn. Oxford University Press, New York, pp. 100–135.

Steckler, A., Goodman, R. M., McLeroy, K. R., Davis, S. and Koch, G. (1992) Measuring the diffusion of innovative health promotion programs. American Journal of Health Promotion, 6, 214–224.[Medline]

Sudman, S., Bradburn, N. and Schwarz, N. (1996) Thinking about Answers: The Application of Cognitive Processes to Survey Methodology. Jossey-Bass, San Francisco, CA.

Received on February 13, 2001; accepted on May 3, 2001


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
Health Educ ResHome page
S. Thaker, A. Steckler, V. Sanchez, S. Khatapoush, J. Rose, and D. D. Hallfors
Program characteristics and organizational factors affecting the implementation of a school-based indicated prevention program
Health Educ. Res., April 1, 2008; 23(2): 238 - 248.
[Abstract] [Full Text] [PDF]


Home page
Eval Health ProfHome page
L. A. Rohrbach, R. Grana, S. Sussman, and T. W. Valente
Type II Translation: Transporting Prevention Interventions From Research to Real-World Settings
Eval Health Prof, September 1, 2006; 29(3): 302 - 333.
[Abstract] [PDF]


Home page
Health Educ ResHome page
M. C. White, J. P. Tulsky, E. Menendez, S. Arai, J. Goldenson, and L. M. Kawamura
Improving tuberculosis therapy completion after jail: translation of research to practice
Health Educ. Res., April 1, 2005; 20(2): 163 - 174.
[Abstract] [Full Text] [PDF]


Home page
Youth Violence and Juvenile JusticeHome page
S. F. Mihalic and K. Irwin
Blueprints for Violence Prevention: From Research to Real-World Settings--Factors Influencing the Successful Replication of Model Programs
Youth Violence and Juvenile Justice, October 1, 2003; 1(4): 307 - 329.
[Abstract] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow E-letters: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when E-letters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (12)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Pankratz, M.
Right arrow Articles by Cho, H.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Pankratz, M.
Right arrow Articles by Cho, H.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?