Health Education Research, Vol. 15, No. 1, 109-116,
February 2000
© 2000 Oxford University Press
Short Communication |
Promising community-level indicators for evaluating cardiovascular health-promotion programs
Department of Health Services, University of Washington, Seattle, WA 98195,
1 Division of Chronic Disease Control and Community Intervention, Centers for Disease Control, Atlanta, GA 30341, and
2 Work Group on Health Promotion and Community Development, University of Kansas, Lawrence, KS 66045, USA
| Abstract |
|---|
|
|
|---|
Rigorous evaluation of community-based programs can be costly, particularly when a representative sample of all members of the community are surveyed in order to assess the impact of a program on individual health behavior. Community-level indicators (CLIs), which are based on observations of aspects of the community other than those associated with individuals, may serve to supplement individual-level measures in the evaluation of community-based programs or in some cases provide a lower-cost alternative to individual-level measures. Because they are often based on observations of the community environment, CLIs also provide a way of measuring environmental changesoften an intermediate goal of community-based programs. The Centers for Disease Control and Prevention convened a panel of experts knowledgeable about community-based program evaluation and cardiovascular disease (CVD) prevention to develop a list of CLIs, and rate their feasibility, reliability and validity. The indicators developed by the panel covered tobacco use, physical activity, diet and a fourth group that were considered `cross-cutting' because they related to all three behaviors. The indicators were subdivided into policy and regulation, information, environmental change, and behavioral outcome. For example, policy and regulation indicators included laws and ordinances on tobacco use, policies on physical education, and guidelines for menu and food preparation. These indicators provide a good starting point for communities interested in tracking CVD-related outcomes at the community level.
| Introduction |
|---|
|
|
|---|
Community-based approaches to health promotion and disease prevention have become increasingly popular and are believed to offer an effective strategy for addressing many health problems, including cardiovascular disease (CVD) and cancer (Farquhar et al., 1977
Rigorous evaluation of community-based programs can be costly, particularly when a representative sample of all members of the community are surveyed in order to assess the impact of a program on individual health behavior. In multi-community trials, survey costs can approach or even exceed the intervention budget. We have previously suggested that `environmental' or `community-level' indicators (CLIs) might serve to supplement individual-level measures in the evaluation of community-based programs or in some cases provide a lower-cost alternative to individual-level measures (Cheadle et al., 1992
; Fawcett et al., 1999). Because they are often based on observations of the community environment, CLIs also provide a way of measuring environmental changesoften an intermediate goal of community-based programs (Glanz et al., 1995
; Stokols et al., 1996
). In this context the term `environment' is broadly defined to include aspects of the legal, social, political as well as the physical environment.
CLIs as we have conceptualized them are most easily defined `negatively': they consist of all community measures that are not derived from individual-level information. Examples of individual-level data sources used in constructing community measures include mail and telephone surveys, health insurance claims information, census data, vital records, and disease registries. Examples of CLIs include grocery store shelf-space measures (e.g. percent of shelf space that is low-fat milk) (Cheadle et al., 1990
, 1991
, 1993
, 1995
; Fisher and Strogatz, 1999
) and characteristics of restaurant no-smoking areas (e.g. percent of seating that set aside as non-smoking) (Cheadle et al., 1994
). Given this negative, open-ended definition, there are a potentially very large number of CLIsthe only limiting factor is that they are feasible to collect and yield meaningful (i.e. valid and reliable) measures of an important dimension of community health. In practice, however, since most community-based programs focus on the health and well-being of individuals, most community measures developed to date have been aggregates of individual-level information.
CLIs as we define them are not a new ideathey have been used in a variety of disciplines and specifically in evaluations of other community-based health programs. These previous efforts will be reviewed in more detail in the Discussion below. However, the literature on alternatives to individual-level measures is limited enough that the Centers for Disease Control and Prevention (CDC) deemed it useful to convene a working group with the express purpose of generating indicators that were not based on individual-level characteristics. This paper presents examples of CLIs generated by the CDC working group.
| Methods |
|---|
|
|
|---|
The Community Level Indicators of Cardiovascular Health project was part of an effort to build capacity for evaluation of community-based initiatives to reduce risks for CVD (Elder et al., 1993
The first survey asked panelists to generate potential indicators for the three major behavioral risk factors of CVD: diet, physical inactivity and tobacco use. To guide the selection process, respondents were asked to consider the sectors that would be involved in a community effort (e.g. work sites, schools, religious institutions, health care agencies, public and private agencies) and the strategies that could be employed to promote changes in a community (e.g. information, skill building, policy and regulation, environmental change, and barrier modification).
For the second round, a subset of 15 panelists (nine representing academia and state public health departments; six from CDC) plus about 12 additional participants from CDC attended a 2-day meeting in Atlanta. During this meeting participants reviewed and refined the lists of indicators, added important or missing indicators, and deleted indicators considered unimportant or clearly not feasible. The resulting lists of indicators were then sent to all panelists after the meeting, who were asked to rate the indicators (round three) according to their quality (accuracy, sensitivity, reliability, validity) and feasibility (cost, ease of data collection), as well as to give each indicator an overall, global rating (not necessarily an average of quality and feasibility). The results were then tabulated and a final list, including mean ratings, distributed to all panelists for final comments.
| Results |
|---|
|
|
|---|
In all, 141 separate indicators were generated over the course of the Delphi process and subsequently rated by panelists. Tables IIV
|
|
|
|
The indicators are organized by risk behavior: tobacco use (Table I
We now summarize the indicators shown in Tables IIV![]()
![]()
![]()
. Policy and regulation indicators primarily included laws and ordinances for tobacco use, policies related to physical education (PE) for physical activity, and guidelines for menus and food preparation for diet. No cross-cutting indicators were identified for policy and regulation. Under information indicators, all three health behaviors included `point of purchase' information (in a variety of media), as well as measures of how much information is provided by various health-related professionals. Environmental change indicators for tobacco included limitations on access to tobacco products and availability of no-smoking areas in a variety of settings. Measures for physical activity focused on the availability of facilities; and dietary measures focused on the availability of healthy products. Cross-cutting environmental measures included program availability, screenings and the number of agencies sponsoring CVD-related activities. Behavioral outcome indicators included sales data and observations in stores (e.g. proportion of milk that is of the low-fat variety).
| Discussion |
|---|
|
|
|---|
The CDC assembled a working panel of experts in community-based health promotion evaluation and CVD prevention to generate promising CLIs for use in evaluating community-based CVD programs. CLIs are based on observations of aspects of the community other than those associated with individuals. This paper presented examples of candidate indicators generated by the working group for tobacco use, physical activity, and diet and nutrition. The indicators were grouped in four broad categories: policy and regulation, information, environmental change, and behavioral outcome. Panelists gave overall ratings of the potential usefulness of the indicators as well as separate ratings of their quality and feasibility.
Two features of CLIs make them useful for evaluations of community-based health interventions. First, by avoiding individually based measures, CLIs may be cheaper to collect, e.g. visiting 10 large workplaces or grocery stores rather than surveying 1000 people. In a previous study, we showed that grocery store shelf-space measures could detect community-level changes in dietary indicators (e.g. percent drinking low-fat milk) with roughly the same relative power as individual-level surveys at less than one-tenth of the cost (Cheadle et al., 1990
). Second, CLIs are often derived from aspects of the community environment, which is a target of many community-based interventions and therefore important to measure as an intermediate outcome.
It is useful to place the CLIs in the context of the existing literature. There is a vast literature on social indicators that can be applied to communities, but most of the measurements are made at the individual level and then aggregated to larger geographic units (e.g. cities, counties). Individual-level measures include census information, employment surveys, disease registries, mortality data and health surveys. There are some examples of non-individually based measures, e.g. measures of health system capacity (such as number of hospital beds) (Fitzsimmons and Lavey, 1975
; Carley, 1981
).
Another important strand in the literature related to CLIs are the unobtrusive or non-reactive measures collected and categorized by Webb and Sechrest [see Webb et al., 1966)]. A measure is unobtrusive if the object of interest is unaware that they are being observed. Non-reactive measures do not suffer from the problem of reactivity bias, i.e. the `true' response is not altered by the process of measurement (Sechrest and Phillips, 1979
). All unobtrusive measures are non-reactive, but some non-reactive measures may be highly obtrusive (e.g. blood tests). Unobtrusive measures are used frequently in social psychology because of the high probability of reactivity bias, e.g. in studies of attitudes toward race (Bochner, 1979
). A number of measures reported in the literature are based on characteristics of the community environment [e.g. graffiti (Sechrest and Belew 1983
)] and can therefore meet our definition of CLIs.
Some of the indicators generated by the CDC working group have already been applied in other studies, particularly in the area of environmental and regulatory interventions related to tobacco use. One line of research examined their utility with community coalitions for reducing risks for CVD (Paine-Andrews et al., 1997
). Several studies have profiled the stringency of tobacco-related laws in a state or county (Forster et al., 1992
, 1996
; Kolpien and Lippert, 1995
; Cismoski et al., 1997
; McDermott et al., 1998
). Others have used the stringency of tobacco-related laws to evaluate the effectiveness of environmental interventions related to tobacco (Feighery et al., 1991
; Rogers et al., 1995
; DiFranza et al., 1996
; Elder et al., 1996
). Finally, there have been studies looking at changes in the availability of worksite programs as an indicator of the effectiveness of worksite smoking interventions (Fielding, 1990
; Weisbrod et al., 1991
).
An important limitation of the measures presented in the paper is that they are somewhat sketchy, since the goal of the process was to brainstorm and generate as many indicators as possible, not to try and refine them into operational measures. For example, in Table I
the first indicator listed under `policy and regulation' is `clean air laws for public buildings, restaurants, work sites, etc.'. To create operational measures, the characteristics of clean air laws would need to be further specified, e.g.. indicators for restaurants might include presence of a clean air law related to restaurants (yes/no), stringency of the law (percent of seating required to be set aside), resources devoted to enforcement, number of violators cited and fines collected. Because the actual procedures for making the measures operational were not specified, the ratings of feasibility shown in the tables should be viewed with some skepticism.
The capability of these indicators to usefully track community-level changes can only be assessed by using them in actual program evaluations. The next step in the CDC-organized process is to collaborate with coalitions and other community-based initiatives to implement some of the suggested indicators. A web page has been set up to provide examples of CLIs and assistance for groups interested in using CLIs to track changes in their own communities (http://faculty.washington.edu/cheadle/cli/), as well as a more general resource for community evaluation: the Community Tool Box (http://ctb.lsi.ukans.edu/). CDC staff have been working with a variety of people outside traditional public health disciplines to identify potential CLIs for physical activity. Representatives from transportation, urban design, architecture, environmental protection and other disciplines identified a number of candidate CLIs for walking and bicycling. For instance, housing density, number of sidewalks, street connectivity (pattern of intersection and proximity of trip destinations), access to transit and proximity to walking/bike paths may be useful indicators of the level of walking and biking within a community. Further research is being done to validate these measures and determine their usefulness for program planning and evaluation.
| Acknowledgments |
|---|
This work was supported in part by a grant from the National Cancer Institute (90-2118-06).
| References |
|---|
|
|
|---|
Blackburn, H. (1983) Research and demonstration projects in community cardiovascular disease prevention. Journal of Public Health Policy, 4, 398421.[Medline]
Bochner, S. (1979) Designing field experiments in social psychology. In Sechrest, L. (ed.), Unobtrusive Measurement Today. Jossey-Bass, San Francisco, CA, pp. 3345.
Carley, M. (1981) Social Measurement and Social Indicators: Issues of Policy and Theory. George Allen & Unwin, London.
Cheadle, A., Psaty, B., Wagner, E., Diehr, P., Koepsell, T., Curry, S. and Von Korff, M. (1990) Evaluating community-based nutrition programs: assessing the reliability of a survey of grocery store product displays. American Journal of Public Health, 80, 709711.
Cheadle, A., Psaty, B., Curry, S., Wagner, E., Diehr, P., Koepsell, T. and Kristal, A. (1991) Community-level comparisons between the grocery store environment and individual dietary practices. Preventative Medicine, 20, 250261.[ISI][Medline]
Cheadle, A., Wagner, E., Koepsell, T., Kristal, A. and Patrick, D. (1992) Environmental indicators: a tool for evaluating community-based health-promotion programs. American Journal of Preventative Medicine, 8, 345350.
Cheadle, A., Psaty, B., Curry, S., Wagner, E., Diehr, P., Koepsell, T. and Kristal, A. (1993) Can measures of the grocery store environment be used to track community-level dietary change? Preventative Medicine, 22, 361372.[ISI][Medline]
Cheadle, A., Psaty, B., Curry, S., Wagner, E., Diehr, P., Koepsell, T., Kristal, A. and Patrick, D. (1994) Community-level assessment of the health-promotion environment in restaurants. American Journal of Health Promotion, 9, 8891.[Medline]
Cheadle, A., Psaty, B., Diehr, P., Koepsell, T., Wagner, E., Curry, S. and Kristal, A. (1995) Evaluating community-based nutrition programs: comparing grocery store and individual-level survey measures of program impact. Preventative Medicine, 24, 7179.[ISI][Medline]
Cismoski, J., Sheridan, M. and duLac, F. (1997) Enforcement of minor tobacco laws: Wisconsin, 1996. Wisconsin Medical Journal, 96, 3740.
COMMIT Research Group (1995a) Community Intervention Trial for Smoking Cessation (COMMIT): I. Cohort results from a four-year community intervention. American Journal of Public Health, 85, 183192.
COMMIT Research Group (1995b) Community Intervention Trial for Smoking Cessation (COMMIT): II. Changes in adult cigarette smoking prevalence. American Journal of Public Health, 85, 193200.
Curry, S. J., Wagner, E. H., Cheadle, A., Diehr, P., Koepsell, T., Psaty, B. and McBride, C. (1993) Assessment of community-level influences on individuals' attitudes about cigarette smoking, alcohol use, and consumption of dietary fat. American Journal of Preventative Medicine, 9, 7884.
DiFranza, J. R., Savageau, J. A. and Aisquith, B. F. (1996) Youth access to tobacco: the effects of age, gender, vending machine locks, and `it's the law' programs. American Journal of Public Health, 86, 221224.
Elder, J. P., Schmid, T. L., Dower, P. and Hedlund, S. (1993) Community heart health programs: components, rationale, and strategies for effective interventions. Journal of Public Health Policy, 14, 463479.[Medline]
Elder, J. P., Edwards, C. C., Conway, T. L., Kenney, E., Johnson, C. A. and Bennett, E. D. (1996) Independent evaluation of the California Tobacco Education Program. Public Health Reports, 111, 353358.[ISI][Medline]
Farquhar, J. W., Fortmann, S. P., Flora, J. A., Taylor, C. B., Haskell, W. L., Williams, P. T., Maccoby, N. and Wood, P. D. (1977) Community education for cardiovascular health. Lancet, i, 11921195.
Farquhar, J., Fortmann, S. P., Flora, J. A., et al. (1990) Effects of community-wide education on cardiovascular disease risk factors. Journal of the American Medical Association, 264, 359365.[Abstract]
Fawcett, S. B., Sterling, T. D., Schmid, T. L., Paine-Andrews, A., Harris, K. J., Francisco, V. T., Richter, K. P. and Lewis, R. K. (1995) Evaluating Community Efforts to Prevent Cardiovascular Disease. Centers for Disease Control and Prevention, Atlanta, GA.
Fawcett, S. B, Paine-Andrews, A., Francisco, V. T., Schultz, J., Richter, K. P., Patton, J. B., Fisher, J. L., Lewis, R. K., Lopez, C. M., Russos, S., Williams, M., Harris, K. J. and Evensen, P. (2000) Evaluating community initiatives for health and development. In Rootman, I,, Goodstadt, M., McQueen, D., Potrin, L., Springett, J. and Ziglio, E. (eds), Evaluation of Health Promotion: Principles and Perspectives. WHO, Copenhagen, Denmark, in press.
Feighery, E., Altman, D. G. and Shaffer, G. (1991) The effects of combining education and enforcement to reduce tobacco sales to minors. A study of four northern California communities. Journal of the American Medical Association, 266, 31683171.[Abstract]
Fielding, J. E. (1990) Worksite health promotion survey: smoking control activities. Preventative Medicine, 19, 402413.[ISI][Medline]
Fisher, B. D. and Strogatz, D. (1999) Community measures of low-fat milk consumption: comparing store shelves and households. American Journal of Public Health, in press.
Fitzsimmons, S. J. and Lavey, W. G. (1975) Social Economic Accounts System (SEAS) toward comprehensive community-level assessment procedure. Social Indicators Research, 2, 389452.
Forster, J. L., Hourigan, M. and McGovern, P. (1992) Availability of cigarettes to underage youth in three communities. Preventative Medicine, 21, 320328.[ISI][Medline]
Forster, J. L., Komro, K. A. and Wolfson, M. (1996) Survey of city ordinances and local enforcement regarding commercial availability of tobacco to minors in Minnesota, United States. Tobacco Control, 5, 4651.[Abstract]
Glanz, K., Lankenau, B., Foerster, S., Temple, S., Mullis, R. and Schmid, T. (1995) Environmental and policy approaches to cardiovascular disease prevention through nutrition: opportunities for state and local action. Health Education Quarterly, 22, 512527.[ISI][Medline]
Glasgow, R. E., Terborg, J. R., Hollis, J. F., Severson, H. H. and Boles, S. M. (1995) Take Heart: results from the initial phase of a work-site wellness program. American Journal of Public Health, 85, 209216.
Kolpien, K. A. and Lippert, M. T. (1995) Compliance with Wisconsin Statute 134.66 regulating cigarette vending machines, Wood County, Wisc, 199395. Wisconsin Medical Journal, 94, 621624.[Medline]
Kottke, T. E., Puska, P., Salonen, J. T., Tuomilehto, J. and Nissinen, A. (1985) Projected effects of high-risk versus population-based prevention strategies in coronary heart disease. American Journal of Epidemiology, 121, 697704.
Lando, H. A., Pechacek, T. F., Pirie, P. L., Murray, D. M., Mittelmark, M. B., Lichtenstein, E., Nothwehr, F. and Gray, C. (1995) Changes in adult cigarette smoking in the Minnesota Heart Health Program. American Journal of Public Health, 85, 201208.
McDermott, S. R., Scott, K. L. and Frintner, M. P. (1998) Accessibility of cigarettes to minors in suburban Cook County, Illinois. Journal of Community Health, 23, 153160.[ISI][Medline]
Maccoby, N., Farquhar, J., Wood, P. D. and Alexander, J. (1977) Reducing the risk of cardiovascular disease: effects of a community-based campaign on knowledge and behavior. Journal of Community Health, 3, 100114.[Medline]
Mittelmark, M. B., Luepker, R. V., Jacobs, D. R., Bracht, N. F., Carlaw, R. W., Crow, R. S., Finnegan, J., Grimm, R. H., Jeffery, R. W., Kline, F. G., Mullis, R. M., Murray, D. M., Pechacek, T. F., Perry, C. L., Pirie, P. L. and Blackburn, H. (1986) Community-wide prevention of cardiovascular disease: education strategies of the Minnesota Heart Health Program. Preventative Medicine, 15, 117.[ISI][Medline]
Mittelmark, M. B., Hunt, M. K., Heath, G. W. and Schmid, T. L. (1993) Realistic outcomes: lessons from community-based research and demonstration programs for the prevention of cardiovascular diseases. Journal of Public Health Policy, 14, 463479.
Paine-Andrews, A., Harris, K. J., Fawcett, S. B., Richter, K. P., Lewis, R. K., Francisco, V. T., Johnston, J. and Coen, S. (1997) Evaluating a statewide partnership for reducing risks for chronic diseases. Journal of Community Health, 22, 343359.[ISI][Medline]
Puska, P., Nissinen, A., Tuomilehto, J., Salonen, J. T., Koskela, K., McAlister, A., Kottke, T. E., Maccoby, N. and Farquhar, J. W. (1985) The community-based strategy to prevent coronary heart disease: conclusions from the ten years of the North Karelia project. Annual Review of Public Health, 6, 147193.[ISI][Medline]
Ramirez, A. G. and McAlister, A. L. (1988) Mass media campaignA su salud. Preventative Medicine, 17, 608621.[ISI][Medline]
Rogers, T., Feighery, E. C., Tencati, E. M., Butler, J. L. and Weiner, L. (1995) Community mobilization to reduce point-of-purchase advertising of tobacco products. Health Education Quarterly, 22, 427442.[ISI][Medline]
Rose, G. (1981) Strategy of prevention: lessons from cardiovascular disease. British Medical Journal, 282, 18471851.
Schwartz, R., Smith, C., Speers, M. A., Dusenbury, L. J., Bright, F., Hedlund, S., Wheeler, F. and Schmid, T. L. (1993) Capacity building and resource needs of state health agencies to implement community-based cardiovascular disease programs. Journal of Public Health Policy, 14, 480494.[Medline]
Sechrest, L. and Belew, J. (1983) Nonreactive measures of social attitudes. Applied Social Psychology Annual, 4, 2363.
Sechrest, L. and Phillips, M. (1979) Unobtrusive measures: an overview. In Sechrest, L. (ed.), Unobtrusive Measurement Today. Jossey-Bass, San Francisco, CA, pp. 117.
Shea, S. and Basch, C. E. (1990) A review of five major community-based cardiovascular disease prevention programs. Part I: rationale, design, and theoretical framework. American Journal of Health Promotion, 4, 203213.[Medline]
Stokols, D., Pelletier, K. R. and Fielding, J. E. (1996) The ecology of work and health: research and policy directions for the promotion of employee health. Health Education Quarterly, 23, 137158.[ISI][Medline]
Webb, E. J., Campbell, D. T., Schwartz, R. D. and Sechrest, L. (1966) Unobtrusive Measure: Non-reactive Research in the Social Sciences. Rand McNally & Co., Chicago.
Weisbrod, R. R., Pirie, P. L., Bracht, N. F. and Elstun, P. (1991) Worksite health promotion in four Midwest cities. Journal of Community Health, 16, 169177.[Medline]
Worthen, B. R. and Sanders, J. R. (1987) Educational Evaluation: Alternative Approaches and Practical Guidelines. Longman, New York.
Received on April 2, 1998; accepted on March 23, 1999
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
J. Emery, C. Crump, and M. Hawkins Formative Evaluation of AARP's Active for Life(R) Campaign to Improve Walking and Bicycling Environments in Two Cities Health Promot Pract, October 1, 2007; 8(4): 403 - 414. [Abstract] [PDF] |
||||
![]() |
E. Yorkston, C. Turner, P. J Schluter, and R. McClure Quantifying the effect of a community-based injury prevention program in Queensland using a generalized estimating equation approach Inj. Prev., June 1, 2007; 13(3): 191 - 196. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. C. Goff Jr, L. Brass, L. T. Braun, J. B. Croft, J. D. Flesch, F. G.R. Fowkes, Y. Hong, V. Howard, S. Huston, S. F. Jencks, et al. Essential Features of a Surveillance System to Support the Prevention and Management of Heart Disease and Stroke: A Scientific Statement From the American Heart Association Councils on Epidemiology and Prevention, Stroke, and Cardiovascular Nursing and the Interdisciplinary Working Groups on Quality of Care and Outcomes Research and Atherosclerotic Peripheral Vascular Disease Circulation, January 2, 2007; 115(1): 127 - 155. [Full Text] [PDF] |
||||
![]() |
K. L. Robinson, M. S. Driedger, S. J. Elliott, and J. Eyles Understanding Facilitators of and Barriers to Health Promotion Practice Health Promot Pract, October 1, 2006; 7(4): 467 - 476. [Abstract] [PDF] |
||||
![]() |
M. A. Veazie, J. M. Galloway, D. Matson-Koffman, D. R. LaBarthe, J. N. Brownstein, M. Emr, E. Bolton, E. Freund Jr, R. Fulwood, J. Guyton-Krishnan, et al. Taking the Initiative: Implementing the American Heart Association Guide for Improving Cardiovascular Health at the Community Level: Healthy People 2010 Heart Disease and Stroke Partnership Community Guideline Implementation and Best Practices Workgroup Circulation, October 18, 2005; 112(16): 2538 - 2554. [Full Text] [PDF] |
||||
![]() |
R. C. Brownson, J. J. Chang, A. A. Eyler, B. E. Ainsworth, K. A. Kirtland, B. E. Saelens, and J. F. Sallis Measuring the Environment for Friendliness Toward Physical Activity: A Comparison of the Reliability of 3 Questionnaires Am J Public Health, March 1, 2004; 94(3): 473 - 483. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. K. Brennan, E. A. Baker, D. Haire-Joshu, and R. C. Brownson Linking Perceptions of the Community to Behavior: Are Protective Social Factors Associated with Physical Activity? Health Educ Behav, December 1, 2003; 30(6): 740 - 755. [Abstract] [PDF] |
||||
![]() |
J. J. Librett, M. M. Yore, and T. L. Schmid Local Ordinances That Promote Physical Activity: A Survey of Municipal Policies Am J Public Health, September 1, 2003; 93(9): 1399 - 1403. [Abstract] [Full Text] [PDF] |
||||
![]() |
M A Koelen, L Vaandrager, and C Colomer Health promotion research: dilemmas and challenges J. Epidemiol. Community Health, April 1, 2001; 55(4): 257 - 262. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||





