Research Design Issues for Evaluating Complex Multicomponent Interventions in Neighborhoods and Communities References

  1. Biglan, A., Brennan, P. A., Foster, S. L., & Holder, H. D. (2004). Multi-problem youth: Prevention, intervention, and treatment. New York: Guilford.
  2. Biglan, A., & Promise Neighborhoods Research Consortium. (2010). The evaluation and research infrastruction for comprehensive prevention. Available online here.
  3. National Research Council, & Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington, DC: The National Academy Press.
  4. Cohen, D. A., Farley, T. A., & Mason, K. (2003). Why is poverty unhealthy? Social and physical mediators. Social Science & Medicine, 57, 1631-1641.
  5. Sampson, R. J., Morenoff, J. D., & Gannon-Rowley, T. (2002). Assessing Neighborhood Effects: Social Processes and New Directions in Research. Annual review of sociology, 28, 443-478.
  6. Tough, P. (2009). Whatever it takes: Geoffrey Canada's quest to change Harlem and America. New York: Houghton-Mifflin.
  7. Biglan, A., Flay, B. R., & Embry, D. D. (Under review). Nurturing environments and the next generation of prevention research.
  8. Biglan, A., & Hinds, E. (2009). Evolving Prosocial and Sustainable Neighborhoods and Communities. Annual Review of Clinical Psychology, 5, 169-196.
  9. Komro, K. A., Biglan, A., Flay, B. R., & Promise Neighborhoods Research Consortium. (2011). Creating nurturing environments: a science-based framework for promoting child health and development within high-poverty neighborhoods. Clinical Child and Family Psychology Review, in press.
  10. Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). New York: Guilford.
  11. Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11, 75-113.
  12. Weitzman, B. C., Mijanovich, T., Silver, D., & Brecher, C. (2009). Finding the impact in a messy intervention: Using an integrated design to evaluate a comprehensive citywide health initiative. American Journal of Evaluation, 30, 495-514.
  13. Flay, B. R. (1986). Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Preventive Medicine, 15, 451-474.
  14. Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S. et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151-175. doi: DOI 10.1007/s11121-005-5553-y
  15. Chen, H. T. (2010). The bottom-up approach to integrative validity: A new perspective for program evaluation. Evaluation and Program Planning, 33, 205-214.
  16. Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G. et al.. (2009). A pragmatic-explanatory continuum indicator summary (PRÉCIS): A tool to help trial designers. Canadian Medical Association Journal, 180, E47-E57.
  17. Institute of Medicine, & National Research Council. (2010). Strategic approach to the evaluation of programs implemented under the Tom Lantos and Henry J. Hyde U.S. Global Leadership Against HIV/AIDS, Tuberculosis, and Malaria Reauthorization Act of 2008. Washington, DC: The National Academies Press.
  18. Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11, 193-221.
  19. Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: the RE-AIM framework. American Journal of Public Health, 89, 1322.
  20. Kam, C. M., Greenberg, M. T., & Walls, C. T. (2003). Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prevention Science, 4, 55-63.
  21. Rogers, P. J., Petrosino, A., Huebner, T. A., & Hacsi, T. A. (2000). Program theory evaluation: Practice, promise, and problems. New Directions for Evaluation, 5-13.
  22. Hallfors, D., Cho, H., Sanchez, V., Khatapoush, S., Kim, H.M., & Bauer, D. (2006). Efficacy vs effectiveness trial results of an indicated 'model' substance abuse program: Implications for public health. American Journal of Public Health, 96, 2254-2259.
  23. Dobbie, W., & Fryer Jr, R. G. (2009). Are high quality schools enough to close the achievement gap? Evidence from a social experiment in Harlem. Boston: Harvard University Press.
  24. COMMIT Research Group. (1995). Community intervention trial for smoking cessation (COMMIT): I. Cohort results from a four-year community intervention. American Journal of Public Health, 85, 183-192.
  25. National Cancer Institute. (2005). ASSIST: shaping the future of tobacco prevention and control. Tobacco Control Monograph. Washington, DC: U.S. Department of Health and Human Services, National Institutes of Health, National Cancer Institute.
  26. Flay, B. R., Graumlich, S., Segawa, E., Burns, J. L., Holliday, M. Y., & Aban Aya Investigators. (2004). Effects of 2 prevention programs on high-risk behaviors among African American youth - A randomized trial. Archives of Pediatrics & Adolescent Medicine, 158, 377-384.
  27. Redmond, C., Spoth, R. L., Shin, C., Schainker, L. M., Greenberg, M. T., & Feinberg, M. (2009). Long-term protective factor outcomes of evidence-based interventions implemented by community teams through a community/university partnership. The Journal of Primary Prevention, 30, 513-530.
  28. Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics and Adolescent Medicine, 163, 789-798.
  29. Prinz, R. J., Sanders, M. R., Shapiro, C. J., Whitaker, D. J., & Lutzker, J. R. (2009). Population-based prevention of child maltreatment: The US Triple P system population trial. Prevention Science, 10, 1-12.
  30. Cook, T. D., Shadish, W. R., & Wong, V. C. (2008). Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management, 27, 724-750.
  31. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin.
  32. West, S., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D., Holtgrave, D., et al. (2008). Alternatives to the randomized controlled trial. American Journal of Public Health, 98, 1359-1365.
  33. Schochet, P., Cook, T. D., Deke, J., Imbens, G. W., Lockwood, J. R., Porter, J., et al. (2010). Standards for regression discontinuity designs. Princeton, NJ: What Works Clearinghouse. Available here.
  34. Vaughn, S., Wanzek, J., Murray, C.S., Scammacca, N., Linan-Thompson, S., & Woodruff, A.L. (2009). Response to early reading intervention: Examining higher and lower responders. Exceptional Children, 75, 165-183.
  35. Berwick, D. M. (1991). Controlling variation in health care: A consultation from Walter Shewhart. Medical Care, 29, 1212-1225.
  36. Ogata, K. (2010). Modern control engineering (5th ed.). New Jersey: Prentice Hall.
  37. Shewhart, W. A. (1952). The application of statistics as an aid in mantaining quality of a manufactured product. Journal of the American Statistical Association, 20, 546-548.
  38. Olmstead, E. H., & James, M. D. (1952). Claude Bernard and the experimental method in medicine. New York: Henry Schumann.
  39. Kazdin, A. E. (2001). Behavior modification in applied settings (6th edition). Stamford, CT: Wadworth/Thomson.
  40. Sidman, M. (1960). Tactics of scientific research. New York: Basic Books.
  41. Baker, S. K., & Baker, D. L. (2008). English learners and response to intervention: Improving quality of instruction in general and special education. In E. L. Grigorenko (Ed.), Educating individuals with disabilities: IDEA 2004 and beyond (249-273). New York: Springer.
  42. Wagenaar, A. C., Maldonado-Molina, M. M., Ma, L., Tobler, A. L., & Komro, K. A. (2007). Effects of legal BAC limits on fatal crash involvement: Analyses of 28 states from 1976 through 2002. Journal of Safety Research, 38, 493-499.
  43. Wagenaar, A. C., Maldonado-Molina, M. M., & Wagenaar, B. H. (2009). Effects of alcohol tax increases on alcohol-related disease mortality in Alaska: Time-series analyses from 1976 to 2004. American Journal of Public Health, 99, 1464-1470.
  44. Biglan, A., Ary, D. V., & Wagenaar, A. C. (2000). The value of interrupted time-series experiments for community intervention research. Prevention Research, 1, 31-49.
  45. Box, G., & Jenkins, G. (1970). Time series analysis: Forecasting and control. San Francisco, CA: Holden-Day.
  46. Gordon, R. A., & Heinrich, C. J. (2004). Modeling trajectories in social program outcomes for performance accountability. American Journal of Evaluation, 25, 161-189.
  47. Baer, D.M., Wolf, M.M., & Risley, T.R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 91-97.
  48. Barlow, D. H., & Herson, M. (1984). Single case experimental designs: Strategies for studying behavior change (2nd ed.). Needham Heights, MA: Allyn & Bacon.
  49. Roussos, S. T., & Fawcett, S. B. (2000). A review of collaborative partnerships as a strategy for improving community health. Annual Review of Public Health, 21, 369-402.
  50. Biglan, A., Ary, D. V., Smolkowski, K., Duncan, T., & Black, C. (2000). A randomised controlled trial of a community intervention to prevent adolescent tobacco use. Tobacco Control, 9, 24-32.
  51. Barlow, D.H., Nock, M.K., & Hersen, M. (2008). Single case experimental designs: Strategies for studying behavior change (3rd ed.). Boston: Allyn & Bacon.
  52. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M. et al. (2010). Single-case designs technical documentation. Princeton, NJ: What Works Clearinghouse. Available here.
  53. Shadish, W. R., & Rindskopf, D. M. (2007). Methods for evidence-based practice: Quantitative synthesis of single-subject designs. New Directions for Evaluation, 95-109.
  54. Wagenaar, A. C., & Maldonado-Molina, M. M. (2007). Effects of drivers' license suspension policies on alcohol-related crash involvement: long-term follow-up in forty-six states. Alcoholism: Clinical and Experimental Research, 31, 1399-1406.
  55. Brown, C. H., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P. et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74-S104.
  56. Rivera, D. E., Pew, M. D., & Collins, L. M. (2007). Using engineering control principles to inform the design of adaptive interventions: A conceptual introduction. Drug and Alcohol Dependence, 88, S31-S40.
  57. Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19, 531.
  58. Forgatch, M. S., & Patterson, G. R. (Eds.). (2010). Parent Management Training – Oregon Model: An intervention for antisocial behavior in children and adolescents. New York: Guilford.
  59. Forgatch, M. S., Patterson, G. R., Degarmo, D. S., & Beldavs, Z. G. (2009). Testing the Oregon delinquency model with 9-year follow-up of the Oregon Divorce Study. Development and Psychopathology, 21, 637-660.
  60. Blaine, T. M., Forster, J. L., Hennrikus, D., O'Neil, S., Wolfson, M., & Pham, H. (1997). Creating tobacco control policy at the local level: implementation of a direct action organizing approach. Health Education & Behavior, 24, 640.
  61. Bosma, L. M., Komro, K. A., Perry, C. L., Mortenson, S. V., & Farbakhsh, K. (2005). Community organizing to prevent youth drug use and violence. Journal of Community Practice, 13, 5-19.
  62. Komro, K. A., Perry, C. L., Veblen-Mortenson, S., Farbakhsh, K., Toomey, T. L., Stigler, M. H. et al. (2008). Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction, 103, 606-618.
  63. Wagenaar, A. C., Erickson, D. J., Harwood, E. M., & O'Malley, P. M. (2006). Effects of state coalitions to reduce underage drinking: A national evaluation. American Journal of Preventive Medicine, 31, 307-315.
  64. Wagenaar, A. C., & Perry, C. L. (1994). Community strategies for the reduction of youth drinking: theory and application. Journal of Research on Adolescence, 4, 319-345.
  65. Brody, G. H., Murry, V. M., Kogan, S. M., Gerrard, M., Gibbons, F. X., Molgaard, V., et al. (2006). The Strong African American Families Program: A cluster-randomized prevention trial of long-term effects and a mediational model. Journal of Consulting and Clinical Psychology, 74, 356-366.
  66. Spoth, R., Randall, G. K., Shin, C., & Redmond, C. (2005). Randomized study of combined universal family and school preventive interventions: patterns of long-term effects on initiation, regular use, and weekly drunkenness. Psychology of Addictive Behaviors, 19, 372-381.
  67. Mrazek, P. J., Biglan, A., & Hawkins, J. D. (2004). Community monitoring systems: Tracking and improving the well-being of America’s children and adolescents. Falls Church, VA: Society for Prevention Research. Available here.