Abstract
Recent research advances have focused on the use of evidence-based practices to improve academic and behavior support in schools (Hoagwood, 2004; Walker, 2004). Simultaneously, education policy has advocated for strategies that will allow implementation of these practices on a meaningful scale (Adelman & Taylor, 2003; Elias, Zins, Graczyk, & Weissburg, 2003; Mihalic & Irwin, 2003). These complementary efforts are shaping an agenda for transforming research to practice by training typical school personnel to provide efficient and effective interventions. The effectiveness of these practices is measured in part not only by immediate effects but also by sustained effects (Adelman & Taylor, 2003), and some have argued that the widespread use of practices is only significant to the extent that these practices are sustained (Coburn, 2003; McLaughlin & Mitra, 2001). Therefore, if comprehensive school reform is to occur, researchers must make efforts to ensure that implemented practices are both effective and sustainable.
Sustainability may be defined as durable, long-term implementation of a practice at a level of fidelity that continues to produce valued outcomes (Han & Weiss, 2005). In practical, school-level terms, sustainability is the creation of a social norm, the point at which a practice ceases to be a project or initiative and becomes institutionalized. Descriptions of certain practices by personnel as “what we've always done” or “the way we do business” are an indication that these practices are being sustained (Rogers, 2003), at least at the present moment. Such comments may also indicate that the process becomes easier to continue than it was to initiate.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Adelman, H. S., & Taylor, L. (1997). Addressing barriers to learning: Beyond school-linked services and full service schools.American Journal of Orthopsychiatry,67, 408–421
Adelman, H. S., & Taylor, L. (2003). On sustainability of project innovations as systemic change.Journal of Educational and Psychological Consultation,14, 1–25
Albin, R. W., Lucyshyn, J. M., Horner, R. H., & Flannery, K. B. (1996). Contextual fit for behavioral support plans: A model for “goodness of fit.” In L. K. Koegel, R. L. Koegel, & G. Dunlap (Eds.),Positive behavioral support: Including people with difficult behavior in the community(pp. 81–98). Baltimore: Brookes
August, G. J., Lee, S. S., Bloomquist, M. L., Realmuto, G. M., & Hektner, J. M. (2004). Maintenance effects of an evidence-based prevention innovation for aggressive children living in culturally diverse urban neighborhoods: The Early Risers effectiveness study.Journal of Emotional and Behavioral Disorders,12, 194–205
Barrett, S. B., Bradshaw, C., & Lewis-Palmer, T. L. (2008). Maryland statewide Positive Behavior Interventions and Supports Initiative: Systems, evaluation, and next steps.Journal of Positive Behavior Interventions,10, 105–114
Benz, M. R., Lindstrom, L., Unruh, D., & Waintrup, M. (2004). Sustaining secondary transition programs in local schools.Remedial and Special Education,25, 39–50
Bernfield, G. A., Blase, K. A., & Fixsen, D. L. (1990). Toward a unified perspective on human service delivery systems: Application of the teaching-family model. In R. J. McMahon & R. D. Peters (Eds.),Behavior disorders of adolescence: Research, intervention, and policy in clinical and school settings(pp. 191–205). New York: Plenum Press
Biglan, A. (1995). Translating what we know about the context of antisocial behavior into a lower prevalence of such behavior.Journal of Applied Behavior Analysis,28, 479–492
Blase, K. A., & Fixsen, D. L. (2004).Infrastructure for implementing and sustaining evidence-based programs with fidelity. Tampa, FL: National Implementation Research Network
Brass, C. T., Nunez-Neto, B., & Williams, E. D. (2006).Congress and program evaluation: An overview of randomized controlled trials (RCTs) and related issues. Washington, DC: Congressional Research Service, Library of Congress. Congressional Research Service Order Code RL 33301
Carter, D. R., & Horner, R. H. (2007). Adding functional behavioral assessment to First Step to Success: A case study.Journal of Positive Behavior Interventions. 9, 229– 238
Center for Mental Health in Schools. (2001).Sustaining school-community partnerships to enhance outcomes for children and youth: A guidebook and tool kit. Los Angeles: Center for Mental Health in Schools at UCLA
Center on Positive Behavioral Interventions and Supports. (2004).School-wide positive behavior support implementers' blueprint and self-assessment. Eugene: University of Oregon. Available at http://www.pbis.org/tools.htm
Cherniss, C. (2006).School change and the microsociety program. Thousand Oaks, CA: Corwin Press
Coburn, C. E. (2003). Rethinking scale: Moving beyond numbers to deep and lasting change.Educational Researcher,32(6), 3–12
Colvin, G., Kame'enui, E. J., & Sugai, G. (1993). Reconceptualizing behavior management and school-wide discipline in general education,Education and Treatment of Children,16, 361–381
Comer, J. P., Ben-Avie, M., Haynes, N. M., & Joyner, E. T. (Eds.). (1999).Child by child: The Comer process for change in education. New York: Teachers College Press
Datnow, A., & Castellano, M. (2000). Teachers' responses to Success for All: How beliefs, experiences, and adaptations shape implementation.American Educational Research Journal,37, 775–799
Deno, S. L. (1995). School psychologist as problem solver. In A. Thomas & J. P. Grimes (Eds.),Best practices in school psychology III(pp. 471–484). Bethesda, MD: National Association of School Psychologists
Doolittle, J. H. (2006).Sustainability of positive behavior supports in schools. Unpublished doctoral dissertation, University of Oregon
Eber, L. (2006).Illinois PBIS evaluation report. LaGrange Park, IL: Illinois State Board of Education, PBIS/EBD Network
Elias, M. J., Zins, J. E., Graczyk, P. A., & Weissburg, R. P. (2003). Implementation, sus-tainability, and scaling up of social-emotional and academic innovations in public schools.School Psychology Review,32, 303–319
Elliott, S. N., Kratochwill, T. R., & Roach, A. T. (2003). Commentary: Implementing social-emotional and academic innovations: Reflections, reactions, and research.School Psychology Review,32, 320–326
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005).Implementation research: Synthesis of the literature. Tampa, FL: National Implementation Research Network
Fullan, M. (2005).Leadership and sustainability. Thousand Oaks, CA: Corwin Press
Furney, K. S., Hasazi, S. B., Clark-Keefe, K., & Hartnett, J. (2003). A longitudinal analysis of shifting policy landscapes in special and general education reform.Exceptional Children,70(1), 81–94
Gager, P. J., & Elias, M. J. (1997). Implementing prevention programs in high-risk environments: Application of the resiliency paradigm.American Journal of Orthopsy-chiatry,67, 363–373
Gersten, R., Chard, D. J., & Baker, S. (2000). Factors enhancing sustained use of research-based instructional practices.Journal of Learning Disabilities,33, 445–457
Gray, S. W. (1963).The psychologist in the schools. New York: Holt, Rhinehart, & Wilson
Greenberg, M. T., Weissburg, R. P., & O'Brien, M. E. (2003). Enhancing school-based prevention and youth development through coordinated social, emotional, and academic learning.American Psychologist,58, 466–474
Greenwood, C. R., Delquadri, J., & Bulgren, J. (1993). Current challenges to behavioral technology in the reform of schooling: Large-scale, high-quality implementation and sustained use of effective educational practices.Education and T reatment of Children,16, 401–404
Greenwood, C. R., Tapia, Y., Abbott, M., & Walton, C. (2003). A building-based case study of evidence-based literacy practices: Implementation, reading behavior, and growth in reading fluency, K–4.Journal of Special Education,37, 95–110
Gresham, F. M., Sugai, G., & Horner, R. H. (2001). Interpreting outcomes of social skills training for students with high-incidence disabilities.Exceptional Children,67, 331–344
Han, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs.Journal of Abnormal Child Psychology,33, 665–679
Hanley, T. V. (2003). Commentary: Scaling up social-emotional and academic supports for all students, including students with disabilities.School Psychology Review,32, 327–330
Hatch, T. (2000). What does it take to break the mold? Rhetoric and reality in new American schools.Teachers College Record,102, 561–589
Hedges, L. V. (2007). Meta-analysis. In C. R. Rao & S. Sinbaray (Eds.),The handbook of statistics(Vol. 26, pp. 919–953). New York: Elsevier Scientific
Hinshaw, S. P., Klein, R. G., & Abikoff, H. B. (2002). Childhood attention-deficit hyper-activity disorder: Nonpharmalogical treatments and their combination with medication. In P. E. Nathan & J. M. Gorman (Eds.),A guide to treatments that work(2nd ed., pp. 3–23). New York: Oxford University Press
Hoagwood, K. (2004). Evidence-based practice in child and adolescent mental health: Its meaning, application and limitations.Emotional and Behavioral Disorders in Youth,4, 7–8
Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., et al. (in press). A randomized, controlled trial assessing school-wide positive behavior support in elementary schools.Journal of Positive Behavior Interventions
Horner, R. H., Sugai, G., Todd, A. W., & Lewis-Palmer, T. (2005). School-wide positive behavior support. In L. Bambara & L. Kern (Eds.),Individualized supports for students with problem behaviors: Designing positive behavior plans(pp. 359–390). New York: Guilford Press
Horner, R. H., Todd, A. W., Lewis-Palmer, T., Irvin, L. K., Sugai, G., & Boland, J. B. (2004). The School-wide Evaluation Tool (SET): A research instrument for assessing school-wide positive behavior support.Journal of Positive Behavior Interventions,6, 3–12
Huberman, A. M. (1983). School improvement strategies that work: Some scenarios.Educational Leadership,43, 23–27
Ikeda, M. J., Grimes, J. P., Tilly, W. D., Allison, S., Kurns, S., & Stumme, J. (2002). Implementing an intervention-based approach to service delivery: A case example. In M. R. Shinn, H. M. Walker, & G. Stoner (Eds.),Interventions for academic and behavioral problems II: Preventive and remedial approaches(pp. 53–69). Bethesda, MD: National Association of School Psychologists
Irvin, L. K., Horner, R. H., Ingram, K., Todd, A. W., Sugai, G., Sampson, N. K., et al. (2006). Using office discipline referral data for decision making about student behavior in elementary and middle schools: An empirical evaluation of validity.Journal of Positive Behavior Interventions,8, 10–23
Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., & Vincent, C. G. (2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions.Journal of Positive Behavior Interventions,6, 131–147
Kealey, K. A., Peterson, A. V., Gaul, M. A., & Dinh, K. T. (2000). Teacher training as a behavior change process: Principles and results from a longitudinal study.Health Education and Behavior,27, 64–81
Kellam, S. G., Mayer, L. S., Rebok, G. W., & Hawkins, W. E. (1998). Effects of improving achievement on aggressive behavior and of improving aggressive behavior on achievement through two preventive interventions: An investigation of causal paths. In B. P. Dohrenwend (Ed.),Adversity, stress, and psychopathology(pp. 486–505). London: Oxford University Press
Klingner, J. K., Arguelles, M. E., Hughes, M. T., & Vaughn, S. (2001). Examining the school-wide “spread” of research-based practices.Learning Disability Quarterly,24, 221–234
Kratochwill, T. R. (2002). Evidence-based interventions in school psychology: Thoughts on thoughtful commentary.School Psychology Quarterly,17, 518–532
Kratochwill, T. R., & Shernoff, E. S. (2004). Evidence-based practice: Promoting evidence-based interventions in school psychology.School Psychology Review,33, 34–48
Latham, G. (1988). The birth and death cycles of educational innovations.Principal,68, 41–43
Lewis, T. J., & Sugai, G. (1999). Effective behavior support: A systems approach to proactive schoolwide management.Focus on Exceptional Children,31, 1–24
Lucyshyn, J. M., Albin, R. A., Horner, R. H., Mann, J. C., Mann, J. A., & Wadsworth, G. (2007). Family implementation of positive behavior support with a child with Autism: A longitudinal, single case experimental and descriptive replication and extension.Journal of Positive Behavior Interventions,9, 131–150
Mass-Galloway, R. L., Panyon, M. V., Smith, C. R., & Wessendord, S. (2008). Systems change with school-wide positive behavior support: Iowa's work in progress.Journal of Positive Behavior Interventions.10, 129–135
May, S., Ard, W. I., Todd, A. W., Horner, R. H., Glasgow, A., Sugai, G., et al. (2006).School-wide information system. Eugene: Educational and Community Supports, University of Oregon
Mayer, G. R. (1995). Preventing antisocial behavior in the schools.Journal of Applied Behavior Analysis,28, 467–478
McIntosh, K., Reinke, W. M., & Herman, K. E. (in press). School-wide analysis of data for social behavior problems: Assessing outcomes, selecting targets for intervention, and indentifying need for support. In R. A. Ervin, G. Peacock, E. J. Daly & K. W. Merrell (Eds.),The practical handbook of school psychology, New York: Guilford
McLaughlin, M. W., & Mitra, D. (2001). Theory-based change and change-based theory: Going deeper, going broader.Journal of Educational Change,2, 301–323
Merrell, K. W., & Buchanan, R. S. (2006). Intervention selection in school-based practice: Using public health models to enhance systems capacity of schools.School Psychology Review,35, 167–180
Mihalic, S. F., & Irwin, K. (2003). Blueprints for violence prevention: From research to real-world settings—Factors influencing the successful replication of model programs.Youth Violence and Juvenile Justice,1, 307–329
Muscott, H., Mann, E.L. & LeBrun, M. (2008). Positive Behavioral Interventions and Supports in New Hampshire: Effects of large-scale implementation of Schoolwide Positive Behavior Support on student discipline and academic achievement.Journal of Positive Behavior Interventions,10, 190–205
Nelson, J. R. (1996). Designing schools to meet the needs of students who exhibit disruptive behavior.Journal of Emotional and Behavioral Disorders,4, 147–161
Nelson, J. R., Martella, R. M., & Marchand-Martella, N. (2002). Maximizing student learning: The effects of a comprehensive school-based program for preventing problem behaviors.Journal of Emotional and Behavioral Disorders,10, 136–148
Newton, J. S. (2008).Toward a technology of sustainable positive behavior support. Manuscript in preparation
NIMH Intervention Workgroup. (2001, November).An integrated framework for preventive and treatment interventions. Paper presented at the National Institute of Mental Health workgroup meeting, Washington, DC
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., et al. (2005). Treatment implementation following behavioral consultation in schools: A comparison of three follow-up strategies.School Psychology Review,34, 87–106
Riley, D. A. (1997). Using local research to change 100 communities for children and families.American Psychologist,52, 424–433
Rogers, E. (2003).Diffusion of innovations(5th ed.). New York: Free Press
Sadler, C. (2004, March).Sustaining PBS. Paper presented at the Second Annual Oregon Statewide Positive Behavior Support Conference, Corvallis
Sarason, S. B. (2004). What we need to know about intervention and interventionists.American Journal of Community Psychology,33, 275–277
Sindelar, P. T., Shearer, D. K., Yendol-Hoppey, D., & Liebert, T. W. (2006). The sustain-ability of inclusive school reform.Exceptional Children,72, 317–331
Stokes, L. M., Sato, N. E., McLaughlin, M. W., & Talbert, J. E. (1997).Theory-based reform and problems of change: Contexts that matter for teachers' learning and community. Palo Alto, CA: Stanford University
Sugai, G., & Horner, R. H. (2005). School-wide positive behavior supports: Achieving and sustaining effective learning environments for all students. In W. H. Heward(Ed.),Focus on behavior analysis in education: Achievements, challenges, and opportunities(pp. 90–102). Upper Saddle River, NJ: Pearson Prentice-Hall
Sugai, G., & Horner, R. H. (2006). A promising approach for expanding and sustaining the implementation of school-wide positive behavior support.School Psychology Review,35, 245–259
Sugai, G., Horner, R. H., Dunlap, G., Hieneman, M., Lewis, T. J., Nelson, C. M., et al. (2000). Applying positive behavior support and functional behavioral assessment in schools.Journal of Positive Behavior Interventions,2, 131–143
Sugai, G., Horner, R. H., & Lewis-Palmer, T. L. (2001).Team Implementation Checklist (TIC). Eugene, OR: Educational and Community Supports. Available at http:// www.pbis.org
Sugai, G., Lewis-Palmer, T. L., Todd, A. W., & Horner, R. H. (2001).School-wide Evaluation Tool (SET). Eugene, OR: Educational and Community Supports. Available at http://www.pbis.org
Sugai, G., Sprague, J. R., Horner, R. H., & Walker, H. M. (2000). Preventing school violence: The use of office discipline referrals to assess and monitor school-wide discipline interventions.Journal of Emotional and Behavioral Disorders,8, 94–101
Sulzer-Azaroff, B., & Mayer, G. R. (1994).Achieving educational excellence: Behavior analysis for achieving classroom and schoolwide behavior change. San Marcos, CA: Western Image
Taylor-Greene, S., Brown, D., Nelson, L., Longton, J., Gassman, T., Cohen, J., et al. (1997). School-wide behavioral support: Starting the year off rightJournal of Behavioral Education,7, 99–112
Taylor-Greene, S., & Kartoub, D. T. (2000). Durable implementation of school-wide behavior support: The High Five Program.Journal of Positive Behavior Interventions,2, 233–235
Tobin, T. J., Sugai, G., & Colvin, G. (1996). Patterns in middle school discipline records.Journal of Emotional and Behavioral Disorders,4, 82–94
Togneri, W., & Anderson, S. E. (2003).Beyond islands of excellence: What districts can do to improve instruction and achievement in all schools. Washington, DC: Learning First Alliance
Vaughn, S., Klingner, J., & Hughes, M. (2000). Sustainability of research-based practices.Exceptional Children,66, 163–171
Walker, H. M. (2004). Commentary: Use of evidence-based intervention in schools: Where we've been, where we are, and where we need to go.School Psychology Review,33, 398–407
Walker, H. M., Ramsey, E., & Gresham, F. M. (2005).Antisocial behavior in school: Strategies and best practices(2nd ed.). Pacific Grove, CA: Brooks/Cole
Waterhouse, T., & Chapman, D. (2006).Effective behavior support and school-wide discipline: A review of implementation and sustainability in BC schools. Abbotsford, BC: Institute for Safe Schools of British Columbia
Wolf, M. M. (1978). Social validity: The case for subjective measurement, or how behavior analysis is finding its heart.Journal of Applied Behavior Analysis,11, 203–214
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer Science + Business Media B.V
About this chapter
Cite this chapter
McIntosh, K., Horner, R.H., Sugai, G. (2009). Sustainability of Systems-Level Evidence-Based Practices in Schools: Current Knowledge and Future Directions. In: Sailor, W., Dunlap, G., Sugai, G., Horner, R. (eds) Handbook of Positive Behavior Support. Issues in Clinical Child Psychology. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09632-2_14
Download citation
DOI: https://doi.org/10.1007/978-0-387-09632-2_14
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09631-5
Online ISBN: 978-0-387-09632-2
eBook Packages: Behavioral ScienceBehavioral Science and Psychology (R0)