lynx   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v52y2015icp107-117.html
   My bibliography  Save this article

Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use

Author

Listed:
  • Campbell, Rebecca
  • Townsend, Stephanie M.
  • Shaw, Jessica
  • Karim, Nidal
  • Markowitz, Jenifer
Abstract
In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed.

Suggested Citation

  • Campbell, Rebecca & Townsend, Stephanie M. & Shaw, Jessica & Karim, Nidal & Markowitz, Jenifer, 2015. "Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 107-117.
    • Handle: RePEc:eee:epplan:v:52:y:2015:i:c:p:107-117
    DOI: 10.1016/j.evalprogplan.2015.04.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915000506
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2015.04.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wandersman, Abraham & Imm, Pamela & Chinman, Matthew & Kaftarian, Shakeh, 2000. "Getting to outcomes: a results-based approach to accountability," Evaluation and Program Planning, Elsevier, vol. 23(3), pages 389-395, August.
    2. Burford, Gemma & Velasco, Ismael & Janoušková, Svatava & Zahradnik, Martin & Hak, Tomas & Podger, Dimity & Piggot, Georgia & Harder, Marie K., 2013. "Field trials of a novel toolkit for evaluating ‘intangible’ values-related dimensions of projects," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 1-14.
    3. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rorrer, Audrey S., 2016. "An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 103-111.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    2. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    3. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    4. Gemma Burford & Elona Hoover & Ismael Velasco & Svatava Janoušková & Alicia Jimenez & Georgia Piggot & Dimity Podger & Marie K. Harder, 2013. "Bringing the “Missing Pillar” into Sustainable Development Goals: Towards Intersubjective Values-Based Indicators," Sustainability, MDPI, vol. 5(7), pages 1-25, July.
    5. Kupiec, Tomasz, 2022. "Does evaluation quality matter? Quantitative analysis of the use of evaluation findings in the field of cohesion policy in Poland," Evaluation and Program Planning, Elsevier, vol. 93(C).
    6. Gullickson, Amy M. & King, Jean A. & LaVelle, John M. & Clinton, Janet M., 2019. "The current state of evaluator education: A situation analysis and call to action," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 20-30.
    7. Harman, Elena & Azzam, Tarek, 2018. "Incorporating public values into evaluative criteria: Using crowdsourcing to identify criteria and standards," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 68-82.
    8. Pleasant, Andrew & O’Leary, Catina & Carmona, Richard H., 2020. "Using formative research to tailor a community intervention focused on the prevention of chronic disease," Evaluation and Program Planning, Elsevier, vol. 78(C).
    9. Gagnon, France & Aubry, Tim & Cousins, J. Bradley & Goh, Swee C. & Elliott, Catherine, 2018. "Validation of the evaluation capacity in organizations questionnaire," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 166-175.
    10. Szijarto, Barbara & Milley, Peter & Svensson, Kate & Cousins, J. Bradley, 2018. "On the evaluation of social innovations and social enterprises: Recognizing and integrating two solitudes in the empirical knowledge base," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 20-32.
    11. Neumann, Jan & Robson, Andrew & Sloan, Diane, 2018. "Monitoring and evaluation of strategic change programme implementation—Lessons from a case analysis," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 120-132.
    12. Alemdar, Meltem & Cappelli, Christopher J. & Criswell, Brett A. & Rushton, Gregory T., 2018. "Evaluation of a Noyce program: Development of teacher leaders in STEM education," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 1-11.
    13. L. Shakiyla Smith & Natalie J. Wilkins & Roderick J. McClure, 2021. "A systemic approach to achieving population‐level impact in injury and violence prevention," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(1), pages 21-30, January.
    14. Bourgeois, Isabelle & Whynot, Jane, 2018. "The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 13-18.
    15. McCabe, Lisa A. & Ruberti, Mary R. & Endres, Thomas, 2022. "Sustaining program implementation: A co-constructed technical assistance process to support continuous high-quality implementation of the Therapeutic Crisis Intervention program," Evaluation and Program Planning, Elsevier, vol. 91(C).
    16. Healy, John & Hughes, Jeffrey & Donnelly-Cox, Gemma & Shantz, Amanda, 2024. "A long and winding road: The hard graft of scaling social change in complex systems," Journal of Business Venturing Insights, Elsevier, vol. 21(C).
    17. Kalpazidou Schmidt, Evanthia & Graversen, Ebbe Krogh, 2020. "Developing a conceptual evaluation framework for gender equality interventions in research and innovation," Evaluation and Program Planning, Elsevier, vol. 79(C).
    18. Arasanz, Carla & Nylen, Kirk, 2020. "The theory of change of the evaluation support program: Enhancing the role of community organizations in providing an ecology of care for neurological disorders," Evaluation and Program Planning, Elsevier, vol. 80(C).
    19. Schalock, Robert L. & Lee, Tim & Verdugo, Miguel & Swart, Kees & Claes, Claudia & van Loon, Jos & Lee, Chun-Shin, 2014. "An evidence-based approach to organization evaluation and change in human service organizations evaluation and program planning," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 110-118.
    20. Renger, Ralph & Foltysova, Jirina & Becker, Karin L. & Souvannasacd, Eric, 2015. "The power of the context map: Designing realistic outcome evaluation strategies and other unanticipated benefits," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 118-125.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:52:y:2015:i:c:p:107-117. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.
    Лучший частный хостинг