Evaluation Publications

  • Defining Systems to Evaluate System Efficiency and Effectiveness
    Article focuses on the application of systems thinking, systems theory and systems evaluation theory (SET) in evaluating of modern day systems efficiency and effectiveness.
    Author(s): Renger, R., Foltysova, J., Renger, J., Booze, W.
    Publication: Evaluation Journal of Australasia, 17(3), 4-13
    Date: August 2017
    Type: Journal Article
  • Evaluating System Cascading Failures
    In the article, Renger and coauthors share methods used to evaluate system cascading failures.
    Author(s): Renger, R., Foltysova, J., Ienuso, S., Renger, J., Booze, W.
    Publication: Evaluation Journal of Austalasia, 17(2), 29-36
    Date: June 2017
    Type: Journal Article
  • Being Smart about Writing SMART Objectives
    Article discusses the issues that occur when baseline data is missing when using the mainstream SMART method for developing program objectives. Also offers guidance on delineating between different contexts when using the SMART method.
    Author(s): Bjerke, M., Renger, R.
    Publication: Evaluation and Program Planning, 61, 125-127
    Date: April 2017
    Type: Journal Article
  • An Interprofessional Programme to Culturally Sensitise Students to the Needs of Patients and Realities of Practice in Rural Areas
    The University of North Dakota programme, Students/residents Experiences And Rotations in Community Health (SEARCH), was implemented to address recruitment and retention problems and stereotypes associated with practicing in rural areas.
    Author(s): Schuller, K., Amundson, M., McPherson, M., Halaas, G.
    Publication: Journal of Interprofessional Care, 28, 1-3
    Date: February 2017
    Type: Journal Article
  • Illustrating the Evaluation of System Feedback Mechanisms using System Evaluation Theory (SET)
    This article illustrates how system evaluation theory guided the evaluation of system feedback mechanisms within the cardiac care response systems of seven rural states.
    Author(s): Renger, R.
    Publication: Evaluation Journal of Australasia, 16(4), 14-20
    Date: December 2016
    Type: Journal Article
  • Challenges and Solutions Facing EMS in Supporting the IOM Recommendation for a National Cardiac Arrest Registry: A System Perspective
    This white paper uses systems theory to focus on the feasibility of the Institute of Medicine’s recommendation to support a national cardiac arrest registry.
    Author(s): Renger, R., Qin, X, Rice, D., Foltysova, J., Souvannasacd, E., Renger, J. Markwart, B., Hart, G., Bjerke, M.B.
    Date: September 2016
    Type: Report
  • Suggested Guidelines for Writing Reflective Case Narratives
    Discusses the use of adult learning theory to restructure case narratives so as to increase their effectiveness as a resource for transferring knowledge, sharing ideas, and keeping a pulse on the dynamic and fluid process of evaluation.
    Author(s): Becker, K., Renger, R.
    Publication: American Journal of Evaluation
    Date: August 2016
    Type: Journal Article
  • Process Flow Mapping for Systems Improvement: Lessons Learned
    The article details how to conduct process flow mapping for systems improvement. The method and its importance are explained in the context of evaluating a cardiac care system.
    Author(s): Renger, R., McPherson, M., Kontz-Bartels, T., Becker, K.
    Publication: The Canadian Journal of Program Evaluation, 31(1)
    Date: July 2016
    Type: Journal Article
  • National Data Collection Efforts Pose Challenges for Many EMS Agencies
    Rural EMS agencies face challenges in participating in national data collection efforts. The article presents the consequences of these challenges and propose some suggestions for EMS leadership when confronted with requests to participate in national data collection efforts. Note: Login is required.
    Author(s): Renger, R., Qin, X., Rice, D., Foltysova, J., & Renger, J.
    Publication: EMS Insider
    Date: June 2016
    Type: Journal Article
  • System Evaluation Theory (SET): A Practical Framework for Evaluators to Meet the Challenges of System Evaluation
    The article presents a guiding framework for evaluators to conduct systems evaluation: system evaluation theory (SET). The article defines systems, system theory, and system thinking, as well as discusses the confusion in evaluation literature surrounding the use of these terms. Three guiding principles for evaluating modern day systems are presented.
    Author(s): Renger, R.
    Publication: Evaluation Journal of Australasia, 15(4), 16-28
    Date: December 2015
    Type: Journal Article
  • Indicators of Buy-in to Gauge Evaluation Success
    The article suggests a set of indicators of buy-in that novice evaluators can use to assess stakeholder engagement and responsiveness. It also showcases a tracking tool which serves as a systematic, responsive prompt to monitor buy-in.
    Author(s): Becker, K., Renger, R., McPherson, M.
    Publication: Evaluation Journal of Australasia, 15(2), 12-21
    Date: June 2015
    Type: Journal Article
  • Collaborating to Improve Cardiac Care
    North Dakota Medicine, Vol. 39, Issue 3. Evaluating a lifesaving device leads to a cooperative effort to review statewide cardiac care.
    Author(s): Massmann, N.
    Date: September 2014
    Type: Magazine
  • Lessons Learned in Testing the Feasibility of Evaluating Transfer of Training to an Operations Setting
    Article explores the feasibility, identifies challenges, and offers solutions to evaluation transfer of training to the operations setting. Eight lessons are shared including the need to design training courses to align to an operation-based exercise.
    Author(s): Renger, R.; Granillo, B.
    Publication: Journal of Public Health Management & Practice, 20(5), 30-36
    Date: September 2014
    Type: Journal Article
  • Contributing Factors to the Continued Blurring of Evaluation and Research: Strategies for Moving Forward
    Article published in the Canadian Journal of Program Evaluation that examines contributing factors to purpose-method incongruence for evaluation and research.
    Author(s): Renger, R.
    Publication: Canadian Journal of Program Evaluation, 29(1), 104-117
    Date: May 2014
    Type: Journal Article
  • Deliberation Derived Process (DDP) Evaluation
    Describes a methodology for conducting process evaluations.
    Author(s): Renger, R., Foltysova, J.
    Publication: Evaluation Journal of Australasia
    Date: November 2013
    Type: Journal Article
  • The Reciprocal Relationship Between Implementation Theory and Program Theory in Assisting Program Design and Decision-Making
    Discusses how Theory Driven Evaluation and two if its central tenets – program theory and implementation theory – can be used to inform and assist programmatic decision-making.
    Author(s): Renger, R., Bartel, G., Foltysova, J.
    Publication: Canadian Journal of Program Evaluation, 28(1), 27-41
    Date: March 2013
    Type: Journal Article