Grant Writing Evaluation Terms

Efficacy
An evaluation of the extent to which a new (untested) program produced significant changes.

Effectiveness
An evaluation of the extent to which an existing (tested) program with documented internal validity produced a significant change

Internal Validity
The degree to which an observed significant change

1. Among a population
2. Can be attributed to what you did
3. Did C, cause A to change among B?

External Validity
The degree to which a significant change can be generalized to other populations beyond your 'intervention' group.

Process Evaluation
An evaluation designed to document the degree to which replicable program procedures were implemented with fidelity. Did you do what you were supposed to do?

Formative Evaluation
An evaluation designed to give insight in the early developmental phase of a program, including an assessment of

1. Program feasibility;
2. Appropriateness of methods; and
3. The immediate or short-term impacts

Program Evaluation (Summative)
An evaluation to assess the feasibility, and long-term effectiveness and cost-effectiveness or cost-benefit of a program.

Qualitative Evaluation
An evaluation designed to explain why a program succeeded or failed.

Cost-Effectiveness Analysis
An evaluation designed to assess the program costs (input) and an impact rate (output); a ratio of cost per unit to percent impact. 
Example:  Costs of prenatal case management program:  percent of high-risk women enrolled in a program

Cost-Benefit Analysis
An evaluation designed to assess the program costs (input) and a health outcome rate, expressed as a monetary benefit-consequence (outputs) or a ratio of costs per unit of economic benefit and net economic benefit (savings).
Example:  Costs of prenatal case management program: reductions in NICU costs