Eval Academy

View Original

Evaluation questions

Evaluation questions are the high-level questions that an evaluation is designed to answer. Evaluation is all about asking and answering questions that matter—about programs, processes, products, policies and initiatives. Evaluation questions are part of a simple logic: ask questions, get answers, take action based on the answers.

Evaluation questions should be developed and agreed on at the beginning of an evaluation (i.e., during planning), which makes it easier to decide what data to collect, how to analyze it, and how to report it. Try not to have too many evaluation questions (5-7 is usually enough).


Good evaluation questions:

  • Are broad, overarching questions

  • Can be answered (with data that can be collected)

  • Are developed as a team with stakeholders

  • Reflect diverse perspectives and experiences

  • Are aligned with goals and objectives

  • Focus the evaluation

  • Communicate to others what the evaluation will and will not address (i.e., scope)

  • Consider how results will feed into improving the program


Evaluation questions differ depending on the type of evaluation being done. Below are some examples of evaluation questions related to different evaluation goals.

Judgement of merit
(e.g., outcome evaluation)

How well did the program work?

Which groups of users benefited from the program?

What unintended outcomes were produced?


Learning
(e.g., process evaluation):

Is the program being implemented correctly?

Are the target audiences of the program being reached?

How satisfied are program users?

What are the strengths and weaknesses of the program?

How can positive impacts be increased?

How can costs be reduced?


Monitoring

Are results being produced as expected? What are the program participation and drop-out rates? Are the program outputs changing?


Accountability

Are funds being used properly?

Are goals and targets being met?

Are staff qualified?

Is the program following the approved plan?

 

See also: program evaluation, evaluation design, evaluation framework

Return to the Evaluation Dictionary