Common Evaluation FAQs
This article is rated as:
In this article, we provide the answers to some of your FAQs about evaluation including:
Why do people conduct evaluations?
Where can I find an evaluator?
What makes a good evaluator?
How can I get training in evaluation?
What is the difference between research and evaluation?
How much does an evaluation cost?
Why do people conduct evaluations?
The “why” for an evaluation depends on the “who.” Generally, an evaluation is conducted because a person or group of people (i.e., stakeholder(s)) need to systematically answer questions about a project, program, initiative, and/or system. The information discovered through an evaluation can be used for different purposes depending on the stakeholders involved, but may include:
Assessing merit/worth (i.e., judgement)
Improvement (i.e., learning)
Demonstrating resources are well spent (i.e., accountability)
Early identification of problems (i.e., monitoring)
Adapting and informing design of the initiative (i.e., development)
Where can I find an evaluator?
Recommendations from colleagues and business contacts who have used an evaluator in the past is always the best place to start. If you’ve asked around and still can’t find anyone, then you can search the online directories. Evaluation is a distinct discipline and profession, which means there are professional associations all over the world.
The Canadian Evaluation Society, the American Evaluation Association, the European Evaluation Society, the Australian Evaluation Society and African Evaluation Association all have directories of evaluators you can search for according to geography.
If you’ve found some names on the directories, it’s a good idea to do some background research on that person or firm. LinkedIn is a good place to find out about their qualifications.
What makes a good evaluator?
In our article The Six C’s of a Good Evaluator, we list credibility, curiosity, communication, creativity, and common-sense orientation as five important skills and traits to look for in an evaluator. All of these are important in determining the sixth “C” which is competency. A competent evaluator will demonstrate all these traits and will sometimes even have a professional designation that shows they have the requisite skills, knowledge, and practical experience. For example, the Canadian Evaluation Society has a Credentialed Evaluator designation and a listing of those people on their site.
Of course, “good” is a value-based term that ultimately will be determined by who is interpreting it. If one person values one particular skill, trait, method, approach, or type of evaluation over another, then it is best to find an evaluator who is competent in that area and prioritize that over other areas to best meet your need.
How can I get training in evaluation?
If you are looking for formal education in evaluation, several universities offer high-quality, graduate-level education in evaluation. In Canada, The Consortium of Universities for Evaluation Education (CUEE) lists courses and programs. The American Evaluation Association also has a listing of university programs all over the world.
If you are not looking for formal education, but self-directed learning then there are a number of online courses, webinars, articles, and podcasts you can start with. Eval Academy is a great place to start. Check out our available courses. The professional associations mentioned above also have listings of courses.
Of course, some of the best learning and training occur by doing. Do you know someone who is an evaluator? Are they willing to mentor you? Do you work in an organization that contracts evaluators? Can you find a way to learn from them? Most of us learn by doing, so the best training is some formal learning with a lot of real-world applications.
What’s the difference between research and evaluation?
Research and evaluation share methods but differ in their purpose. Research is curiosity-driven and often aims to generalize or develop theories that apply broadly. Evaluation is utilization driven and focuses on understanding a particular project, program, initiative, etc. While research aims to control settings and often uses an experimental design to support that (e.g., Randomized Control Trials); evaluation occurs in real-world settings which often inhibits the use of experimental design.
How can I become an evaluator?
There are many paths to becoming an evaluator. Although such programs exist, you do not need a degree in evaluation to be an evaluator. In Canada, The Consortium of Universities for Evaluation Education (CUEE) lists courses and programs. The American Evaluation Association also has a listing of university programs all over the world.
Having a thesis-based graduate degree may help an evaluator’s technical practice (i.e., competencies related to methodological decision-making). Many evaluators have degrees in social sciences, education, healthcare, or statistics that are complimented with shorter, targeted training courses.
How much does an evaluation cost?
Asking how much an evaluation costs is like asking how much a house costs. When you buy a house there are lots of factors that determine cost – location, size, level of finishing in the house, lot size, etc. The same applies to an evaluation. How many evaluation questions do you have? How many stakeholder groups? How often do they want to be involved? How do they want to be involved? How do they want the findings reported? Presentation? Video? Report? How many reports? What length is the report? And this doesn’t even get into the questions around methodology and evaluation approach!
If you need to fill in a line item on your budget, then some common rules of thumb are 5% – 20% of an initiative’s overall budget; however, your best bet is to go to a credible evaluator with as many details regarding your initiative and evaluation so they can provide you with an informed quote.
Do you have other evaluation questions you want answered? Drop them in the comments below or connect with us over Twitter!