IEA Training Manual - Module 8

3.1 Attributes of Effective Assessments

This framework takes a look at key attributes that enhance the IEA report’s effectiveness in influencing policy-makers. The notions of saliency, credibility and legitimacy—as key attributes of effective assessments—arise from earlier academic research that focused on better understanding the factors that determine the effectiveness of assessments (Box 2; Figure 3).

Box 2: Attributes of Effective Assessments

Through a five-year consultative process involving hundreds of professional evaluators internationally, the American Evaluation Association identified four criteria for effective evaluation: utility, feasibility, propriety and accuracy (Patton 1997). A couple of years later, the Social Learning Group’s international research team arrived at a similar conclusion from a different point of departure, namely studying what makes environmental assessments effective, and what makes them utilized. The Social Learning Group found that the user (i.e., policy-maker’s) perception of the assessment’s saliency, credibility and legitimacy was critical (Farrell and Jäger 2005).


 
Figure 3: Corresponding Attributes of Effective Evaluations

The saliency-credibility-legitimacy attribute triad acknowledges that the process is subject to political interests. We do not suggest that the process should bend to those interests, but emphasize the need to attract political attention when legitimacy and credibility are not convincing enough on their own merits. It also implies that without credibility and legitimacy, political saliency is not enough to attract and maintain attention.

The assessment of stratospheric ozone depletion is a good example, because it was perceived by policy-makers as salient, credible and legitimate:

  • Salient. Because it addressed a global threat to survival that called for immediate attention and action from decision-makers.
  • Credible. Because it involved high-profile research institutions from different countries, triangulating their observations and results.
  • Legitimate. Because of the transparent process, engaging all relevant stakeholders and acknowledging their investment.

The Social Learning Group’s findings highlight another important point, the importance of involving user representatives which, in the case of an IEA, means key policy-makers. Through their participation in the assessment, these decision-makers can develop a sense of saliency in addition to being assured of credibility and legitimacy.

Comments/Feedback


Write comment:

Posted by:
- - 19 Sep 2012
I072Mm , [url=http://bgnlnaepalww.com/]bgnlnaepalww[/url], [link=http://uakmuvlwnajq.com/]uakmuvlwnajq[/link], http://qkhtxzctshdq.com/
- - 16 Sep 2012
qIkbJV , [url=http://ycqtytxrbxkt.com/]ycqtytxrbxkt[/url], [link=http://yjldgcxvtney.com/]yjldgcxvtney[/link], http://xxwdwzjnxnyx.com/
- - 15 Sep 2012
The technology aaerldy developed for nuclear powered naval vessels means sea going ships are covered. The Navy is aaerldy funding a lot of research towards all-electric ships, including electromagnetic artillery (i.e., and ).Propeller driven aircraft, I don't think any such aircraft still in service are large enough to be candidates. Commercial airliners, some of which are big enough to be candidates, are (I believe) either jets or turboprops. I doubt the airlines would accept a replacement engine that resulted in a significantly slower airliner, especially for the long routes. There once was a project to develop (1951-1963), but I don't think any of that research would be applicable.Transportation has always been the sticky part of trying to get away from petroleum. We (and the rest of the world) use a lot of gasoline, diesel, and aviation fuel.Hmm, maybe it's time to start working out just how much Boron-11 would be needed per mega-Watt hour. That would give us a handle on how much Boron-11 would be needed.Given the performance of Congress, I think I'd rather see this not "Manhattanized", thank you very much. It's too important to mess up, and legislators especially tend to muck things up. Remember Synfuels Corporation? The final Stage 2 plans will take five years to develop, allow three years to develop a mass production version, then serious deployment can begin.