Skip to main content icon/video/no-internet

Judicial Model of Evaluation

The early 1970s saw a proliferation of new models for evaluation, including some extrapolated from fields such as art, literature, and justice. Though still discussed as part of evaluation theory, only a few of these extrapolated approaches have thrived. Most seem to have gone extinct. The models based on jurisprudential procedures may be among the latter.

More specifically, in the Western approach to jurisprudence, hearings are among the chief methods of sorting out the most convincing conclusion from often incomplete or biased evidence. There are several variations. Hearings can be used for clarification or illumination purposes without a decision being reached, such as hearings before Congressional committees. Hearings can be used for review purposes, such as hearings on the fitness of candidates for key appointments. Hearings can also be used for reaching a legal decision, such as hearings before a judge and jury on specific charges. Usually, the judge or hearing officer ensures that the rules of fair argument are observed and a jury reaches conclusions based on evidence presented by the defense and prosecution attorneys.

Among the defining elements of a hearing is the assumption that there are two (or more) sides to almost every question, sides that are adversaries to each other. The hearing process recognizes this through providing a forum for presenting the best case for or against a position, with cross-examination to identify weaknesses in arguments by the defense or advocate and the prosecution or adversary. In this sense, the judicial process is similar to the formal debate process.

The intriguing parallels between judicial processes and evaluation, particularly with regard to possible biases in favor of or against a program, seem to have been discussed first by T. R. Owens in 1971. In the next few years, some evaluators tried out what was then called the adversarial or judicial evaluation model. Since the early 1980s, however, there seem to be no instances of a real-world application of the approach. The last full-on sighting may have been around 1980 and 1981 in the National Institute of Education's national hearing on minimum competency testing. Nonetheless, in texts on evaluation, the judicial, adversarial, or clarification approach often is included as if it were no more or less flourishing than, say, case study approaches, experiments, and mixed methods. Although judicial, adversarial, and clarification concepts are not quite entirely interchangeable, for purposes of this entry, the term “clarification hearing” will refer to all three variants because it seems best to reflect the underlying purposes.

Characteristics of the Clarification Hearing Approach

The underlying purpose in this approach is to provide a balanced picture of strengths and weaknesses, illuminate the complexities of the issues, and reveal where evidence is more or less strong. The program is put on trial, with a judge hearing arguments from the defense that evidence shows the program has succeeded and receiving from the prosecution evidence, including witnesses, showing that the program has failed. The process requires the following:

  • Selection of a “judge” to organize and be arbitrator of the proceedings
  • Selection of a “jury” of stakeholders who give the “verdict,” or plans for videotaping and distributing the proceedings to a larger audience
  • Criteria of effectiveness with which both prosecution and defense evaluators agree
  • Generation of possible issues
  • Selection of issues to be argued
  • Preparation of the case, including locating evidence and witnesses
  • Rehearsal of the arguments
  • Statement of appropriate “charges” or assertions
  • Opposing presentation, including cross-examinations

The Context of the 1970s

The experimental or quasiexperimental approach characterized many of the early evaluations of Great Society demonstrations and programs. These included randomized experimental evaluations of income maintenance programs (the Seattle and Denver Income Maintenance Experiment demonstrations) and quasiexperimental studies such as those of Head Start. The methodological limitations of these experimental studies were of concern to many evaluators, who searched for improvements and alternatives, both in quantitative and more qualitative modes. The alternative approaches developed at this time include—but are by no means limited to—Eisner's examination of methods from art, such as connoisseurship; Stake's countenance model, combining description and judgment, and his 1971 responsive evaluation approach; Scriven's goal-free evaluation; Parlett's illuminative model; adversarial evaluation; and Guba and Lincoln's 1981 discussions of constructivist knowing and naturalistic and participatory evaluation, ideas developed more fully in their fourth-generation evaluation. The context for the clarification hearing approach thus is somewhat analogous to an explosion of new life forms, each searching for its own niche and struggling to predominate, to survive, and to avoid extinction.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading