Bridging Case Conceptualization, Assessment, and Intervention
Publication Year: 2003
Bridging Case Conceptualization, Assessment, and Intervention presents a new approach to the integration of science and practice in clinical work. Author Scott T. Meier systematically connects case conceptualization, assessment, and analysis of intervention effects. This integrative approach differs from traditional methods of teaching counseling in its emphasis on the inclusion of assessment data in the intervention process. With its emphasis on concepts and procedure, Bridging Case Conceptualization, Assessment, and Intervention is intended as a manual for students in psychology, psychiatry, social work, or counseling and practicing psychotherapists, psychiatrists, or counselors.
- Front Matter
- Back Matter
- Subject Index
- Chapter 1: Introduction
- Building on Traditional Nomothetic Approaches
- Assumptions and Values
- Basic Tasks
- Chapter 2: Case Conceptualization
- What Information is Needed?
- Sources of Information for Conceptualization
- Creating a Case Conceptualization
- A Conceptualization Example
- Treatment Failure
- Summary and Cautions
- Chapter 3: Clinical Assessment
- General Measurement Principles
- Common Types of Assessments and Tests
- Other Methods
- Ruling Out Methods
- Units of Measurement
- Creating a Clinical Assessment
- Begin with the Case Conceptualization
- Explicate Constructs
- Measure Behaviors
- Collect as Much Data as Possible
- Summary and Cautions
- Chapter 4: Analyses of Clinical Data
- Analyses Related to Outcome
- Analyses Related to Conceptualization
- Analyses Related to Assessment
- Data Patterns
- Computer Systems
- Summary and Cautions
- Chapter 5: Alternative Explanations
- Issues in Case Conceptualization
- Issues in Clinical Assessment
- Issues in Analytic Judgments
- Chapter 6: Possible Futures
- How Change Might Occur
- Obstacles to Change
- Research into Science-Practice Integration
Copyright © 2003 by Sage Publications, Inc.
All rights reserved. No part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without permission in writing from the publisher.
Sage Publications, Inc.
2455 Teller Road
Thousand Oaks, California 91320
Sage Publications Ltd.
6 Bonhill Street
London EC2A 4PU
Sage Publications India Pvt. Ltd.
B-42 Panchsheel Enclave
Post Box 4109
New Delhi 110 017 India
Printed in the United States of America
Library of Congress Cataloging-in-Publication Data
Meier, Scott T., 1955-
Bridging case conceptualization, assessment, and intervention / Scott T. Meier.
Includes bibliographical references and index.
1. Psychotherapy. 2. Psychotherapy-Evaluation. I. Title.
RC480.5 .M365 2002
02 03 04 05 10 9 8 7 6 5 4 3 2 1
Acquiring Editor: Margaret H. Seawell
Editorial Assistant: Alicia Carter
Production Editor: Claudia A. Hoffman
Copy Editor: Jamie Robinson
Cover Designer: Michelle Lee
Attempts to bridge the science and practice of clinical work in mental health have a long history (Hess & Mullen, 1995; Pepinsky & Pepinsky, 1954; Stricker & Trierweiler, 1995). Eldridge (1993), for example, noted that accountability (i.e., outcome assessment) had been proposed as the central issue confronting social workers during the 1970s; counseling educators have expressed concerns about students' ability to conceptualize clients for decades (Holloway & Wolleat, 1980; Nelson & Neufeldt, 1998). Yet many observers (e.g., Goldman, 1972) conclude that a science-practice integration has failed or at least failed to meet expectations. Potential explanations include:
- The science-practice link has been strained because of the different purposes of scientists and practitioners. Researchers are typically concerned with discovering general laws, whereas practitioners focus on helping specific cases that consist of individuals, groups, and families (e.g., Fensterheim & Raw, 1996; Hess & Mullen, 1995; Stricker & Trierweiler, 1995).
- Many students in the helping professions enter graduate school with vocational interests that are socially oriented and unrelated to research activities (Kahn & Scott, 1997). Beginning students, for example, often express a stronger desire to learn the what and how (i.e., techniques) of clinical work than the why; graduates in the helping professions seldom conduct or publish research. Expecting such individuals to change their vocational interests and abilities is unrealistic.
- Clinicians have been resistant to evaluation efforts because of the additional workload and the potential for critical feedback involved (Nugent, Sieppert, & Hudson, 2001). Issues of accountability and effectiveness often hold more interest for administrators, funding agencies, and researchers than [Page viii]they do for clinicians. Thus, scientific methods have been perceived as having little to offer clinicians except negative consequences.
- Scientific methods and clinical practice are typically taught in separate courses and seldom completely integrated (Meier, 1999; Stoltenberg, Kashubeck-West, Biever, Patterson, & Welch, 2000). Chwalisz (2001) noted that “the scientist-practitioner model, as currently enacted in psychology training programs, has not built a sufficient relationship between science and practice” (p. 265). Many training programs appear to assume that if graduate students receive separate courses in research design, testing and assessment, and reviews of counseling research, they will naturally integrate this information into their work with clients. My experience as a student and faculty member is that this is usually not the case: Many students differentiate research and practice into separate domains.
This book approaches the science-practice problem by focusing explicitly on the links between case conceptualization, assessment, and analysis of intervention effects during clinical work. Observing the professional behaviors of neurosurgeons, Gladwell (1996) noted that “the complexity and mystery of the brain has … led to a culture that rewards intuition, and has thus convinced each neurosurgeon that [his or her] own experience is as valid as anyone else's” (p. 39). Like neurosurgeons, clinicians conducting psychotherapy typically receive little systematic feedback about the effects of their work and make many of their decisions intuitively. The approach described in this book attempts to present a balance between questioning and supporting clinical intuition by making clinicians' thoughts, decisions, and judgments explicit, and then checking them against other kinds of information (see Berman, 1997; O'Brien, 1995). By integrating this structured approach directly into the content of clinical, theoretical, and practicum courses, faculty can increase the likelihood that student clinicians will increase their confidence in using more systematic methods and thus actually use them (Meier, 1999).
The most basic reason for investing in such an integrative approach is improving clinical outcomes. Failure to conceptualize and monitor treatment may be one of the contributing factors to treatment failure (Clark, 1999). In addition, by closely linking case conceptualization and assessment data with intervention decisions, students and clinicians can (a) be introduced to a standard of practice that moves beyond an eclectic, flying-by-the-seat-of-your-pants [Page ix]approach to therapy and (b) better understand why counseling is ineffective with some individuals and thus have a basis for adjusting treatment in those instances. A commitment to an integrative approach that increases professional reflection should also foster clinicians' professional development (Ronnestand & Skovholt, 2001; Skovholt & Ronnestand, 1995).
Four basic themes form the foundation of this integrative approach. First, Lazarus (1971, p. xi) cautioned clinicians “not to forget the obvious fact that every individual is unique, and to tailor … therapy accordingly” (cited in Gottman & Leiblum, 1974). Many psychotherapy theories and clinical measures, however, treat clients as if they were largely interchangeable and not individual interpreters and creators of meaning. Although case conceptualization, clinical assessment, and intervention are built on nomothetic theories, they work best when focused on the relatively unique, idiographic aspects of each client.
Second, this integrative approach differs from traditional methods of teaching counseling and psychotherapy in its emphasis on the inclusion of assessment data in the intervention process. For example, while many counseling texts provide information related to counseling process and intervention, and some explicitly relate this information to client conceptualization, few thoroughly and systematically connect conceptualization and intervention with assessment. Assessment tends to be taught in separate courses on measurement, intelligence testing, and personality testing. The extent to which assessment is integrated into the therapeutic process often depends upon the judgment and background of a particular supervisor in a practicum setting. In fact, the mental health professions appear to be lagging behind medicine and education in their use of assessment data as feedback in the intervention process (see Cross & Angelo, 1988; Mark et al, 1991).
Third, structured feedback is critical to learning for both students and practicing clinicians. Experience becomes helpful when we have “systematic procedures for learning from our failures as well as our successes” (Gottman & Leiblum, 1974, p. 9). When clinicians closely examine the set of outcomes experienced by each client, they often find evidence of both success and failure. Thus, analysis of clinically relevant data is key to learning about and improving work with individual clients.
Fourth, this approach focuses on the application of scientific methods, as contrasted with the exclusive use of specific theoretical knowledge or empirical results. The methods and procedures described in this book are [Page x]transtheoretical in that they can potentially be applied by clinicians of any particular school of counseling and psychotherapy. The descriptions and examples provided here include a variety of modalities (e.g, individual, group, family) and therapeutic orientations (e.g., social learning, multicultural). Instructors should modify and employ these concepts with whatever therapeutic approaches they prefer, as well as adapt and introduce their particular techniques for case conceptualization, clinical assessment, and analysis of intervention effects.
This book will be useful to graduate students in clinical fields, and postgraduate clinicians may benefit from a review of these concepts. Introductory courses in counseling theory (including theories of personality, psychopathology, and psychotherapy), measurement and assessment, and qualitative or quantitative analysis will help the reader make sense of these chapters. These materials are intended as an extension of or sequel to class texts, to be used in psychotherapy, counseling, and practical classes where the instructor wishes to bring scientific methods into the discussion of clinical issues. With its emphasis on concepts and procedure, the book's primary intended use is as a manual; those looking for discussions of philosophical foundations should consult sources such as Trierweiler and Stricker (1998). Because the focus of the book is the integration of conceptualization, assessment, and analysis of intervention effects, the treatment of each of these areas is necessarily brief; references are cited in each chapter for sources that provide a deeper discussion. When referring to the counselor or therapist, I prefer to use the word clinician, as it “is a general term used to refer to individuals who have obtained, or are in the process of obtaining, professional training in psychology, counseling, education, or social work departments at universities, medical centers, or training institutions” (Berman, 1997, p. xi). Given the diverse potential readership of the book, terms like psychotherapy and counseling are employed interchangeably.
The book consists of six chapters. Chapter 1 provides an introduction to the key elements of conceptualization, assessment, and analysis, as well as a more thorough rationale for their integration. Chapter 2 introduces and guides the clinician through the steps necessary to select (a) process elements related to client etiology and intervention and (b) outcome elements for multiple and selected problems. In Chapter 3, the focus shifts to how to assess these process and outcome elements; the presentation includes an overview of assessment methods (including idiographic and behavioral assessment), construct explication, psychometric principles, guidelines for method selection, the use of [Page xi]baselines, and examples. Chapter 4 presents basic graphical, qualitative, and quantitative analytic techniques that can be used to address questions related to outcome, conceptualization, and assessment. Chapter 5 addresses common problems in conceptualization, idiographic assessment, and analysis, while Chapter 6 includes possible future directions for science-practice efforts in the helping professions.
Portions of this book are based on Meier (1994, 1999); more detailed descriptions of teaching methods related to this material are in Meier (1999), and descriptions of measurement and assessment issues can be found in Meier (1994). Client and therapist names and characteristics have been altered to protect confidentiality; because the purpose of the data presented in this book is teaching, not research, some data have also been altered to protect confidentiality. I would like to thank the many graduate students (particularly Caroline Baltzer, Julie Nettina, Benson Hendricks-Hoffman, and Beth Wahlig) who provided creative (but sometimes uncited, to protect confidentiality) examples of clinical models and analytic displays. Finally, I would like to thank my graduate assistants, the latest including Ron Beebe, Benson Hendricks-Hoffman, Christine Messmer, Julie Nettina, and Erin Steck, for their considerable assistance and helpful feedback.
—Scott T. Meier Ph.D., firstname.lastname@example.org, http://www.acsu.buffalo.edu/~stmeier, University at Buffalo, August 19, 2002[Page xii]
References[Page 165][Page 186]1995). Statistics as principled argument. Hillsdale, NJ: Lawrence Erlbaum.(1999). Considerations for ethical practice in managed care. Professional Psychology: Research and Practice, 30, 563–575. http://dx.doi.org/10.1037/0735-7028.30.6.563, , , , , , & (1999). The dialectics of manual-based treatment. The Behavior Therapist, 7, 130–132., , , , & (1994). On revitalizing the measurement curriculum. American Psychologist, 49, 889–890. http://dx.doi.org/10.1037/0003-066X.49.10.889(1937). Personality. New York: Henry Holt.(1942). The use of personal documents in psychological science (Bull. No. 49). New York: Social Science Research Council.(American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.American Psychological Association. (1993). Record keeping guidelines. American Psychologist, 48, 984–986. http://dx.doi.org/10.1037/0003-066X.48.9.9841976). Theories of action that inhibit individual learning. American Psychologist, 31, 638–654. http://dx.doi.org/10.1037/0003-066X.31.9.638(1991). Costs and benefits of judgment errors: Implications for debiasing. Psychological Bulletin, 110, 486–498. http://dx.doi.org/10.1037/0033-2909.110.3.486(1990). Validity of self-reports in applied research on addictive behaviors: Fact or fiction?Behavioral Assessment, 12, 5–31., , & (1987). Verbal report methods in clinical research on alcoholism: Response bias and its minimization. Journal of Studies on Alcohol, 48, 410–424., , & (1999). The self made tapestry. Oxford, UK: Oxford University Press.(1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191–215. http://dx.doi.org/10.1037/0033-295X.84.2.191(1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.(1997). Self efficacy: The exercise of control. New York: Freeman.([Page 166]1977). Behavioral assessment in clinical settings: Developing issues. In J. D.Cone & R. P.Hawkins (Eds.), Behavioral assessment (pp. 283–307). New York: Brunner/Mazel.(1984). The scientist practitioner. New York: Pergamon., , & (1988). Psychosocial functioning and depression: Distinguishing among antecedents, concomitants, and consequences. Psychological Bulletin, 104, 97–126. http://dx.doi.org/10.1037/0033-2909.104.1.97, & (1966). Target complaints as criteria of improvement. American Journal of Psychotherapy, 20, 184–192., , , , , & (Beail, N. (Ed.). (1985). Repertory grid technique and personal constructs. London: Croom Helm.2000). The process of group psychotherapy: Systems for analyzing change. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10378-000, & (1976). Cognitive therapies and the emotional disorders. New York: International Universities Press.(1985). Anxiety disorders and phobias: A cognitive perspective. New York: Basic Books., , & (1979). Cognitive therapy of depression. New York: Guilford., , , & (1995). Cognitive therapy: Basics and beyond. New York: Guilford.(1994). Experiential group research: Can the canon fire? In A. E.Bergin & S. L.Garfield (Eds.), Handbook of psychotherapy and behavior change (, & (4th ed., pp. 631–663). New York: John Wiley.Belar, C., & Perry, N. (Eds.). (1992). National Conference on Scientist-Practitioner Education and Training for the Professional Practice of Psychology. American Psychologist, 47, 71–75. http://dx.doi.org/10.1037/0003-066X.47.1.711980). Effects of conceptual level and supervision structure on counselor skill development. Journal of Counseling Psychology, 27, 500–509. http://dx.doi.org/10.1037/0022-022.214.171.1240, & (Bergin, A. E., & Garfield, S. L. (Eds.). (1994). Handbook of psychotherapy & behavior change. New York: John Wiley.1997). Case conceptualization and treatment planning. Thousand Oaks, CA: Sage.(2000). Empirically based decision making in clinical practice. Prevention & Treatment, 3, Article 27. Retrieved December 1, 2000, from http://journals.apa.org/prevention/volume3/toc-sep01-00.html(1986). Individualized outcome measures of internal change: Methodological considerations. Journal of Consulting and Clinical Psychology, 54, 48–53. http://dx.doi.org/10.1037/0022-006X.54.1.48, & (2000). Prescriptive psychotherapy: A practical guide to systematic treatment selection. Oxford, UK: Oxford University Press., & ([Page 167]1997). Clinician reliability and accuracy in judging appropriate level of care. Journal of Consulting and Clinical Psychology, 65, 515–520. http://dx.doi.org/10.1037/0022-006X.65.3.515, , & (2000). What information do clinicians value for monitoring adolescent client progress and outcomes?Professional Psychology: Research and Practice, 31, 70–74. http://dx.doi.org/10.1037/0735-7028.31.1.70, , , , , , & (1988). The case presentation approach to clinical supervision. Counselor Education and Supervision, 28, 240–248. http://dx.doi.org/10.1002/j.1556-6978.1988.tb00762.x(1997). Supervision of psychodynamic psychotherapies. In C. E.Watkins, Jr. (Ed.), Handbook of psychotherapy supervision (pp. 44–62). New York: John Wiley., & (1988). Psychotherapy tradecraft: The technique and style of doing therapy. New York: Brunner/Mazel.(1987). The professional counselor. New York: Macmillan.(1992). The effects of computer assisted data collection on students’ behavior. Behavioral Assessment, 14, 173–190., , , & (1982). Evaluating practice: Guidelines for the accountable professional. Englewood Cliffs, NJ: Prentice Hall., & (2000). Personality and object relations in patients with affective disorders: Idiographic research by means of the repertory grid technique. Journal of Affective Disorders, 60, 52–59., , , , , , , , , & (1979). The evaluation of a “target problem” approach to outcome measurement. Psychotherapy: Theory, Research, and Practice, 1, 48–54. http://dx.doi.org/10.1037/h0085874, , & (1994). Helping students apply the scientist-practitioner model: A teaching approach. Counselor Education and Supervision, 34, 172–179. http://dx.doi.org/10.1002/j.1556-6978.1994.tb00324.x, , , & (2000). Chaos, group psychotherapy, and the future of uncertainty and uniqueness. Group, 24, 23–32. http://dx.doi.org/10.1023/A:1007551120290(1986). Maternal perceptions of child maladjustment as a function of the combined influence of child behavior and maternal depression. Journal of Consulting and Clinical Psychology, 54, 237–240. http://dx.doi.org/10.1037/0022-006X.54.2.237, & (1990). The skillful teacher. San Francisco: Jossey-Bass.(1970). Sexrole stereotypes and clinical judgments of mental health. Journal of Consulting and Clinical Psychology, 34, 1–7. http://dx.doi.org/10.1037/h0028797, , , , & (1995). Long-term outcome in cognitive-behavior treatment of panic disorder: Clinical predictors and alternative strategies for assessment. Journal of Consulting and Clinical Psychology, 63, 754–765. http://dx.doi.org/10.1037/0022-006X.63.5.754, & (2000). Assessments A to Z. San Francisco: Jossey-Bass., & ([Page 168]1991). Coping styles, homework assignments, and the effectiveness of cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 59, 305–311. http://dx.doi.org/10.1037/0022-006X.59.2.305, & (1990). Assessing patients in psychotherapy: Use of the MMPI-2 for treatment planning. New York: Oxford University Press.(1990). Inferring psychological significance from physiological signals. American Psychologist, 45, 16–28. http://dx.doi.org/10.1037/0003-066X.45.1.16, & (1959). Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105. http://dx.doi.org/10.1037/h0046016, & (2000). Clinical practice guidelines development in evidence-based psychotherapy. In N.Rowland & S.Goss (Ed.), Evidence-based counselling and psychological therapies: Research and applications (pp. 171–190). London: Routledge., & (1987). A comparative review of family rating scales: Guidelines for clinicians and researchers. Journal of Family Psychology, 1, 23–47. http://dx.doi.org/10.1037/h0080437, & (1998). Enhancing the recall of text: Knowledge mapping training promotes implicit transfer. Journal of Educational Psychology, 90, 407–413. http://dx.doi.org/10.1037/0022-06126.96.36.1997, & (1992). Interparental agreement on child behavior problems. Psychological Assessment, 4, 419–425. http://dx.doi.org/10.1037/1040-35188.8.131.529, , & (2001). A common factors revolution: Let's not “cut off our discipline's nose to spite its face.”Journal of Counseling Psychology, 48, 262–267. http://dx.doi.org/10.1037/0022-0184.108.40.2062(1999). Case conceptualization and treatment failure: A commentary. Journal of Cognitive Psychotherapy: An International Quarterly, 13, 331–337.(1994). Quantitative evaluation of 26 years of private practice. Professional Psychology: Research and Practice, 25, 173–176. http://dx.doi.org/10.1037/0735-7028.25.2.173(1999). Outcomes and incomes. New York: Guilford.(1988). Psychometric considerations and the multiple models of behavioral assessment. In A. S.Bellack & M.Hersen (Eds.), Behavioral assessment: A practical handbook ((3rd ed., pp. 42–66). Elmsford, NY: Pergamon.1989). Is there utility for treatment utility?American Psychologist, 44, 1241–1242. http://dx.doi.org/10.1037/0003-066X.44.9.1241(2001). Evaluating outcomes: Empirical tools for effective practice. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10384-000(1979). Quasi-experimentation. Chicago: Rand McNally., & (1994). Practice evaluation in the context of managed care: Case-recording methods for quality assurance reviews. Research on Social Work Practice, 4, 326–337. http://dx.doi.org/10.1177/104973159400400304, & (1996). Theory and practice of counseling and psychotherapy ((5th ed.). Pacific Grove, CA: Brooks/Cole.1995). Current psychotherapies (, & ([Page 169]5th ed.). Itasca, IL: F. E. Peacock.1994). Research design: Qualitative and quantitative approaches. Thousand Oaks, CA: Sage.(2002). Educational research. Upper Saddle River, NJ: Merrill-Prentice Hall.(1984). Essentials of psychological testing ((4th ed.). New York: Harper & Row.1965). Psychological tests and personnel decisions (, & (2nd ed.). Urbana, IL: University of Illinois Press.1988). Classroom assessment techniques. Ann Arbor, MI: National Center for Research to Improve Postsecondary Teaching and Learning., & (1990). Implications of counselor conceptualizations for counselor education. Counselor Education & Supervision, 30, 120–134. http://dx.doi.org/10.1002/j.1556-6978.1990.tb01189.x, , , , & (1992). Participants’ memories for therapeutic events and ratings of session effectiveness. Journal of Cognitive Psychotherapy: An International Quarterly, 6, 113–124., , , & (1998). The generation and recall of personally relevant information. Journal of Experimental Education, 66, 293–315. http://dx.doi.org/10.1080/00220979809601403, & (1980). Expectancy confirmation processes arising in the social interaction sequence. American Psychologist, 35, 867–881. http://dx.doi.org/10.1037/0003-066X.35.10.867, & (2001). The elements of managed care. Pacific Grove, CA: Brooks/Cole., & (1989). Clinical versus actuarial judgment. Science, 243, 1668–1674. http://dx.doi.org/10.1126/science.2648573, , & (1983). Judging change in psychotherapy: Reliability of clinical formulations. Archives of General Psychiatry, 40, 1121–1128. http://dx.doi.org/10.1001/archpsyc.1983.01790090083013, , , & (1985). Processes and stages of change: Coping and competence in smoking behavior change. In S.Shiffman & T. A.Wills (Eds.), Coping and substance abuse. New York: Academic Press., & (1989). A meta-analysis of the efficacy of cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 57, 414–419. http://dx.doi.org/10.1037/0022-006X.57.3.414(1987). Inferential processes in clinical work: Inquiry into logical errors that affect diagnostic judgments. Professional Psychology: Research and Practice, 18, 433–438. http://dx.doi.org/10.1037/0735-7028.18.5.433, & (1985). Path analysis: Sociological examples. In H. M.Blalock, Jr. (Ed.), Causal models in the social sciences ((2nd ed., pp. 55–79). Hawthorne, NY: Aldine.1953). The relationship between the judged desirability of a trait and the probability that the trait will be endorsed. Journal of Consulting Psychology, 24, 90–93.(Eells, T. D. (1997). (Ed.). Handbook of psychotherapy case formulation. New York: Guilford.[Page 170]1998). The skilled helper: A problem-management approach to helping ((6th ed.). Pacific Grove, CA: Brooks/Cole.1997). Manualized behavior therapy: Merits and challenges. Behavior Therapy, 28, 499–509. http://dx.doi.org/10.1016/S0005-7894%2897%2980005-6, , , , & (1978). Confidence in judgment: Persistence of the illusion of validity. Psychological Review, 85, 395–416. http://dx.doi.org/10.1037/0033-295X.85.5.395, & (2000). Problems and limitations in using psychological assessment in the contemporary health care delivery system. Professional Psychology: Research & Practice, 31, 131–140. http://dx.doi.org/10.1037/0735-7028.31.2.131, , , , , , , & (1993). Conceptualizing the evaluation of clinical counseling. Lanham, MD: University Press of America.(1998). Editor's introduction: A guide to the empirically supported treatments controversy. Psychotherapy Research, 8, 115–125.(1979). The stability of behavior: I. On predicting most of the people much of the time. Journal of Personality and Social Psychology, 37, 1097–1126. http://dx.doi.org/10.1037/0022-35220.127.116.117(1986). Research on human judgment and its application to clinical practice. Professional Psychology: Research and Practice, 17, 420–430. http://dx.doi.org/10.1037/0735-7028.17.5.420(1996). Psychotherapy research is not psychotherapy practice. Clinical Psychology: Science and Practice, 3, 168–171. http://dx.doi.org/10.1111/j.1468-2850.1996.tb00067.x, & (1998). Not rocket science. New Yorker, 74, 4–5.(2001). Observing families through the stories that they tell: A multidimensional approach. In P.Kerig & K.Lindahl (Eds.), Family observational coding systems: Resources for systemic research (pp. 259–271). Mahwah, NJ: Lawrence Erlbaum., , , , , & (1994). Measures for clinical practice (, & (2nd ed.). New York: Free Press.1983). Success and failure in the behavioral treatment of obsessive-compulsives. Journal of Consulting and Clinical Psychology, 51, 287–297. http://dx.doi.org/10.1037/0022-006X.51.2.287, , , , , & (1991). Persuasion and healing: A comparative study of psychotherapy (, & (3rd ed.). Baltimore, MD: Johns Hopkins University Press.1994). Handbook of group psychotherapy. New York: John Wiley., & (1992). The trained psychologist as expert witness. Clinical Psychology Review, 12, 451–467. http://dx.doi.org/10.1016/0272-7358%2892%2990127-T(1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10299-000(1998). The validity of the Rorschach and the Minnesota Multiphasic Personality Inventory: Results from meta-analyses. Psychological Science, 9, 402–404. http://dx.doi.org/10.1111/1467-9280.00075, , & (1990). Educational psychology. Dubuque, IA: Kendall/Hunt.([Page 171]1996). Conquering the coma. New Yorker, 72, 34–40.(1972). Tests and counseling: The marriage that failed. Measurement and Evaluation in Guidance, 15, 70–73.(1992). Qualitative assessment: An approach for counselors. Journal of Counseling & Development, 70, 616–621. http://dx.doi.org/10.1002/j.1556-6676.1992.tb01671.x(1979). Marital interaction: Experimental investigations. New York: Academic Press.(1974). How to do psychotherapy and how to evaluate it. New York: Holt, Rinehart & Winston., & (1990). MMPI-2: Assessing personality and psychopathology. New York: Oxford University Press.(2001). Feedback: A key to improving therapy outcomes. Behavioral Healthcare Tomorrow, 10, 25–45., & (1986). Change process research. Journal of Consulting and Clinical Psychology, 54, 4–9. http://dx.doi.org/10.1037/0022-006X.54.1.4(2000). How to work with clients’ strengths in crisis intervention: A solution-focused approach. In A. R.Roberts (Ed.), Crisis intervention handbook: Assessment, treatment, and research (, , , & (2nd ed., pp. 31–55). New York: Oxford University Press.1995). A framework for assessment in multicultural counseling. In J. G.Ponterotto, J. M.Casas, L. A.Suzuki, & C. M.Alexander (Eds.), Handbook of multicultural counseling. Thousand Oaks, CA: Sage., & (1990). Handbook of psychological assessment ((2nd ed.). New York: John Wiley.2000). Visions of clinical assessment: Then, now, and a brief history of the future. Journal of Clinical Psychology, 56, 349–365. http://dx.doi.org/10.1002/%28SICI%291097-4679%28200003%2956:3%3C349::AID-JCLP11%3E3.0.CO;2-T(2001). A predictive model of health-related quality of life in obstructive sleep apnea patients. Unpublished manuscript, State University of New York, Buffalo.(1996). Theory and experience: Teaching dialectical thinking in counselor education. Counselor Education and Supervision, 36, 14–24. http://dx.doi.org/10.1002/j.1556-6978.1996.tb00232.x, , & (1978). Diagrammatic assessment of family relationships. Social Casework, 59, 465–476.(1984). Assessment strategies. In D. H.Barlow & M.Hersen (Eds.), Single case experimental designs (pp. 107–139). New York: Pergamon.(1993). Confirmatory bias in hypothesis testing for client-identified and counselor self-generated hypotheses. Journal of Counseling Psychology, 40, 305–315. http://dx.doi.org/10.1037/0022-018.104.22.1683(1995). What do we want from scientific standards of psychological practice. In S. C.Hayes, V. M.Follette, R. M.Dawes, & K. E.Grady (Eds.), Scientific standards of psychological practice: Issues and recommendations (pp. 49–66). Reno, NV: Context.([Page 172]1999). The scientist practitioner: Research and accountability in the age of managed care (, , & (2nd ed.). Boston: Allyn & Bacon.1987). The treatment utility of assessment. American Psychologist, 42, 963–974. http://dx.doi.org/10.1037/0003-066X.42.11.963, , & (1993). Treatment implications of psychological assessment. Psychological Assessment, 5, 251–25. http://dx.doi.org/10.1037/1040-3522.214.171.124(2001). Introduction to the special section on clinical applications of analogue behavioral observation. Psychological Assessment, 13, 304.(1993). Identifying causal relationships in clinical assessment. Psychological Assessment, 5, 281–291. http://dx.doi.org/10.1037/1040-35126.96.36.1991, , & (1995). Graphing data. Thousand Oaks, CA: Sage.(1992). A proposal to integrate science and practice in counseling psychology. The Counseling Psychologist, 20, 107–122. http://dx.doi.org/10.1177/0011000092201017, , , , , , , , , & (1999). Research design in counseling (, , & (2nd ed.). Pacific Grove, CA: Brooks/Cole.1995). Practitioner-researcher partnerships. Washington, DC: NASW., & (2001). Observation of couple conflicts: Clinical assessment applications, stubborn truths, and shaky foundations. Psychological Assessment, 13, 5–35. http://dx.doi.org/10.1037/1040-35188.8.131.52(1985). Community as a client: Assessment and diagnosis. Philadelphia: F. A. Davis., & (1982). Counseling process research: Philosophical and methodological dilemmas. Counseling Psychologist, 10, 7–19. http://dx.doi.org/10.1177/0011000082104003(1991). Almost everything you ever wanted to know about how to do process research on counseling and psychotherapy but didn't know who to ask. In C.Watkins & L.Schneider (Eds.), Research in counseling (pp. 85–118). Hillsdale, NJ: Lawrence Erlbaum.(2001). An individualized approach to managed mental health care in colleges and universities: A case study. Journal of College Student Psychotherapy, 15, 49–64. http://dx.doi.org/10.1300/J035v15n04_06, & (1997). Making vocational choices: A theory of vocational personalities and work environments ((3rd ed.). Englewood Cliffs, NJ: Prentice Hall.1980). Cognitive self-statements in depression: Development of an Automatic Thoughts Questionnaire. Cognitive Therapy and Research, 4, 383–395. http://dx.doi.org/10.1007/BF01178214, & (1995). Clinical supervision. Thousand Oaks, CA: Sage. http://dx.doi.org/10.4135/9781452224770(1980). Relationship of counselor conceptual level to clinical hypothesis formation. Journal of Counseling Psychology, 27, 539–545. http://dx.doi.org/10.1037/0022-0184.108.40.2069, & (1994). Orientation to inquiry in a reflective professional psychology. Albany, NY: SUNY Press.([Page 173]1995). Integra outpatient tracking system. Philadelphia: Compass Information Services., , , & (1986). The dose-effect relationship in psychotherapy. American Psychologist, 41, 159–164. http://dx.doi.org/10.1037/0003-066X.41.2.159, , , & (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61, 678–685. http://dx.doi.org/10.1037/0022-006X.61.4.678, , , & (1996). Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059–1064. http://dx.doi.org/10.1037/0003-066X.51.10.1059, , , , & (1999). Statistical strategies for small sample research. Thousand Oaks, CA: Sage.(1992). Reliability of retrospective self-report by narcotics addicts. Psychological Assessment, 4, 207–213. http://dx.doi.org/10.1037/1040-35220.127.116.11, , & (1999). The usefulness of tests in clinical decisions. In J. W.Lichtenberg & R. K.Goodyear (Eds.), Scientist-practitioner perspectives on test interpretation (pp. 59–112). Needham Heights, MA: Allyn & Bacon.(2000). Reviewing effective components of feminist therapy. Counselling Psychology Quarterly, 13, 233–247. http://dx.doi.org/10.1080/095150700300091820, & (1999). Psychotherapy and chaos theory: The metaphoric relationship between psychodynamic therapy and chaos theory. Psychotherapy, 36, 274–286. http://dx.doi.org/10.1037/h0087720(1989). Research structured vs. clinically flexible versions of social learning-based marital therapy. Behaviour Research and Therapy, 27, 173–180. http://dx.doi.org/10.1016/0005-7967%2889%2990076-4, , , , , & (Joint Commission on Accreditation of Healthcare Organizations (JCAHO). (1997). A practical guide to clinical documentation in behavioral health care. Oakbrook Terrace, IL: Author.1968). Pattern of performance and ability attribution: An unexpected primacy effect. Journal of Personality and Social Psychology, 10, 317–340. http://dx.doi.org/10.1037/h0026818, , , , & (1995). The compete psychotherapy treatment planner. New York: John Wiley., & (2001). Therascribe 3.5 [Computer software]. New York: John Wiley., , & (1996). How much therapy is really enough?Journal of Psychotherapy Practice and Research, 5, 132–151., , & (1999). Level of measurement and the Family System Test: The relationship between participants’ constructions and interpretation of scores. Constructivism in the Human Sciences, 4, 103–116., & (2001). Children's Definitions of Family Power and Cohesion Affect Scores on the Family System Test. American Journal of Family Therapy, 29, 141–154., & ([Page 174]1997). Predictors of research productivity and science-related career goals among counseling psychology doctoral students. The Counseling Psychologist, 25, 38–67. http://dx.doi.org/10.1177/0011000097251005, & (Kahneman, D., Slovic, P., & Tversky, A. (Eds.). (1982). Judgment under uncertainty: Heuristics and biases. Cambridge, UK: Cambridge University Press.1988). Guiding the process of therapeutic change. Champaign, IL: Research., & (1986). The specificity versus nonspecificity dilemma: Toward identifying therapeutic change agents. American Journal of Psychiatry, 143, 698–695.(1994). Pretraining and structure: Parallel lines yet to meet. In A.Fuhriman & G. M.Burlingame (Eds.), Handbook of group psychotherapy. New York: John Wiley., & (1980). Research design in clinical psychology. New York: Harper & Row.(1993). Evaluation in clinical practice: Clinically sensitive and systematic methods of treatment delivery. Behavior Therapy, 24, 11–45. http://dx.doi.org/10.1016/S0005-7894%2805%2980255-2(1999). Foreword. In P. W.Clement, Outcomes and incomes (pp. ix-xi). New York: Guilford.(1955). The psychology of personal constructs (Vols. 1–2). New York: Norton.(1992). When clients don't progress: Influences on and explanations of therapeutic progress. Cognitive Therapy and Research, 16, 269–281. http://dx.doi.org/10.1007/BF01183281, , & (2001). Introduction and overview: Conceptual issues in family observational research. In P.Kerig & K.Lindahl (Eds.), Family observational coding systems: Resources for systemic research (pp. 1–22). Mahwah, NJ: Lawrence Erlbaum.(Kerig, P., & Lindahl, K. (Eds.). (2001). Family observational coding systems: Resources for systemic research. Mahwah, NJ: Lawrence Erlbaum.1998). History of managed behavioral health care and speculations about its future. Harvard Review of Psychiatry, 6, 155–159. http://dx.doi.org/10.3109/10673229809000324(1988). On watching birds. Chelsea, VT: Chelsea Green.(1994). Historical perspective. In T. J.Kiresuk, A.Smith, & J. E.Cardillo (Eds.), Goal attainment scaling: Applications, theory, and measurement (pp. 135–160). Hillsdale, NJ: Lawrence Erlbaum.(1994). Training in goal attainment scaling. In T. J.Kiresuk, A.Smith, & J. E.Cardillo (Eds.), Goal attainment scaling: Applications, theory, and measurement (pp. 105–118). Hillsdale, NJ: Lawrence Erlbaum., , , & (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4, 443–453. http://dx.doi.org/10.1007/BF01530764, & (Kiresuk, T. J., Smith, A., & Cardillo, J. E. (1994). (Eds.). Goal attainment scaling: Applications, theory, and measurement. Hillsdale, NJ: Lawrence Erlbaum.[Page 175]1994). Case study of the process and outcome of career counseling. Journal of Counseling Psychology, 41, 216–226. http://dx.doi.org/10.1037/0022-018.104.22.168, , & (1994). Patterns of symptomatic recovery in psychotherapy. Journal of Consulting & Clinical Psychology, 62, 1009–1016. http://dx.doi.org/10.1037/0022-006X.62.5.1009, , , & (1996). Local clinicians need knowledge tools. American Psychologist, 51, 1335–1336. http://dx.doi.org/10.1037/0003-066X.51.12.1335(1971). Foundations of measurement: Vol. I. Additive and polynomial representations. New York: Academic Press., , , & (1994). Use of psychological tests for outcome assessment. In M. E.Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (pp. 75–97). Hillsdale, NJ: Lawrence Erlbaum.(1998). Manual-based treatment and clinical practice: Hangman of life or promising development?Clinical Psychology: Science & Practice, 5, 391–395. http://dx.doi.org/10.1111/j.1468-2850.1998.tb00160.x(1996, August). Measuring outcomes in clinical practice. Workshop conducted at the American Psychological Association Annual Convention, Toronto., & (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced?Psychotherapy Research, 11, 49–68. http://dx.doi.org/10.1080/713663852, , , , , & (Enhancing psychotherapy outcomes via providing feedback on client progress: A replication. Journal of Consulting and Clinical Psychology., , , , , , & (in press).1981). Toward an idiothetic psychology of personality. American Psychologist, 36, 276–289. http://dx.doi.org/10.1037/0003-066X.36.3.276(1968). Fear reduction and fear behaviour: Problems in treating a construct. In J. M.Shlien (Ed.), Research in psychotherapy (Vol. 3, pp. 90–102). Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10546-004(1974). A patient by any other name … : Clinical group differences in labeling bias. Journal of Consulting and Clinical Psychology, 42, 4–9. http://dx.doi.org/10.1037/h0036054, & (1982). Personality assessment (, & (2nd ed.). New York: John Wiley.1999). N of 1 clinical trials—A technique for improving medical therapeutics. Western Journal of Medicine, 152, 52–56.(1993). Cognitive therapy of borderline personality disorder. Needham Heights, MA: Allyn & Bacon., , , & (1997). Brief but comprehensive psychotherapy: The multimodal way. New York: Springer.(1999). Strategic self-limitation. Journal of Cognitive Psychotherapy: An International Quarterly, 13, 273–291.([Page 176]1998). Seasonal Affective Disorder. Clinical Psychology: Science & Practice, 5, 275–290. http://dx.doi.org/10.1111/j.1468-2850.1998.tb00150.x, , , , , & (1988). The effects of graduate training on reasoning. American Psychologist, 43, 431–442. http://dx.doi.org/10.1037/0003-066X.43.6.431, , & (1987). Recall of parental behavior by acute depressives, remitted depressives, and nondepressives. Journal of Personality & Social Psychology, 52, 611–619. http://dx.doi.org/10.1037/0022-3522.214.171.1241, & (1970). Techniques for assessing outcomes of psychotherapy. In P.McReynolds (Ed.), Advances in psychological assessment (Vol. 2, pp.178–197). Palo Alto, CA: Science and Behavior Books.(1986). Standardized direct-multivariate DOC systems for service and research. In G. L.Paul (Ed.), Assessment in residential treatment settings (pp. 223–266). Champaign, IL: Research Press., , & (1973). Encounter groups: First facts. New York: Basic Books., , & (1993). Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford.(1990). Theory as method: Small theories of treatments. In L.Sechrest, J.Bunker, & E.Perrin (Eds.), Health services research methodology: Strengthening causal inference from nonexperimental research. Washington, DC: U. S.. Public Health Service, National Center for Health Services Research and Health Care Technology Research.(1989). Driving toward theory in program evaluation: More models to choose from. Evaluation and Program Planning, 12, 317–328. http://dx.doi.org/10.1016/0149-7189%2889%2990048-7, & (1977). Flow chart models for using tests. Measurement and Evaluation in Guidance, 10, 18–23.(1998). Using feedback on patient progress to predict the outcome of psychotherapy. Journal of Clinical Psychology, 54, 383–393. http://dx.doi.org/10.1002/%28SICI%291097-4679%28199804%2954:3%3C383::AID-JCLP7%3E3.0.CO;2-Q(Lyons, J., Howard, K., O'Mahoney, M., & Lish, J. (Eds.). (1997). The measurement and management of clinical outcomes in mental health. New York: John Wiley.1974). The relationship of physicians’ medical recording performance to their medical care performance. Medical Care, 12, 463–469. http://dx.doi.org/10.1097/00005650-197405000-00008, & (1996). Inferences in therapy: Processes and hazards. Professional Psychology: Research and Practice, 27, 600–603. http://dx.doi.org/10.1037/0735-7028.27.6.600(2001). The potential of conversation analysis for psychotherapy research. The Counseling Psychologist, 29, 413–434. http://dx.doi.org/10.1177/0011000001293006, , & (1987). Explorations in nonverbal and verbal behavior. Hillsdale, NJ: Lawrence Erlbaum.(1959). On assessing the results of psychotherapy. British Journal of Medical Psychology, 32, 86–105. http://dx.doi.org/10.1111/j.2044-8341.1959.tb00472.x(1976). Psychological assessment: A conceptual approach. New York: Oxford University Press., & ([Page 177]1991). A system for improving psychiatric record keeping. Hospital & Community Psychiatry, 42, 1163–1166., , , , , & (1989). Conceptualizations of novice and experienced counselors. Journal of Counseling Psychology, 36, 395–400. http://dx.doi.org/10.1037/0022-0126.96.36.1995, , , , & (1994). The use of psychological testing for treatment planning and outcome assessment. Hillsdale, NJ: Lawrence Erlbaum.(1991). Measurement of parent-child interaction in studies of child maltreatment. In R. H.Starr, Jr. & D. A.Wolfe (Eds.), The effects of child abuse and neglect (pp. 203–256). New York: Guilford.(1986). Assessment of family interaction with the Response-Class Matrix. In R. J.Prinz (Ed.), Advances in the behavioral assessment of children and families (pp. 29–69). Greenwich, CT: JAI., & (2001). Exporting analogue behavioral observation from research to clinical practice: Useful or cost-defective?Psychological Assessment, 13, 86–98. http://dx.doi.org/10.1037/1040-35188.8.131.52, & (1993). Assessment considerations in the identification of failing psychotherapy: Bringing the negatives out of the darkroom. Psychological Assessment, 5, 292–301. http://dx.doi.org/10.1037/1040-35184.108.40.2062, & (Masterpasqua, F., & Perna, P. A. (Eds). (1997). The psychological meaning of chaos: Translating theory into practice. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10240-0001992). Psychological testing and assessment in the 21st century. American Psychologist, 47, 1007–1018. http://dx.doi.org/10.1037/0003-066X.47.8.1007(1993). More than a thousand words: Graphics for clinical practice. Washington, DC: NASW.(1997). Clinical practice with individuals. Washington, DC: NASW Press.(1996). Qualitative research design: An interactive approach. Thousand Oaks, CA: Sage.(1999). Multicultural summit cheers packed house. APA Monitor, 30, 26.(1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota Press. http://dx.doi.org/10.1037/11281-000(1980). Cognitive therapy modification. In C. H.Patterson (Ed.), Theories of counseling psychotherapy ((3rd ed., pp. 251–270). New York: Harper & Row.1994). The chronic crisis in psychological measurement and assessment. New York: Academic Press.(1997). Nomothetic item selection rules for tests of psychological interventions. Psychotherapy Research, 7, 419–427. http://dx.doi.org/10.1080/10503309712331332113(1998). Evaluating change-based item selection rules. Measurement and Evaluation in Counseling and Development, 31, 15–27.([Page 178]1999). Training the practitioner-scientist: Bridging case conceptualization, assessment, and intervention. The Counseling Psychologist, 27, 589–613. http://dx.doi.org/10.1177/0011000099276008(1990). Trends in reporting psychometric properties of instruments employed in counseling psychology research. Journal of Counseling Psychology, 37, 113–115. http://dx.doi.org/10.1037/0022-0220.127.116.11, & (2001). The elements of counseling (, & (4th ed.). Pacific Grove, CA: Brooks/Cole.2000). Data collection issues in an urban community mental health center: What is necessary and sufficient information for outcome assessment?Professional Psychology: Research and Practice, 31, 409–411. http://dx.doi.org/10.1037/0735-7028.31.4.409, & (1991). Computer-based unobtrusive measurement: Potential supplements to reactive self-reports. Professional Psychology: Research and Practice, 22, 410–412. http://dx.doi.org/10.1037/0735-7028.22.5.410, & (1996). Applying multiple computerized text-analytic measures to single psychotherapy cases. Journal of Psychotherapy Practice & Research, 5, 307–318., & (1994). Qualitative data analysis. Thousand Oaks, CA: Sage., & (1984). The sociology of small groups ((2nd ed.). Englewood Cliffs, NJ: Prentice Hall.1974). Families and family therapy. Cambridge, MA: Harvard University Press.(2001). Analogue assessment of child behavior problems. Psychological Assessment, 13, 36–45. http://dx.doi.org/10.1037/1040-3518.104.22.168, & (1994). Assessing predictions of violence: Being accurate about accuracy. Journal of Consulting and Clinical Psychology, 62, 783–792. http://dx.doi.org/10.1037/0022-006X.62.4.783(1991). Case conceptualization: Applying theory to individuals. Counselor Education and Supervision, 30, 355–365. http://dx.doi.org/10.1002/j.1556-6978.1991.tb01216.x(1988). Psychological testing. Englewood Cliffs, NJ: Prentice Hall., & (1994). Psychological testing (, & (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.1998). Practice guidelines: Not yet ideal. American Psychologist, 53, 290–299. http://dx.doi.org/10.1037/0003-066X.53.3.290(1999). Cognitive case conceptualization. Mahwah, NJ: Lawrence Erlbaum.(1988). Cognitive integration and differentiation in vocational behavior. The Counseling Psychologist, 16, 440–475. http://dx.doi.org/10.1177/0011000088163009(1989a). Application of repertory grid technique to vocational assessment. Journal of Counseling and Development, 67, 585–589. http://dx.doi.org/10.1002/j.1556-6676.1989.tb01336.x(1989b). Personal construct systems in vocational development and information-processing. Journal of Career Development, 16, 83–96.([Page 179]1989). The impact of sex, sex-role orientation, and construct type on vocational differentiation, integration, and conflict. Journal of Vocational Behavior, 34, 236–251. http://dx.doi.org/10.1016/0001-8791%2889%2990016-X, , , , & (1993). Defining the boundaries of constructivist assessment. In G. J.Neimeyer (Ed.), Constructivist assessment (pp. 1–30). Newbury Park, CA: Sage., & (1993). Constructivist approaches to the measurement of meaning. In G. J.Neimeyer (Ed.), Constructivist assessment (pp. 58–103). Newbury Park, CA: Sage.(1998). The pedagogy of counseling: A critical examination. Counselor Education and Supervision, 38, 70–88. http://dx.doi.org/10.1002/j.1556-6978.1998.tb00560.x, & (1977a). Assessment and therapeutic functions of self-monitoring. In M.Hersen, R. M.Eisler, & P. M.Miller (Eds.), Progress in behavior modification (Vol. 5, pp. 263–308). New York: Brunner/Mazel.(1977b). Methodological issues in assessment via self-monitoring. In J. D.Cone & R. P.Hawkins (Eds.), Behavioral assessment: New directions in clinical psychology (pp. 217–254). New York: Brunner/Mazel.(1977). Clinical quantitative methods. New York: Grune & Stratton.(1995). Supervision strategies for the first practicum. Alexandria, VA: American Counseling Association., , & (1996). A qualitative study of experts’ conceptualization of supervisee reflectivity. Journal of Counseling Psychology, 43, 3–9. http://dx.doi.org/10.1037/0022-022.214.171.124, , & (2001). Social identities in contexts: An ecological model of multicultural counseling psychology processes. The Counseling Psychologist, 29, 471–486. http://dx.doi.org/10.1177/0011000001294001, & (1995). Clinical decision making in everyday practice: The science in the art. Cognitive & Behavioral Practice, 2, 5–25. http://dx.doi.org/10.1016/S1077-7229%2805%2980003-3, & (1997). Declaration of treatment failures. In J.Rush (Ed.), Mood disorders: Systematic medication management. (Vol. 25, pp. 17–33). Basel, Switzerland: S. Karger AG. http://dx.doi.org/10.1159/000061672, & (Norcross, J. C., & Goldfried (Eds.). (1992). Handbook of psychotherapy integration. New York: Basic Books.2001). Analogue observational methods in the assessment of social functioning in adults. Psychological Assessment, 13, 59–72. http://dx.doi.org/10.1037/1040-35126.96.36.199, & (2001). Practice evaluation for the 21st Century. Belmont, CA: Wadsworth., , & (1967). Psychometric theory. New York: McGraw-Hill.(1995). Inaccuracies in the estimation of functional relationships using self-monitoring data. Journal of Behavior Therapy and Experimental Psychiatry, 26, 351–357. http://dx.doi.org/10.1016/0005-7916%2895%2900042-9(1991). A model for the clinical assessment of the sexually abuse child. Behavioral Assessment, 13, 325–339., & ([Page 180]1989). What is a good treatment decision? The client's perspective. Professional Psychology: Research and Practice, 20, 404–407. http://dx.doi.org/10.1037/0735-7028.20.6.404, , , & (1996). Assessing outcome in clinical practice. Needham Heights, MA: Allyn & Bacon., , & (1993). Clinical inference: How to draw meaningful conclusions from tests. Brandon, VT: Clinical Psychology.(1994). Process and outcome in psychotherapy: Noch einmal. In A. E.Bergin & S. L.Garfield (Eds.), Handbook of psychotherapy and behavior change (, , & (4th ed., pp. 270–376). New York, NY: John Wiley.1986). Does quality assurance improve ambulatory care? Implementing a randomized controlled trial in sixteen group practices. Journal of Ambulatory Care Management, 9, 1–15.(1988). MMPI, Rorschach and WAIS: A meta-analytic comparison of reliability, stability, and validity. Psychological Bulletin, 103, 367–373. http://dx.doi.org/10.1037/0033-2909.103.3.367, , & (1995). Time frames for mood: Relations between monetary and generalized ratings of affect. Personality & Social Psychology Bulletin, 21, 331–339. http://dx.doi.org/10.1177/0146167295214003, , , & (1996). Multicultural counseling: From diversity to universality. Journal of Counseling & Development, 74, 227–231. http://dx.doi.org/10.1002/j.1556-6676.1996.tb01856.x(Paul, G. L. (Ed.). (1986). Assessment in residential treatment settings. Champaign, IL: Research Press.1987a). The time-sample behavioral checklist. Champaign, IL: Research Press.(Paul, G. L. (Ed.). (1987b). The staff-resident interaction chronograph. Champaign, IL: Research Press.1986). Assessment purposes, domains, and utility for decision making. In G. L.Paul (Ed.), Assessment in residential treatment settings (pp. 1–26). Champaign, IL: Research Press., , & (1992). Effectiveness of inpatient treatment programs for mentally ill adults in public psychiatric facilities. Applied & Preventive Psychology, 1, 41–63. http://dx.doi.org/10.1016/S0962-1849%2805%2980133-7, & (1954). Counseling theory and practice. New York: Ronald Press. http://dx.doi.org/10.1037/10631-000, & (1989). Cognitive therapy in practice: A case formulation approach. New York: Norton.(1998). Are results of randomized controlled trials useful to psychotherapists?Journal of Consulting and Clinical Psychology, 66, 126–135. http://dx.doi.org/10.1037/0022-006X.66.1.126, & (1984). Idiographic approaches to personality. In N.Endler & J. McV.Hunt (Eds.), Personality and the behavioral disorders (pp. 261–282). New York: John Wiley.([Page 181]1992). Strategies of inquiry for the practice of psychology. The Journal of Training and Practice in Professional Psychology, 6, 35–45.(Peterson, R., McHolland, J., Bent, R., Davis-Russell, E., Edwall, G., Polite, K., Singer, D., & Stricker, G. (Eds.). (1991). The core curriculum in professional psychology. Washington, DC: American Psychological Association.1996). Use of the Beck Depression Inventory in clinical practice. Psychological Reports, 79, 873–874. http://dx.doi.org/10.2466/pr0.19188.8.131.523(1998). Residential drug abuse treatment for probationers: Use of node-link mapping to enhance participation and progress. Journal of Substance Abuse Treatment, 15, 535–543. http://dx.doi.org/10.1016/S0740-5472%2897%2900313-9, , , & (1977). Strong inference. In H. S.Broudy, R. H.Ennis, & L. I.Krimerman (Eds.), Philosophy of educational research (pp. 203–217). New York: John Wiley.(1995). An eclectic and integrative approach: Transtheoretical therapy. In A. S.Gurman & S. B.Messer (Eds.), Essential psychotherapies (pp. 403–440). New York: Oxford University Press.(1983). Stages and processes of self-change in smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology, 5, 390–395. http://dx.doi.org/10.1037/0022-006X.51.3.390, & (1998). Evaluating the impact of structured groupwork with men in a high security hospital. Criminal Behaviour and Mental Health, 8, 77–92. http://dx.doi.org/10.1002/cbm.286, & (1974). Synchrony and desynchrony in fear and avoidance. Behavior Research and Therapy, 12, 311–318. http://dx.doi.org/10.1016/0005-7967%2874%2990005-9, & (1998). Multicultural assessment: Reexamination, recon-ceptualization, and practical application. The Counseling Psychologist, 26, 827–910. http://dx.doi.org/10.1177/0011000098266001, , & (1999). Dynamic cognitive case conceptualization and the treatment of anxiety disorders: Implications of the looming vulnerability model. Journal of Cognitive Psychotherapy: An International Quarterly, 13, 293–313., & (2001). Assessing changes in family interaction: Structural Family Systems Ratings. In P.Kerig & K.Lindahl (Eds.), Family observational coding systems: Resources for systemic research (pp. 207–224). Mahwah, NJ: Lawrence Erlbaum., , , & (2001). Clinic observations of structured parent-child interaction designed to evaluate externalizing disorders. Psychological Assessment, 13, 46–58. http://dx.doi.org/10.1037/1040-35184.108.40.206(1996). Multicultural issues in assessment: Toward an inclusive model. In J.DeLucia-Waack (Ed.), Multicultural counseling competencies: Implications for training and practice (pp. 113–153). Alexandria, VA: Association for Counselor Education and Supervision., & (2001). Learning arenas for professional development: Retrospective accounts of senior psychotherapists. Professional Psychology: Research & Practice, 32, 181–187. http://dx.doi.org/10.1037/0735-7028.32.2.181, & (1992). Facilitating clinical decision making and evaluation. Families in Society: The Journal of Contemporary Human Services, 73, 522–532.([Page 182]1980). Rating the ratings: Assessing the psychometric quality of rating data. Psychological Bulletin, 88, 413–428. http://dx.doi.org/10.1037/0033-2909.88.2.413, , & (1970). The psychiatric interview: The impact of the first three minutes. American Journal of Psychiatry, 126, 968–973., , & (1986). Prediction and clinical inference: Forty years later. Journal of Personality Assessment, 50, 362–369. http://dx.doi.org/10.1207/s15327752jpa5003_5(1992). Tailor-made versus standardized therapy of phobic patients. Advances in Behaviour Research and Therapy, 14, 67–92. http://dx.doi.org/10.1016/0146-6402%2892%2990001-5, , , & (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105. http://dx.doi.org/10.1037/0003-066X.54.2.93(1996). Using the inverted pyramid heuristic in counselor education and supervision. Counselor Education & Supervision, 35, 258–267. http://dx.doi.org/10.1002/j.1556-6978.1996.tb01927.x(2000). An idiographic approach to understanding personality structure and individual differences among smokers. Cognitive Therapy and Research, 24, 345–359. http://dx.doi.org/10.1023/A:1005567405173, , & (1990). Strategies for increasing the rigor of qualitative methods in evaluation of health care programs. Evaluation Review, 14, 57–74. http://dx.doi.org/10.1177/0193841X9001400104, , & (1995). The evolving professional self: Stages and themes in therapist and counselor development. New York: John Wiley., & (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752–760. http://dx.doi.org/10.1037/0003-066X.32.9.752, & (1978). Hypothesis-testing processes in social interaction. Journal of Personality and Social Psychology, 36, 1202–1212. http://dx.doi.org/10.1037/0022-35220.127.116.112, & (1999). Clinical interviewing (, & (2nd ed.). Needham Heights, MA: Allyn & Bacon.1996). Mental health services outcome evaluation. Clinical Psychology: Science & Practice, 3, 105–129. http://dx.doi.org/10.1111/j.1468-2850.1996.tb00061.x, & (1994). Clinical judgment biases: The moderating roles of counselor cognitive complexity and counselor client preferences. Journal of Counseling Psychology, 41, 8–17. http://dx.doi.org/10.1037/0022-018.104.22.168, & (1995). A scientist-practitioner model of psychological assessment: Implications for training, practice and research. The Counseling Psychologist, 23, 506–534. http://dx.doi.org/10.1177/0011000095233009, , , & (1996). Treatment outcomes in psychotherapy and psychiatric interventions. New York: Brunner/Mazel., , , & (1970). Manual for the State-Trait Anxiety Inventory: STAI. Palo Alto, CA: Consulting Psychologists Press., , & (1980). Measurement of the impact of psychotherapy sessions. Journal of Consulting and Clinical Psychology, 48, 176–185. http://dx.doi.org/10.1037/0022-006X.48.2.176(2000). Training models in counseling psychology: Scientist-practitioner versus practitioner-scholar. The Counseling Psychologist, 28, 622–640. http://dx.doi.org/10.1177/0011000000285002, , , , & ([Page 183]1998). IDM supervision. San Francisco: Jossey-Bass., , & (1985). Happiness and reminiscing: The role of time perspective, mood, and mode of thinking. Journal of Personality and Social Psychology, 49, 1460–1469. http://dx.doi.org/10.1037/0022-3522.214.171.1240, , & (Strauss, A., & Corbin, J. (Eds.). (1997). Grounded theory in practice. Thousand Oaks, CA: Sage.1998). Thinking small: Research designs appropriate for clinical practice. Canadian Journal of Psychiatry, 43, 737–741.(1995). The local clinical scientist: A bridge between science and practice. American Psychologist, 50, 995–1002. http://dx.doi.org/10.1037/0003-066X.50.12.995, & (1995). Interpersonal influence theory: The situational and individual determinants of interpersonal behavior. In D. J.Lubinski & R. V.Dawis (Eds.), Assessing individual differences in human behavior: New concepts, methods, and findings (pp. 263–295). Palo Alto, CA: Consulting Psychologists.(1992). Social psychology and counseling psychology: The history, products, and promise of an interface. Journal of Counseling Psychology, 39, 139–157. http://dx.doi.org/10.1037/0022-0126.96.36.199, , , & (1997). On the limitations of therapy manuals. Clinical Psychology: Science and Practice, 4, 76–82. http://dx.doi.org/10.1111/j.1468-2850.1997.tb00101.x, & (Strupp, H. H., Horowitz, L. M., & Lambert, M. J. (Eds.). (1997). Measuring patient changes in mood, anxiety, and personality disorders: Toward a core battery. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10232-000Sue, D. W., Ivey, A. E., & Pedersen, P. B. (Eds.). (1996). A theory of multicultural counseling and therapy. Pacific Grove, CA: Brooks/Cole.1984). Effects of sex-role stereotypes and androgynous alternatives on mental health judgments of psychotherapists. Psychological Reports, 54, 475–481. http://dx.doi.org/10.2466/pr0.19188.8.131.525, & (2000). Interpersonal process in psychotherapy ((4th ed.). Pacific Grove, CA: Brooks/Cole.1999). Using case formulation to manage treatment nonresponse. Journal of Cognitive Psychotherapy: An International Quarterly, 13, 317–331.(1999). Inference and attribution errors in test interpretation. In J. W.Lichtenberg & R. K.Goodyear (Eds.), Scientist-practitioner perspectives on test interpretation (pp. 59–112). Needham Heights, MA: Allyn & Bacon., & (1989). Reactance in relation to different supervisory environments and counselor development. Journal of Counseling Psychology, 36, 336–344. http://dx.doi.org/10.1037/0022-0184.108.40.2066, , & (1998). The scientific practice of professional psychology. New York: Plenum., & (1983). Visual display of quantitative information. Cheshire, CT: Graphics.(1990). Envisioning information. Cheshire, CT: Graphics.([Page 184]1977). Exploratory data analysis. Reading, MA: Addison-Wesley.(1981). Heterosexual avoidance in college males. Behavior Modification, 5, 523–552. http://dx.doi.org/10.1177/014544558154005, , & (1996). Outcome assessment of psychotherapy. American Psychologist, 51, 1005–1106. http://dx.doi.org/10.1037/0003-066X.51.10.1005(1996). A criterion measurement model for health behavior change. Addictive Behaviors, 21, 555–584. http://dx.doi.org/10.1016/0306-4603%2895%2900083-6, , , & (1999). A review of recent research addressing the utility of the Rorschach. Psychological Assessment, 11, 251–265. http://dx.doi.org/10.1037/1040-35220.127.116.11(1999). Dictionary of statistics and methodology: A nontechnical guide for the social sciences ((2nd ed.). Thousand Oaks, CA: Sage.2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Lawrence Erlbaum.(1994). Teaching counselor trainees a divergent versus a convergent hypothesis-formation strategy. Journal of Counseling & Development, 73, 69–73. http://dx.doi.org/10.1002/j.1556-6676.1994.tb01712.x, & (1997). Some concluding thoughts about psychotherapy supervision. In C. E.Watkins, Jr. (Ed.), Handbook of psychotherapy supervision (pp. 603–616). New York: John Wiley.(1981). Nonreactive measures in the social sciences. Boston: Houghton Mifflin., , , , & (1989). Clinical judgment and decision making in neuropsychology. Archives of Clinical Neuropsychology, 4, 233–265., & (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 177, 450–468. http://dx.doi.org/10.1037/0033-2909.117.3.450, , , , & (1976). Computer power and human reason. San Francisco: Freeman.(2001). A multi-dimensional meta-analysis of treatments for depression, panic, and generalized anxiety disorder: An empirical examination of the status of empirically supported therapies. Journal of Consulting and Clinical Psychology, 69, 875–899. http://dx.doi.org/10.1037/0022-006X.69.6.875, & (1999). The psychotherapy documentation primer. New York: John Wiley.(1973). Personality and prediction: Principles of personality assessment. Reading, MA: Addison-Wesley.(1991). Test validity and invalidity reconsidered. In R. E.Snow & E.Wiley (Eds.), Improving inquiry in social science (pp. 75–108). Hillsdale, NJ: Lawrence Erlbaum.(1996). Manual-based treatments: The clinical application of research findings. Behavior Research and Therapy, 34, 295–314. http://dx.doi.org/10.1016/0005-7967%2895%2900084-4(1995). Theory and practice of group psychotherapy (([Page 185]4th ed.). New York: Basic Books.1995). Coping with psychiatric and psychological testimony ((5th ed.). Los Angeles: Law and Psychology Press.1997). The paper office ((2nd ed.). New York: Guilford.
About the Author[Page 191]
Scott T. Meier is Professor and Co-Director of Training of the Program in Counseling/School Psychology, Department of Counseling, School, and Educational Psychology, University at Buffalo. His major research and teaching areas focus on psychological assessment and testing (particularly outcome assessment), research methods (particularly program evaluation), and counseling skills (particularly the integration of case conceptualization and assessment with intervention). He is a licensed psychologist who received his Ph.D. in Counseling Psychology from Southern Illinois University, Carbondale in 1984. He is also the author or coauthor of four books, including Elements of Counseling (Brooks/Cole, 2001), and 40 journal articles.