Journal of the American Academy of Child & Adolescent Psychiatry
Volume 47, Issue 10 , Pages 1114-1119 , October 2008

A Measurement Feedback System (MFS) Is Necessary to Improve Mental Health Outcomes

  • Leonard Bickman, Ph.D.

      Affiliations

    • Dr. Bickman is with Vanderbilt University
    • Corresponding Author InformationCorrespondence to Dr. Leonard Bickman, Center for Evaluation and Program Improvement, #151 Peabody, 230 Appleton Place, Nashville TN 37203-5721

,Accepted 6 April 2008.

References 

  1. APA Presidential Task Force on Evidence-Based Practice  . Evidence-based practice in psychology . Am Psychol . 2006;61:271–285
  2. Johnston C , Gowers S . Routine outcome measurement: a survey of UK child and adolescent mental health services . Child Adolesc Mint Health . 2005;10:133–139
  3. Phelps R , Eisman EJ , Kohout J . Psychological practice and managed care results of the CAPP Practitioner Survey . Prof Psychol Res Pract . 1998;29:31–36
  4. Garland AF , Kruse M , Aarons GA . Clinicians and outcome measurement: what's the use? . J Behav Health Serv Res . 2003;30:393–405
  5. Schoenwald SK , Chapman JE , Kelleher K , et al.   A survey of the infrastructure for children's mental health services: implications for the implementation of empirically supported treatments (ESTs) . Adm Policy Ment Health . 2008;35:84–97
  6. Ægisdóttir S , White MJ , Spengler PM , et al.   The meta-analysis of clinical judgment project: fifty-six years of accumulated research on clinical versus statistical prediction . Couns Psychol . 2006;34:341–382
  7. Kluger AN , Denisi A . The effects of feedback interventions on performance: a historical review, a meta-analysis and a preliminary feedback intervention theory . Psychol Bull . 1996;119:254–284
  8. Rose DJ , Church RJ . Learning to teach: the acquisition and maintenance of teaching skills . J Behav Educ . 1998;8:5–35
  9. Hawkins EJ , Lambert MJ , Vermeersch D , Slade K , Tuttle K . The therapeutic effects of providing patient progress information to therapists and patients . Psychother Res . 2004;14:308–327
  10. Lambert MJ , Whipple JL , Hawkins EJ , Vermeersch D , Nielsen SL , Smart DW . Is it time for clinicians to routinely track patient outcome? A meta-analysis . Clin Psychol Sci Pract . 2003;10:288–301
  11. Stricker G , Trierweiler SJ . The local clinical scientist: a bridge between science and practice . Am Psychol . 1995;50:995–1002
  12. Hatfield DR , Ogles BM . The use of outcome measures by psychologists in clinical practice . Prof Psychol Res Pract . 2004;35:485–491
  13. Meehan T , McCombes S , Hatzipetrou L , Catchpoole R . Introduction of routine outcome measures: staff reactions and issues for consideration . J Psychiatr Ment Health Nurs . 2006;13:581–587
  14. Bachman J . Pay for performance in primary and specialty behavioral health care: two “concept” proposals . Prof Psychol Res Pract . 2006;37:384–388
  15. Center for Mental Health Services  . Mental Health, United States, 2000 (DHHS Publ. No. (SMA) 01-3537) . Washington, DC: U.S. Government Printing Office; 2001;
  16. Foote SM , Jones SB . Trends: consumer choice markets: lessons from FEHB mental health coverage . Health Aff . 1999;18:125–130
  17. Mark TL , Levit KR , Coffey RM , et al.   National Expenditures for Mental Health Services and Substance Abuse Treatment, 1993–2003 (SAMHSA Publication No. SMA 07-4227) . Rockville, MD: Substance Abuse and Mental Health Services Administration; 2007;
  18. Martin A , Leslie D . Psychiatric inpatient, outpatient, and medication utilization and costs among privately insured youths, 1997–2000 . Am J Psychol . 2003;160:757–764
  19. Weisz JR , Jensen-Doss A , Hawley KM . Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons . Am Psychol . 2006;61:671–689
  20. Marinopoulos SS, Dorman T, Ratanawongsa N, et al. Effectiveness of Continuing Medical Education. Evidence Report/Technology Assessment No. 149. AHRQ Publication No. 07-E006. Rockville, MD: Agency for Healthcare Research and Quality; 2007.
  21. Ganju VK . The Need for an Evidence-Based Culture: Lessons Learned from Evidence-Based Practices Implementation Initiatives . Alexandria, VA: NASMHPD Research Institute; 2006;
  22. National Association of State Mental Health Program Directors  . Results of a Survey of State Directors of Adult and Child Mental Health Services on Implementation of Evidence-Based Practices . Alexandria, VA: NASMHPD Research Institute, Inc.; 2005;
  23. Sawyer RK . Creative teaching: collaborative discussion as disciplined improvisation . Educ Res . 2004;33:12–20
  24. Teich JL , Ireys HT . A national survey of state licensing, regulating, and monitoring of residential facilities for children with mental illness . Psychiatr Serv . 2007;58:991–998
  25. Joint Commission on the Accreditation of Healthcare Organizations (JCAHO)  . Performance measurement initiatives . http://www.jointcommission.org/PerformanceMeasurement/PerformanceMeasurement/ Accessed February 26, 2008
  26. Commission on Accreditation of Rehabilitation Facilities (CARF)  . 2007 Behavioral Health Standards Manual . Tucson, AZ: CARF International; 2007;
  27. Brosan L , Reynolds S , Moore RG . Factors associated with competence in cognitive therapists . Behav Cogn Psychother . 2007;35:179–190
  28. Barber JP , Sharpless BA , Klostermann S , McCarthy KS . Assessing intervention competence and its relation to therapy outcome: a selected review derived from the outcome literature . Prof Psychol Res Pract . 2007;38:493–500
  29. Michael KD , Huelsman TJ , Crowley SL . Interventions for child and adolescent depression: do professional therapists produce better results? . J Child Family Stud . 2005;14:223–236
  30. Lutz W , Leon SC , Martinovich Z , Lyons JS , Stiles WB . Therapist effects in outpatient psychotherapy: a three-level growth curve approach . J Couns Psychol . 2007;54:32–39
  31. Wampold BE , Brown GS . Estimating therapist variability: a naturalistic study of outcomes in managed care . J Consult Clin Psychol . 2005;73:914–923
  32. Kim DM , Wampold BE , Bolt DM . Therapist effects in psychotherapy: a random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data . Psychother Res . 2006;16:161
  33. Crits-Christoph P , Baranackie K , Kurcias JS , et al.   Meta-analysis of therapist effects in psychotherapy outcome studies . Psychother Res . 1991;1:81–91
  34. Elkin I . Rejoinder to commentaries by Stephen Soldz and Paul Crits-Christoph on therapist effects . Psychother Res . 2006;16:182–183
  35. Howard KI , Moras K , Brill PL , Martinovich Z , Lutz W . Evaluation of psychotherapy efficacy, effectiveness and patient progress . Am Psychol . 1996;51:1059–1064
  36. Margison FR , McGrath G , Barkhamj M , et al.   Measurement and psychotherapy . Br J Psychiatry . 2000;177:123–130
  37. Bickman L . A common factors approach to improving mental health services . Ment Health Serv Res . 2005;7:1–4
  38. Duncan BL , Miller SD , Sparks J . Common factors and the uncommon heroisms of youth . Psychother Aust . 2007;13:34–43
  39. Mash EJ , Hunsley J . Evidence-based assessment of child and adolescent disorders: issues and challenges . J Clin Child Adolesc Psychol . 2005;34:362–379
  40. Hunsley J , Mash EJ . Evidence-based assessment . Annu Rev Clin Psychol . 2007;3:29–51
  41. Lambert MJ , Burlingame GM . Using practice-based evidence with evidence-based practice (health module) . Behav Healthc . 2007;27:16
  42. Chorpita BF , Bernstein A , Daleiden EL . The Research Network on Youth Mental Health. Driving with roadmaps and dashboards: using information resources to structure the decision models in service organizations . Adm Policy Mental Health . 2008;35:114–123
  43. Wolpert M , Cooper L , Tingay K , Young K , Svanberg E , the CORC Committee  . CAMHS Outcomes Research Consortium Handbook (Version 2.0) . London: The Consortium; 2007; http://www.networks.nhs.uk/uploads/user/handbook_2007.pdf Accessed January 10, 2008
  44. Bickman L , Nurcombe B , Townsend C , Belle M , Schut J , Karver M . Consumer Measurement System in Child and Adolescent Mental Health . Canberra: Department of Health and Family Services; 1999;
  45. Pirkis J , Burgess P , Coombs T , Clarke A , Jones-Ellis D , Dickson R . Routine measurement of outcomes in Australia's public sector mental health services . Aust N Z Health Policy . 2005;2:8; DOI: 10.1186/1743-8462-2-8
  46. Birleson P . Turning child and adolescent mental-health services into learning organizations . Clin Child Psychol Psychiatry . 1999;4:265–274
  47. Riemer M , Rosof-Williams J , Bickman L . Theories related to changing clinician practice . Child Adolesc Psychiatr Clin N Am . 2005;14:241–254
  48. Sapyta J , Riemer M , Bickman L . Feedback to clinicians: theory, research, and practice . J Clin Psychol . 2005;61:145–153
  49. Glisson C , Landsverk J , Schoenwald SK , et al.   Assessing the organizational social context (OSC) of mental health services: implications for implementation research and practice . Adm Policy Ment Health . 2008;35:98–113
  50. Peterson KA , Bickman L . Program personnel: the missing ingredient in describing the program environment . In:  Conrad KJ ,  Roberts-Gray C editor. Evaluating Program Environments . San Francisco: Jossey-Bass; 1988;p. 83–92
  51. Karver MS , Handelsman JB , Fields S , Bickman L . A theoretical model of common process factors in youth and family therapy . Ment Health Serv Res . 2005;7:35–51
  52. Reichhardt T . Harder than rocket science . Nature . 2005;435:1024–1025

 Preparation of this article was partially supported by grants from NIMH (MH 068589-01) and the Leon Lowenstein Foundation.

PII: S0890-8567(08)60095-7

doi: 10.1097/CHI.0b013e3181825af8

Journal of the American Academy of Child & Adolescent Psychiatry
Volume 47, Issue 10 , Pages 1114-1119 , October 2008

Article Tools