Interpreting Results in Mental Health Research
Tóm tắt
It is often difficult to interpret the clinical or policy significance of findings from mental health research when results are presented only in terms of statistical significance. Results expressed in terms of p values or as a metric corresponding to a mental health status scale are seldom intuitively meaningful. To help interpret the significance of research results, we demonstrate a social validity approach that relates scores on mental health status scales to four subsequent major life events. A logistic regression model is used to estimate the relation between mental health status scores and the probability of subsequent major life events, using data obtained on Medicaid beneficiaries with schizophrenia from an evaluation of the Utah Prepaid Mental Health Plan. Using this relatively simple approach will demonstrate to policy makers, clinicians, and researchers the social impact of an outcome, thereby aiding in the interpretation of the significance of results.
Tài liệu tham khảo
Anderson, J., Larsen, J. K., Schultz, V., Nielsen, B. M., Korner, A., Behnke, K., Munk-Andersen, E., Butler, B., Allerup, P., & Bech, P. (1989). The brief psychiatric rating scale: Dimensions of schizophrenia-reliability and construct validity. Psychopathology, 22, 168–176.
Bebbington, P., Wilkins, S., Jones, P., Foerster, A., Murray, R., Toone, B., & Lewis, S. (1993). Life events and psychosis: Initial results from the Camberwell Collaborative Psychosis Study. British Journal of Psychiatry, 162, 72–79.
Brook, R. H., Ware, J. E., Rogers, W. H., Keeler, E.B., Davies, A. R., Donald, C. A., Goldberg, G. A., Lohr, K. N., Masthay, P. C., & Newhouse, J. P. (1983). Does free care improve adults' health? The New England Journal of Medicine, 309, 1426–1434.
Christianson, J. B., & Gray, D. Z. (1994). What CMHCs can learn from two states' efforts to capitate Medicaid benefits. Hospital and Community Psychiatry, 45, 777–781.
Christianson, J. B., Gray, D. Z., Kihlstrom, L. C., & Speckman, Z. K. (1995). Development of the Utah prepaid mental health plan. Advances in Health Economics and Health Research, 15, 117–135.
Christianson, J., Manning, W., Lurie, N., Stoner, T., Gray, D., Popkin, M., & Marriott, S. (1995). Utah's prepaid mental health plan: The first year. Health Affairs, 14, 160–172.
Cohen, J. (1977) Statistical Power Analysis for the Behavioral Sciences. New York, NY: Academic Press.
Dworkin, R. J., Friedman, L. C., Telschow, R. L., Grant, K. D., Moffic, H. S., & Sloan, V. J. (1990). The longitudinal use of the Global Assessment Scale in multiple-rater situations. Community Mental Health Journal, 26, 335–344.
Endicott, J., & Spitzer, R. L. (1978). A diagnostic interview: The schedule for affective disorders and schizophrenia. Archives of General Psychiatry, 35, 837–844.
Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The Global Assessment Scale: A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33, 766–771.
Foster, S. L., & Nash, E. J. (1999). Assessing social validity in clinical treatment research: Issues and procedures. Journal of Consulting and Clinical Psychology, 67, 308–319.
Glick, I. D., Clarkin, J. F., Haas, G. L., & Spencer, J. H. (1993). Clinical significance of inpatient family intervention: Conclusions from a controlled clinical trial. Hospital and Community Psychiatry, 44, 869–873.
Hedlund, J. L., & Vieweg, M. S. (1980). The Brief Psychiatric Rating Scale (BPRS): A comprehensive review. Journal of Operational Psychiatry, 11, 48–65.
Huber, P. J. (1981). Robust statistics. New York: Wiley.
Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999). Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives. Journal of Consulting and Clinical Psychiatry, 67, 300–307.
Johnson, M. H., Magaro, P. A., & Stern S. L. (1986). Use of the SADS-C as a diagnostic and symptom severity measure. Journal of Consulting and Clinical Psychology, 54, 546–551.
Kazdin, A. E. (1977). Assessing the clinical or applied importance of behavior change through social validation. Behavior Modi-fication, 1, 427–452.
Kazdin, A. E. (1999). The meaning and measurement of clinical significance. Journal of Consulting and Clinical Psychology, 67, 332–339.
Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989). Effect sizes for interpreting changes in health status. Medical Care, 27, s178–s189.
Kendall, P. C., Marrs-Garcia, A., Nath, S. R., & Sheldrick, R. C. (1999). Normative comparisons for the evaluation of clinical significance. Journal of Consulting and Clinical Psychology, 67, 285–299.
Lehman, A. F. (1983) The well-being of chronic mental patients: Assessing their quality of life. Archives of General Psychiatry, 40, 369–373.
Lurie, N., Moscovice, I., Popkin, M. & Dysken, M. (1992). Accuracy of medicaid claims for psychiatric diagnoses: Experience with the diagnosis of schizophrenia. Hospital and Community Psychiatry, 43, 69–71.
Malla, A. K., & Norman, R. M. (1992). Relationship of major life events and daily stressors to symptomatology in schizophrenia.Journal of Nervous and Mental Disease, 180, 664–667.
Overall, J. E. (1979). Criteria for the selection of subjects for research in biological psychiatry. In Van H. M. Prag, M.H. Lader, O. J. Rafaelsen, & E. J. Sachar (Eds.), Handbook of biological psychiatry (pp. 359–391). New York: Dekker.
Overall, J. E., & Gorham, D. R. (1962).The Brief Psychiatric Rating Scale. Psychological Reports, 10, 799–812.
Sechrest, L., McKnight, P., & McKnight, K. (1996). Calibration of measures for psychotherapy outcome studies. American Psychologist, 51, 1065–1071.
Van Os, J., Fahy, T. A., Bebbington, P., Jones, P., Wilkins, S., Sham, P., Russell, A., Gilvarry, K., Lewis, S., Toone, B., & Murray, R. (1994). The influence of life events on the subsequent course of psychotic illness: A prospective follow-up of the Camberwell Collaborative Psychosis Study. Psychological Medicine, 24, 503–513.
Wells, K. B., Manning, W. G., & Valdez, R. B. (1989). The effect of insurance generosity on the psychological distress and psychological well-being of a general population. Archives of General Psychiatry, 46, 315–320.
Wirshing, D. A., Marshall, B.D., Jr., Green, M. F., Mintz, J., Marder, S. R., & Wirshing, W. C. (1999). Risperidone in treatmentrefractory schizophrenia. American Journal of Psychiatry, 156, 1374–1379.
Wolf, M. M. (1978). Social validity: The case of subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203–214.