Listening to the elephant in the room: response-shift effects in clinical trials research
Tóm tắt
While a substantial body of work postulates that adaptation (response-shift effects) may serve to hide intervention benefits, much of the research was conducted in observational studies, not randomized-controlled trials. This scoping review identified all clinical trials that addressed response shift phenomena, and characterized how response-shift effects impacted trial findings. A scoping review was done of the medical literature from 1968 to 2021 using as keywords “response shift” and “clinical trial.” Articles were included if they were a clinical trial that explicitly examined response-shift effects; and excluded if they were not a clinical trial, a full report, or if response shift was mentioned only in the discussion. Clinical-trials papers were then reviewed and retained in the scoping review if they focused on randomized participants, showed clear examples of response shift, and used reliable and valid response-shift detection methods. A synthesis of review results further characterized the articles’ design characteristics, samples, interventions, statistical power, and impact of response-shift adjustment on treatment effect. The search yielded 2148 unique references, 25 of which were randomized-controlled clinical trials that addressed response-shift effects; 17 of which were retained after applying exclusion criteria; 10 of which were adequately powered; and 7 of which revealed clinically-important response-shift effects that made the intervention look significantly better. These findings supported the presumption that response shift phenomena obfuscate treatment benefits, and revealed a greater intervention effect after integrating response-shift related changes. The formal consideration of response-shift effects in clinical trials research will thus not only improve estimation of treatment effects, but will also integrate the inherent healing process of treatments.
Tài liệu tham khảo
Wilson IB (1999) Clinical understanding and clinical implications of response shift. Soc Sci Med 48(11):1577–1588
Rothermund K, Brandtstadter J (2003) Coping with deficits and losses in later life: from compensatory action to accommodation. Psychol Aging 18(4):896–905
Richards TA, Folkman S, Schwartz CE, Sprangers MAG (2000) Response shift: a coping perspective. In: Adaptation to changing health: response shift in quality-of-life research. American Psychological Association, Washington, pp 25–36
Wrosch C, Scheier MF (2003) Personality and quality of life: the importance of optimism and goal adjustment. Qual Life Res 12(Suppl. 1):59–72
Ubel PA, Loewenstein G, Jepson C (2003) Whose quality of life? A commentary exploring discrepancies between health state evaluations of patients and the general public 1. Qual Life Res 12(6):599–607
Westerman MJ, Sprangers MA, Groen HJ, van der Wal G, Hak T (2007) Small-cell lung cancer patients are just “a little bit” tired: response shift and self-presentation in the measurement of fatigue. Qual Life Res 16(5):853–861
Sprangers MAG, Schwartz CE (1999) Integrating response shift into health-related quality of life research: a theoretical model. Soc Sci Med 48(11):1507–1515
Schwartz CE, Sprangers MAG (1999) Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Soc Sci Med 48:1531–1548. https://doi.org/10.1016/s0277-9536(99)00047-7
Rapkin BD, Schwartz CE (2004) Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health Qual Life Outcomes 2(1):14
Rapkin BD, Schwartz CE (2019) Advancing quality-of-life research by deepening our understanding of response shift: a unifying theory of appraisal. Qual Life Res 28(10):2623–2630. https://doi.org/10.1007/s11136-019-02248-z
Schwartz CE, Rohde G, Biletch E, Stuart RB, Huang I, Lipscomb J et al (2022) If it’s information, it’s not “bias”: a scoping review and proposed nomenclature for future response-shift research. Qual Life Res 31:2247–2257
Barclay-Goddard R, Epstein JD (2009) Response shift: A brief overview and proposed research priorities. Qual Life Res 18:335–346
Sajobi TT, Brahmbatt R, Lix LM, Zumbo BD, Sawatzky R (2018) Scoping review of response shift methods: current reporting practices and recommendations. Qual Life Res 27(5):1133–1146
Munn Z, Peters MD, Stern C, Tufanaru C, McArthur A, Aromataris E (2018) Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol 18(1):1–7
Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D et al (2018) PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 169(7):467–473
Schwartz CE, Bode R, Repucci N, Becker J, Sprangers MAG, Fayers PM (2006) The clinical significance of adaptation to changing health: a meta-analysis of response shift. Qual Life Res 15:1533–1550
Schwartz CE, Sprangers MAG, Carey A, Reed G (2004) Exploring response shift in longitudinal data. Psychol Health 19(1):51–69
Schwartz CE, Rapkin BD (2012) Understanding appraisal processes underlying the thentest: a mixed methods investigation. Qual Life Res 21:381–388. https://doi.org/10.1007/s11136-011-0023-4
Ahmed S, Mayo NE, Corbiere M, Wood-Dauphinee S, Hanley J, Cohen R (2005) Change in quality of life of people with stroke over time: true change or response shift? Qual Life Res 14:611–627. https://doi.org/10.1007/s11136-004-3708-0
Cohen J (1988) Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates, Hillsdale
Cohen J (1992) A power primer. Psychol Bull 112:155–159
Wolf EJ, Harrington KM, Clark SL, Miller MW (2013) Sample size requirements for structural equation models: an evaluation of power, bias, and solution propriety. Educ Psychol Meas 73(6):913–934
Kaplan D (1996) Statistical power in SEM. In: Schumacker RE, Lomax RG (eds) A beginner’s guide to structural equation modeling. Lawrence Erlbaum Associates, Publishers, Mahwah, pp 100–117
Saris WE, Satorra A (1993) Power evaluations in structural equation models. In: Bollen KA, Long JS (eds) Testing structural equation models, vol 154. Sage Publications, Newbury Park, pp 181–204
Norman GR, Sloan JA, Wyrwich KW (2003) Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 41(5):582–592
Schwartz CE, Sendor M (1999) Helping others helps oneself: response shift effects in peer support. Soc Sci Med 48(11):1563–1575
Bernhard J, Hurny C, Maibach R, Herrmann R, Laffer U (1999) Quality of life as subjective experience: reframing of perception in patients with colon cancer undergoing radical resection with or without adjuvant chemotherapy. Swiss Group for Clinical Cancer Research (SAKK). Ann Oncol 10(7):775–782
Bernhard J, Lowy A, Maibach R, Hürny C (2001) Response shift in the perception of health for utility evaluation an explorative investigation. Eur J Cancer 37(14):1729–1735. https://doi.org/10.1016/s0959-8049(01)00196-4
Ahmed S, Mayo NE, Wood-Dauphinee S, Hanley JA, Cohen SR (2004) Response shift influenced estimates of change in health-related quality of life poststroke. J Clin Epidemiol 57:561–570
Ring L, Höfer S, Heuston F, Harris D, O’Boyle CA (2005) Response shift masks the treatment impact on patient reported outcomes (PROs): the example of individual quality of life in edentulous patients. Health Qual Life Outcomes 3:55. https://doi.org/10.1186/1477-7525-3-55
Bernhard J, Lowy A, Mathys N, Herrmann R, Hürny C (2004) Health related quality of life: a changing construct? Qual Life Res 13(7):1187–1197
Mayo NE, Scott S (2011) Evaluating a complex intervention with a single outcome may not be a good idea: an example from a randomised trial of stroke case management. Age Ageing 40(6):718–724
Mollerup A, Johansen JD (2015) Response shift in severity assessment of hand eczema with visual analogue scales. Contact Dermatitis 72(3):178–183
Mayo N, Scott C, Ahmed S (2009) Case management post-stroke did not induce response shift: the value of residuals. J Clin Epidemiol 62:1148–1156
Ahmed S, Bourbeau J, Maltais F, Mansour A (2009) The Oort structural equation modeling approach detected a response shift after a COPD self-management program not detected by the Schmitt technique. J Clin Epidemiol 62:1165–1172. https://doi.org/10.1016/j.jclinepi.2009.03.015
Robertson C, Langston AL, Stapley S, McColl E, Campbell MK, Fraser WD et al (2009) Meaning behind measurement: self-comparisons affect responses to health-related quality of life questionnaires. Qual Life Res 18(2):221–230
Gandhi PK, Ried LD, Kimberlin CL, Kauf TL, Huang IC (2013) Influence of explanatory and confounding variables on HRQoL after controlling for measurement bias and response shift in measurement. Expert Rev Pharmacoecon Outcomes Res 13(6):841–851. https://doi.org/10.1586/14737167.2013.852959
Nirenberg T, Longabaugh R, Baird J, Mello MJ (2013) Treatment may influence self-report and jeopardize our understanding of outcome. J Stud Alcohol Drugs 74(5):770–776
Sajobi TT, Fiest KM, Wiebe S (2014) Changes in quality of life after epilepsy surgery: the role of reprioritization response shift. Epilepsia 55:1331–1338
Murata T, Suzukamo Y, Shiroiwa T, Taira N, Shimozuma K, Ohashi T et al (2020) Response shift-adjusted treatment effect on health-related quality of life in a randomized controlled trial of taxane versus S-1 for metastatic breast cancer: structural equation modeling. Value Health 23:768–774
Sanders JJ, Miller K, Desai M, Geerse OP, Paladino J, Kavanagh J et al (2020) Measuring goal-concordant care: results and reflections from secondary analysis of a trial to improve serious illness communication. J Pain Symptom Manag 60(5):889–897
Schwartz CE, Stark RB, Stucky BD, Li Y, Rapkin BD (2021) Response-shift effects in neuromyelitis optica spectrum disorder: estimating response-shift-adjusted scores using equating. Qual Life Res 1–10
Schwartz CE, Stark RB, Stucky BD (2021) Response-shift effects in neuromyelitis optica spectrum disorder: a secondary analysis of clinical trial data. Qual Life Res 30(5):1267–1282
Schwartz CE, Stark RB, Borowiec K, Nolte S, Myren KJ (2021) Norm-based comparison of the quality-of-life impact of Ravulizumab and Eculizumab in Paroxysmal Nocturnal Hemoglobinuria. Orphanet J Rare Dis 16:389. https://doi.org/10.1186/s13023-021-02016-8
Verdam M, Van Ballegooijen W, Holtmaat C, Knoop H, Lancee J, Oort F et al (2021) Re-evaluating randomized clinical trials of psychological interventions: impact of response shift on the interpretation of trial results. PLoS ONE 16(5):e0252035
Schwartz CE, Wheeler HB, Hammes B, Basque N, Edmunds J, Reed G et al (2002) Early intervention in planning end-of-life care with ambulatory geriatric patients: results of a pilot trial. Arch Intern Med 162(14):1611–1618
Ahmed S, Mayo NE, Wood-Dauphinee S, Hanley JA, Cohen SR (2005) The structural equation modeling technique did not show a response shift, contrary to the results of the then test and the individualized approaches. J Clin Epidemiol 58:1125–1133. https://doi.org/10.1016/j.jclinepi.2005.03.003
Machuca C, Vettore MV, Krasuska M, Baker SR, Robinson PG (2017) Using classification and regression tree modelling to investigate response shift patterns in dentine hypersensitivity. BMC Med Res Methodol 17(1):120. https://doi.org/10.1186/s12874-017-0396-3
Hoerger M, Perry LM, Gramling R, Epstein RM, Duberstein PR (2017) Does educating patients about the Early Palliative Care Study increase preferences for outpatient palliative cancer care? Findings from Project EMPOWER. Health Psychol 36(6):538
Ahmed S, Mayo N, Wood-Dauphinee S, Hanley J, Cohen R (2005) Using the patient generated index to evaluate response shift post-stroke. Qual Life Res 14:2247–2257
Machuca C, Vettore MV, Robinson PG (2020) How peoples’ ratings of dental implant treatment change over time? Qual Life Res 29(5):1323–1334. https://doi.org/10.1007/s11136-019-02408-1
Schwartz CE, Feinberg RG, Jilinskaia E, Applegate JC (1999) An evaluation of a psychosocial intervention for survivors of childhood cancer: paradoxical effects of response shift over time. Psychooncology 8:344–354. https://doi.org/10.1002/(sici)1099-1611(199907/08)8:4%3c344::aid-pon399%3e3.0.co;2-t
Barclay-Goddard R, Epstein JD, Mayo NE (2009) Response shift: a brief overview and proposed research priorities. Qual Life Res 18(3):335–346. https://doi.org/10.1007/s11136-009-9450-x
Laird NM, Ware JH (1982) Random-effects models for longitudinal data. Biometrics 38(4):963–974
Kolen MJ, Brennan RL (1995) Test equating: methods and practices. Springer, New York
Rothman KJ, Greenland S (1998) Case–control studies. In: Rothman KJ, Greenland S (eds) Modern epidemiology, vol 3. Wolters Kluwer Health/Lippincott Williams & Wilkins, Philadelphia, pp 93–114