Presenting quantitative information about decision outcomes: a risk communication primer for patient decision aid developers

Sackett D, Rosenberg W, Muir Gray J, Haynes R, Richardson W: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1136/bmj.312.7023.71.

Haynes R, Devereaux P, Guyatt G: Clinical expertise in the era of evidence-based medicine and patient choice. Evid Based Med. 2002, 7: 36-38. 10.1136/ebm.7.2.36.

Trevena LJ, Davey HM, Barratt A, Butow P, Caldwell P: A systematic review on communicating with patients about evidence. J Eval Clin Pract. 2006, 12 (1): 13-23. 10.1111/j.1365-2753.2005.00596.x.

Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Legare F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011, CD001431-10

Gigerenzer G: What are natural frequencies?. BMJ. 2011, 343: 10.1136/bmj.d6386.

Gigerenzer G, Gaissmaier W, Kurz-Milcke E, Schwartz L, Woloshin S: Helping doctors and patients make sense of health statistics. Psychol Sci Public Interest. 2007, 8 (2): 53-96.

Gigerenzer G, Galesic M: Why do single event probabilities confuse patients? Statements of frequency are better for communicating risk. BMJ. 2012, 344: e245-10.1136/bmj.e245.

Peters E, Hart PS, Fraenkel L: Informing Patients: the Influence of Numeracy, Framing and Format of Side Effect information on Risk Perceptions. Med Decis Making. 2011, 31 (3): 432-436. 10.1177/0272989X10391672.

Woloshin S, Schwartz L: Communicating data about the benefits and harms of treatment. Ann Intern Med. 2011, 155 (2): 87-96. 10.7326/0003-4819-155-2-201107190-00004.

Cuite C, Weinstein N, Emmons K, Colditz G: A test of numeric formats for communicating risk probabilities. Med Decis Making. 2008, 28 (3): 377-384. 10.1177/0272989X08315246.

Pighin S, Savadori L, Barilli E, Cremonesi L, Ferrari M, Bonnefon J-F: The 1-in-X effect on the subjective assessment of medical probabilities. Med Decis Making. 2011, 31 (5): 721-729. 10.1177/0272989X11403490.

Garcia-Retamero R, Galesic M: Using plausible group sizes to communicate information about medical risks. Patient Educ Couns. 2011, 84 (2): 245-250. 10.1016/j.pec.2010.07.027.

Akl E, Oxman A, Herrin J, Vist G, Terrenato I, Sperati F, Costiniuk C, Blank D, Schünemann H: Using alternative statistical formats for presenting risks and risk reductions. Cochrane Database Syst Rev. 2011, 3: CD006776-

Covey J: A meta-analysis of the effects of presenting treatment benefits in different formats. Med Decis Making. 2007, 27 (5): 638-654. 10.1177/0272989X07306783.

Halvorsen P, Selmer R, Kristiansen I: Different ways to describe the benefits of risk-reducing treatments. Ann Intern Med. 2007, 146 (12): 848-856. 10.7326/0003-4819-146-12-200706190-00006.

Zikmund-Fisher B, Fagerlin A, Roberts T, Derry H, Ubel P: Alternate methods of framing information about medication side effects: Incremental risk versus total risk occurrence. J Health Commun. 2008, 13 (2): 107-124. 10.1080/10810730701854011.

Schwartz L, Woloshin S, Welch H: Using a drug facts box to communicate drug benefits and harms. Ann Intern Med. 2009, 150 (8): 516-527. 10.7326/0003-4819-150-8-200904210-00106.

Zikmund-Fisher B, Ubel P, Smith D, Derry H, McClure J, Stark A, Pitsch R, Fagerlin A: Communicating side effect risks in a tamoxifen prophylaxis decision aid: The debiasing influence of pictographs. Patient Educ Couns. 2008, 73 (2): 209-214. 10.1016/j.pec.2008.05.010.

Malenka D, Baron J, Johansen S, Wahrenberger J, Ross J: The framing effect of relative and absolute risk. J Gen Intern Med. 1993, 8 (10): 543-548. 10.1007/BF02599636.

Naylor C, Chen E, Strauss B: Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness?. Ann Intern Med. 1992, 117 (11): 916-921. 10.7326/0003-4819-117-11-916.

Tversky A, Kahneman D: The framing of decisions and the psychology of choice. Science. 1981, 211 (4481): 453-458. 10.1126/science.7455683.

Moxey A, O'Connell D, McGettigan P, Henry D: Describing treatment effects to patients. J Gen Intern Med. 2003, 18 (11): 948-959. 10.1046/j.1525-1497.2003.20928.x.

Hoffrage U, Lindsey S, Hertwig R, Gigerenzer G: Communicating statistical information. Science. 2000, 290 (5500): 2261-2262. 10.1126/science.290.5500.2261.

Gigerenzer G, Hoffrage U: How to improve Bayesian reasoning without instruction: Frequency formats. Psychol Rev. 1995, 102 (4): 684-704.

Hoffrage U, Gigerenzer G, Krauss S, Martignon L: Representation facilitates reasoning: what natural frequencies are and what they are not. Cognition. 2002, 84 (3): 343-352. 10.1016/S0010-0277(02)00050-1.

Stacey D, Bennett C, Barry M, Col N, Eden K, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Légaré F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2001, 10 (CD001431):

Gattellari M, Ward J: Does evidence-based information about screening for prostate cancer enhance consumer decision-making? A randomised controlled trial. J Med Screen. 2003, 10 (1): 27-39. 10.1258/096914103321610789.

Kuppermann M, Norton M, Gates E, Gregorich S, Learman L, Nakagawa S, Feldstein V, Lewis J, Washington A, Nease RF J: Computerised prenatal genetic testing decision-assisting tool. Obstet Gynecol. 2009, 113 (1): 53-63. 10.1097/AOG.0b013e31818e7ec4.

Schapira M, VanRuiswyk J: The effect of an illustrated pamphlet decision-aid on the use of prostate cancer screening tests. J Fam Pract. 2000, 49 (5): 418-424.

Wolf A, Schorling J: Does informed consent alter elderly patients' preferences for colorectal cancer screening? Results of a randomized trial. J Gen Intern Med. 2000, 15 (1): 24-30. 10.1046/j.1525-1497.2000.01079.x.

Lerman C, Biesecker B, Benkendorf J, Kerner J, Gomez-Caminero A, Hughes C, Reed M: Controlled trial of pretest education approaches to enhance informed decision-making for BRCA1 gene testing. J Natl Cancer Inst. 1997, 89 (2): 148-157. 10.1093/jnci/89.2.148.

Woloshin S, Schwartz L, Welch H: The risk of death by age, sex, and smoking status in the United States: Putting health risks in context. J Natl Cancer Inst. 2008, 100: 845-853. 10.1093/jnci/djn124.

Peters E, Dieckmann N, Vastfjall D, Mertz C, Slovic P, Hibbard J: Bringing meaning to numbers: The impact of evaluative categories on decisions. J Exp Psycho App. 2009, 15 (3): 213-227.

Zikmund-Fisher B, Fagerlin A, Keeton K, Ubel P: Does labeling prenatal screening test results as negative or positive affect a woman's responses?. Am J Obstet Gynecol. 2007, 197 (5): 528.e521-528.e526.

Han P, Klein W, Arora N: Varieties of uncertainty in health care: a conceptual taxonomy. Med Decis Making. 2011, 31 (6): 828-838. 10.1177/0272989X10393976.

Lenert L, Cher D: Use of meta-analytic results to facilitate shared decision making. J Am Med Inform Assoc. 1999, 6 (5): 412-419. 10.1136/jamia.1999.0060412.

Baty B, Venne V, McDonald J, Croyle R, Halls C, Nash J, Botkin J: BRCA1 testing: Genetic counseling protocol development and counseling issues. J Genet Couns. 1997, 6 (2): 223-244. 10.1023/A:1025620404473.

Schapira M, Nattinger A, McHorney C: Frequency or probability? A qualitative study of risk communication formats used in health care. Med Decis Making. 2001, 21 (6): 459-467. 10.1177/0272989X0102100604.

Han P, Klein W, Killam B, Lehman T, Massett H, Freedman A: Representing randomness in the communication of individualized cancer risk estimates: Effects on cancer risk perceptions, worry, and subjective uncertainty about risk. Patient Educ Couns. 2012, 86 (1): 106-113. 10.1016/j.pec.2011.01.033.

Ancker J, Weber E, Kukafka R: Effects of game-like interactive graphics on risk perceptions and decisions. Med Decis Making. 2011, 31 (1): 130-142. 10.1177/0272989X10364847.

Han P, Klein W, Lehman T, Killam B, Massett H, Freedman A: Communication of uncertainty regarding individualized cancer risk estimates: Effects and influential factors. Med Decis Making. 2011, 31 (2): 354-366. 10.1177/0272989X10371830.

Lipkus I, Klein W, Rimer B: Communicating breast cancer risks to women using different formats. Cancer Epidemiol Biomarkers Prev. 2001, 10 (8): 895-898.

Mazor K, Dodd K, Kunches L: Communicating hospital infection data to the public: A study of consumer responses and preferences. Am J Med Qual. 2009, 24 (2): 108-115.

Muscatello DJ, Searles A, Macdonald R, J L: Communicating population health statistics through graphs: A randomised controlled trial of graph design interventions. BMC Med. 4 (1): 33-

Han P, Klein W, Lehman T, Massett H, Lee S, Freedman A: Laypersons’ responses to the communication of uncertainty regarding cancer risk estimates. Med Decis Making. 2009, 29 (3): 391-403. 10.1177/0272989X08327396.

Ellsberg D: Risk, ambiguity, and the savage axioms. Q J Econ. 1961, 75: 643-669. 10.2307/1884324.

Camerer C, Weber M: Recent developments in modeling preferences: Uncertainty and ambiguity. J Risk Uncertain. 1992, 5 (4): 325-370. 10.1007/BF00122575.

Kuhn K: Communicating uncertainty: Framing effects on responses to vague probabilities. Organ Behav Hum Dec. 1997, 71: 55-83. 10.1006/obhd.1997.2715.

Viscusi W, Magat W, Huber J: Communication of ambiguous risk information. Theor Decis. 1991, 31 (2): 159-173.

Garcia-Retamero R, Galesic M, Gigerenzer G: Do icon arrays help reduce denominator neglect?. Med Decis Making. 2010, 30 (6): 672-684. 10.1177/0272989X10369000.

Garcia-Retamero R, Cokely E: Effective communication of risks to young adults: Using message framing and visual aids to increase condom use and STD screening. J Exp Psycho App. 2011, 17 (3): 270-

Garcia-Retamero R, Galesic M: How to reduce the effect of framing on messages about health. J Gen Intern Med. 2010, 25 (12): 1323-1329. 10.1007/s11606-010-1484-9.

Fagerlin A, Wang C, Ubel P: Reducing the influence of anecdotal reasoning on people’s health care decisions: Is a picture worth a thousand statistics?. Med Decis Making. 2005, 25 (4): 398-405. 10.1177/0272989X05278931.

Barbey A, Sloman S: Base-rate respect: From ecological rationality to dual processes. Beh Brain Sci. 2007, 30: 241-97.

Sloman SA, Over D, Slovak L, Stibel J: Frequency illusions and other fallacies. Organ Behav Hum Dec. 2003, 91 (2): 296-309. 10.1016/S0749-5978(03)00021-9.

Brase G: Pictorial representations in statistical reasoning. Appl Cognitive Psych. 2009, 23 (3): 369-381. 10.1002/acp.1460.

Gurmankin A, Helweg-Larsen M, Armstrong K, Kimmel S, Volpp K: Comparing the standard rating scale and the magnifier scale for assessing risk perceptions. Med Decis Making. 2005, 25 (5): 560-570. 10.1177/0272989X05280560.

Woloshin S, Schwartz L, Byram S, Fischhoff B, Welch H: A new scale for assessing perceptions of chance: a validation study. Med Decis Making. 2000, 20 (3): 298-307. 10.1177/0272989X0002000306.

Paling J: Strategies to help patients understand risks. BMJ. 2003, 327 (7417): 745-748. 10.1136/bmj.327.7417.745.

Spiegelhalter D, Pearson M, Short I: Visualizing uncertainty about the future. Science. 2011, 333 (6048): 1393-1400. 10.1126/science.1191181.

Galesic M, Garcia-Retamero R: Graph literacy: a cross-cultural comparison. Med Decis Making. 2011, 31: 444-457. 10.1177/0272989X10373805.

Garcia-Retamero R, Galesic M: Who profits from visual aids: Overcoming challenges in people’s understanding of risks. Soc Sci Med. 2010, 70 (7): 1019-1025. 10.1016/j.socscimed.2009.11.031.

Galesic M, Garcia-Retamero R, Gigerenzer G: Using icon arrays to communicate medical risks to low-numeracy people. Health Psychol. 2009, 28 (2): 210-216.

Garcia-Retamero R, Galesic M: Communicating treatment risk reduction to people with low numeracy skills: A cross-cultural comparison. Am J Public Health. 2009, 99 (12): 2196-2202. 10.2105/AJPH.2009.160234.

Gaissmaier W, Wegwarth O, Skopec D, Müller A-S, Broschinski S, Politi M: Numbers can be worth a thousand pictures: Individual differences in understanding graphical and numerical representations of health-related information. Health Psychol. 2012, 31 (3): 286-296.

Feldman-Stewart D, Kocovski N, McConnell B, Brundage M, Mackillop W: Perception of quantitative information for treatment decisions. Med DecisMaking. 2000, 20 (2): 228-238.

Reyna V: A theory of medical decision making and health: Fuzzy-trace theory. Med Decis Making. 2008, 28 (6): 829-833. 10.1177/0272989X08327069.

Hawley S, Zikmund-Fisher B, Ubel P, Jankovic A, Lucas T, Fagerlin A: The impact of the format of graphical presentation on health-related knowledge and treatment choices. Patient Educ Couns. 2008, 73 (3): 448-455. 10.1016/j.pec.2008.07.023.

Lipkus I: Numeric, verbal, and visual formats of conveying health risks: Suggested best practices and future recommendations. Med Decis Making. 2007, 27 (5): 696-713. 10.1177/0272989X07307271.

Lipkus I, Hollands J: The visual communication of risk. J Natl Cancer Inst Monogr. 1999, 25: 149-163.

Zikmund-Fisher B, Fagerlin A, Ubel P: Improving understanding of adjuvant therapy options by using simpler risk graphics. Cancer. 2008, 113 (12): 3382-3390. 10.1002/cncr.23959.

Zikmund-Fisher B, Fagerlin A, Ubel P: A demonstration of ''less can be more'' in risk graphics. Med Decis Making. 2010, 30 (6): 661-671. 10.1177/0272989X10364244.

Ancker J, Weber E, Kukafka R: Effect of arrangement of stick figures on estimates of proportion in risk graphics. Med Decis Making. 2011, 31 (1): 143-150. 10.1177/0272989X10369006.

Stone E, Yates J, Parker A: Effects of numerical and graphical displays on professed risk-taking behavior. J Exp Psychol Appl. 1997, 3 (4): 243-256.

Stone E, Sieck W, Bull B, Yates J, Parks S, Rush C: Foreground:background salience: Explaining the effects of graphical displays on risk avoidance. Organ Behav Hum Decis Process. 2003, 90 (1): 19-36. 10.1016/S0749-5978(03)00003-7.

McCaffery K, Dixon A, Hayen A, Jansen J, Smith S, Simpson J: The Influence of Graphic Display Formaton the Interpretations of Quantitative Risk Information among Adultswith Lower Education and Literacy: A Randomized Experimental Study. Med Decis Making. 2012, 32: 532-544. 10.1177/0272989X11424926.

Kurz-Milcke E, Gigerenzer G, Martignon L: Transparency in risk communication: Graphical and analog tools. Strategies for risk communication: Evolution, evidence, experience. Edited by: Tucker W, Ferson S, Finkel A, Long T, Slavin D, Wright P. 2008, New York: Blackwell, 1128: 18-28.

Shah P, Hoeffner J: Review of graph comprehension research: Implications for instruction. Educ Psychol Rev. 2002, 14 (1): 47-69. 10.1023/A:1013180410169.

Kosslyn S: Graph Design for the Eye and Mind. 2006, New York: Oxford University Press

Noar S, Benac C, Harris M: Does tailoring matter? Meta-analytic review of tailored print health behaviour change interventions. Psychol Bull. 2007, 133: 673-693.

Manne S, Coups E, Markowitz A, Meropol N, Haller D, J P, Jandorf L, Peterson S, Lesko S, Pilipshen S, et al: A randomized trial of generic versus tailored interventions to increase colorectal cancer screening among intermediate risk siblings. Ann Behav Med. 2009, 37: 207-217. 10.1007/s12160-009-9103-x.

Albada A, Ausems M, Bensing J, Van Dulmen S: Tailored information about cancer risk and screening: A systematic review. Patient Educ Couns. 2009, 77: 155-171. 10.1016/j.pec.2009.03.005.

Bodurtha J, Quillin J, Tracy K, Borzelleca J, McClish D, Wilson D, Jones R, Quillin J, Bowen D: Mammography screening after risk-tailored messages: The Women Improving Screening through Education and Risk Assessment (WISER) randomized, controlled trial. J Womens Health. 2009, 18: 41-47. 10.1089/jwh.2007.0703.

Lu C, Karon J, Sorich M: The importance of high-quality evidence of the long-term impact of nonfatal events used in randomized controlled trials: a case study of Parasugrel. Clin Pharmacol Ther. 2011, 90 (1): 27-29. 10.1038/clpt.2011.61.

NICE: National Institute for Health and Clinical Excellence. Prasugrel for the treatment of acute coronary syndromes with percutaneous coronary intervention. NICE technology appraisal guidance 182. Edited by: National Institute for Health and Clinical Excellence. 2009, London

Goldhaber-Fiebert J, Stout N, Goldie S: Empirically evaluating decision-analytic models. Value Health. 2010, 13 (5): 667-674. 10.1111/j.1524-4733.2010.00698.x.

Stout N, Knudsen A, Kong C, McMahon P, Gazelle G: Calibration methods used in cancer simulation models and suggested reporting guidelines. Pharmacoeconomics. 2009, 27: 533-545. 10.2165/11314830-000000000-00000.

Tunis S, Stryer D, Clancy C: Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290 (12): 1624-1632. 10.1001/jama.290.12.1624.

Levin L, Goeree R, Levine M, Krahn M, Easty T, Brown A, Henry D: Coverage with evidence development: The Ontario experience. Int J Technol Assess Health Care. 2001, 27 (2): 159-168.

Statin Choice. Mayo Knowledge and Encounter Research Unit, Mayo Clinic College of Medicine. [ http://shareddecisions.mayoclinic.org/decision-aids-for-diabetes/cardiovascular-prevention/ ]

Bennett C, Drake E, Hopkins L, O’Connor A: What can you do to prevent HPV and cervical cancer?: A decision aid for parents/guardians of girls in grade 8 in Ontario. Canadian Institute of Health. 2009, [ http://decisionaid.ohri.ca/docs/das/HPV_vaccine.pdf ]

Heart disease: Should I have bypass surgery?. [ https://www.healthwise.net/cochranedecisionaid/Content/StdDocument.aspx?DOCHWID=av2037 ]

Vandemheen K, Aaron S, Tullis E, Poirier C: When your lung function is getting worse: Should you be referred for a lung transplant? A decision aid for adults with cystic fibrosis. 2009, [ http://decisionaid.ohri.ca/docs/das/CF_group_a.pdf ]

Zikmund-Fisher B, Fagerlin A, Ubel P: What’s time got to do with it? Inattention to duration in interpretation of survival graphs. Risk Analysis. 2005, 25 (3): 589-595. 10.1111/j.1539-6924.2005.00626.x.

Zikmund-Fisher B, Fagerlin A, Ubel P: Mortality versus survival graphs: Improving temporal consistency in perception of treatment effectiveness. Patient Educ Couns. 2007, 66: 100-107. 10.1016/j.pec.2006.10.013.

Armstrong K, Schwartz J, Fitzergald G, Putt M, Ubel P: Effect of framing as gain versus loss on understanding and hypothetical treatment choices: Survival and mortality curves. Med Decis Making. 2002, 22: 76-83. 10.1177/0272989X0202200108.

Redelmeier D, Rozin P, Kahneman D: Understanding patients’ decisions: Cognitive and emotional perspectives. JAMA. 1993, 270 (1): 72-76. 10.1001/jama.1993.03510010078034.

McNair A, Brookes S, Davis C, Argyropoulos M, Blazeby J: Communicating the results of randomized clinical trials: Do patients understand multidimensional patient-reported outcomes?. J Clin Oncol. 2010, 28: 738-743. 10.1200/JCO.2009.23.9111.

Rolison J, Hanoch Y, Miron-Shatz T: What do men understand about lifetime risk following genetic testing? The effect of context and numeracy. Health Psychol. 2012, 31 (4): 530-3. doi: 10.1037/a0026562

National Cancer Institue: BRCA1 and BRCA2: Cancer Risk and Genetic Testing. [ http://www.cancer.gov/cancertopics/factsheet/Risk/BRCA ]

Cochrane Musculoskeletal Group: Decision Aids. [ http://musculoskeletal.cochrane.org/decision-aids ]

Sydney Health Decision Group: Making Decisions: Should I use hormone replacement therapy? (HRT). [ http://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/wh37.pdf ]

Healthwise: Achilles tendon rupture: Should I have surgery?. [ https://www.healthwise.net/cochranedecisionaid/Content/StdDocument.aspx?DOCHWID=ug2998 ]

Healthwise: Heart Failure: Should I get a Pacemaker (Cardiac Resychronization Therapy)?. [ https://www.healthwise.net/cochranedecisionaid/Content/StdDocument.aspx?DOCHWID=uf9843 ]

Mayo Clinic: Birth control. [ http://www.mayoclinic.com/health/birth-control/MY01182 ]

Betsch C, Ulshofer C, Renkewitz F, Betsch T: The Influence of Narrative v. Statistical Information on Perceiving Vaccination Risks. Med Decis Making. 2011, 31 (5): 742-53. 10.1177/0272989X11400419.

Ubel PA, Jepson C, Baron J: The inclusion of patient testimonials in decision aids: effects on treatment choices. Med Decis Making. 2001, 21 (1): 60-68. 10.1177/0272989X0102100108.

Shaffer V, Zikmund-Fisher B: All stories are not alike: A purpose-, content-, and valence-based taxonomy of patient narratives in decision aids. Med Decis Making. 2013, 33 (1): 4-13. 10.1177/0272989X12463266.

Lipkus I, Peters E: Understanding the role of numeracy in health: proposed theoretical framework and practical insights. Health Educ Behav. 2009, 36: 1065-1081. 10.1177/1090198109341533.

Reyna V, Nelson W, Han P, Dieckmann N: How numeracy influences risk comprehension and medical decision making. Psychol Bull. 2009, 135: 943-973.

Lipkus I, Peters E, Kimmick G, Liotcheva V, Marcom P: Breast cancer patients' treatment expectations after exposure to the decision aid program adjuvant online: the influence of numeracy. Med Decis Making. 2010, 30: 464-473. 10.1177/0272989X09360371.

Dieckmann NF, Slovic P, Peters EM: The use of narrative evidence and explicit likelihood by decisionmakers varying in numeracy. Risk Anal. 2009, 29 (10): 1473-1488. 10.1111/j.1539-6924.2009.01279.x.

Galesic M, Garcia-Retamero R: Communicating consequences of risky behaviors: Life expectancy versus risk of disease. Patient Educ Couns. 2011, 82: 30-35. 10.1016/j.pec.2010.02.008.

Weinstein N, Atwood K, Puleo E, Fletcher R, Colditz G, Emmons K: Colon cancer: risk perceptions and risk communication. J Health Commun. 2004, 9: 53-65. 10.1080/10810730490271647.

Woloshin S, Schwartz L, Black W, Welch H: Women’s perceptions of breast cancer risk: How you ask matters. Med Decis Making. 1999, 19: 221-229. 10.1177/0272989X9901900301.

Peters E, Västfjäll D, Slovic P, Mertz C, Mazzocco K, Dickert S: Numeracy and decision making. Psychol Sci. 2006, 17: 407-413. 10.1111/j.1467-9280.2006.01720.x.

Zikmund-Fisher B, Angott A, Ubel P: The benefits of discussing adjuvant therapies one at a time instead of all at once. Breast Cancer Res Treat. 2011, 129: 79-87. 10.1007/s10549-010-1193-4.

Reyna VF, Brainerd C: Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learn Individ Differ. 2008, 18: 89-107. 10.1016/j.lindif.2007.03.011.

Peters E: Beyond comprehension: The role of numeracy in judgments and decisions. Curr Dir Psychol Sci. 2012, 21: 31-10.1177/0963721411429960.

Galesic M, Garcia-Retamero R: Statistical numeracy for health: A cross-cultural comparison with probabilistic national samples. Arch Intern Med. 2010, 170: 462-468. 10.1001/archinternmed.2009.481.

Lipkus I, Samsa G, Rimer B: General performance on a numeracy scale among highly educated samples. Med Decis Making. 2001, 21: 37-44.

Hibbard J, Peters E, Dixon A, Tusler M: Consumer competencies and the use of comparative quality information: It isn’t just about literacy. Med Care Res Rev. 2007, 64 (4): 379-394. 10.1177/1077558707301630.

Peters E, Baker D, Dieckmann N, Leon J, Collins J: Explaining the effect of education on health: A field study in Ghana. Psychol Sci. 2010, 21 (10): 1369-1376. 10.1177/0956797610381506.

Yin H, Wolf M, Dreyer B, Sanders L, Parker R: Evaluation of consistency in dosing directions and measuring devices for pediatric nonprescription liquid medications. JAMA. 2010, 304 (23): 2595-2602. 10.1001/jama.2010.1797.

Kumar D, Sanders L, Perrin E, Lokker N, Patterson B, Gunn V, Finkle J, Franco V, Choi L, Rothman R: Parental understanding of infant health information: Health literacy, numeracy, and the Parental Health Literacy Activities Test (PHLAT). AcadPediatr. 2010, 10 (5): 309-316.

Cokely E, Galesic M, Schulz E, Garcia-Retamero R: Measuring risk literacy: the Berlin Numeracy Test. Judgm Decis Mak. 2012, 7: 35-47.

Liberali J, Reyna V, Furlan S, Stein L, Pardo S: Individual differences in numeracy and cognitive reflection, with implications for biases and fallacies in probability judgment. J Beh Dec Mak. 2012, 25: 361-381. 10.1002/bdm.752.

Butterworth B: Mathematical expertise. Cambridge Handbook of Expertise and Expert Performance. Edited by: Ericsson K. 2006, Cambridge: CUP, 553-568.

Stigler J, Gonzales P, Kawanaka T, Knoll S, Serrano A: The TIMSS videotape classroom study: Methods and findings from an exploratory research project on eighth-grade mathematics instruction in Germany, Japan, and the United States. Edited by: US Dept of Education, National Center for Education Statistics. Washington DC. 1999

Peters E, Hess T, Västfjäll D, Auman C: Adult age differences in dual information processes: Implications for the role of affective and deliberative processes in older adults’ decision making. Perspect Psychol Sci. 2007, 2 (1): 1-23. 10.1111/j.1745-6916.2007.00025.x.

Kahan D, Peters E, Wittlin M, Slovic P, Ouellette L, Braman D, Mandel G: The polarizing impact of science literacy and numeracy on perceived climate change risks. Nature Clim Change. 2012, 2: 732-745. 10.1038/nclimate1547.

Lipkus IM: Numeric, verbal, and visual formats of conveying health risks: suggested best practices and future recommendations. Med Decis Making. 2007, 27 (5): 696-713. 10.1177/0272989X07307271.

Zikmund-Fisher B, Smith D, Ubel P, Fagerlin A: Validation of the Subjective Numeracy Scale (SNS): Effects of low numeracy on comprehension of risk communications and utility elicitations. Med Decis Making. 2007, 27: 663-671. 10.1177/0272989X07303824.

Schwartz L, Woloshin S, Black W, Welch G: The role of numeracy in understanding the benefit of screening mammography. Ann Intern Med. 1997, 127: 966-971. 10.7326/0003-4819-127-11-199712010-00003.

Schapira M, Walker C, Cappaert K, Ganschow P, Fletcher K, McGinley E, Del Pozo S, Schauer C, Tarima S, Jacobs E: The Numeracy Understanding in Medicine Instrument: : A measure of health numeracy developed using item response theory. Med Decis Making. 2012, 32: 852-865.

Weller J, Dieckmann N, Tusler M, Mertz C, Burns W, Peters E: Development and testing of an abbreviated numeracy scale: A Rasch analysis approach. J Beh Dec Mak. 2012, 26 (2): 198-212.

Fagerlin A, Zikmund-Fisher B, Ubel P, Jankovic A, Derry H, Smith D: Measuring numeracy without a math test: development of the subjective numeracy scale. Med Decis Making. 2007, 27: 672-680. 10.1177/0272989X07304449.

Baker W: The meaning and the measure of health literacy. J Gen Intern Med. 2006, 21: 878-883. 10.1111/j.1525-1497.2006.00540.x.

Schwartz L, Woloshin S, Welch G: Can patients interpret health information? An assessment of the medical data interpretation test. Medical Decision Making. 2005, 25: 290-300. 10.1177/0272989X05276860.

Natter H, Berry D: Effects of active information processing on the understanding of risk information. Appl Cogn Psychol. 2005, 19: 123-135. 10.1002/acp.1068.

Ancker J, Chan C, Kukafka R: Interactive graphics for expressing health risks: development and qualitative evaluation. J Health Commun. 2009, 14 (5): 461-475. 10.1080/10810730903032960.

Tversky B, Morrison J, Betrancourt M: Animation: can it facilitate?. Int J Hum Comput Stud. 2002, 57: 247-262. 10.1006/ijhc.2002.1017.

Zikmund-Fisher B, Dickson M, Witteman H: Cool but counterproductive: interactive web-based risk communications can backfire. J Med Internet Res. 2011, 13 (3): e60-10.2196/jmir.1665. doi:10.2196/jmir.1665

Zikmund-Fisher B, Witteman H, Fuhrel-Forbis A, Exe N, Kahn V, Dickson M: Animated graphics for comparing two risks: a cautionary tale. J Med Internet Res. 2012, 14 (4): e106-10.2196/jmir.2030. doi: 110.2196/jmir.2030