The influence of automation on tumor contouring
Tóm tắt
Fully or semi-automatic contouring tools are increasingly being used in the tumor contouring task for radiotherapy. While the fully automatic contouring tools have not reached sufficient efficiency, the semi-automatic contouring tools balance more effectively between the human interaction and automation. This study evaluates the influences of a semi-automation contouring tool, called between-slice interpolation, on the resulting contours and the contouring process. The tumor contouring study was conducted on three patient cases with five physicians in a naturalistic setting. The contouring task consisted of initiating the 2D contour manually or with the interpolation tool and correcting that initial contour. The similarity of the resulting contours was pairwise measured within the manual or the interpolated category. Interactions with the software were recorded, and variations in the contouring workflows steps were compared. Results indicated that using the between-slice interpolation tool for creating the initial contour, instead of initiating it manually, influenced both the contouring process and outcomes. First, it was identified that contours initiated by the interpolation tool showed an increased similarity among themselves compared to the manually initiated contours. At the same time, influences to the resulting contours were below clinical relevance, and toward the desired direction—improved consistency of contours. Second, when interpolation was used, in two cases out of three, the average contouring time also decreased significantly. Therefore, the use of such an automation tool can be encouraged.
Tài liệu tham khảo
Aselmaa A, Goossens RHM, Rowland B et al (2014) Medical factors of brain tumor delineation in radiotherapy for software design. In: Ahram T, Karwowski W, Marek T (eds) 5th International conference on applied human factors and ergonomics (AHFE), pp 4865–4875
Aselmaa A, van Herk M, Laprie A et al (2017) Using a contextualized sensemaking model for interaction design: a case study of tumor contouring. J Biomed Inform 65:145–158. doi:10.1016/j.jbi.2016.12.001
Barrett WA, Mortensen EN (1997) Interactive live-wire boundary extraction. Med Image Anal 1:331–341. doi:10.1016/S1361-8415(97)85005-0
Batumalai V, Holloway LC, Kumar S et al (2016) Survey of image-guided radiotherapy use in Australia. J Med Imaging Radiat Oncol. doi:10.1111/1754-9485.12556
Bauer S, Wiest R, Nolte L-P, Reyes M (2013) A survey of MRI-based medical image analysis for brain tumor studies. Phys Med Biol 58:R97–R129. doi:10.1088/0031-9155/58/13/R97
Behin A, Hoang-Xuan K, Carpentier AF, Delattre J-Y (2003) Primary brain tumours in adults. Lancet 361:323–331. doi:10.1016/S0140-6736(03)12328-8
Bravo ER, Ostos J (2017) Performance in computer-mediated work: the moderating role of level of automation. Cognit Technol Work. doi:10.1007/s10111-017-0429-z
Brundage MD, Dixon PF, Mackillop WJ et al (1999) A real-time audit of radiation therapy in a regional cancer center. Int J Radiat Oncol 43:115–124. doi:10.1016/S0360-3016(98)00368-X
Brunskill K, Nguyen TK, Boldt RG et al (2017) Does peer review of radiation plans affect clinical care? A systematic review of the literature. Int J Radiat Oncol 97:27–34. doi:10.1016/j.ijrobp.2016.09.015
Burnet NG (2004) Defining the tumour and target volumes for radiotherapy. Cancer Imaging 4:153–161. doi:10.1102/1470-7330.2004.0054
Delaney G, Jacob S, Featherstone C, Barton M (2005) The role of radiotherapy in cancer treatment: estimating optimal utilization from a review of evidence-based clinical guidelines. Cancer 104:1129–1137. doi:10.1002/cncr.21324
Dinkel J, Khalilzadeh O, Hintze C et al (2013) Inter-observer reproducibility of semi-automatic tumor diameter measurement and volumetric analysis in patients with lung cancer. Lung Cancer 82:76–82. doi:10.1016/j.lungcan.2013.07.006
Dolz J, Kirişli HA, Fechter T et al (2016) Interactive contour delineation of organs at risk in radiotherapy: clinical evaluation on NSCLC patients. Med Phys 43:2569–2580. doi:10.1118/1.4947484
Dowsett RJ, Galvin JM, Cheng E et al (1992) Contouring structures for 3-dimensional treatment planning. Int J Radiat Oncol Biol Phys 22:1083–1088. doi:10.1016/0360-3016(92)90812-V
Drabik DM, MacKenzie MA, Fallone GB (2007) Quantifying appropriate PTV setup margins: analysis of patient setup fidelity and intrafraction motion using post-treatment megavoltage computed tomography scans. Int J Radiat Oncol 68:1222–1228. doi:10.1016/j.ijrobp.2007.04.007
Drew T, Evans K, Võ ML-H et al (2013) Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images? RadioGraphics 33:263–274. doi:10.1148/rg.331125023
Duffey RB, Saull JW (2002) Know the risk: learning from errors and accidents: safety and risk in today’s technology. Butterworth-Heinemann, Oxford
Fitton I, Cornelissen SAP, Duppen JC et al (2011) Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. Med Phys 38:4662–4666. doi:10.1118/1.3611045
Fotina I, Lutgendorf-Caucig C, Stock M et al (2012) Critical discussion of evaluation parameters for inter-observer variability in target definition for radiation therapy. Strahlenther Onkol 188:160–167. doi:10.1007/s00066-011-0027-6
Gevaert O, Mitchell LA, Achrol AS et al (2014) Glioblastoma multiforme: exploratory radiogenomic analysis by using quantitative image features. Radiology 273:131731. doi:10.1148/radiol.14131731
Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv Psychol 52:139–183. doi:10.1016/S0166-4115(08)62386-9
Heckel F, Moltz JH, Tietjen C, Hahn HK (2013) Sketch-based editing tools for tumour segmentation in 3D medical images. Comput Graph Forum 32:144–157. doi:10.1111/cgf.12193
Hillstrom AP (2000) Repetition effects in visual search. Percept Psychophys 62:800–817. doi:10.3758/BF03206924
Huttenlocher DP, Klanderman GA, Rucklidge WJ (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15:850–863. doi:10.1109/34.232073
International Commission on Radiation Units and Measurements (1999) ICRU Report 50. Prescribing, recording, and reporting photon beam therapy. Bethesda, MD
Johnson CW (2006) Why did that happen? Exploring the proliferation of barely usable software in healthcare systems. Qual Saf Health Care 15:i76–i81. doi:10.1136/qshc.2005.016105
Kirrmann S, Gainey M, Röhner F et al (2015) Visualization of data in radiotherapy using web services for optimization of workflow. Radiat Oncol. doi:10.1186/s13014-014-0322-3
Kuijf HJ (2015) MeVisLab-Hausdorff-distance source code. https://github.com/hjkuijf/MeVisLab-Hausdorff-distance. Accessed 23 Mar 2017
Lazar J, Jones A, Shneiderman B (2006) Workplace user frustration with computers: an exploratory investigation of the causes and severity. Behav Inf Technol 25:239–251. doi:10.1080/01449290500196963
Lim JY, Leech M (2016) Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck. Acta Oncol (Madr) 55:799–806. doi:10.3109/0284186X.2016.1173723
Louie AV, Rodrigues G, Olsthoorn J et al (2010) Inter-observer and intra-observer reliability for lung cancer target volume delineation in the 4D-CT era. Radiother Oncol 95:166–171. doi:10.1016/j.radonc.2009.12.028
Mackenzie J, Graham G, Olivotto IA (2016) Peer review of radiotherapy planning: quantifying outcomes and a proposal for prospective data collection. Clin Oncol 28:e192–e198. doi:10.1016/j.clon.2016.08.012
Manzey D, Reichenbach J, Onnasch L (2012) Human performance consequences of automated decision aids. J Cogn Eng Decis Mak 6:57–87. doi:10.1177/1555343411433844
Marks LB, Adams RD, Pawlicki T et al (2013) Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: executive summary. Pract Radiat Oncol 3:149–156. doi:10.1016/j.prro.2012.11.010
MeVis Medical Solutions AG (2016) MeVisLab—development environment for medical image processing and visualization. MeVis Medical Solutions AG, Bremen. Available at http://www.mevislab.de/mevislab/features/image-processing/. Accessed 28 Aug 2017
Niyazi M, Brada M, Chalmers AJ et al (2016) ESTRO-ACROP guideline “target delineation of glioblastomas”. Radiother Oncol. doi:10.1016/j.radonc.2015.12.003
Njeh CF (2008) Tumor delineation: the weakest link in the search for accuracy in radiotherapy. J Med Phys 33:136–140. doi:10.4103/0971-6203.44472
Nodine CF, Mello-Thoms C, Kundel HL, Weinstein SP (2002) Time course of perception and decision making during mammographic interpretation. Am J Roentgenol 179:917–923. doi:10.2214/ajr.179.4.1790917
Noyes JM, Bruneau DPJ (2007) A self-analysis of the NASA-TLX workload measure. Ergonomics 50:514–519. doi:10.1080/00140130701235232
Nutting C, Dearnaley DP, Webb S (2000) Intensity modulated radiation therapy: a clinical review. Br J Radiol 73:459–469. doi:10.1259/bjr.73.869.10884741
Olabarriaga S, Smeulders AW (2001) Interaction in the segmentation of medical images: a survey. Med Image Anal 5:127–142. doi:10.1016/S1361-8415(00)00041-4
Olsen LA, Robinson CG, He GR et al (2014) Automated radiation therapy treatment plan workflow using a commercial application programming interface. Pract Radiat Oncol 4:358–367. doi:10.1016/j.prro.2013.11.007
Pantazi SV, Arocha JF, Moehr JR (2004) Case-based medical informatics. BMC Med Inform Decis Mak 4:19. doi:10.1186/1472-6947-4-19
Parasuraman R, Manzey DH (2010) Complacency and bias in human use of automation: an attentional integration. Hum Factors 52:381–410. doi:10.1177/0018720810376055
Prabhakar R, Haresh K, Laviraj M et al (2011) A study on the tumor volume computation between different 3D treatment planning systems in radiotherapy. J Cancer Res Ther 7:168. doi:10.4103/0973-1482.82917
Ramkumar A, Dolz J, Kirisli HA et al (2016) User interaction in semi-automatic segmentation of organs at risk: a case study in radiotherapy. J Digit Imaging 29(2):264–277. doi:10.1007/s10278-015-9839-8
Schaffner B, Pedroni E (1998) The precision of proton range calculations in proton radiotherapy treatment planning: experimental verification of the relation between CT-HU and proton stopping power. Phys Med Biol 43(6):1579–1592. doi:10.1088/0031-9155/43/6/016
Skitka LJ, Mosier KL, Burdick M et al (1999) Does automation bias decision-making? Int J Hum Comput Stud 51:991–1006. doi:10.1006/ijhc.1999.0252
Song Y, Hoeksema J, Ramkumar A, Molenbroek JFM (2017) A landmark based 3D parametric foot model for footwear customization. Int J Digital Human (in press)
Steenbakkers RJHM, Duppen JC, Fitton I et al (2005) Observer variation in target volume delineation of lung cancer related to radiation oncologist–computer interaction: a “Big Brother” evaluation. Radiother Oncol 77:182–190. doi:10.1016/j.radonc.2005.09.017
Stupp R, Mason WP, van den Bent MJ et al (2005) Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. N Engl J Med 352:987–996
Sykes J (2014) Reflections on the current status of commercial automated segmentation systems in clinical practice. J Med Radiat Sci 61:131–134. doi:10.1002/jmrs.65
van Herk M (2004) Errors and margins in radiotherapy. Semin Radiat Oncol 14:52–64. doi:10.1053/j.semradonc.2003.10.003
Varga E, Pattynama PMT, Freudenthal A (2013) Manipulation of mental models of anatomy in interventional radiology and its consequences for design of human–computer interaction. Cogn Technol Work 15(4):457–473. doi:10.1007/s10111-012-0227-6
Vieira B, Hans EW, van Vliet-Vroegindeweij C et al (2016) Operations research for resource planning and-use in radiotherapy: a literature review. BMC Med Inform Decis Mak 16:149. doi:10.1186/s12911-016-0390-4
Vorwerk H, Zink K, Schiller R et al (2014) Protection of quality and innovation in radiation oncology: the prospective multicenter trial the German Society of Radiation Oncology (DEGRO-QUIRO study). Strahlenther Onkol 190:433–443. doi:10.1007/s00066-014-0634-0
Weersink RA (2016) Chapter 3—image fusion and visualization. In: Farhat WA, Drake J (eds) Bioengineering for surgery, Elsevier, Amsterdam, pp 29–58
Weiss E, Hess CF (2003) The impact of gross tumor volume (GTV) and clinical target volume (CTV) definition on the total accuracy in radiotherapy. Strahlenther Onkol 179:21–30. doi:10.1007/s00066-003-0976-5
Wesley D, Dau LA (2017) Complacency and automation bias in the enbridge pipeline disaster. Ergon Des 25:17–22. doi:10.1177/1064804616652269
Whitfield GA, Price P, Price GJ, Moore CJ (2013) Automated delineation of radiotherapy volumes: are we going in the right direction? Br J Radiol 86:20110718. doi:10.1259/bjr.20110718
Winkel D, Bol GH, van Asselen B et al (2016) Development and clinical introduction of automated radiotherapy treatment planning for prostate cancer. Phys Med Biol 61:8587–8595. doi:10.1088/1361-6560/61/24/8587
Xing L, Thorndyke B, Schreibmann E et al (2006) Overview of image-guided radiation therapy. Med Dosim 31:91–112. doi:10.1016/j.meddos.2005.12.004
Yancik R, Ries LAG (2004) Cancer in older persons: an international issue in an aging world. Semin Oncol 31:128–136. doi:10.1053/j.seminoncol.2003.12.024
Zabramski S (2011) Careless touch. In: Proceedings of the 23rd Australian computer-human interaction conference on—OzCHI ’11. ACM Press, New York, New York, USA, pp 329–332