A variable baseline stereoscopic camera with fast deployable structure for natural orifice transluminal endoscopic surgery
Tóm tắt
Stereo vision can provide surgeons with 3D images and reduce the difficulty of operation in robot-assisted surgery. In natural orifice transluminal endoscopic surgery, distortions of the stereoscopic images could be induced at different observation depths. This would increase the risk of surgery. We proposed a novel camera to solve this problem. This study integrated the camera calibration matrix and the geometric model of stereoscopic system to find the cause of distortion. It was found that image distortions were caused by inappropriate disparity, and this could be avoided by changing the camera baseline. We found the relationship between camera baseline and observation depth with the model. A variable baseline stereoscopic camera with deployable structure was designed to achieve this requirement. The baseline could be adjusted to provide appropriate disparity. Three controlled experiments were conducted to verify the stereo vision of the proposed camera at different observation depths. No significant difference was observed in the completion time. At the observation depths of 30 mm and 90 mm, the number of errors apparently decreased by 62.90% and 51.06%, respectively. The significant decrease in number of errors shows that the proposed camera has a better stereo vision than a regular camera at both small and large observation depths. It can produce more accurate stereoscopic images at any depth. This will further improve the safety of robot-assisted surgery.
Tài liệu tham khảo
Zhou Y, Ren H, Meng MQH, Tsz Ho Tse Z, Yu H (2013) Robotics in natural orifice transluminal endoscopic surgery. J Mech Med Biol 13(02):1350044. https://doi.org/10.1142/S0219519413500449
Chan M, Lin W, Zhou C, Qu JY (2003) Miniaturized three-dimensional endoscopic imaging system based on active stereovision. Appl Opt 42(10):1888–1898. https://doi.org/10.1364/AO.42.001888
Hu M, Penney G, Figl M, Edwards P, Bello F, Casula R, Rueckert D, Hawkes D (2012) Reconstruction of a 3D surface from video that is robust to missing data and outliers: Application to minimally invasive surgery using stereo and mono endoscopes. Med Image Anal 16(3):597–611. https://doi.org/10.1016/j.media.2010.11.002
Ohuchida K (2013) New advances in three-dimensional endoscopic surgery. J Gastrointest Dig Syst 03(04):1000152. https://doi.org/10.4172/2161-069x.1000152
Bogdanova R, Boulanger P, Zheng B (2016) Depth perception of surgeons in minimally invasive surgery. Surg Innov 23(5):515–524. https://doi.org/10.1177/1553350616639141
Higuchi K, Kaise M, Noda H, Kirita K, Koizumi E, Umeda T, Akimoto T, Omori J, Akimoto N, Goto O, Tatsuguchi A, Iwakiri K (2020) Three-dimensional flexible endoscopy enables more accurate endoscopic recognition and endoscopic submucosal dissection marking for superficial gastric neoplasia: a pilot study to compare two- and three-dimensional imaging. Surg Endosc 20:1–7. https://doi.org/10.1007/s00464-020-08124-z
Andrew JW, Tom D, Rolf K (1993) Image distortions in stereoscopic video systems. Stereoscop Disp Appl IV. https://doi.org/10.1117/12.157041
Fishman JM, Ellis SR, Hasser CJ, Stern JD (2008) Effect of reduced stereoscopic camera separation on ring placement with a surgical telerobot. Surg Endosc 22(11):2396–2400. https://doi.org/10.1007/s00464-008-0032-8
Hoffman DM, Girshick AR, Akeley K, Banks MS (2008) Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. J Vis 8(3):33–33. https://doi.org/10.1167/8.3.33
Dawei F (2009) Analysis and design of stereoscopic display in stereo television endoscope system. Int Conf Opt Inst Technol 12:7156. https://doi.org/10.1117/12.806811
Rosenberg LB (1993) The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks. IEEE Virtual Reality Annu Int Symp 27–32. https://doi.org/10.1109/vrais.1993.380802
Groen PCD (2017) History of the endoscope [scanning our past. Proc IEEE 105(10):1987–1995. https://doi.org/10.1109/JPROC.2017.2742858
Mintz D, Falk V, Salisbury JK (2000) Comparison of three high-end endoscopic visualization systems on telesurgical performance. Med Image Comput Comput Assist Intervent. Berlin, Heidelberg. Doi: https://doi.org/10.1007/978-3-540-40899-4_39
Avinash A, Abdelaal AE, Salcudean SE (2020) Evaluation of increasing camera baseline on depth perception in surgical robotics. IEEE Int Conf Robot Auto 5509–5515. https://doi.org/10.1109/ICRA40945.2020.9197235
Koh JX, Ren H (2017) Open-source development of a low-cost stereo-endoscopy system for natural orifice transluminal endoscopic surgery. Comput Vis Syst 357–370. https://doi.org/10.1007/978-3-319-68345-4_32
Xu K, Zhao J, Dai Z (2014) A foldable stereo vision unit for Single Port Access Laparoscopy. In: IEEE international conference on robotics and automation, pp 4182–4187. Doi: https://doi.org/10.1109/ICRA.2014.6907467
Avinash A, Abdelaal AE, Mathur P, Salcudean SE (2019) A “pickup” stereoscopic camera with visual-motor aligned control for the da Vinci surgical system: a preliminary study. Int J Comput Assist Radiol Surg 14(7):1197–1206. https://doi.org/10.1007/s11548-019-01955-9
Diner DB, Fender DH (1993) Human engineering in stereoscopic viewing devices. advances in computer vision and machine intelligence, 1st edn. Springer US, New York. Doi: https://doi.org/10.1007/978-1-4899-1274-9
Zhengyou Z (1999) Flexible camera calibration by viewing a plane from unknown orientations. IEEE Int Conf Comput Vis 1:666–673. https://doi.org/10.1109/ICCV.1999.791289
Schreuder H, van den Berg C, Hazebroek E, Verheijen R, Schijven M (2011) Laparoscopic skills training using inexpensive box trainers: which exercises to choose when constructing a validated training course. BJOG Int J Obstet Gynaecol 118 (13):1576–1584. Doi: https://doi.org/10.1111/j.1471-0528.2011.03146.x
Faul F, Erdfelder E, Buchner A, Lang A-G (2009) Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav Res Methods 41(4):1149–1160. Doi: https://doi.org/10.3758/BRM.41.4.1149
Pallant J (2013) SPSS survival manual: A step by step guide to data analysis using SPSS for windows. Aust NZ J Public Health 37(6):597–598. https://doi.org/10.1111/1753-6405.12166