Fast occlusion-based point cloud exploration

The Visual Computer - Tập 37 Số 9-11 - Trang 2769-2781 - 2021
Mohamed Radwan1, Stefan Ohrhallinger1, Michael Wimmer1
1TU Wien, Vienna, Austria

Tóm tắt

AbstractLarge-scale unstructured point cloud scenes can be quickly visualized without prior reconstruction by utilizing levels-of-detail structures to load an appropriate subset from out-of-core storage for rendering the current view. However, as soon as we need structures within the point cloud, e.g., for interactions between objects, the construction of state-of-the-art data structures requires O(NlogN) time for N points, which is not feasible in real time for millions of points that are possibly updated in each frame. Therefore, we propose to use a surface representation structure which trades off the (here negligible) disadvantage of single-frame use for both output-dominated and near-linear construction time in practice, exploiting the inherent 2D property of sampled surfaces in 3D. This structure tightly encompasses the assumed surface of unstructured points in a set of bounding depth intervals for each cell of a discrete 2D grid. The sorted depth samples in the structure permit fast surface queries, and on top of that an occlusion graph for the scene comes almost for free. This graph enables novel real-time user operations such as revealing partially occluded objects, or scrolling through layers of occluding objects, e.g., walls in a building. As an example application we showcase a 3D scene exploration framework that enables fast, more sophisticated interactions with point clouds rendered in real time.

Từ khóa


Tài liệu tham khảo

Asafi, S., Goren, A., Cohen-Or, D.: Weak convex decomposition by lines-of-sight. Comput. Graphics Forum 32(5), 23–31 (2013)

Benger, W., Hildenbrand, D., Dobler, W.: Optimizing refined geometric primitive’s leaflet visibility for interactive 3d visualization via geometric algebra. In: Proceedings of CGI 2018, p. 267–272. ACM, NY (2018)

Bruckner, S., Groeller, M.E.: Exploded views for volume data. IEEE TVCG 12(5), 1077–1084 (2006)

Calderon, S., Boubekeur, T.: Bounding proxies for shape approximation. ACM Trans. Graphics 36(4), 1–13 (2017)

Carnecky, R., Fuchs, R., Mehl, S., Jang, Y., Peikert, R.: Smart transparency for illustrative visualization of complex flow surfaces. IEEE Trans. Vis. Comput. Graphics 19(5), 838–851 (2013)

Cashion, J., Wingrave, C., LaViola Jr., J.J.: Dense and dynamic 3d selection for game-based virtual environments. IEEE TVCG 18(4), 634–642 (2012)

Chen, M., Correa, C., Silver, D.: Illustrative deformation for data exploration. TVCG 13(06), 1320–1327 (2007)

Xian, C., Lin, H., Gao, S.: Automatic generation of coarse bounding cages from dense meshes. In: 2009 IEEE ICSMA, pp. 21–27 (2009)

Dachsbacher, C., Vogelgsang, C., Stamminger, M.: Sequential point trees. ACM ToG 22(3), 657–662 (2003)

Deng, Z., Luo, X., Miao, X.P.: Automatic cage building with quadric error metrics. JCST 26, 538–547 (2011)

Diepstraten, J., Weiskopf, D., Ertl, T.: Transparency in Interactive Technical Illustrations. CGF (2002)

Eisemann, E., Paris, S., Durand, F.: A visibility algorithm for converting 3d meshes into editable 2d vector graphics. ACM Trans. Graph. 28(3), 83:1–83:8 (2009)

Elmqvist, N., Tsigas, P.: A taxonomy of 3d occlusion management techniques. In: 2007 IEEE Virtual Reality Conference, pp. 51–58 (2007)

Elvins, T.T., Nadeau, D.R., Kirsh, D.: Worldlets–3d thumbnails for wayfinding in virtual environments. In: Proc. UIST ’97, pp. 21–30. ACM, NY, USA (1997)

Everitt, C.: Interactive order-independent transparency. Tech. rep., NVIDIA corporation (2001)

Faure, F., Barbier, S., Allard, J., Falipou, F.: Image-based collision detection and response between arbitrary volume objects. EG Ass. (2008)

Gobbetti, E., Marton, F.: Layered point clouds: A simple and efficient multiresolution structure for distributing and rendering gigantic point-sampled models. Comput. Graphics 28(6), 815–826 (2004)

Heidelberger, B., Teschner, M., Gross, M.: Real-time volumetric intersections of deforming objects. In: VMV’03, vol. 2003, pp. 461–468 (2003)

Heidelberger, B., Teschner, M., Gross, M.: Detection of collisions and self-collisions using image-space techniques. J. WSCG 12, 145–152 (2004)

Hoberock, J., Bell, N.: Thrust: A parallel template library (2010). http://thrust.github.io/. Version 1.7.0

Hofmann, N., Bogendörfer, P., Stamminger, M., Selgrad, K.: Hierarchical multi-layer screen-space ray tracing. In: Proc. of HPG ’17. ACM, NY, USA (2017)

Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., Markham, A.: Randla-net: Efficient semantic segmentation of large-scale point clouds. In: Proceedings of the IEEE Conference on CVPR (2020)

Kobbelt, L., Botsch, M.: A survey of point-based techniques in computer graphics. C&G 28(6), 801–814 (2004)

Kopper, R., Bacim, F., Bowman, D.A.: Rapid and accurate 3d selection by progressive refinement. In: 2011 IEEE Symp. on 3D User Int. (3DUI), pp. 67–74 (2011)

Mossel, A., Koessler, C.: Large scale cut plane: An occlusion management technique for immersive dense 3d reconstructions. In: Proc. 22nd ACM Conference on VRST, pp. 201–210. ACM, NY, USA (2016)

Ponto, K., Tredinnick, R., Casper, G.: Simulating the experience of home environments. In: 2017 International Conference on Virtual Rehabilitation (ICVR), pp. 1–9 (2017)

Qi, C.R., Su, H., Mo, K., Guibas, L.J.: Pointnet: Deep learning on point sets for 3d classification and segmentation. arXiv:1612.00593 (2016)

Qi, C.R., Yi, L., Su, H., Guibas, L.J.: Pointnet++: Deep hierarchical feature learning on point sets in a metric space (2017)

Radwan, M., Ohrhallinger, S., Wimmer, M.: Efficient collision detection while rendering dynamic points. In: Proceedings of the 2014 Graphics Interface Conference, pp. 25–33 (2014)

Röhlig, M., Schumann, H.: Visibility widgets: Managing occlusion of quantitative data in 3d terrain visualization. In: Proc. 9th Intl Symp. VICI, VINCI ’16, pp. 51–58. ACM, New York, NY, USA (2016)

Rusinkiewicz, S., Levoy, M.: Qsplat: A multiresolution point rendering system for large meshes. In: Proc. 27th Ann. Conf. CGIT, pp. 343–352. ACM, USA (2000)

Sacht, L., Vouga, E., Jacobson, A.: Nested cages. ACM Trans. Graphics 34, 6 (2015)

Sander, P.V., Gu, X., Gortler, S.J., Hoppe, H., Snyder, J.: Silhouette clipping. SIGGRAPH ’00, pp. 327–334. ACM Press/Addison-Wesley Publishing Co., USA (2000)

Schuetz, M.: Potree: Rendering large point clouds in web browsers. Master’s thesis, ICGA, TU Wien (2016)

Shade, J., Gortler, S., He, L.W., Szeliski, R.: Layered depth images. In: Proc. 25th Ann. Conf. CGIT, SIGGRAPH ’98, pp. 231–242. ACM, NY, USA (1998)

Stoakley, R., Conway, M.J., Pausch, R.: Virtual reality on a wim: Interactive worlds in miniature. In: Proc. of SIGCHI, CHI ’95, pp. 265–272. ACM, USA (1995)

Tredinnick, R., Broecker, M., Ponto, K.: Progressive feedback point cloud rendering for virtual reality display. In: 2016 IEEE Virtual Reality (VR), pp. 301–302 (2016)

Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3d virtual environments. In: 2007 IEEE Symposium on 3D User Interfaces (2007)

Wimmer, M., Scheiblauer, C.: Instant points: Fast rendering of unprocessed point clouds. In: Proc. Symp. on PBG 2006, pp. 129–136. Eurographics, EG Ass. (2006)

Wu, M., Popescu, V.: Multiperspective focus+context visualization. IEEE Trans. Vis. Comput. Graphics 22(5), 1555–1567 (2016)

Xian, C., Lin, H., Gao, S.: Automatic cage generation by improved obbs for mesh deformation. Vis. Comput. 28(1), 21–33 (2012)