A Riemannian geometric framework for manifold learning of non-Euclidean data
Tóm tắt
A growing number of problems in data analysis and classification involve data that are non-Euclidean. For such problems, a naive application of vector space analysis algorithms will produce results that depend on the choice of local coordinates used to parametrize the data. At the same time, many data analysis and classification problems eventually reduce to an optimization, in which the criteria being minimized can be interpreted as the distortion associated with a mapping between two curved spaces. Exploiting this distortion minimizing perspective, we first show that manifold learning problems involving non-Euclidean data can be naturally framed as seeking a mapping between two Riemannian manifolds that is closest to being an isometry. A family of coordinate-invariant first-order distortion measures is then proposed that measure the proximity of the mapping to an isometry, and applied to manifold learning for non-Euclidean data sets. Case studies ranging from synthetic data to human mass-shape data demonstrate the many performance advantages of our Riemannian distortion minimization framework.
Tài liệu tham khảo
Barahona S, Gual-Arnau X, Ibáñez MV, Simó A (2018) Unsupervised classification of children’s bodies using currents. Adv Data Anal Classif 12(2):365–397
Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396
Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434
Boothby WM (1986) An introduction to differentiable manifolds and Riemannian geometry, vol 120. Academic press, Cambridge
Bronstein MM, Bruna J, LeCun Y, Szlam A, Vandergheynst P (2017) Geometric deep learning: going beyond euclidean data. IEEE Signal Process Magazine 34(4):18–42
Coifman RR, Lafon S (2006) Diffusion maps. Appl Comput Harmonic Anal 21(1):5–30
Desbrun M, Meyer M, Alliez P (2002) Intrinsic parameterizations of surface meshes. Comput Graph Forum Wiley Online Libr 21:209–218
Donoho DL, Grimes C (2003) Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data. Proc Natl Acad Sci 100(10):5591–5596
Dubrovin BA, Fomenko AT, Novikov SP (1992) Modern geometry-methods and applications Part I. The geometry of surfaces, transformation groups, and fields. Springer, Berlin
Eells J, Lemaire L (1978) A report on harmonic maps. Bull London Math Soc 10(1):1–68
Eells J, Lemaire L (1988) Another report on harmonic maps. Bull London Math Soc 20(5):385–524
Eells J, Sampson JH (1964) Harmonic mappings of Riemannian manifolds. Am J Math 86(1):109–160
Feragen A, Lauze F, Hauberg S (2015) Geodesic exponential kernels: When curvature and linearity conflict. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3032–3042
Fletcher PT, Joshi S (2007) Riemannian geometry for the statistical analysis of diffusion tensor data. Signal Process 87(2):250–262
Goldberg Y, Zakai A, Kushnir D, Ritov Y (2008) Manifold learning: the price of normalization. J Mach Learn Res 9:1909–1939
Gu X, Wang Y, Chan TF, Thompson PM, Yau ST (2004) Genus zero surface conformal mapping and its application to brain surface mapping. IEEE Trans Med Imag 23(8):949–958
Jang C (2019) Riemannian distortion measures for non-euclidean data. Ph.D. thesis, Seoul National University
Jayasumana S, Hartley R, Salzmann M, Li H, Harandi M (2015) Kernel methods on riemannian manifolds with gaussian rbf kernels. IEEE Trans Pattern Anal Mach Intell 37(12):2464–2477
Lafon SS (2004) Diffusion maps and geometric harmonics. PhD thesis, Yale University Ph.D dissertation
Lee T, Park FC (2018) A geometric algorithm for robust multibody inertial parameter identification. IEEE Robot Autom Lett 3(3):2455–2462
Lin B, He X, Ye J (2015) A geometric viewpoint of manifold learning. Appl Inform 2:3. https://doi.org/10.1186/s40535-015-0006-6
McQueen J, Meila M, Perrault-Joncas D (2016) Nearly isometric embedding by relaxation. In: Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R (eds) Advances in Neural Information Processing Systems, pp 2631–2639
Mullen P, Tong Y, Alliez P, Desbrun M (2008) Spectral conformal parameterization. Comput Graph Forum Wiley Online Libr 27:1487–1494
Park FC, Brockett RW (1994) Kinematic dexterity of robotic mechanisms. Int J Robot Res 13(1):1–15
Pelletier B (2005) Kernel density estimation on riemannian manifolds. Stat Probab Lett 73(3):297–304
Perrault-Joncas D, Meila M (2013) Non-linear dimensionality reduction: Riemannian metric estimation and the problem of geometric discovery. arXiv preprint arXiv:1305.7255
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326
Steinke F, Hein M, Schölkopf B (2010) Nonparametric regression between general riemannian manifolds. SIAM J Imag Sci 3(3):527–563
Tenenbaum JB, De Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323
Vinué G, Simó A, Alemany S (2016) The \(k\)-means algorithm for 3d shapes with an application to apparel design. Adv Data Anal Classif 10(1):103–132
Wensing PM, Kim S, Slotine JJE (2018) Linear matrix inequalities for physically consistent inertial parameter identification: a statistical perspective on the mass distribution. IEEE Robot Autom Lett 3(1):60–67
Yang Y, Yu Y, Zhou Y, Du S, Davis J, Yang R (2014) Semantic parametric reshaping of human body models. In: 3D Vision (3DV), 2014 2nd International Conference on, IEEE, vol 2, pp 41–48
Zhang T, Li X, Tao D, Yang J (2008) Local coordinates alignment (lca): a novel manifold learning approach. Int J Pattern Recogn Artif Intell 22(04):667–690
Zhang Z, Zha H (2004) Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J Sci Comput 26(1):313–338