Abstract
Though a great deal of research work has been devoted to the development of dimensionality reduction algorithms, the problem is still open. The most recent and effective techniques, assuming datasets drawn from an underlying low dimensional manifold embedded into an high dimensional space, look for “small enough” neighborhoods which should represent the underlying manifold portion. Unfortunately, neighborhood selection is an open problem, for the presence of noise, outliers, points not uniformly distributed, and to unexpected high manifold curvatures, causing the inclusion of geodesically distant points in the same neighborhood. In this paper we describe our neighborhood selection algorithm, called ONeS; it exploits both distance and angular information to form neighborhoods containing nearby points that share a common local structure in terms of curvature. The reported experimental results show the enhanced quality of the neighborhoods computed by ONeS w.r.t. the commonly used k-neighborhoods solely employing the euclidean distance.
Chapter PDF
Similar content being viewed by others
References
Ceruti, C., Bassis, S., Rozza, A., Lombardi, G., Casiraghi, E., Campadelli, P.: DANCo: an intrinsic Dimensionalty estimator exploiting Angle and Norm Concentration. Pattern Recognition 47(8), 2569–2581 (2014)
Costa, J.A., Hero, A.O.: Learning intrinsic dimension and entropy of high-dimensional shape spaces. In: Proc. of EUSIPCO, pp. 231–252 (2004)
Demartines, P., Herault, J.: Curvilinear component analysis: A self-organizing neural network for nonlinear mapping in cluster analysis. IEEE Trans. on Neural Networks 8(1), 148–154 (1997)
Gashler, M., Martinez, T.: Robust manifold learning with cyclecut. Connection Science, 24(1) (2012)
Gashler, M., Martinez, T.: Tangent space guided intelligent neighbor finding, pp. 2617–2624 (2011)
Hein, M., Audibert, J.Y.: Intrinsic dimensionality estimation of submanifolds in euclidean space. In: Proc. of ICML, pp. 289–296 (2005)
Jing, L., Shao, C.: Selection of the suitable parameter value for isomap. Journal of Software 6(6), 1034–1041 (2011)
Jollife, I.T.: Principal component analysis. Springer Series in Statistics. Springer-Verlag, New York (1986)
Kruskal, J.B.: Linear transformation of multivariate data to reveal clustering, vol. I. Ac. Press (1972)
Levina, E., Bickel, P.J.: Maximum likelihood estimation of intrinsic dimension. In: Proceedings of NIPS, vol. 1, pp. 777–784 (2004)
Little, A.V., Maggioni, M., Rosasco, L.: Multiscale Geometric Methods for Data Sets I: Multiscale SVD, Noise and Curvature. MIT-CSAIL-TR-2012-029 (2012)
Roweis, S.T., Saul, L.K.: Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290, 2323–2326 (2000)
Rozza, A., Lombardi, G., Ceruti, C., Casiraghi, E., Campadelli, P.: Novel high intrinsic dimensionality estimators. Machine Learning Journal 89(1–2), 37–65 (2012)
Shepard, R.N., Carroll, J.D.: Parametric representation of nonlinear data structures. Ac. Press (1969)
Silva, V., Tenenbaum, J.B.: Global versus local methods in nonlinear dimensionality reduction. In: Advances in Neural Information Processing Systems, vol. 15, pp. 705–712 (2002)
Tenenbaum, J., Silva, V., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)
Wang, J.: Improve local tangent space alignment using various dimensional local coordinates. Neurocomputing 71(1618), 3575–3581 (2008)
Wang, J., Jiang, W., Gou, J.: Extended local tangent space alignment for classification. Neurocomputing 77(1), 261–266 (2012)
Wei, J., Peng, H., Lin, Y.S., Huang, Z.M., Wang, J.B.: Adaptive neighborhood selection for manifold learning. In: International Conference on Machine Learning and Cybernetics, pp. 380–384 (2008)
Zhan, Y., Yin, J.: Robust local tangent space alignment via iterative weighted PCA. Neurocomputing 74(11), 1985–1993 (2011)
Zhang, P., Qiao, H., Zhang, B.: An improved local tangent space alignment method for manifold learning. Pattern Recognition Letters 32(2), 181–189 (2011)
Zhang, Z., Wang, J., Zha, H.: Adaptive Manifold Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(2), 253–265 (2012)
Zhang, Z., Zha, H.: Principal manifolds and nonlinear dimension reduction via local tangent space alignment. SIAM Journal of Scientific Computing 26, 313–338 (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Campadelli, P., Casiraghi, E., Ceruti, C. (2015). Neighborhood Selection for Dimensionality Reduction. In: Murino, V., Puppo, E. (eds) Image Analysis and Processing — ICIAP 2015. ICIAP 2015. Lecture Notes in Computer Science(), vol 9279. Springer, Cham. https://doi.org/10.1007/978-3-319-23231-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-23231-7_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23230-0
Online ISBN: 978-3-319-23231-7
eBook Packages: Computer ScienceComputer Science (R0)