Skip to Main Content
 

Global Search Box

 
 
 
 

ETD Abstract Container

Abstract Header

Graph Based Regularization of Large Covariance Matrices

Abstract Details

2009, Master of Science, Ohio State University, Computer Science and Engineering.

A range of successful techniques in computer vision, such as Eigenfaces and Fisherfaces are based on using the spectral decomposition of the empirical covariance matrices that are constructed from given data. These matrices are typically constructed in a setting where the dimension of the data (number of pixels) exceeds the number of available samples, sometimes by a large margin. However it has been established in statistics that under these conditions and some fairly general modeling assumptions, the eigenvectors and eigenvalues of covariance matrices cannot be estimated reliably. Several techniques to remedy this problem have been proposed. These techniques typically make specific assumptions about the structure of the covariance matrix and assume that this structure is known in advance.

In this thesis we propose a new method for automatically learning non-local structure in the covariance matrix in a data-dependent way. This learned structure is then used to improve inference for methods like Eigenfaces. Unlike most existing methods in computer vision and statistics we do not make any assumptions about the spatial (pixel) proximity structure of the data.

We provide theoretical results indicating that our methods may overcome the problem of insufficient data. We evaluate the performance of our algorithms empirically and demonstrate significant and consistent improvements over traditional Eigenfaces as well as more recent techniques, such as 2D PCA, Euclidean Banding and thresholding for a wide range of parameter settings.

Mikhail Belkin, PhD (Advisor)
Simon Dennis, PhD (Committee Member)
43 p.

Recommended Citations

Citations

  • Yekollu, S. (2009). Graph Based Regularization of Large Covariance Matrices [Master's thesis, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1237243768

    APA Style (7th edition)

  • Yekollu, Srikar. Graph Based Regularization of Large Covariance Matrices. 2009. Ohio State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1237243768.

    MLA Style (8th edition)

  • Yekollu, Srikar. "Graph Based Regularization of Large Covariance Matrices." Master's thesis, Ohio State University, 2009. http://rave.ohiolink.edu/etdc/view?acc_num=osu1237243768

    Chicago Manual of Style (17th edition)