Skip to Main Content
 

Global Search Box

 
 
 
 

ETD Abstract Container

Abstract Header

Regularization of Case Specific Parameters: A New Approach for Improving Robustness and/or Efficiency of Statistical Methods

Abstract Details

2010, Doctor of Philosophy, Ohio State University, Statistics.
Regularization methods allow one to handle a variety of inferential problems where there are more covariates than cases. This allows one to consider a potentially enormous number of covariates for a problem. We exploit the power of these techniques, supersaturating models by augmenting the “natural” covariates in the problem with an additional indicator for each case in the data set. We attach a penalty term for these case-specific indicators which is designed to produce a desired effect. For regression methods with squared error loss, an L1 type penalty for case-specific parameters produces a regression which is robust to outliers and high leverage cases. Through this modification we have devised a robust LASSO which retains desirable property of the LASSO and performs better when outlying observations exist. For quantile regression methods, an L2 type penalty decreases the variance of the fit enough to overcome an increase in bias. The paradigm thus allows us to robustify procedures which lack robustness and to increase the efficiency of procedures which are robust. Including the case-specific parameters can be viewed as a modification of the current loss function to produce better estimator. For the LASSO with the squared error loss, the modification yields Huber’s loss. The check loss function in quantile regression is adjusted to be quadratic near its minimum. This modification produces an averaging effect near the target quantile thus more efficient quantile estimation in various settings. Applications to classification procedures such as logistic regression and support vector machines are also considered. Finally, a modification to cross validation through use of a new validation function in quantile regression is investigated. The new validation function makes use of the same adjusted check loss which is used for estimation. iii
Steven MacEachern (Committee Co-Chair)
Yoonkyung Lee (Committee Co-Chair)
Tao Shi (Committee Member)

Recommended Citations

Citations

  • Jung, Y. (2010). Regularization of Case Specific Parameters: A New Approach for Improving Robustness and/or Efficiency of Statistical Methods [Doctoral dissertation, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1275115372

    APA Style (7th edition)

  • Jung, Yoonsuh. Regularization of Case Specific Parameters: A New Approach for Improving Robustness and/or Efficiency of Statistical Methods. 2010. Ohio State University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1275115372.

    MLA Style (8th edition)

  • Jung, Yoonsuh. "Regularization of Case Specific Parameters: A New Approach for Improving Robustness and/or Efficiency of Statistical Methods." Doctoral dissertation, Ohio State University, 2010. http://rave.ohiolink.edu/etdc/view?acc_num=osu1275115372

    Chicago Manual of Style (17th edition)