Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer

Abstract Background Many questions in statistical genomics can be formulated in terms of variable selection of candidate biological factors for modeling a trait or quantity of interest. Often, in these applications, additional covariates describing clinical, demographical or experimental effects mus...

Full description

Bibliographic Details
Main Authors: Jing Zhai, Chiu-Hsieh Hsu, Z. John Daye
Format: Article
Language:English
Published: BMC 2017-01-01
Series:BMC Medical Research Methodology
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12874-017-0291-y
id doaj-e34786a1b7874b8c88704e44e86b7be2
record_format Article
spelling doaj-e34786a1b7874b8c88704e44e86b7be22020-11-24T21:44:57ZengBMCBMC Medical Research Methodology1471-22882017-01-0117111310.1186/s12874-017-0291-yRidle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancerJing Zhai0Chiu-Hsieh Hsu1Z. John Daye2Epidemiology and Biostatistics Department, University of ArizonaEpidemiology and Biostatistics Department, University of ArizonaEpidemiology and Biostatistics Department, University of ArizonaAbstract Background Many questions in statistical genomics can be formulated in terms of variable selection of candidate biological factors for modeling a trait or quantity of interest. Often, in these applications, additional covariates describing clinical, demographical or experimental effects must be included a priori as mandatory covariates while allowing the selection of a large number of candidate or optional variables. As genomic studies routinely require mandatory covariates, it is of interest to propose principled methods of variable selection that can incorporate mandatory covariates. Methods In this article, we propose the ridge-lasso hybrid estimator (ridle), a new penalized regression method that simultaneously estimates coefficients of mandatory covariates while allowing selection for others. The ridle provides a principled approach to mitigate effects of multicollinearity among the mandatory covariates and possible dependency between mandatory and optional variables. We provide detailed empirical and theoretical studies to evaluate our method. In addition, we develop an efficient algorithm for the ridle. Software, based on efficient Fortran code with R-language wrappers, is publicly and freely available at https://sites.google.com/site/zhongyindaye/software . Results The ridle is useful when mandatory predictors are known to be significant due to prior knowledge or must be kept for additional analysis. Both theoretical and comprehensive simulation studies have shown that the ridle to be advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves. A microarray gene expression analysis of the histologic grades of breast cancer has identified 24 genes, in which 2 genes are selected only by the ridle among current methods and found to be associated with tumor grade. Conclusions In this article, we proposed the ridle as a principled sparse regression method for the selection of optional variables while incorporating mandatory ones. Results suggest that the ridle is advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves.http://link.springer.com/article/10.1186/s12874-017-0291-yGene expression analysisLassoLinear modelsPenalized regressionRidgeVariable selection
collection DOAJ
language English
format Article
sources DOAJ
author Jing Zhai
Chiu-Hsieh Hsu
Z. John Daye
spellingShingle Jing Zhai
Chiu-Hsieh Hsu
Z. John Daye
Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
BMC Medical Research Methodology
Gene expression analysis
Lasso
Linear models
Penalized regression
Ridge
Variable selection
author_facet Jing Zhai
Chiu-Hsieh Hsu
Z. John Daye
author_sort Jing Zhai
title Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
title_short Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
title_full Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
title_fullStr Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
title_full_unstemmed Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
title_sort ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
publisher BMC
series BMC Medical Research Methodology
issn 1471-2288
publishDate 2017-01-01
description Abstract Background Many questions in statistical genomics can be formulated in terms of variable selection of candidate biological factors for modeling a trait or quantity of interest. Often, in these applications, additional covariates describing clinical, demographical or experimental effects must be included a priori as mandatory covariates while allowing the selection of a large number of candidate or optional variables. As genomic studies routinely require mandatory covariates, it is of interest to propose principled methods of variable selection that can incorporate mandatory covariates. Methods In this article, we propose the ridge-lasso hybrid estimator (ridle), a new penalized regression method that simultaneously estimates coefficients of mandatory covariates while allowing selection for others. The ridle provides a principled approach to mitigate effects of multicollinearity among the mandatory covariates and possible dependency between mandatory and optional variables. We provide detailed empirical and theoretical studies to evaluate our method. In addition, we develop an efficient algorithm for the ridle. Software, based on efficient Fortran code with R-language wrappers, is publicly and freely available at https://sites.google.com/site/zhongyindaye/software . Results The ridle is useful when mandatory predictors are known to be significant due to prior knowledge or must be kept for additional analysis. Both theoretical and comprehensive simulation studies have shown that the ridle to be advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves. A microarray gene expression analysis of the histologic grades of breast cancer has identified 24 genes, in which 2 genes are selected only by the ridle among current methods and found to be associated with tumor grade. Conclusions In this article, we proposed the ridle as a principled sparse regression method for the selection of optional variables while incorporating mandatory ones. Results suggest that the ridle is advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves.
topic Gene expression analysis
Lasso
Linear models
Penalized regression
Ridge
Variable selection
url http://link.springer.com/article/10.1186/s12874-017-0291-y
work_keys_str_mv AT jingzhai ridleforsparseregressionwithmandatorycovariateswithapplicationtothegeneticassessmentofhistologicgradesofbreastcancer
AT chiuhsiehhsu ridleforsparseregressionwithmandatorycovariateswithapplicationtothegeneticassessmentofhistologicgradesofbreastcancer
AT zjohndaye ridleforsparseregressionwithmandatorycovariateswithapplicationtothegeneticassessmentofhistologicgradesofbreastcancer
_version_ 1725907577040011264