Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer
Abstract Background Many questions in statistical genomics can be formulated in terms of variable selection of candidate biological factors for modeling a trait or quantity of interest. Often, in these applications, additional covariates describing clinical, demographical or experimental effects mus...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2017-01-01
|
Series: | BMC Medical Research Methodology |
Subjects: | |
Online Access: | http://link.springer.com/article/10.1186/s12874-017-0291-y |
id |
doaj-e34786a1b7874b8c88704e44e86b7be2 |
---|---|
record_format |
Article |
spelling |
doaj-e34786a1b7874b8c88704e44e86b7be22020-11-24T21:44:57ZengBMCBMC Medical Research Methodology1471-22882017-01-0117111310.1186/s12874-017-0291-yRidle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancerJing Zhai0Chiu-Hsieh Hsu1Z. John Daye2Epidemiology and Biostatistics Department, University of ArizonaEpidemiology and Biostatistics Department, University of ArizonaEpidemiology and Biostatistics Department, University of ArizonaAbstract Background Many questions in statistical genomics can be formulated in terms of variable selection of candidate biological factors for modeling a trait or quantity of interest. Often, in these applications, additional covariates describing clinical, demographical or experimental effects must be included a priori as mandatory covariates while allowing the selection of a large number of candidate or optional variables. As genomic studies routinely require mandatory covariates, it is of interest to propose principled methods of variable selection that can incorporate mandatory covariates. Methods In this article, we propose the ridge-lasso hybrid estimator (ridle), a new penalized regression method that simultaneously estimates coefficients of mandatory covariates while allowing selection for others. The ridle provides a principled approach to mitigate effects of multicollinearity among the mandatory covariates and possible dependency between mandatory and optional variables. We provide detailed empirical and theoretical studies to evaluate our method. In addition, we develop an efficient algorithm for the ridle. Software, based on efficient Fortran code with R-language wrappers, is publicly and freely available at https://sites.google.com/site/zhongyindaye/software . Results The ridle is useful when mandatory predictors are known to be significant due to prior knowledge or must be kept for additional analysis. Both theoretical and comprehensive simulation studies have shown that the ridle to be advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves. A microarray gene expression analysis of the histologic grades of breast cancer has identified 24 genes, in which 2 genes are selected only by the ridle among current methods and found to be associated with tumor grade. Conclusions In this article, we proposed the ridle as a principled sparse regression method for the selection of optional variables while incorporating mandatory ones. Results suggest that the ridle is advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves.http://link.springer.com/article/10.1186/s12874-017-0291-yGene expression analysisLassoLinear modelsPenalized regressionRidgeVariable selection |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jing Zhai Chiu-Hsieh Hsu Z. John Daye |
spellingShingle |
Jing Zhai Chiu-Hsieh Hsu Z. John Daye Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer BMC Medical Research Methodology Gene expression analysis Lasso Linear models Penalized regression Ridge Variable selection |
author_facet |
Jing Zhai Chiu-Hsieh Hsu Z. John Daye |
author_sort |
Jing Zhai |
title |
Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer |
title_short |
Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer |
title_full |
Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer |
title_fullStr |
Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer |
title_full_unstemmed |
Ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer |
title_sort |
ridle for sparse regression with mandatory covariates with application to the genetic assessment of histologic grades of breast cancer |
publisher |
BMC |
series |
BMC Medical Research Methodology |
issn |
1471-2288 |
publishDate |
2017-01-01 |
description |
Abstract Background Many questions in statistical genomics can be formulated in terms of variable selection of candidate biological factors for modeling a trait or quantity of interest. Often, in these applications, additional covariates describing clinical, demographical or experimental effects must be included a priori as mandatory covariates while allowing the selection of a large number of candidate or optional variables. As genomic studies routinely require mandatory covariates, it is of interest to propose principled methods of variable selection that can incorporate mandatory covariates. Methods In this article, we propose the ridge-lasso hybrid estimator (ridle), a new penalized regression method that simultaneously estimates coefficients of mandatory covariates while allowing selection for others. The ridle provides a principled approach to mitigate effects of multicollinearity among the mandatory covariates and possible dependency between mandatory and optional variables. We provide detailed empirical and theoretical studies to evaluate our method. In addition, we develop an efficient algorithm for the ridle. Software, based on efficient Fortran code with R-language wrappers, is publicly and freely available at https://sites.google.com/site/zhongyindaye/software . Results The ridle is useful when mandatory predictors are known to be significant due to prior knowledge or must be kept for additional analysis. Both theoretical and comprehensive simulation studies have shown that the ridle to be advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves. A microarray gene expression analysis of the histologic grades of breast cancer has identified 24 genes, in which 2 genes are selected only by the ridle among current methods and found to be associated with tumor grade. Conclusions In this article, we proposed the ridle as a principled sparse regression method for the selection of optional variables while incorporating mandatory ones. Results suggest that the ridle is advantageous when mandatory covariates are correlated with the irrelevant optional predictors or are highly correlated among themselves. |
topic |
Gene expression analysis Lasso Linear models Penalized regression Ridge Variable selection |
url |
http://link.springer.com/article/10.1186/s12874-017-0291-y |
work_keys_str_mv |
AT jingzhai ridleforsparseregressionwithmandatorycovariateswithapplicationtothegeneticassessmentofhistologicgradesofbreastcancer AT chiuhsiehhsu ridleforsparseregressionwithmandatorycovariateswithapplicationtothegeneticassessmentofhistologicgradesofbreastcancer AT zjohndaye ridleforsparseregressionwithmandatorycovariateswithapplicationtothegeneticassessmentofhistologicgradesofbreastcancer |
_version_ |
1725907577040011264 |