Penalized regression method in high dimensional data

ZUHARAH JAAFAR; NORAZLINA ISMAIL

No Detail Found!

Penalized regression method in high dimensional data

Author(s)

ZUHARAH JAAFAR Department of Mathematics, Universiti Teknologi Malaysia.

NORAZLINA ISMAIL Department of Mathematics, Universiti Teknologi Malaysia.

Abstract

In huge multivariate data set with a number of variables greater than the number of samples, the standard linear model (or ordinary least squares method) performs badly. In such situations, a better option is penalized regression, which allows you to design a linear regression model that is penalized for having too many variables by adding a constraint to the equation Shrinkage or regularization procedures are other names for this. The penalty has the effect of reducing (i.e. shrinking) the coefficient values towards zero. This permits the coefficients of the less important variables to be near to or equal to zero. By decreasing the number of coefficients and maintaining those with coefficients greater than zero, penalized regression models improve prediction in new data when compared to traditional methods. We demonstrate that the proposed regularizer is capable of achieving competitive results as well as exceedingly compact networks. Extensive tests are carried out on a number of benchmark datasets to demonstrate the effectiveness of the method.

Publication Details

Page(s) 2470-2479

DOI DOI not available

Published Journal: Journal of Theoretical and Applied Information Technology, Volume: 100, Issue: 8, Year: 2022

Request the full text from PASTIC

Keywords

Ridge, LASSO, Adaptive lasso, Cifar-10, ImageNet, Elastic-Net, Vgg-19, MNIST

Citations

Downloads

111

Views