No Detail Found!

Weighted High Leverage Collinear Robust Ridge Estimator in Logistic Regression Model.

Author(s)
Syaiba Balqish Ariffin Faculty of Science, Universiti Putra Malaysia, Serdang Selangor, Malaysia
Habshah Midi Faculty of Science, Universiti Putra Malaysia, Serdang Selangor, Malaysia;Institute of Mathematical Research, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
Abstract
The combination of high leverage points and multicollinearity problem occurs frequently in logistic regression model. Methods that successfully address these problems separately are not effective for the combined problems. A robust logistic ridge regression (RLR) which incorporates the weighted Bianco and Yohai (WBY) robust estimator with fully iterated logistic ridge regression (LR) is proposed to rectify the combined problems of high leverage points and multicollinearity in a data. A numerical example and simulation study are presented to compare the performance of the RLR with the ML, the WBY, and the LR estimators. Results of the study indicate that the RLR outperforms the established estimators for the combined problems.
Publication Details
Page(s) 55-75
DOI DOI not available
Published Journal: Pakistan Journal of Statistics, Volume: 34, Issue: 1, Year: 2018

Request the full text from PASTIC

References
Al-Aabdi , F.A.A.,Al-Shaibani , R.M.A., 2014.Robust estimators of logistic regression with problems multicollinearity or outliers values,Journal of Kufa for Mathematics and Computer 2 64 -71
Askin , R.G.,Montgomery , D.C., 1980.Augmented robust estimators,Technometrics 22 333 -341
Bagheri , A.,Midi , H., 2015.Diagnostic plot for the identification of high leverage collinearity-influential observations,SORT-Statistics and Operations Research Transactions 39 51 -70
Bagheri , A.,Midi , H.,Imon , A.H.M.R., 2010.The effect of collinearityinfluential observations on collinear data set: A monte carlo simulation study,Journal of Applied Sciences 10 2086 -2093
Bagheri , A.,Midi , H.,ArticleID, 2012.On the performance of the measure for diagnosing multiple high leverage collinearity-reducing observations,doi: 10 -
Barker , L.,Brown , C., 2001.Logistic regression when binary variables are highly correlated, 20 1431 -1442
Carroll , R.J.,Pederson , S., 1993.On robustness in the logistic regression model,Journal of Royal Statistics Society B 55 693 -706
Christmann , A.,Rousseeuw , P.J., 2001.Measuring overlap in binary regression,Computational Statistics and Data Analysis 37 65 -75
Collet , D.,Jemain , A.A., 1985.Residuals outliers and influential observations in regression analysis,Sains Malaysiana 14 493 -511
Croux , C.,Haesbroeck , G., 2003.Implementing the Bianco and Yohai estimator for logistic regression,Computational Statistics and Data Analysis 44 273 -295
Cule,De Iorio , M., 2012.A semi-automatic method to guide the choice of ridge parameter in ridge regression,The Annals of Applied Statistics 1 302 -332
Duzan , H.,Shariff , N.S.B.M., 2015.Ridge regression for solving the multicollinearity problem: Review of methods and models,Journal of Applied Sciences 15 392 -
Frisch , R., 1934.Statistical confluence analysis by means of complete regression systems, 8 -
Godínez-Jaimes , F.,Ramírez-Valverde , G.,Reyes-Carreto , R.,Ariza-Hernandez , F.J.,Barrera-Rodriguez , E., 2012.Collinearity and separated data in the Logistic regression model,Journal Agrociencia 46 411 -425
Gunst , R.F., 1983.Regression analysis with multicollinear predictor variables: Definition, detection and effects, 12 2217 -2260
Habshah , M.,Syaiba , B.A., 2012.The performance of classical and robust logistic estimators in the presence of outliers,Pertanika Journal of Science and Technology 20 313 -325
Hoerl , A.E,R.W., 1970.Ridge Regression: Applications to nonorthogonal problems, 12 69 -82
P.W., 1973.Weighted ridge regression: Combining ridge and robust regression methods,NBER Working paper series 11 1 -19
Kibria , B.M.G.,Månsson , K.,Shukur , G., 2012.Performance of some logistic ridge regression estimators,Computational Economics 40 401 -414
Kibria , B.M.G.,Salleh , A.K.E., 2012.Improved the estimators of the parameters of a probit regression model: A ridge regression approach,Journal of Statistical Planning and Inference 142 1421 -1435
Lawrence,Arthur , J.L, 1990.Robust regression: analysis and applications, -
Lesaffre , E.,Marx , B.D., 1993.Collinearity in generalized linear regression,Communications in Statistics - Theory and Methods 22 1933 -1952
Locking , H.,Månsson , K.,Shukur , G., 2013.Performance of some ridge parameters for probit regression: with application on Swedish job search data,Communications in Statistics Simulation and Computation 42 698 -710
Månsson , K.,Shukur , G., 2011.On ridge parameters in logistic regression,Communications in Statistics - Theory and Methods 40 3366 -3381
Marx , B.D.,Smith , E.P., 1990.Weighted multicollinearity in logistic regression: diagnostics and biased estimation techniques with an example from lake acidification,Canadian Journal of Fisheries and Aquatic Sciences 47 1128 -1135
Park,Hastie , T., 2008.Penalized logistic regression for detecting gene interactions,Biostatistics 9 30 -50
Park , H.,Konishi , S., 2016.Robust logistic regression modelling via the elastic net-type regularization and tuning parameter selection,Journal of Statistical Computation and Simulation 86 1450 -1461
Peduzzi , P.,Concato , J.,Kemper , E.,Holford , T.R.,Feinstein , A.R., 1996.A simulation study of the number of events per variable in logistic regression analysis,Journal of Clinical Epidemiology 49 1373 -1379
Piegorsch , W.W., 1992.Complementary log regression for generalized linear models,The American Statistician 46 94 -99
Rousseeuw,Van Driessen , K., 1999.A fast algorithm for the minimum covariance determinant estimator,Technometrics 41 212 -223
Rousseeuw , P.J.,Christmann , A., 2003.Robustness against separation and outliers in logistic regression,Computational Statistics and Data Analysis 43 315 -332
Schaefer , R.L.,Roi , L.D.,Wolfe , R.A., 1984.A ridge logistic estimator,Communications in Statistics - Theory and Methods 13 99 -113
Schaefer , R.L., 1986.Alternative estimators in logistic regression when the data are collinear,Journal of Statistical Computation and Simulation 25 75 -91
Shahmandi , M,Farmanesh , F.,Gharahbeigi , M.,Shahmandi , L., 2013.Data analyzing by attention to weighted multicollinearity in logistic regression applicable in industrial data,British Journal of Applied Science and Technology 3 748 -763
Segerstedt , B.,Nyquist , H., 1992.On the conditioning problem in generalized linear models,Journal of Applied Statistics 19 513 -526
Syaiba , B.A.,Habshah , M., 2010.Robust logistic diagnostic for the identification of high leverage points in logistic regression model,Journal of Applied Sciences 10 3042 -3050
Vago , E.,Kemeny , S., 2006.Logistic ridge regression for clinical data analysis (a case study),Applied Ecology and Environmental Research 4 171 -179
Victoria-Feser , M-P., 2002.Robust inference with binary data,Psychometrika 67 21 -32
Weissfeld , L.A.,Sereika , S.M., 1991.A multicollinearity diagnostic for generalized linear model,Communications in Statistics - Theory and Methods 20 1183 -1198
0

Citations

0

Downloads

64

Views