Pakistan Science Abstracts
Article details & metrics
No Detail Found!!
Weighted High Leverage Collinear Robust Ridge Estimator in Logistic Regression Model.
Author(s):
1. Syaiba Balqish Ariffin: Faculty of Science, Universiti Putra Malaysia, Serdang Selangor, Malaysia
2. Habshah Midi: Faculty of Science, Universiti Putra Malaysia, Serdang Selangor, Malaysia;Institute of Mathematical Research, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
Abstract:
The combination of high leverage points and multicollinearity problem occurs frequently in logistic regression model. Methods that successfully address these problems separately are not effective for the combined problems. A robust logistic ridge regression (RLR) which incorporates the weighted Bianco and Yohai (WBY) robust estimator with fully iterated logistic ridge regression (LR) is proposed to rectify the combined problems of high leverage points and multicollinearity in a data. A numerical example and simulation study are presented to compare the performance of the RLR with the ML, the WBY, and the LR estimators. Results of the study indicate that the RLR outperforms the established estimators for the combined problems.
Page(s): 55-75
DOI: DOI not available
Published: Journal: Pakistan Journal of Statistics, Volume: 34, Issue: 1, Year: 2018
Keywords:
Keywords are not available for this article.
References:
[1] Al-Aabdi , F.A.A.,Al-Shaibani , R.M.A., 2014.Robust estimators of logistic regression with problems multicollinearity or outliers values,Journal of Kufa for Mathematics and Computer 2 64 -71
[2] Askin , R.G.,Montgomery , D.C., 1980.Augmented robust estimators,Technometrics 22 333 -341
[3] Bagheri , A.,Midi , H., 2015.Diagnostic plot for the identification of high leverage collinearity-influential observations,SORT-Statistics and Operations Research Transactions 39 51 -70
[4] Bagheri , A.,Midi , H.,Imon , A.H.M.R., 2010.The effect of collinearityinfluential observations on collinear data set: A monte carlo simulation study,Journal of Applied Sciences 10 2086 -2093
[5] Bagheri , A.,Midi , H.,ArticleID, 2012.On the performance of the measure for diagnosing multiple high leverage collinearity-reducing observations,doi: 10 -
[6] Barker , L.,Brown , C., 2001.Logistic regression when binary variables are highly correlated, 20 1431 -1442
[7] Carroll , R.J.,Pederson , S., 1993.On robustness in the logistic regression model,Journal of Royal Statistics Society B 55 693 -706
[8] Christmann , A.,Rousseeuw , P.J., 2001.Measuring overlap in binary regression,Computational Statistics and Data Analysis 37 65 -75
[9] Collet , D.,Jemain , A.A., 1985.Residuals outliers and influential observations in regression analysis,Sains Malaysiana 14 493 -511
[10] Croux , C.,Haesbroeck , G., 2003.Implementing the Bianco and Yohai estimator for logistic regression,Computational Statistics and Data Analysis 44 273 -295
[11] Cule,De Iorio , M., 2012.A semi-automatic method to guide the choice of ridge parameter in ridge regression,The Annals of Applied Statistics 1 302 -332
[12] Duzan , H.,Shariff , N.S.B.M., 2015.Ridge regression for solving the multicollinearity problem: Review of methods and models,Journal of Applied Sciences 15 392 -
[13] Frisch , R., 1934.Statistical confluence analysis by means of complete regression systems, 8 -
[14] Godínez-Jaimes , F.,Ramírez-Valverde , G.,Reyes-Carreto , R.,Ariza-Hernandez , F.J.,Barrera-Rodriguez , E., 2012.Collinearity and separated data in the Logistic regression model,Journal Agrociencia 46 411 -425
[15] Gunst , R.F., 1983.Regression analysis with multicollinear predictor variables: Definition, detection and effects, 12 2217 -2260
[16] Habshah , M.,Syaiba , B.A., 2012.The performance of classical and robust logistic estimators in the presence of outliers,Pertanika Journal of Science and Technology 20 313 -325
[17] Hoerl , A.E,R.W., 1970.Ridge Regression: Applications to nonorthogonal problems, 12 69 -82
[18] P.W., 1973.Weighted ridge regression: Combining ridge and robust regression methods,NBER Working paper series 11 1 -19
[19] Kibria , B.M.G.,Månsson , K.,Shukur , G., 2012.Performance of some logistic ridge regression estimators,Computational Economics 40 401 -414
[20] Kibria , B.M.G.,Salleh , A.K.E., 2012.Improved the estimators of the parameters of a probit regression model: A ridge regression approach,Journal of Statistical Planning and Inference 142 1421 -1435
[21] Lawrence,Arthur , J.L, 1990.Robust regression: analysis and applications, -
[22] Lesaffre , E.,Marx , B.D., 1993.Collinearity in generalized linear regression,Communications in Statistics - Theory and Methods 22 1933 -1952
[23] Locking , H.,Månsson , K.,Shukur , G., 2013.Performance of some ridge parameters for probit regression: with application on Swedish job search data,Communications in Statistics Simulation and Computation 42 698 -710
[24] Månsson , K.,Shukur , G., 2011.On ridge parameters in logistic regression,Communications in Statistics - Theory and Methods 40 3366 -3381
[25] Marx , B.D.,Smith , E.P., 1990.Weighted multicollinearity in logistic regression: diagnostics and biased estimation techniques with an example from lake acidification,Canadian Journal of Fisheries and Aquatic Sciences 47 1128 -1135
[26] Park,Hastie , T., 2008.Penalized logistic regression for detecting gene interactions,Biostatistics 9 30 -50
[27] Park , H.,Konishi , S., 2016.Robust logistic regression modelling via the elastic net-type regularization and tuning parameter selection,Journal of Statistical Computation and Simulation 86 1450 -1461
[28] Peduzzi , P.,Concato , J.,Kemper , E.,Holford , T.R.,Feinstein , A.R., 1996.A simulation study of the number of events per variable in logistic regression analysis,Journal of Clinical Epidemiology 49 1373 -1379
[29] Piegorsch , W.W., 1992.Complementary log regression for generalized linear models,The American Statistician 46 94 -99
[30] Rousseeuw,Van Driessen , K., 1999.A fast algorithm for the minimum covariance determinant estimator,Technometrics 41 212 -223
[31] Rousseeuw , P.J.,Christmann , A., 2003.Robustness against separation and outliers in logistic regression,Computational Statistics and Data Analysis 43 315 -332
[32] Schaefer , R.L.,Roi , L.D.,Wolfe , R.A., 1984.A ridge logistic estimator,Communications in Statistics - Theory and Methods 13 99 -113
[33] Schaefer , R.L., 1986.Alternative estimators in logistic regression when the data are collinear,Journal of Statistical Computation and Simulation 25 75 -91
[34] Shahmandi , M,Farmanesh , F.,Gharahbeigi , M.,Shahmandi , L., 2013.Data analyzing by attention to weighted multicollinearity in logistic regression applicable in industrial data,British Journal of Applied Science and Technology 3 748 -763
[35] Segerstedt , B.,Nyquist , H., 1992.On the conditioning problem in generalized linear models,Journal of Applied Statistics 19 513 -526
[36] Syaiba , B.A.,Habshah , M., 2010.Robust logistic diagnostic for the identification of high leverage points in logistic regression model,Journal of Applied Sciences 10 3042 -3050
[37] Vago , E.,Kemeny , S., 2006.Logistic ridge regression for clinical data analysis (a case study),Applied Ecology and Environmental Research 4 171 -179
[38] Victoria-Feser , M-P., 2002.Robust inference with binary data,Psychometrika 67 21 -32
[39] Weissfeld , L.A.,Sereika , S.M., 1991.A multicollinearity diagnostic for generalized linear model,Communications in Statistics - Theory and Methods 20 1183 -1198
Citations
Citations are not available for this document.
0

Citations

0

Downloads

1

Views