No Detail Found!

Improved Resampling Technique for the Choice of Stopping Criterion and Model Selection in Stepwise Logistic Regression.

Author(s)
Zafar Mahmoood The University of Agriculture, Peshawar, Khyber Pakhtunkhwa, Pakistan
Peter Salzman Department of Biostatistics and Computational Biology, The University of Rochester, USA
Salahuddin Department of Biostatistics and Computational Biology, The University of Rochester, USA
Abstract
In recent years, logistic regression models are widely used in many research fields for establishing relation between a discrete outcome variable and predictor variable(s). Various automated selection procedures are used for the selection of predictor variables that might influence the outcome variable. The significance level (c2(a) ) is the standard stopping criterion in these automated model selection methods in logistic regression. The problem with these automated model selection methods is the choice of appropriate stopping criterion for entry and removal of predictor variables. Most of the statistical packages typically used the default significance value (a = 0.05) for an entry that may be unreasonable and sometimes even dangerous because it results either too many variables in the model for a reliable interpretation or too few variables for best prediction. Besides different recommendations concerning the entry and removal criteria, there is still a problem for the true best choice of these values in automated selection methods in logistic regression models. We propose to resolve this problem by using cross-validation resampling technique that will optimize the stopping criterion each time for different data sets and different number of significant predictor variables. We further proposed the bootstrap resampling screening test for validating the final parsimonious logistic regression model. Moreover, for moderate correlated predictor variables, our strategy had shown better results as compared to other model selection methods.
Publication Details
Page(s) 21-36
DOI DOI not available
Published Journal: Pakistan Journal of Statistics, Volume: 32, Issue: 1, Year: 2016

Request the full text from PASTIC

References
Azen , R.,Budescu , D.V.,Reiser , B.,,2001,Criticality of Predictors in Multiple Regression,British J. Math. Stat. Psy.,54,201-225
Bendel , R.B.,Afifi , A.A.,,1977,Comparison of Stopping Rule in Forward Stepwise Regression,J. Amer. Statist,72,46-53
Chatterjee , S.,Hadi , A.S.,,2006,Regression Analysis by Example (4th Edition),,,-
Draper , N.R.,Smith , H.,,1998,Applied Regression Analysis (2nd Edition),,,-
Dixon , W.J.,Brown,Engelman , L.,Hill , M.A.,Jennrich , R.I.,,1988,,BMDP Statistical Software Manual,1,-
EfronB.,,1979,Bootstrap Methods: Another look at the Jackknife,Annal. Stat., 9,,1-26
Flack , V.F.,Chang , P.C.,,1987,Frequency of Selecting Noise Variables in Subset Regression Analysis: A Simulation Study,The American Statistician,41,84-86
Glantz , S.A.,Sliker , B.K.,,2000,Primer of Applied Regression and Analysis of Variance. McGraw-Hill.,,,-
Hosmer , D.,Lemeshow , S.,Wiley-IntersciencePublication,,2000,Applied Logistic Regression, (2nd Edition),,,-
Hoerl , F.E.,Schuenemeyer , J.H.,Hoerl , A.E.,,1986,A Simulation of Biased Estimation and Subset Regression Techniques,,28,369-380
Hampel , F.,Armitage , P.,Colton , T.,,1998,Edition),In Encyclopedia of Biostatistics,3,2488-2489
Kennedy , W.J.,Bancroft , T.A.,,1971,Model-building for Prediction in Regression Based on Repeated Significance Tests,,42,1273-1284
Kutner , M.H.,Nachtsheim , C.J.,Neter , J.,Models (4th Edition) McGraw-Hell,,2004,,,,-
Lee , K.,Koval , J.J.,Statist,,1997,Determination of the Best Significance Level in Forward Stepwise Logistic Regression Based on Repeated Significance Test: Commun,,26,559-575
Menard , S.W.,,2002,Applied Logistic Regression Analysis (2nd Edition),,106,-
Norusis , M.J.,McGraw-Hill,,1985,,,,-
R-Development Core Team,,2004,R: A Language and Environment for Statistical Computing,org.,,-
,1999,SAS User's Guide: Statistics,Cary NC.,,-
Sauerbrei , W.,Schuhmacher , M.,,1992,A Bootstrap Resampling Procedure for Model Building: Application to Cox Regression Model,Stat. Med,11,907-916
0

Citations

0

Downloads

72

Views