A comparative Study of Three Improved Robust Regression Procedures. | [Pakistan Journal of Statistics • 2016]

Author(s):

1. Dost Muhammad Khan: Department of Statistics, Abdul Wali Khan University, Mardan, Pakistan

2. Sajjad Ahmad Khan: Department of Statistics, Abdul Wali Khan University, Mardan, Pakistan

3. Umair Khalil: Department of Statistics, Abdul Wali Khan University, Mardan, Pakistan

4. Amjad Ali: Department of Statistics, Islamia College Peshawar, Peshawar, Pakistan

Abstract:

In this study we evaluated three robust regression techniques namely least trimmed square (LTS), least absolute deviation (LTA) and a redescending M-estimator in terms of efficiency and robustness in simple and multiple linear regressions using extensive simulations. The impacts of outlier concentration, geometry and outlying distance in both leverage and residual have been assessed. The simulation scenarios focus on outlier configurations likely to be encountered in practice. The results for each scenario provide insight and restrictions to performance to each procedure. From the simulation results we found that the underlying estimators are robust whenever an acceptable percentage of outliers is present in the data and when it crosses that limit, the robust estimators? breakdown occurs. It is also worth-revealing that no single uniform robust method under study may completely be satisfying all the concerns for regression analysis in the presence of outliers. That is one method may be best for one contamination scenario but might not be good for other. For example, for the full coverage h = n (sample size), LTS perform better than LTA for normal errors and LTA perform better than LTS for Laplace errors. Lastly, we summarize each procedure?s performance and make recommendations.

Page(s): 425-441

DOI: DOI not available

Published: Journal: Pakistan Journal of Statistics, Volume: 32, Issue: 6, Year: 2016

Keywords:

Keywords are not available for this article.

References:

[1] Andersen , R.,,2008,Modern Methods for Robust Regression, Sara Miller McCune, SAGE publications,The United States of America.,,-

[2] Andrews , D.F.,Bickel , P.J.,Hampel , F.R.,Huber , P.J.,Rogers , W.H.,Tukey , J.W.,,1972,,Robust Estimates of Location: Survey and Advances,,-

[3] Ali , A.,Qadir , M.F.,,2005,A Modified M-estimator for the detection of outliers,Pakistan Journal of Statistics and Operations Research,1,49-64

[4] Ali , A.,Qadir , M.F.,Salahuddin , A.Q.,Outliers: New M-ClassΨ,,2005,Functions based on Winsor‟s Principle with Improved Asymptotic Efficiency,In Proceedings of the 8th Islamic Countries Conference on Statistical Sciences, Lahore,13,313-319

[5] Barnett , V.,Lewis , T.,,1994,Outliers in Statistical Data,,,-

[6] Beaton , A.E.,Tukey , J.W.,,1974,The fitting of power series, meaning polynomials, illustrated on hand-spectroscopic data,Technometrics,16,147-192

[7] Carroll , R.J.,Ruppert , D.,,1985,Transformations in regression: a robust analysis,Technometrics,27,1-12

[8] Cook , R.D.,,1979,Influential Observations in Linear Regression,Journal of American Statistical Association,74,169-174

[9] Draper , N.R,Smith , H.,,1998,,Applied Regression Analysis, 3rd Edition,,-

[10] Fox , J.,,2002,Robust Regression, Appendix to An R and S-PLUS Companion to Applied Regression,,,-

[11] Hawkins , D.M.,,1980,Identification of Outliers, Chapman,,,-

[12] Hawkins , D.M.,Bradu , D.,Kass , G.V.,,1984,Location of several outliers in multiple regression data using elemental sets,Technometrics,26,197-208

[13] Hawkins , D.M.,Olive , D.,,1999a,Applications and Algorithms for Least Trimmed Sum of Absolute Deviations Regression,Computational Statistics and Data Analysis,32,119-134

[14] Hawkins , D.M.,Olive , D.J.,,1999b,Improved Feasible Solution Algorithms for High Breakdown Estimation,Computational Statistics and Data Analysis,30,1-11

[15] Hogg , R.V.,,1979,Statistical Robustness: One View of its use in Application Today,,33,108-115

[16] P. and Welsch,R.,,1977,Robust Regression Using Interactively Reweighted Least-Squares,,6,813-827

[17] Huber , P.J.,,1964,Robust Estimation of a Location Parameter,Annals of Mathematical Statistics,35,73-101

[18] Huber , P.J.,,2004,,,,-

[19] Jajo , N.K.,,2005,A Review of Robust Regression and Diagnostic Procedures in Linear Regression,Acta Mathematicae Applicatae Sinica, English Series,21,209-224

[20] Ortiz,SarabiaL.A.,Herrero , A.,,2006,Robust regression techniques: A useful alternative for the detection of outlier data in chemical analysis,Talanta,70,499-512

[21] Qadir , M.F.,,1996,Robust Method for Detection of Single and Multiple Outliers,Scientific Khyber,9,135-144

[22] Rousseeuw , P.J.,Leroy , A.M.,,1987,,Robust Regression and Outlier Detection,,-

[23] Street , J.O.,Carroll , R.J.,Rupert , D.,,1988,,A Note on Computing Robust Regression Estimates Via Iteratively Reweighted Least Squares. The American Statistician,42,152-154

[24] Ullah , I.,Qadir , M.F.,Ali , A.,,2006,Insha‟s redecending M-estimator for robust regression: A comparative study,II(2),,135-144

[25] Wilcox , R.R.,,2005,Introduction to Robust Estimation and Hypothesis Testing, 2nd Edition,,,-

[26] Wu , L.L.,,1985,Robust M-estimation of Location and Regression,Sociological Methodology,15,316-388

Citations

Downloads

Views