Utility of CK Metrics in Predicting Size of Board-based Software Games. | [Mehran University Research Journal of Engineering and Technology • 2017]

Author(s):

1. NOSHEEN SABAHAT: Department of Computer Engineering, National University of Sciences & Technology, Islamabad, Pakistan

2. Ali Afzal Malik: Department of Computer Science, National University of Computer & Emerging Sciences, Lahore, Pakistan

3. Farooque Azam: Department of Computer Engineering, National University of Sciences & Technology, Islamabad, Pakistan

Abstract:

Software size is one of the most important inputs of many software cost and effort estimation models. Early estimation of software plays an important role at the time of project inception. An accurate estimate of software size is, therefore, crucial for planning, managing, and controlling software development projects dealing with the development of software games. However, software size is unavailable during early phase of software development. This research determines the utility of CK (Chidamber and Kemerer) metrics, a well-known suite of object-oriented metrics, in estimating the size of software applications using the information from its UML (Unified Modeling Language) class diagram. This work focuses on a small subset dealing with board-based software games. Almost sixty games written using an object-oriented programming language are downloaded from open source repositories, analyzed and used to calibrate a regression-based size estimation model. Forward stepwise MLR (Multiple Linear Regression) is used for model fitting. The model thus obtained is assessed using a variety of accuracy measures such as MMRE (Mean Magnitude of Relative Error), Prediction of x(PRED(x)), MdMRE (Median of Relative Error) and validated using K-fold cross validation. The accuracy of this model is also compared with an existing model tailored for size estimation of board games. Based on a small subset of desktop games developed in various object-oriented languages, we obtained a model using CK metrics and forward stepwise multiple linear regression with reasonable estimation accuracy as indicated by the value of the coefficient of determination (R2 = 0.756).Comparison results indicate that the existing size estimation model outperforms the model derived using CK metrics in terms of accuracy of prediction.

Page(s): 975-986

DOI: DOI not available

Published: Journal: Mehran University Research Journal of Engineering and Technology, Volume: 36, Issue: 4, Year: 2017

Keywords:

multiple linear regression , Open Source , Project Management , Chidamber and Kemerer Metrics , Game Sizing , Software Size Estimation , Kfold Cross Validation , Simple LinearRegression , Project Planning

References:

[1] Fenton , N.E.,Pfleeger , S.L.,BostonUSA, 1998.“Software Metrics: A Rigorous and Practical Approach”, 2nd Edition, 435 -445

[2] QSM Code Counters, 2016.,[Last Accessed: 30th December -

[3] Pfleeger , S.L.,Wu , F.,Lewis , R.,CaliforniaUSA, 2005.Software Cost Estimation and Sizing Methods: Issues and Guidelines”,RAND Corporation 1 -7

[4] Boehm , B.W.,Abts , C.,Brown , A.W.,Chulani , S.,Clark , B.K.,Horowitz , E.,Madachy , R.,Reifer , D.J.,Steece , B., 2000.Software Cost Estimation with COCOMO-II”, -

[5] Laird , L.M.,Brennan , M.C., 2006.Software Measurement and Estimation: A Practical Approach”, -

[6] Albrecht , A.J., 1979.,Proceedings of the IBM Applications Development Joint SHARE/ GUIDE Symposium 83 -92

[7] Meyer , B.,PrenticeHall, 1988.Object-Oriented Software Construction”, 2 331 -410

[8] Booch , G., 1980.”Object-Oriented Analysis and Design”, -

[9] Blaha , M.,Rumbaugh, 2005.Object-Oriented Modeling and Design with UML”, Pearson Education, Upper Saddle River, -

[10] October,Zhou , Y.,Yang , Y.,Xu , B.,Leung , H.,Zhou , X., 2014.Source Code Size Estimation Approaches for ObjectOriented Systems from UML Class Diagrams: A Comparative Study”,Information and Software Technology 56 220 -237

[11] Chikofsky , E.J.,Cross , J.H., 1990.“Reverse Engineering and Design Recovery: A Taxonomy”,IEEE Software 7 13 -17

[12] Chidamber , S.R.,Kemerer , C.F., 1994.“A Metrics Suite for Object-Oriented Design”,IEEE Transactions on Software Engineering 20 476 -493

[13] Chidamber , S.R.,Darcy , D.P.,Kemerer , C.F., 1998.Managerial Use of Metrics for Object-Oriented Software: An Exploratory Analysis”,IEEE Transactions on Software Engineering 24 629 -639

[14] Picard , R.R.,Cook, 1984.Cross-Validation of Regression Models”,Journal of the American Statistical Association 387 575 -83

[15] Mišic , V.B.,Tešic , D.N., 1998.Estimation of Effort and Complexity: An Object-Oriented Case Study”,Journal of Systems and Software 41 133 -143

[16] Harizi , M., 2012.The Role of Class Diagram in Estimating Software Size”,International Journal of Computer Applications 44 31 -33

[17] Costagliola , G.,Ferrucci , F.,Tortora , G.,Vitiello , G., 2005.“Class point: An Approach for the Size Estimation of ObjectOriented Systems”,IEEE Transactions on Software Engineering 31 52 -74

[18] Tan , H.B.K.,Zhao , Y.,Zhang, 2009.Conceptual Data Model-based Software Size Estimation for Information Systems”,ACM Transactions on Software Engineering and Methodology 19 1 -37

[19] Antoniol , G.,Lokan , C.,Fiutem , R., 2003.Object-Oriented Function Points: An Empirical Validation”,Empirical Software Engineering 8 225 -254

[20] Antoniol , G.,Lokan , C.,Caldiera , G.,Fiutem, 1999.A Function Point-like Measure for Object-Oriented Software”,Empirical Software Engineering 4 263 -287

[21] Carbone , M.,Santucci , G.,Serious: A UML Based, 2002.Metric for Effort Estimation”,Proceedings of the 6th International ECOOP Workshop on Quantitative Approaches in Object-Oriented Software Engineering 35 -44

[22] Chidamber , S.R.,Kemerer , C.F., 1991.Towards a Metrics Suite for Object-Oriented Design”,Proceedings of 6th OOPSLA Conference 197 -211

[23] Bakar , N.S., 2016.The Analysis of Object-Oriented Metrics in C++ Programs”,Lecture Notes on Software Engineering 4 48 -

[24] 2016.,[Last Accessed: 25thDecember -

[25] N. , Malik,A.A. , Azam,F., 2017.“A Size Estimation Model for Desktop Games”, -

[26] Sabahat , N.,Malik , A.A.,Azam , F., 2015.Size Estimation of Open Source Board-based Software Games”,Presented at the 9th IEEE International Conference on Open Source Systems and Technologies -

[27] UCC, 2016., -

[28] QSM Gearing Factors , “ A Flexible,SizingApproach, 2016.G e a r i n g % 2 0 F a c t o r s,[Last Accessed: 30thDecember -

[29] QSM,QuantitativeSoftware, 2016.,[Last Accessed: 30th December -

[30] Weisberg , S., 1980., -

[31] Fritz , M.,Berger, 2015.Improving the User Experience Through Practical Data Analytics”, 239 -269

[32] IBMCorp,IBMCorp, 2013.Released 2013,IBM SPSS Statistics for Windows, Version 22 -

[33] Cook, 1977.Detection of Influential Observations in Linear Regression”,Technometrics 19 15 -18

[34] O'brien, 2007.“A Caution Regarding Rules of Thumb for Variance Inflation Factors”,Quality and Quantity 41 673 -690

[35] Foss , T.,Stensrud , E.,Kitchenham , and B.,Myrtveit , I., 2003.“A Simulation Study of the Model Evaluation Criterion MMRE”,IEEE Transactions on Software Engineering 11 985 -95

[36] Port , D.,Korte , M., 2008.Comparative Studies of the Model Evaluation Criterions MMRE and PRED in Software Cost Estimation Research”,Proceedings of the Second ACMIEEE International Symposium on Empirical Software Engineering and Measurement -

[37] Conte , S.D.,Dunsmore , H.E.,Shen,Redwood, 1986., -

[38] Myrtveit , I.,Stensrud , E.,Shepperd , M., 2005.Reliability and Validity in Comparative Studies of Software Prediction Models”,IEEE Transactions on Software Engineering 31 380 -391

Citations

Downloads

Views