Open Access   Article

A Systematic Review of Realistic Methods and Approaches for Evaluation of Website

S. Kaur1 , S.K. Gupta2

1 Department of Computer science and Engineering, Guru Nanak Dev University RC, Sathiala, India.
2 Department of Computer science and Engineering, Beant College of Engineering and Technology, Gurdaspur, India.

Correspondence should be addressed to:

Section:Research Paper, Product Type: Journal Paper
Volume-6 , Issue-2 , Page no. 39-52, Feb-2018


Online published on Feb 28, 2018

Copyright © S. Kaur, S.K. Gupta . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library


IEEE Style Citation: S. Kaur, S.K. Gupta, “A Systematic Review of Realistic Methods and Approaches for Evaluation of Website”, International Journal of Computer Sciences and Engineering, Vol.6, Issue.2, pp.39-52, 2018.

MLA Style Citation: S. Kaur, S.K. Gupta "A Systematic Review of Realistic Methods and Approaches for Evaluation of Website." International Journal of Computer Sciences and Engineering 6.2 (2018): 39-52.

APA Style Citation: S. Kaur, S.K. Gupta, (2018). A Systematic Review of Realistic Methods and Approaches for Evaluation of Website. International Journal of Computer Sciences and Engineering, 6(2), 39-52.

309 253 downloads 101 downloads


Internet facility along with a web browser has become indispensable needs to do any government as well as non-government task. To devise and evaluate an unbeaten website, web engineers have to consider the two factors, first is the role of website for achieving company or organizational objectives, afterwards, various types of users with their needs. But both of these factors cannot be fully elicited and defined, as the opinions as well as the ambitions of organizers, website users plus IT professionals are entirely different. In order to find the methods along with approaches used for website evaluation, this paper takes a systematic review of the most popular models which are in sphere of website evaluation in distinct domains of websites. Two types of models are studied, one which can be applied to every domain, whereas other which are oriented towards the specific domain with specific mission. It also analyses the practical methods and approaches to find their percentage usage in previous studies of website evaluation. It also investigates the types of assessors involved in these studies. Finally, it winds up with proposed perspectives what a future evaluation study should be endowed with. It is deduced that recent studies have adopted a user judgement method along with certain automation or numerical computation technique. The findings provided by review can benefit the industry readership as well as academicians to evaluate the website for relevance to their own settings in various situations.

Key-Words / Index Term

Web engineering, Web assessment, Web domains, Website evaluation, Design quality


[1] H. Achour, N. Bensedrine, “An evaluation of internet banking and online brokerage in Tunisia”, In Proceedings of the 1st International Conference on E-Business and E-learning (EBEL), Amman, Jordan, pp. 147-158, 2005.
[2] A. P. Afonso, J. R. Lima, M. P. Cota, “A heuristic evaluation of usability of Web interfaces”, In Information Systems and Technologies (CISTI), 2012 7th Iberian Conference on, pp. 1-6, IEEE, June 2006.
[3] J. Alhelalat, E. M. Ineson, T. Jung, K. Evans, “The Evaluation of Hotel Websites’ Quality, Usability and Benefits: Developing a Testing Model”, In Proceedings of Euro-CHRIE Conference, 2008.
[4] M. Alomari, P. Woods, K. Sandhu, “Predictors for e-government adoption in Jordan: Deployment of an empirical evaluation based on a citizen-centric approach”, Information Technology and People, Vol.25, Issue.2, pp.207-234, 2012.
[5] I. Alsmadi, A.T. Al-Taani, N.A. Zaid, “Web structural metrics evaluation”, In Developments in E-systems Engineering (DESE), pp.225-230, IEEE, September 2010.
[6] M. Asmaran, “Quantitative and Qualitative Evaluation of Three Search Engines (Google, Yahoo, and Bing)”, American Scientific Research Journal for Engineering, Technology, and Sciences (ASRJETS), Vol.26, Issue.2, pp.97-106, 2012.
[7] S. Baloglu, Y.A. Pekcan, “The website design and Internet site marketing practices of upscale and luxury hotels in Turkey”, Tourism management, Vol.27, Issue.1, pp.171-176, 2006.
[8] S.J. Barnes, R.T. Vidgen, “An integrative approach to the assessment of e-commerce quality”, J. Electron. Commerce Res., Vol.3, Issue.3, pp.114-127, 2002.
[9] S.J. Barnes, R. Vidgen, “Interactive e-government: evaluating the web site of the UK Inland Revenue”, Journal of Electronic Commerce in Organizations (JECO), Vol.2, Issue.1, pp.42-63, 2004.
[10] S.J. Barnes, R. T. Vidgen, “Data triangulation and web quality metrics: A case study in e-government”, Information and Management, Vol.43, Issue.6, pp.767-777, 2006.
[11] U. Bastida, T.C. Huan, “Performance evaluation of tourism websites` information quality of four global destination brands: Beijing, Hong Kong, Shanghai, and Taipei”, Journal of Business Research, Vol.67, Issue.2, pp.167-170, 2014.
[12] U. Bauernfeind, N. Mitsche, “The application of the data envelopment analysis for tourism website evaluation”, Information Technology and Tourism, Vol.10, Issue.3, pp.245-257, 2008.
[13] P. Becker, P. Lew, L. Olsina, “Specifying process views for a measurement, evaluation, and improvement strategy”, Advances in Software Engineering, pp. 28, 2012,
[14] T. Berners-Lee, “Web Index”, 2014,, Accessed 11 July 2017
[15] E. Bertino, E. Ferrari, A. Perego, “A general framework for web content filtering”, World Wide Web, Vol.13, Issue.3, pp.215-249, 2010.
[16] G. Büyüközkan, D. Ruan, O. Feyzioğlu, “Evaluating e‐learning web site quality in a fuzzy environment”, International Journal of Intelligent Systems, Vol.22, Issue.5, pp.567-586, 2007.
[17] S. Cebi, “Determining importance degrees of website design parameters based on interactions and types of websites”, Decision Support Systems, Vol.54, Issue.2, pp.1030-1043, 2013a.
[18] S. Cebi, “A quality evaluation model for the design quality of online shopping websites”, Electronic Commerce Research and Applications, Vol.12, Issue.2, pp.124-135, 2013b.
[19] S.C. Chiemeke, A.E. Evwiekpaefe, F.O. Chete, “The adoption of Internet banking in Nigeria: An empirical investigation”, Journal of Internet Banking and Commerce, Vol.11,Issue.3, pp.1-10, 2006.
[20] K.C. Chinthakayala, C. Zhao, J. Kong, “A comparative study of three social networking websites’, World Wide Web, Vol.17, Issue.6, pp.1233-1259, 2014.
[21] W.C. Chiou, C.C. Lin, C. Perng, “A strategic framework for website evaluation based on a review of the literature from 1995–2006”, Information and management, Vol.47, Issue.5, pp.282-290, 2010.
[22] W.C. Chiou, C.C. Lin, C. Perng, “A strategic website evaluation of online travel agencies”, Tourism Management, Vol.32, Issue.6, pp.1463-1473, 2011.
[23] W. Chmielarz, M. Zborowski, “Comparative Analysis of Electronic Banking Websites in Poland in 2014 and 2015”, In Information Technology for Management, pp.147-161, 2016, Springer International Publishing.
[24] S.C. Chu, Y. Kim, “Determinants of consumer engagement in electronic word-of-mouth (eWOM) in social networking sites”, International journal of Advertising, Vol.30, Issue.1, pp.47-75, 2011.
[25] M.A. Corigliano, R. Baggio, “On the significance of tourism website evaluations”, Information and Communication Technologies in Tourism 2006, pp.320-331, 2006.
[26] J. Delfos, T. Tan, B. Veenendaal, “Design of a web-based lbs framework addressing usability, cost, and implementation constraints”, World Wide Web, Vol. 13, Issue.4, pp.391-418, 2010.
[27] P.J. Denning, D.E. Comer, D. Gries, “Computing as a discipline”, Computer, Vol.22, Issue.2, pp.63-70, 1989.
[28] Y. Deshpande, S. Hansen, “Web engineering: creating a discipline among disciplines”, IEEE MultiMedia, Vol.8, Issue.2, pp.82-87, 2001.
[29] Y. Deshpande, S. Murugesan, A. Ginige, “Web engineering”, Journal of Web Engineering, Vol.1, Issue.1, pp.3–17, 2002.
[30] F.S. Effendi, I. Alfina, “Quality evaluation of airline`s e-commerce website, a case study of AirAsia and Lion Air websites”, In Advanced Computer Science and Information Systems (ICACSIS), International Conference on 2014, pp.125-128, IEEE, Oct 18, 2014,
[31] N. Elkhani, S. Soltani, A. Bakri, “An Effective Model for Evaluating Website Quality Considering Customer Satisfaction and Loyalty: Evidence of Airline Websites”, IJCSI International Journal of Computer Science Issues, Vol.10, Issue.2, pp.109-117, 2013.
[32] A. Ellahi, R.H. Bokhari, “Key quality factors affecting users` perception of social networking websites”, Journal of Retailing and Consumer Services, Vol.20, Issue.1, pp.120-129, 2013.
[33] I.J. Gabriel, “Usability metrics for measuring usability of business-to-consumer (b2c) e-commerce sites”, In Proceedings of the 6th Annual ISOnEworld Conference, Las Vegas, NV, pp.74.1-74.19, April 11-13, 2007.
[34] A. Garcia, C. Maciel, F. Pinto, “A quality inspection method to evaluate e-government sites”, Electronic government, pp.198-209, 2005.
[35] J.A. Greene, N.K. Choudhry, E. Kilabuk, W.H. Shrank, “Online social networking by patients with diabetes: a qualitative evaluation of communication with Facebook”, Journal of general internal medicine, Vol.26, Issue.3, pp 287-292, 2011.
[36] M. Grimsley, A. Meehan, “e-Government information systems: Evaluation-led design for public value and client trust”, European Journal of Information Systems, Vol.16, Issue.2, pp.134-148, 2007.
[37] S. Gullikson, R. Blades, M. Bragdon, “The impact of information architecture on academic web site usability”, The Electronic Library, Vol.17, Issue.5, pp.293-304, 1999.
[38] A. Henriksson, Y. Yi, B. Frost, M. Middleton, “Evaluation instrument for e-government websites”, Electronic Government, Vol.4, Issue.2, pp.204-226, 2007.
[39] A. Howitt, S. Clement, S. de Lusignan, “An evaluation of general practice websites in the UK”, Family Practice, Vol.19, Issue 5, pp.547-556, 2002.
[40] C.L. Hsu, K.C. Chang, M.C. Chen, “The impact of website quality on customer satisfaction and purchase intention: perceived playfulness and perceived flow as mediators”, Information Systems and e-Business Management, Vol.10, Issue.4, pp.549-570, 2012.
[41] G.J. Huang, T.C. Huang, J.C. Tseng, “A group-decision approach for evaluating educational web sites”, Computers and Education, Vol.42, Issue.1, pp.65-86, 2004.
[42] C. Ip, R. Law, H.A. Lee, “A review of website evaluation studies in the tourism and hospitality fields from 1996 to 2009”, International Journal of Tourism Research, Vol.13, Issue.3, pp.234-265, 2011.
[43] B. Bakariya, G.S. Thakur, "Effectuation of Web Log Preprocessing and Page Access Frequency using Web Usage Mining", International Journal of Computer Sciences and Engineering, Vol.1, Issue.1, pp.1-5, 2013.
[44] R. Shrivastva, S. Mewad, P. Sharma, “An Approach to Give First Rank for Website and Webpage Through SEO”, International Journal of Computer Sciences and Engineering, Vol. 2, Issue.4, pp.13-17, 2014.
[45] L. Kumar, N. Kumar, “SEO technique for a website and its effectiveness in context of Google search engine”, International Journal of Computer Sciences and Engineering, Vol. 2, Issue.6, pp.113-118, 2014.
[46] B.J. Jansen, A. Spink, “How are we searching the World Wide Web? A comparison of nine search engine transaction logs”, Information processing and management, Vol.42, Issue.1, pp.248-263, 2006.
[47] H. Jati, D.D. Dominic, “Quality evaluation of e-government website using web diagnostic tools: Asian case”, In Information Management and Engineering, 2009. ICIME`09. International Conference on, pp.85-89, IEEE, April 2009.
[48] S. Joo, S. Lin, K. Lu, “A usability evaluation model for academic library websites: efficiency, effectiveness and learnability”, Journal of Library and Information studies, Vol.9, Issue.2, pp.11-26, 2011.
[49] A. Kaur, D. Dani, “The Web Navigability Structure of E-Banking in India”, International Journal of Information Technology and Computer Science (IJITCS), Vol.5, Issue.4, pp.29-37, 2013.
[50] A. Keenan, A. Shiri, “Sociability and social interaction on social networking websites”, Library Review, Vol.58, Issue.6, pp.438-450, 2009.
[51] T. Kincl, P. Štrach, “Measuring website quality: asymmetric effect of user satisfaction”, Behaviour and Information Technology, Vol.31, Issue.7, pp.647-657, 2012.
[52] B. Kitchenham, O.P. Brereton, D. Budgen, “Systematic literature reviews in software engineering–a systematic literature review”, Information and software technology, Vol.51, Issue.1, pp.7-15, 2009.
[53] H. Korda, Z. Itani, “Harnessing social media for health promotion and behavior change”, Health promotion practice, Vol.14, Issue.1, pp.15-23, 2013.
[54] R. Law, S. Qi, D. Buhalis, “Progress in tourism management: A review of website evaluation in tourism research”, Tourism management, Vol.31, Issue.3, pp.297-313, 2010.
[55] S. Lee, R.J. Koubek, “The effects of usability and web design attributes on user preference for e-commerce web sites”, Computers in Industry, Vol.61, Issue.4, pp.329-341, 2010.
[56] K.Y. Lin, H.P. Lu, “Why people use social networking sites: An empirical study integrating network externalities and motivation theory”, Computers in human behavior, Vol.27, Issue.3, pp.1152-1161, 2011.
[57] P. Lorca, J. de Andrés, A.B. Martínez, “Does Web accessibility differ among banks?”, World Wide Web, Vol.19, Issue.3, pp.351, 2016.
[58] J. Lu, Z. Lu, “Development, distribution and evaluation of online tourism services in China”, Electronic Commerce Research, Vol.4, Issue.3, pp.221-239, 2004.
[59] Y. Lu, Z. Deng, B. Wang, “Analysis and evaluation of tourism e-commerce websites in China”, International Journal of Services, Economics and Management, Vol.1, Issue.1, pp.6-23, 2007.
[60] R. Malhotra, A. Sharma, “A neuro-fuzzy classifier for website quality prediction”, In Advances in Computing, Communications and Informatics (ICACCI), 2013 International Conference on, pp.1274-1279, IEEE, August 2013.
[61] E.N. Martins, L.S. Morse, “Evaluation of internet websites about retinopathy of prematurity patient education”, British journal of ophthalmology, Vol.89, Issue.5, pp.565-568, 2005.
[62] M. Matera, M.F. Costabile, F., Garzotto, P. Paolini, “SUE inspection: an effective method for systematic usability evaluation of hypermedia”, IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, Vol.32, Issue.1, pp.93-103, 2002.
[63] S. Mavromoustakos, A.S. Andreou, “WAQE: a web application quality evaluation model”, International Journal of web engineering and technology, Vol.3, Issue.1, pp.96-120, 2006.
[64] N.M. Medina, J. Burella, G. Rossi, J. Grigera, E.R. Luna, “An incremental approach for building accessible and usable web applications”, In International Conference on Web Information Systems Engineering, pp.564-577, Springer, Berlin, Heidelberg, December 2010.
[65] L. Mich, “Evaluating website quality by addressing quality gaps: a modular process”, In Software Science, Technology and Engineering (SWSTE), 2014 IEEE International Conference on, pp.42-49, IEEE, June 2014.
[66] L. Mich, M. Franch, G. Cilione, “The 2QCV3Q Quality Model for the Analysiy of Web site Requirements”, J. Web Eng., Vol.2, Issue.1-2, pp.115-127, 2003.
[67] L. Mich, M. Franch, L. Gaio, “Evaluating and designing web site quality”, IEEE MultiMedia, Vol.10, Issue.1, pp.34-43, 2003.
[68] L. Mich, M. Franch, “Un approccio multi-step per la valutazione dell’usabilità del sito web di una destinazione turistica”, Atti di: SIMKTG Il marketing dei talenti: Marketing e Tecnologia, pp.24-25, 2007.
[69] J.M. Moreno, J.M., Del Castillo, C. Porcel, E. Herrera-Viedma, “A quality evaluation methodology for health-related websites based on a 2-tuple fuzzy linguistic approach”, Soft Computing, Vol.14, Issue.8, pp.887-897, 2010.
[70] A.M. Morrison, J.S. Taylor, A. Douglas, “Website evaluation in tourism and hospitality: the art is not yet stated”, Journal of Travel and Tourism Marketing, Vol.17, Issue.2-3, pp.233-251, 2005.
[71] B.L. Neiger, R. Thackeray, S.A. Van Wagenen, C.L. Hanson, J.H. West, M.D. Barnes, M.C. Fagen, “Use of social media in health promotion: purposes, key performance indicators, and evaluation metrics”, Health promotion practice, Vol.13, Issue.2, pp.159-164, 2012.
[72] L. Olsina, G. Rossi, “A quantitative method for quality evaluation of web sites and applications”, IEEE multimedia, Vol.9, Issue.4, pp.20-29, 2002.
[73] L. Olsina, G. Covella, G., Rossi, “Web quality”, Web Engineering, pp.109-142, 2006.
[74] T. Orehovački, A. Granić, D. Kermek, “Evaluating the perceived and estimated quality in use of Web 2.0 applications”, Journal of Systems and Software, Vol.86, Issue.12, pp.3039-3059, 2013.
[75] X. Papadomichelaki, G. Mentzas, “A multiple-item scale for assessing e-government service quality”, In International Conference on Electronic Government, pp.163-175, Springer, Berlin, Heidelberg, August 2009.
[76] A. Parasuraman, V.A. Zeithaml, A. Malhotra, “ES-QUAL: A multiple-item scale for assessing electronic service quality”, Journal of service research, Vol.7, Issue.3, pp.213-233, 2005.
[77] A. Perallos, “Metodología Ágil y Adaptable al Contexto para la Evaluación Integral y Sistemática de la Calidad de Sitios web (Agile and context-adaptable methodology for the integral and systematic evaluation of websites’ quality)”, Ph.D. Diss,.Universidad de Deusto. Facultad de Ingeniería-ESIDE, 2006 (2006) Accessed 15 June 2017
[78] F.R. Pérez-López, “An evaluation of the contents and quality of menopause information on the World Wide Web”, Maturitas, Vol.49, Issue.4, pp.276-282, 2004.
[79] V. Petricek, T. Escher, I.J. Cox, H. Margetts, “The web structure of e-government-developing a methodology for quantitative evaluation”, In Proceedings of the 15th international conference on World Wide Web, pp.669-678, ACM, May 2006.
[80] H. Petrie, O. Kheir, “The relationship between accessibility and usability of websites”, In Proceedings of the SIGCHI conference on Human factors in computing systems, pp.397-406, ACM, April 2007.
[81] L. Pranić, D. Garbin Praničević, J. Arnerić, “Hotel website performance: evidence from a transition country”, Tourism and hospitality management, Vol.20, Issue.1, pp.45-60, 2014.
[82] A. Rocha, “Framework for a global quality evaluation of a website”, Online Information Review, Vol.36, Issue.3, pp.374-382, 2012.
[83] A.M. Santos, “Theoretical-Methodological proposal to evaluate the quality of educational websites to support education”, In Proceedings of the 3rd International Conference on Technological Ecosystems for Enhancing Multiculturality, pp.397-401. ACM, October 2015.
[84] K. Schäfer, T.F. Kummer, “Determining the performance of website-based relationship marketing”, Expert Systems with Applications, Vol.40, Issue.18, pp.7571-7578, 2013.
[85] C. Shchiglik, S.J. Barnes, “Evaluating website quality in the airline industry”, Journal of Computer Information Systems, Vol.44, Issue.3, pp.17-25, 2014.
[86] K. Silius, M. Kailanto, A.M. Tervakari, “Evaluating the quality of social media in an educational context”, In Global Engineering Education Conference (EDUCON) 2011 IEEE, pp.505-510, IEEE, April 2011.
[87] A. Sivaji, A. Abdullah, A.G. Downe, “Usability testing methodology: Effectiveness of heuristic evaluation in E-government website development”, In Modelling Symposium (AMS), 2011 Fifth Asia, pp.68-72, IEEE, May 2011.
[88] S. Srivastava, S. Chawla, “Multifaceted classification of websites for goal oriented requirement engineering”, In International Conference on Contemporary Computing, pp.479-485, Springer, Berlin, Heidelberg, August 2010.
[89] A. Stefani, M. Xenos, “E-commerce system quality assessment using a model based on ISO 9126 and Belief Networks”, Software Quality Journal, Vol.16, Issue.1, pp.107-129, 2008.
[90] C.C. Sun, G.T. Lin, “Using fuzzy TOPSIS method for evaluating the competitive advantages of shopping websites”, Expert Systems with Applications, Vol.36, Issue.9, pp.11764-11771, 2009.
[91] D.D.J. Suwawi, E. Darwiyanto, M. Rochmani, “Evaluation of academic website using ISO/IEC 9126”, In Information and Communication Technology (ICoICT), 2015 3rd International Conference on, pp.222-227, IEEE, May 2015.
[92] M. Tate, J. Evermann, B. Hope, S. Barnes, “Perceived service quality in a university web portal: revising the e-qual instrument”, In System Sciences, 2007. HICSS 2007. 40th Annual Hawaii International Conference on, pp.147b-156b, IEEE, January 2007.
[93] M.C.S. Torrente, A.B.M. Prieto, D.A. GutiéRrez, M.E.A. De Sagastegui, “Sirius: A heuristic-based framework for measuring web usability adapted to the type of website”, Journal of Systems and Software, Vol.86, Issue.3, pp.649-663, 2013.
[94] L. Triacca, D. Bolchini, L. Botturi, A. Inversini, “Mile: Systematic usability evaluation for e-Learning web applications”, In Proceedings of EDMEDIA 2004, Lugano, Switzerland, Vol.1, pp 4398-4405, 2004.
[95] L. Vaughan, “New measurements for search engine evaluation proposed and tested”, Information Processing and Management, Vol.40,Issue.4, pp.677-691, 2004.
[96] P. Verdegem, G. Verleye, “User-centered E-Government in practice:: A comprehensive model for measuring user satisfaction”, Government information quarterly, Vol.26, Issue.3, pp 487-497, 2009.
[97] T. Watanabe, “Experimental evaluation of usability and accessibility of heading elements”, Disability and Rehabilitation: Assistive Technology, Vol.4,Issue.4, pp.236-247, 2009.
[98] D. Wenham, P. Zaphiris, “User interface evaluation methods for internet banking web sites: a review, evaluation and case study”, Human-computer interaction, theory and practice, pp.721-725, 2003.
[99] B. Yen, P.J.H. Hu, M. Wang, “Toward an analytical approach for effective Web site design: A framework for modeling, evaluation and enhancement”, Electronic Commerce Research and Applications, Vol.6, Issue.2, pp.159-170, 2007.
[100] B. Yoo, N. Donthu, “Developing a scale to measure the perceived quality of an Internet shopping site (SITEQUAL)”, Quarterly journal of electronic commerce, Vol.2, Issue.1, pp.31-45, 2001.
[101] C. Zafiropoulos, V. Vrana, “A framework for the evaluation of hotel websites: The case of Greece”, Information Technology and Tourism, Vol.8, Issue.3-1, pp.239-254, 2006.
[102] B. Zhao, Y. Cheng, “Research on B2C e-commerce website service quality evaluation based on analytic hierarchy process”, In Information Science and Technology (ICIST), 4th IEEE International Conference on 2014, pp.364-367, IEEE, Apr 26 2014.
[103] B. Zhao, Y. Zhu, “Formalizing and validating the web quality model for web source quality evaluation”, Expert Systems with Applications, Vol.41, Issue.7, pp.3306-3312, 2014.
[104] Y. Zhu, “Integrating external data from web sources into a data warehouse for OLAP and decision making”, Shaker Verlag, 2004.
[105] M. Zviran, C. Glezer, I. Avni, “User satisfaction from commercial web sites: The effect of design and use”, Information and management, Vol.43, Issue.2, pp.157-178, 2006.