Abstract
Quality is an essential characteristic for web success. Several authors have described different methodologies, guidelines, techniques and tools in order to assure the quality of web sites. Recently, a wide ranging set of metrics has been proposed for quantifying web quality attributes. However, there is little consensus among them. These metrics are sometimes not well defined, nor empirically or theoretically validated. Moreover, these metrics focus on different aspects of web sites or different quality characteristics, confusing, rather than helping, the practitioners interested in using them. With the aim of making their use easier, we have developed the WQM model (Web Quality Model), which distinguishes three dimensions related to web features, lifecycle processes and quality characteristics. In this paper we classify the most relevant web metrics using this framework. As a result of this classification we obtain that most of the metrics are classified into the “usability / exploitation / presentation” cell. Another conclusion obtained from our study is that, in general, metrics are automated but not validated formally nor empirically which is not a good way of doing things.
Chapter PDF
Similar content being viewed by others
Keywords
- Quality Characteristic
- Life Cycle Process
- Lifecycle Process
- IEEE Multimedia
- Estimate Software Development Effort
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Abrahão, S., Condori-Fernandez, N., Olsina, L., Pastor, O.: Defining and Validating Metrics for Navigational Models. In: Ninth International Software Metrics Symposium (METRICS 2003), pp. 200–210. IEEE, Los Alamitos (2003a)
Abrahão, S., Pastor, O.: Calidad de Sistemas Web. In: Calidad en el Desarrollo y mantenimiento del software (2003b), Madrid, Ed. Ra-Ma (spanish)
Alves de Silva, E.A., Ponti de Mattos Fortes, R.: Web Quality Metrics: An Analysis Using Machine Learning Systems. In: International Conference on Information Systems, Analysis and Sintesis. World Multiconference on Systemics, Cybernetics and Informatics. Information Systems Technology. SCI 2001/ ISAS 2001, vol. XI (2001)
Avison, D.E., Fitzgerald, G.: Where Now for Development Methodologies? Communications of the ACM 46(1), 79–82 (2003)
Bajaj, A., Krishnan, R.: CMU-WEB: A Conceptual Model for Designing Usable Web Applications. J. Database Manag. 10(4), 33–43 (1999)
Baresi, L., Morasca, S., Paolini, P.: Estimating the Design Effort of Web Applications. In: Proc. 9th International Metrics Symposium (METRICS 2003), pp. 62–72. IEEE, Los Alamitos (2003)
Botafogo, R., Rivlin, E., Shneiderman, B.: Structural analysis of hypertexts: Identifying hierarchies and useful metrics. ACM Trans. Inform. Systems 10(2), 142–180 (1992)
Calero, C., Piattini, M., Genero, M.: Empirical Validation of Referential Integrity Metrics. Information Software and Technology. Special Issue on Controlled Experiments in Software Technology 43(15), 949–957 (2001)
Ciancarini, P., Moretti, R.: Towards a framework for web sites quality evaluation. In: 15th International conference on Software Engineering and knowledge Engineering, San Francisco, California, July 1-3, pp. 721–725 (2003)
Cutter Consortium (2000) Poor Project Management – Problem of E-Projects (October 2000), http://www.cutter.com/press/001019.html
Deshpande, Y., Murugesan, S., Ginige, A., Hansen, S., Schwabe, D., Gaedke, M., White, B.: Web Engineering. Journal of Web Engineering 1(1), 61–73 (2002)
Dhyani, D., NG, W.K., Bhowmick, S.S.: A Survey of Web Metrics. ACM Computing Surveys 34(4), 469–503 (2002)
Donaldson, A.J.M., Cowderoy, A.J.C.: Towards Multimedia Systems Quality. In: ESSI-SCOPE conference, Dublin (1997)
Fink, D.: Web Site Effectiveness: A Measure of Information and Service Quality. In: Information Resource Management Association International Conference, Toronto, Canada, pp. 144–147 (2001)
Fraternali, P.: Tools and Approaches for Developing Data-Intensive Web Applications: A survey. ACM Computing Surveys 31(3), 227–263 (1999)
Gómez, J., Cachero, C., Pastor, O.: Conceptual Modeling of Device-Independent web applications. IEEE Multimedia, 26–39 (April-June 2001)
Herder, E.: Metrics for the Adaptation of Site Structure. In: Proc. of the German Workshop on Adaptivity and User Modeling in Interactive Systems ABIS 2002, Hannover, pp. 22–26 (2002)
Herzinger, M.: Hyperlink Analysis for the web. IEEE Internet Computing (January-February 2001)
ISO/IEC (1995) ISO/IEC 12207. Information Technology. Software Life Cycle Processes
ISO/IEC (2001a) ISO/IEC 9126. Software Product Evaluation-Quality Characteristics and Guidelines for their Use
ISO/IEC (2001b) ISO/IEC 15288. Systems Engineering – System Life Cycle Processes
Ivory, M., Hearst, M.: The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Comput. Surv. 33(4), 470–516 (2001)
Ivory, M.Y., Sinha, R.R., Hearst, M.A.: Empirically Validated Web Page Design Metrics. In: SIGCHI. Conference on Human Factors in Computing Systems, March 2001, pp. 53–60 (2001)
Ivory, M.Y.: An Empirical Foundation for Automated Web Interface Evaluation. PhD Thesis, University of California, Berkeley, Computer Science Division (2001)
Katterattanakul, P., Siau, K.: Information Quality in Internet Commerce Design. In: Information and database quality, pp. 45–56. Kluwer Academic, Dordrecht (2001)
Lafuente, G., González, J., Olsina, L.: Automatizando Métricas Web. In: 4º Encontro para a Qualidade nas Tecnologias de Informação e Comunicações (QUATIC), Lisboa, Portugal, pp.17–24 (2001)
Mendes, E., Counsell, S.: Web Development Effort Estimation using Analogy. In: Proceedings of the 2000 Australian Software Engineering Conference - ASWEC 2000, Australian National University, Canberra, ACT, Australia, April 28-April 30, pp. 203–212. IEEE CS Press, Los Alamitos (2000)
Mendes, E., Mosley, N., Counsell, S.: Web metrics - Metrics for estimating effort to design and author Web applications. IEEE MultiMedia, special issue on Web Engineering, 50–57 (January-March 2001)
Mendes, E., Mosley, N., Counsell, S.: Comparison of Web size measures for predicting Web design and authoring effort. IEE Proceedings - Software 149(3), 86–92 (2002a)
Mendes, E., Watson, I., Trigss, C., Mosley, N., Counsell, S.: A Comparison of Development Effort Estimation Techniques for Web Hypermedia Applications. In: Proceedings IEEE Metrics, Ottawa, Canada, June 2002, pp. 131–140 (2002b)
Mendes, E., Mosley, N., Counsell, S.: Early Web Size Measures and Effort Prediction for Web Costimation. In: Proc. 9th International Metrics Symposium (METRICS 2003), pp. 18–29 (2003)
Mich, L., Franch, M., Gaio, L.: Evaluating and Designing Web Site Quality. IEEE Multimedia, 34–43 (January-March 2003)
Morisio, M., Stamelos, I., Spahos, V., Romano, D.: Measuring Functionality and Productivity in Web-Based Applications: A Case Study. In: Sixth IEEE International Symposium on Software Metrics, November 1999, pp. 111–118 (1999)
Nielsen, J.: Designing web usability. Ed. New Riders (2000)
Niessink, F.: Software Requirements: Functional & Non-functional Software Requirements (2002), http://www.cs.uu.nl/docs/vakken/swa/Slides/SA-2-Requirements.pdf
Offutt (2002). Quality attributes of web software applications. IEEE Software, 25–32 (March-April 2002)
Oinas-Kukkonnen, H., Alatalo, T., Kaasila, J., Kivelä, H., Sivunen, S.: Requirements for web engineering methodologies. In: Rossi, Siau (eds.) Information Modelling in the New Millenium, pp. 360–382. Idea Group Publishing, USA (2001)
Olsina, L.: Quantitative Methodology for Evaluation and Comparison of Web Site Quality, PhD Thesis, Ciencias Exactas School, UNLP, La Plata, Argentina (2000)
Olsina, L., Lafuente, G., Rossi, G.: Specifying Quality Characteristics and Attributes for Websites. In: Web Engineering: Managing Diversity and Complexity of Web Application Development, June 2001, pp. 266–277. Springer, Heidelberg (2001)
Olsina, L., Rossi, G.: Measuring Web Application Quality with WebQEM. IEEE Multimedia, 20–29 (October-December 2002)
Olsina, L., Martín, M., Fons, J., Abrahão, S., Pastor, O.: Towards the Design of a Metrics Cataloging System by Exploiting Conceptual and Semantic Web Approaches. In: Cueva Lovelle, J.M., Rodríguez, B.M.G., Gayo, J.E.L., Ruiz, M.d.P.P., Aguilar, L.J. (eds.) ICWE 2003. LNCS, vol. 2722, pp. 324–333. Springer, Heidelberg (2003)
Palmer, J.: Web Site Usability, Design and Performance Metrics. Information Systems Research, June 13(2), 151–167 (2002)
Ramler, R., Weippl, E., Winterer, M., Shwinger, W., Altmann, J.: A Quality-Driven Approach to Web Testing. In: Iberoamerican Conference on Web Engineering, ICWE 2002, Argentina, September 2002, vol. 1, pp. 81–95 (2002)
Reifer, D.: Web Development: Estimating Quick-to-Market Software. IEEE Software, 57–64 (November-December 2000)
Reifer, D.: Ten Deadly Risks in Internet and Intranet Software Development. IEEE Software, pp. 12–14 (March-April 2002)
Rivlin, E., Botafago, R., Shneiderman, B.: Navigating in hyperspace: Designing a structure-based toolbox. Communications of the ACM 37(2), 87–96 (1994)
Ruhe, M., Jeffery, R., Wieczorek, I.: Using Web Objects for Estimating Software Development Effort for Web Applications. In: Proc. 9th International Metrics Symposium (METRICS 2003), pp. 30–39. IEEE, Los Alamitos (2003)
Ruiz, J., Calero, C., Piattini, M.: A Three Dimensional Web Quality Model. In: Cueva Lovelle, J.M., Rodríguez, B.M.G., Gayo, J.E.L., Ruiz, M.d.P.P., Aguilar, L.J. (eds.) ICWE 2003. LNCS, vol. 2722, pp. 384–385. Springer, Heidelberg (2003)
Schubert, P.: Extended Web Assessment Method (EWAM) – Evaluation of Electronic Commerce Applications from the Customer’s viewpoint. International Journal of Electronic Commerce 7(2), 51–80 (2002-2003), www.e-business.fhbb.ch/eb/publications.nsf/id/118
W3C (1999) WWW Consortium: Web Content Accessibility Guidelines 1.0, W3C Working Draft, http://www.w3.org/TR/WCAG10/
Warren, P., Gaskell, C., Boldyreff, C.: Preparing the Ground for Website Metrics Research. In: Proc. 3rd International Workshop on Web Site Evolution (WSE 2001), IEEE, Los Alamitos (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Calero, C., Ruiz, J., Piattini, M. (2004). A Web Metrics Survey Using WQM. In: Koch, N., Fraternali, P., Wirsing, M. (eds) Web Engineering. ICWE 2004. Lecture Notes in Computer Science, vol 3140. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27834-4_19
Download citation
DOI: https://doi.org/10.1007/978-3-540-27834-4_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22511-9
Online ISBN: 978-3-540-27834-4
eBook Packages: Springer Book Archive