Abstract
Automated Valuation Models (AVMs) are regularly used in mass appraisal techniques. Thanks to developments in artificial intelligence, machine learning algorithms are increasingly being used alongside traditional econometric models.
The final phase in the definition of the models consists in the verification phase of the results elaborated by Avm. The predictive effectiveness tests evaluate the models trained on part of the dataset (the training set) and then measure their ability to predict the remaining values of the dataset (testing set).
This verification methodology provides as final output the accuracy parameter, i.e. the difference between predicted prices and actual prices. According to many authors this parameter, if considered alone, is insufficient.
The research consists in an accuracy test of 5 Avm in the ability to predict the values of 1038 properties in the city of Padua. To the accuracy results of the test are added the results of cross-validation and the use of different statistical indicators for the measurement of predictive effectiveness.
The results provide useful information that broadens the framework of model knowledge. They can be used in the analysis and description of automated evaluation models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
IAAO: Standard on Mass Appraisal of Real Property. International Association of Assessing Officers (2013)
McCluskey, W.J., McCord, M., Davis, P.T., Haran, M., McIlhatton, D.: Prediction accuracy in mass appraisal: a comparison of modern approaches. J. Prop. Res. 30(4), 239–265 (2013)
Kontrimas, V., Verikas, A.: The mass appraisal of the real estate by computational intelligence. Appl. Soft Comput. 11(1), 443–448 (2011)
Kok, N., Martínez-Barbosa, C.A., Koponen, E.L.: Big data in real estate? From manual appraisal to automated valuation. J. Portf. Manag. 43(6), 202–211 (2017)
Mangialardo, A., Micelli, E.: Rethinking the construction industry under the circular economy: principles and case studies. In: Green Energy and Technology, pp. 333–344. Springer (2018)
Mangialardo, A., Micelli, E., Saccani, F.: Does sustainability affect real estate market values? Empirical evidence from the office buildings market in Milan (Italy). Sustainability (Switzerland) 11(1), 12 (2018)
Tajani, F., Morano, P., Locurcio, M., D’Addabbo, N.: Property valuations in times of crisis. Artificial Neural Networks and evolutionary algorithms in comparison. In: Computational Science and Its Applications - ICCSA 2015, pp. 194–209 (2015)
Mooya, M.M.: Market value without a market: perspectives from transaction cost theory. Urban Stud. 46(3), 687–701 (2009)
Mullainathan, S., Spiess, J.: Machine learning: an applied econometric approach. J. Econ. Perspect. 31(2), 87–106 (2017)
Pérez-Rave, J.I., Correa-Morales, J.C., González-Echavarrìa, F.: A machine learning approach to big data regression analysis of real estate prices for inferential and predictive purposes of real estate prices for inferential and predictive purposes. J. Prop. Res. 36(1), 59–96 (2019)
Athey, S.: The impact of machine learning on economics. In: Agrawal, A., Gans, J., Goldfarb, A. (eds.) The Economics of Artificial Intelligence: An Agenda, pp. 507–522. University Chicago Press, Chicago (2019)
Do, A.Q., Grudnitski, G.: A neural network approach to residential property appraisal. Real Estate Apprais. 58, 38–45 (1992)
Núñez Tabales, J.M., Caridad y Ocerin, J.M., Rey Carmona, F.J.: Artificial neural networks for predicting real estate prices. Revista de Metodos Cuantitativos para la Economia y la Empresa 15(1), 29–44 (2013)
Isakson, H.R.: Valuation analysis of commercial real estate using the nearest neighbors appraisal technique. Growth Change 19(2), 11–24 (1988)
Antipov, E., Pokryshevskaya, E.: Mass appraisal of residential apartments: an application of random forest for valuation and a CART-based approach for model diagnostics. Expert Syst. Appl. 39(2), 1772–1778 (2012)
Ceh, M., Kilibarda, M., Lisec, A., Bajat, B.: Estimating the performance of random forest versus multiple regression for predicting prices of the apartments. Int. J. Geo-Inf. 7(5), 168 (2018)
Huang, Y.: Predicting home value in California, United States via machine learning modeling. Stat. Optim. Inf. Comput. 7(1), 66–74 (2019)
Abidoye, R.B., Chan, A.P.C., Abidoye, F.A.: Predicting property price index using artificial intelligence techniques. Int. J. Hous. Mark. Anal. 12(6), 1072–1092 (2019)
Manganelli, B., De Mare, G., Nesticò, A.: Using genetic algorithms in the housing market analysis. In: Computational Science and Its Applications – ICCSA 2015, pp. 36–45 (2015)
D’Amato, M., Kauko, T.: Advances in Automated Valuation Modeling. Springer, Heidelberg (2017)
Baldominos, A., Blanco, I., Moreno, A., Iturrarte, R., Bernardez, O., Afonso, C.: Identifying real estate opportunities using machine learning. Appl. Sci. 8(11), 2321 (2018)
Graczyk, M., Lasota, T., Trawiński, B.: Comparative analysis of premises valuation models using KEEL, RapidMiner, and WEKA. In: Computational Collective Intelligence. Semantic Web, Social Networks and Multiagent Systems – ICCCI 2009, pp. 800–812 (2009)
Bonifaci, P., Copiello, S.: Real estate market and building energy performance: data for a mass appraisal approach. Data Brief 5, 1060–1065 (2015)
Borde, S., Rane, A., Shende, G., Shetty, G.: Real estate investment advising using machine learning. Int. Res. J. Eng. Technol. 4(3), 1821–1825 (2017)
Rosen, S.: Hedonic prices and implicit markets: product differentiation in pure competition. J. Political Econ. 82(1), 34–55 (1974)
Yacim, J.A., Boshoff, D.G.B.: Impact of Artificial Neural Networks training algorithms on accurate prediction of property values. J. Real Estate Res. 40(3), 375–418 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Valier, A. (2021). Evaluating AVMs Performance. Beyond the Accuracy. In: Bevilacqua, C., Calabrò, F., Della Spina, L. (eds) New Metropolitan Perspectives. NMP 2020. Smart Innovation, Systems and Technologies, vol 178. Springer, Cham. https://doi.org/10.1007/978-3-030-48279-4_107
Download citation
DOI: https://doi.org/10.1007/978-3-030-48279-4_107
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-48278-7
Online ISBN: 978-3-030-48279-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)