Abstract
Recent technical advances and the rise of digital platforms enhanced consumers’ abilities to take and share images and led to a tremendous increase in the importance of visual communication. The abundance of visual data, together with the development of image processing tools and advanced modeling techniques, provides unique opportunities for marketing researchers, in both academia and practice, to study the relationship between consumers and firms in depth and to generate insights which can be generalized across a variety of people and contexts.
However, with the opportunity come challenges. Specifically, researchers interested in using image analytics for marketing are faced with a triple challenge: (1) To which type of research questions can image analytics add insights that cannot be obtained otherwise? (2) Which visual data should be used to answer the research questions, and (3) which method is the right one?
In this chapter, the authors provide a guidance on how to formulate a worthy research question, select the appropriate data source, and apply the right method of analysis. They first identify five relevant areas in marketing that would benefit greatly from image analytics. They then discuss different types of visual data and explain their merits and drawbacks. Finally, they describe methodological approaches to analyzing visual data and discuss issues such as feature extraction, model training, evaluation, and validation as well as application to a marketing problem.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Amit, E., Algom, D., & Trope, Y. (2009). Distance-dependent processing of pictures and words. Journal of Experimental Psychology: General, 138(3), 400.
Ang, S. H., Lee, Y. H., & Leong, S. M. (2007). The ad creativity cube: Conceptualization and initial validation. Journal of the Academy of Marketing Science, 35(2), 220–232.
Bengio, Y. (2012). Deep learning of representations for unsupervised and transfer learning. In I. Guyon, G. Dror, V. Lemaire, G. Taylor, & D. Silver (Eds.), Proceedings o the ICML workshop unsupervised transfer learn (pp. 17–36). Bellevue.
Bengio, Y., Bergeron, A., Boulanger-Lewandowski, N., Breuel, T., Chherawala, Y., Cisse, M., & Erhan, D. (2011). Deep learners benefit more from out-of-distribution examples. In G. Gordon, D. Dunson, & D. Miroslav (Eds.), Proceedings of the 14th international conference artificial intelligence statist (pp. 164–172). Fort Lauderdale, FL.
Bloch, P. H. (1995). Seeking the ideal form: Product design and consumer response. Journal of Marketing, 59(3), 16–29.
Burnap, A., & Hauser, J. (2018). Predicting “design gaps” in the market: Deep consumer choice models under probabilistic design constraints. arXiv preprint arXiv, 1812.11067.
Burnap A., Hauser, J., & Timoshenko A. (2019). Design and evaluation of product aesthetics: A human-machine hybrid approach. Available at SSRN 3421771.
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020). NuScenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 11621–11631).
Chan, T. H., Mihm, J., & Sosa, M. E. (2018). On styles in product design: An analysis of US design patents. Management Science, 64(3), 1230–1249.
Cho, H., Schwarz, N., & Song, H. (2008). Images and preferences: A feelings-as-information analysis. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 259–276). New York: Lawrence Erlbaum Associates.
Crilly, N., Moultrie, J., & Clarkson, P. J. (2004). Seeing things: Consumer response to the visual domain in product design. Design Studies, 25(6), 547–577.
Dew, R., Ansari, A., & Toubia, O. (2019). Letting logos speak: Leveraging multiview representation learning for data-driven logo design. Available at SSRN 3406857.
Dhar, S., Ordonez, V., & Berg, T. L. (2011, June). High level describable attributes for predicting aesthetics and interestingness. In CVPR 2011 (pp. 1657–1664). IEEE.
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2014, January). Decaf: A deep convolutional activation feature for generic visual recognition. In International conference on machine learning (pp. 647–655).
Dzyabura, D., & Peres, R. (2021). Visual elicitation of brand perception. Journal of Marketing, forthcoming.
Dzyabura, D., El Kihal, S., Ibragimov, M., & Hauser J. (2020). Leveraging the power of images in managing product return rates. Available at SSRN 3209307.
Eisenman, M., Frenkel, M., & Wasserman, V. (2016). Toward a theory of effective aesthetic communication. In Academy of management proceedings (Vol. 2016, p. 12822). Briarcliff Manor: Academy of Management.
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580–587).
Goodfellow, I., Bengio, Y., Courville, A., & Bengio, Y. (2016). Deep learning (Vol. 1, No. 2). Cambridge: MIT Press.
Gorn, G. J., Chattopadhyay, A., Yi, T., & Dahl, D. W. (1997). Effects of color as an executional cue in advertising: They’re in the shade. Management Science, 43(10), 1387–1400.
Greenleaf, E., & Raghubir, P. (2008). Geometry in the marketplace. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 113–143). New York: Lawrence Erlbaum Associates.
Han, Y. J., Nunes, J. C., & Drèze, X. (2010). Signaling status with luxury goods: The role of brand prominence. Journal of Marketing, 74(4), 15–30.
Hartmann, J., Heitmann, M., Schamp, C., & Netzer, O. (2021) The Power of brand selfies. Journal of Marketing Research, 58(6), 1159–1177. https://doi.org/10.1177/00222437211037258
Hauser, J. R., Urban, G. L., Liberali, G., & Braun, M. (2009). Website morphing. Marketing Science, 28(2), 202–223.
Hauser, J. R., Liberali, G., & Urban, G. L. (2014). Website morphing 2.0: Switching costs, partial exposure, random exit, and when to morph. Management Science, 60(6), 1594–1616.
Heinonen, R., Luoto, R., Lindfors, P., & Nygård, C. H. (2012). Usability and feasibility of mobile phone diaries in an experimental physical exercise study. Telemedicine and e-Health, 18(2), 115–119.
Hektner, J. M., Schmidt, J. A., & Csikszentmihalyi, M. (2007). Experience sampling method: Measuring the quality of everyday life. Thousand Oaks: Sage Publications, Inc.
Hensel, D. J., Fortenberry, J. D., Harezlak, J., & Craig, D. (2012). The feasibility of cell phone based electronic diaries for STI/HIV research. BMC Medical Research Methodology, 12(75), 1–12.
Hofmann, W., & Patel, P. V. (2015). Survey signal a convenient solution for experience sampling research using participants’ own smartphones. Social Science Computer Review, 33(2), 235–253.
Jalali, N. Y., & Papatla, P. (2016). The palette that stands out: Color compositions of online curated visual UGC that attracts higher consumer interaction. Quantitative Marketing and Economics, 14(4), 353–384.
Janiszewski, C. (1998). The influence of display characteristics on visual exploratory search behavior. Journal of Consumer Research, 25(3), 290–301.
John, D. R., Loken, B., Kim, K., & Monga, A. B. (2006). Brand concept maps: A methodology for identifying brand association networks. Journal of Marketing Research, 43(4), 549–563.
Keller, K. L. (2003). Brand synthesis: The multidimensionality of brand knowledge. Journal of Consumer Research, 29(4), 595–600.
Kireyev, P., Timoshenko, A., & Yang, C. L. (2020). Scaling human effort in idea screening and content evaluation. INSEAD Working Paper No. 2020/42/MKT, HEC Paris Research Paper No. MKG-2020-1384, Available at SSRN: https://ssrn.com/abstract=3685882 or https://doi.org/10.2139/ssrn.3685882
Klostermann, J., Plumeyer, A., Böger, D., & Decker, R. (2018). Extracting brand information from social networks: Integrating image, text, and social tagging data. International Journal of Research in Marketing, 35(4), 538–556.
Koll, O., Von Wallpach, S., & Kreuzer, M. (2010). Multi-method research on consumer–brand associations: Comparing free associations, storytelling, and collages. Psychology & Marketing, 27(6), 584–602.
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84–90.
Labrecque, L. I. (2014). Fostering consumer–brand relationships in social media environments: The role of Parasocial interaction. Journal of Interactive Marketing, 28(2), 134–148.
Lehnert, K., Till, B. D., & Ospina, J. M. (2014). Advertising creativity: The role of divergence versus meaningfulness. Journal of Advertising, 43(3), 274–285.
Li, Y., & Xie, Y. (2020). Is a picture worth a thousand words? An empirical study of image content and social media engagement. Journal of Marketing Research, 57(1), 1–19.
Li, H., Simchi-Levi, D., Wu, M. X., & Zhu, W. (2019a). Estimating and exploiting the impact of photo layout in sharing economy. Available at SSRN.
Li, X., Shi, M., & Wang, X. S. (2019b). Video mining: Measuring visual information using automatic methods. International Journal of Research in Marketing, 36(2), 216–231.
Liu, X., Burns, A. C., & Hou, Y. (2017). An investigation of brand-related user-generated content on Twitter. Journal of Advertising, 46(2), 236–247.
Liu, L., Dzyabura, D., & Mizik, N. (2020). Visual listening in: Extracting brand image portrayed on social media. Marketing Science, 39(4), 669–686.
Lovett, M. J., & Peres, R. (2018). Mobile diaries – Benchmark against metered measurements: An empirical investigation. International Journal of Research in Marketing, 35(2), 224–241.
Lovett, M. J., Peres, R., & Shachar, R. (2013). On brands and word of mouth. Journal of Marketing Research, 50(4), 427–444.
MacInnis, D. J., & Price, L. L. (1987). The role of imagery in information processing: Review and extensions. Journal of Consumer Research, 13(4), 473–491.
McAuley, J., & Leskovec, J. (2012, October). Image labeling on a network: Using social-network metadata for image classification. In European conference on computer vision (pp. 828–841). Berlin/Heidelberg: Springer.
McQuarrie, E. F. (2008). Differentiating the pictorial element in advertising – A rhetorical perspective. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 91–112). New York: Psychology Press.
Meyers-Levy, J., & Zhu, R. (2008). Perhaps the store made you purchase it: Toward an understanding of structural aspects of indoor shopping environment. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 193–224). New York: Psychology Press.
Nanne, A. J., Antheunis, M. L., van der Lee, C. G., Postma, E. O., Wubben, S., & van Noort, G. (2020). The use of computer vision to analyze brand-related user generated image content. Journal of Interactive Marketing, 50, 156–167.
Orsborn, S., Cagan, J., & Boatwright, P. (2009). Quantifying aesthetic form preference in a utility function. Journal of Mechanical Design, 131(6), 061001.
Pavlov, E., & Mizik, N. (2019). Increasing consumer engagement with firm-generated social media content: The role of images and words. Working Paper, University of Washington.
Peng, L., Cui, G., Chung, Y., & Zheng, W. (2020). The faces of success: Beauty and ugliness premiums in e-commerce platforms. Journal of Marketing, 84(4), 67–85.
Peracchio, L. A., & Meyers-Levy, J. (1994). How ambiguous cropped objects in ad photos can affect product evaluations. Journal of Consumer Research, 21(1), 190–204.
Peracchio, L. A., & Meyers-Levy, J. (2005). Using stylistic properties of ad pictures to communicate with consumers. Journal of Consumer Research, 32(1), 29–40.
Pieters, R., & Wedel, M. (2004). Attention capture and transfer in advertising: Brand, pictorial, and text-size effects. Journal of Marketing, 68(2), 36–50.
Pieters, R., Wedel, M., & Zhang, J. (2007). Optimal feature advertising design under competitive clutter. Management Science, 53(11), 1815–1828.
Radach, R., Lemmer, S., Vorstius, C., Heller, D., & Radach, K. (2003). Eye movements in the processing of print advertisements. In R. Radach & H. Deubel (Eds.), The mind’s eye (pp. 609–632). Amsterdam: Elsevier Science Publishers.
Raghubir, P., & Greenleaf, E. A. (2006). Ratios in proportion: What should the shape of the package be? Journal of Marketing, 70(2), 95–107.
Reavey, P. (Ed.). (2012). Visual methods in psychology: Using and interpreting images in qualitative research. Routledge. London.
Rietveld, R., van Dolen, W., Mazloom, M., & Worring, M. (2020). What you feel, is what you like influence of message appeals on customer engagement on Instagram. Journal of Interactive Marketing, 49, 20–53.
Rosbergen, E., Pieters, R., & Wedel, M. (1997). Visual attention to advertising: A segment-level analysis. Journal of Consumer Research, 24(3), 305–314.
Rubera, G. (2015). Design innovativeness and product sales’ evolution. Marketing Science, 34(1), 98–115.
Sheinin, D. A., Varki, S., & Ashley, C. (2011). The differential effect of ad novelty and message usefulness on brand judgments. Journal of Advertising, 40(3), 5–18.
Simonyan, K., & Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition. In Proceedings of International Conference on Learning Representations (ICLR). Available at https://arxiv.org/abs/1409.1556
Smith, R. E., MacKenzie, S. B., Yang, X., Buchholz, L. M., & Darley, W. K. (2007). Modeling the determinants and effects of creativity in advertising. Marketing Science, 26(6), 819–833.
Stadlen, A. (2015). Find every photo with Flickr’s new unified search experience. Available at https://blog.flickr.net/en/2015/05/07/flickr-unified-search/
Toubia, O., & Netzer, O. (2017). Idea generation, creativity, and prototypicality. Marketing Science, 36(1), 1–20.
Van House, N., Davis, M., Ames, M., Finn, M., & Viswanathan, V. (2005). The uses of personal networked digital imaging: An empirical study of cameraphone photos and sharing. In CHI’05 extended abstracts on human factors in computing systems (pp. 1853–1856). ACM.
Venngage. (2020). 14 Visual content marketing statistics to know for 2020. Available at https://venngage.com/blog/visual-content-marketing-statistics/
Vilnai-Yavetz, I., & Tifferet, S. (2015). A picture is worth a thousand words: Segmenting consumers by Facebook profile images. Journal of Interactive Marketing, 32, 53–69.
Wedel, M., & Pieters, R. (2000). Eye fixations on advertisements and memory for brands: A model and findings. Marketing Science, 19(4), 297–312.
Wedel, M., & Pieters, R. (2008). A review of eye-tracking research in marketing. Review of Marketing Research, 4(2008), 123–147.
Wedel, M., & Pieters, R. (2014). Looking at vision (p. 2014). Abingdon: Routledge.
Xiao, H., Rasul, K., & Vollgraf, R. (2017). Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv, 3.
Yang, X., & Smith, R. E. (2009). Beyond attention effects: Modeling the persuasive and emotional effects of advertising creativity. Marketing Science, 28(5), 935–949.
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014). How transferable are features in deep neural networks? In Advances in neural information processing systems (pp. 3320–3328). Available at https://arxiv.org/abs/1411.1792
Zaltman, G., & Coulter, R. H. (1995). Seeing the voice of the customer: Metaphor-based advertising research. Journal of Advertising Research, 35(4), 35–51.
Zaltman, G., & Zaltman, L. H. (2008). Marketing metaphoria: What deep metaphors reveal about the minds of consumers. Boston: Harvard Business Press.
Zhang, M., & Luo, L. (2019). Can User-posted photos serve as a leading indicator of restaurant survival? Evidence from Yelp. Available at SSRN 3108288.
Zhang, H., Korayem, M., You, E., & Crandall, D. J. (2012). Beyond co-occurrence: Discovering and visualizing tag relationships from geo-spatial and temporal similarities. In Proceedings of the fifth ACM international conference on web search and data mining (pp. 33–42). Available at https://doi.org/10.1145/2124295.2124302
Zhang, S., Mehta, N., Singh, P. V., & Srinivasan, K. (2019). Can lower-quality images lead to greater demand on AirBnB? Technical report, working paper, Carnegie Mellon University.
Zhang, S., Lee, D., Singh, P. V., & Srinivasan, K. (2021) “What makes a good image? Airbnb demand analytics leveraging interpretable image features”. Management Science. Forthcomming.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this entry
Cite this entry
Dzyabura, D., El Kihal, S., Peres, R. (2022). Image Analytics in Marketing. In: Homburg, C., Klarmann, M., Vomberg, A. (eds) Handbook of Market Research. Springer, Cham. https://doi.org/10.1007/978-3-319-57413-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-57413-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-57411-0
Online ISBN: 978-3-319-57413-4
eBook Packages: Business and ManagementReference Module Humanities and Social SciencesReference Module Business, Economics and Social Sciences