Don’t Need All Eggs in One Basket: Reconstructing Composite Embeddings of Customers from Individual-Domain Embeddings
Article No.: 20, Pages 1 - 30
Abstract
Although building a 360-degree comprehensive view of a customer has been a long-standing goal in marketing, this challenge has not been successfully addressed in many marketing applications because fractured customer data stored across different “silos” are hard to integrate under “one roof” for several reasons. Instead of integrating customer data, in this article we propose to integrate several domain-specific partial customer views into one consolidated or composite customer profile using a Deep Learning-based method that is theoretically grounded in Kolmogorov’s Mapping Neural Network Existence Theorem. Furthermore, our method needs to securely access domain-specific or siloed customer data only once for building the initial customer embeddings. We conduct extensive studies on two industrial applications to demonstrate that our method effectively reconstructs stable composite customer embeddings that constitute strong approximations of the ground-truth composite embeddings obtained from integrating the siloed raw customer data. Moreover, we show that these data-security preserving reconstructed composite embeddings not only perform as well as the original ground-truth embeddings but significantly outperform partial embeddings and state-of-the-art baselines in recommendation and consumer preference prediction tasks.
References
[1]
Martin Abadi, Andy Chu, Ian Goodfellow, H. Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. 2016. Deep learning with differential privacy. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security. 308–318.
[2]
Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering 17, 6 (2005), 734–749.
[3]
Charu C. Aggarwal. 2016. Recommender Systems, Vol. 1. Springer.
[4]
Asim Ansari and Yang Li. 2018. Big data analytics. In Handbook of Marketing Analytics. Edward Elgar Publishing.
[5]
Asim Ansari, Yang Li, and Jonathan Z. Zhang. 2018. Probabilistic topic model for hybrid recommender systems: A stochastic variational Bayesian approach. Marketing Science 37, 6 (2018), 987–1008.
[6]
Asim Ansari, Carl F. Mela, and Scott A. Neslin. 2008. Customer channel migration. Journal of Marketing Research 45, 1 (2008), 60–76.
[7]
Daniel S. Berman, Anna L. Buczak, Jeffrey S. Chavis, and Cherita L. Corbett. 2019. A survey of deep learning methods for cyber security. Information 10, 4 (2019), 122.
[8]
Anjul Bhambhri. 2020. How Marketers Fulfill Customers’ Desire for Real-Time Brand Experiences. https://www.ana.net/magazines/show/id/forward-2020-08-adobe-future-of-customer-experience.
[9]
Vladimir Bobrikov, Elena Nenova, and Dmitry I. Ignatov. 2016. What is a fair value of your recommendation list? In Proceedings of the 3rd Workshop on Experimental Economics and Machine Learning co-located with the 13th International Conference on Concept Lattices and Their Applications (CLA’16). 1–12.
[10]
Francis Buttle. 2008. Customer Relationship Management. Routledge.
[11]
Iván Cantador, Ignacio Fernández-Tobías, Shlomo Berkovsky, and Paolo Cremonesi. 2015. Cross-domain recommender systems. In Recommender Systems Handbook. Springer, 919–959.
[12]
Ishita Chakraborty, Minkyung Kim, and K. Sudhir. 2021. EXPRESS: Attribute sentiment scoring with online text reviews: Accounting for language structure and missing attributes. Journal of Marketing Research (2021), 00222437211052500.
[13]
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence O. Hall, and W. Philip Kegelmeyer. 2002. SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 (2002), 321–357.
[14]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
[15]
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).
[16]
G. Cybenko. 1989. Approximation by supersitions of a single function. Mathematics of Control, Signals and Systems (1989).
[17]
Aminu Da’u and Naomie Salim. 2020. Recommendation system based on deep learning methods: A systematic review and new directions. Artificial Intelligence Review 53, 4 (2020), 2709–2748.
[18]
Meghana Deodhar, Joydeep Ghosh, Maytal Saar-Tsechansky, and Vineet Keshari. 2017. Active learning with multiple localized regression models. INFORMS Journal on Computing 29, 3 (2017), 503–522.
[19]
Daria Dzyabura and Hema Yoganarasimhan. 2018. Machine learning and marketing. In Handbook of Marketing Analytics. Edward Elgar Publishing.
[20]
Tülin Erdem, Kevin Lane Keller, Dmitri Kuksov, and Rik Pieters. 2016. Understanding branding in a digitally empowered world. International Journal of Research in Marketing 33, 1 (2016), 3–10.
[21]
Ken-Ichi Funahashi. 1989. On the approximate realization of continuous mappings by neural networks. Neural Networks 2, 3 (1989), 183–192.
[22]
Jing Gao, Peng Li, Zhikui Chen, and Jianing Zhang. 2020. A survey on deep learning for multimodal data fusion. Neural Computation 32, 5 (2020), 829–864.
[23]
Michelle Goddard. 2017. The EU general data protection regulation (GDPR): European regulation that has a global impact. International Journal of Market Research 59, 6 (2017), 703–705.
[24]
Jie Gu, Feng Wang, Qinghui Sun, Zhiquan Ye, Xiaoxiao Xu, Jingmin Chen, and Jun Zhang. 2021. Exploiting behavioral consistence for universal user representation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4063–4071.
[25]
Reed Hastings. 2012. AWS re:Invent 2012, Day 1 Keynote. http://www.youtube.com/watch?v=8FJ5DBLSFe4. YouTube video; see the video at 44:40 min.
[26]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.
[27]
Robert Hecht-Nielsen. 1987. Kolmogorov’s mapping neural network existence theorem. In Proceedings of the International Conference on Neural Networks, Vol. 3. IEEE Press New York, 11–14.
[28]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
[29]
Geoffrey E. Hinton and Ruslan R. Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313, 5786 (2006), 504–507.
[30]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735–1780.
[31]
Kurt Hornik. 1993. Some new results on neural network approximation. Neural Networks 6, 8 (1993), 1069–1072.
[32]
Kurt Hornik, Maxwell Stinchcombe, and Halbert White. 1989. Multilayer feedforward networks are universal approximators. Neural Networks 2, 5 (1989), 359–366.
[33]
Yupeng Hou, Shanlei Mu, Wayne Xin Zhao, Yaliang Li, Bolin Ding, and Ji-Rong Wen. 2022. Towards universal sequence representation learning for recommender systems. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 585–593.
[34]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In Proceedings of the 2018 IEEE International Conference on Data Mining (ICDM’18). IEEE, 197–206.
[35]
Alexandros Karatzoglou and Balázs Hidasi. 2017. Deep learning for recommender systems. In Proceedings of the 11th ACM Conference on Recommender Systems. 396–397.
[36]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT. 4171–4186.
[37]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.
[38]
Manfred Krafft, V. Kumar, Colleen Harmeling, Siddharth Singh, Ting Zhu, Jialie Chen, Tom Duncan, Whitney Fortin, and Erin Rosa. 2021. Insight is power: Understanding the terms of the consumer-firm data exchange. Journal of Retailing 97, 1 (2021), 133–149.
[39]
Katherine N. Lemon and Peter C. Verhoef. 2016. Understanding customer experience throughout the customer journey. Journal of Marketing 80, 6 (2016), 69–96.
[40]
Chenglin Li, Mingjun Zhao, Huanming Zhang, Chenyun Yu, Lei Cheng, Guoqiang Shu, Beibei Kong, and Di Niu. 2022. RecGURU: Adversarial learning of generalized user representations for cross-domain recommendation. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining. 571–581.
[41]
Pan Li, Maofei Que, Zhichao Jiang, Yao Hu, and Alexander Tuzhilin. 2020. PURS: Personalized unexpected recommender system for improving user satisfaction. In Proceedings of the 14th ACM Conference on Recommender Systems. 279–288.
[42]
Pan Li and Alexander Tuzhilin. 2020. DDTCDR: Deep dual transfer cross domain recommendation. In Proceedings of the 13th International Conference on Web Search and Data Mining. 331–339.
[43]
Ximeng Liu, Lehui Xie, Yaopeng Wang, Jian Zou, Jinbo Xiong, Zuobin Ying, and Athanasios V. Vasilakos. 2020. Privacy and security issues in deep learning: A survey. IEEE Access 9 (2020), 4566–4593.
[44]
David Loshin. 2010. Master Data Management. Morgan Kaufmann.
[45]
David Loshin and Abie Reifer. 2013. Using Information to Develop a Culture of Customer Centricity: Customer Centricity, Analytics, and Information Utilization. Elsevier.
[46]
Liye Ma and Baohong Sun. 2020. Machine learning and AI in marketing–Connecting computing power to human insights. International Journal of Research in Marketing 37, 3 (2020), 481–504.
[47]
Meghanath Macha, Beibei Li, Natasha Zhang Foutz, and Anindya Ghose. 2020. Perils of location tracking? Personalized and interpretable privacy preservation in consumer mobile trajectories. Personalized and Interpretable Privacy Preservation in Consumer Mobile Trajectories (June 16, 2020) (2020).
[48]
Ruben Mayer and Hans-Arno Jacobsen. 2020. Scalable deep learning on distributed infrastructures: Challenges, techniques, and tools. ACM Computing Surveys (CSUR) 53, 1 (2020), 1–37.
[49]
McKinsey. 2016. The Age of Analytics: Competing in a Data-driven World. Technical Report. Technical report, San Francisco: McKinsey & Company.
[50]
Vijay S. Mookerjee and Brian L. Dos Santos. 1993. Inductive expert system design: Maximizing system value. Information Systems Research 4, 2 (1993), 111–140.
[51]
Vijay S. Mookerjee and Michael V. Mannino. 1997. Redesigning case retrieval to reduce information acquisition costs. Information Systems Research 8, 1 (1997), 51–68.
[52]
James C. Moore, H. Raghav Rao, A. Whinston, Kichan Nam, and T. S. Raghu. 1997. Information acquisition policies for resource allocation among multiple agents. Information Systems Research 8, 2 (1997), 151–170.
[53]
James C. Moore and Andrew B. Whinston. 1986. A model of decision-making with sequential information-acquisition (part 1). Decision Support Systems 2, 4 (1986), 285–307.
[54]
James C. Moore and Andrew B. Whinston. 1987. A model of decision-making with sequential information-acquisition (part 2). Decision Support Systems 3, 1 (1987), 47–72.
[55]
B. P. S. Murthi and Sumit Sarkar. 2003. The role of the management sciences in research on personalization. Management Science 49, 10 (2003), 1344–1362.
[56]
Maryam M. Najafabadi, Flavio Villanustre, Taghi M. Khoshgoftaar, Naeem Seliya, Randall Wald, and Edin Muharemagic. 2015. Deep learning applications and challenges in big data analytics. Journal of Big Data 2, 1 (2015), 1–21.
[57]
Nico Neumann, Catherine E. Tucker, and Timothy Whitfield. 2019. Frontiers: How effective is third-party consumer profiling? Evidence from field studies. Marketing Science 38, 6 (2019), 918–926.
[58]
Yabo Ni, Dan Ou, Shichen Liu, Xiang Li, Wenwu Ou, Anxiang Zeng, and Luo Si. 2018. Perceive your users in depth: Learning universal user representations from multiple e-commerce tasks. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 596–605.
[59]
Balaji Padmanabhan, Zhiqiang Zheng, and Steven O. Kimbrough. 2001. Personalization from incomplete data: What you don’t know can hurt. In Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 154–163.
[60]
Balaji Padmanabhan, Zhiqiang Zheng, and Steven O. Kimbrough. 2006. An empirical analysis of the value of complete information for eCRM models. MIS Quarterly (2006), 247–267.
[61]
Massimo Quadrana, Paolo Cremonesi, and Dietmar Jannach. 2018. Sequence-aware recommender systems. ACM Computing Surveys (CSUR) 51, 4 (2018), 1–36.
[62]
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2015. Recommender systems: Introduction and challenges. In Recommender Systems Handbook. Springer, 1–34.
[63]
David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. 1985. Learning Internal Representations by Error Propagation. Technical Report. California Univ San Diego La Jolla Institute for Cognitive Science.
[64]
Badrul M. Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2002. Recommender systems for large-scale e-commerce: Scalable neighborhood formation using clustering. In Proceedings of the 5th International Conference on Computer and Information Technology, Vol. 1. Citeseer, 291–324.
[65]
Denish Shah, Roland T. Rust, Ananthanarayanan Parasuraman, Richard Staelin, and George S. Day. 2006. The path to customer centricity. Journal of Service Research 9, 2 (2006), 113–124.
[66]
Guy Shani and Asela Gunawardana. 2011. Evaluating recommendation systems. In Recommender Systems Handbook. Springer, 257–297.
[67]
Yu Shi, Fangqiu Han, Xinwei He, Xinran He, Carl Yang, Jie Luo, and Jiawei Han. 2018. mvn2vec: Preservation and collaboration in multi-view network embedding. arXiv preprint arXiv:1801.06597 (2018).
[68]
Zeynab Soltani and Nima Jafari Navimipour. 2016. Customer relationship management mechanisms: A systematic review of the state of the art literature and recommendations for future research. Computers in Human Behavior 61 (2016), 667–688.
[69]
Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1441–1450.
[70]
Pang-Ning Tan, Michael Steinbach, and Vipin Kumar. 2016. Introduction to Data Mining. Pearson Education India.
[71]
Michael Trusov, Liye Ma, and Zainab Jamal. 2016. Crumbs of the cookie: User profiling in customer-base analysis and behavioral targeting. Marketing Science 35, 3 (2016), 405–426.
[72]
Alexander Tuzhilin. 2009. Personalization: The state of the art and future directions. Business Computing 3, 3 (2009), 3–43.
[73]
Alexander Tuzhilin. 2012. Customer relationship management and Web mining: The next frontier. Data Mining and Knowledge Discovery 24, 3 (2012), 584–612.
[74]
Ayan Tyagi. 2021. Information governance program implementation and strategies in banking sector. Available at SSRN 3804620 (2021).
[75]
Moshe Unger, Alexander Tuzhilin, and Amit Livne. 2020. Context-aware recommendations based on deep learning frameworks. ACM Transactions on Management Information Systems (TMIS) 11, 2 (2020), 1–15.
[76]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1235–1244.
[77]
S. Wang, L. Hu, Y. Wang, L. Cao, Q. Z. Sheng, and M. Orgun. 2019. Sequential recommender systems: Challenges, progress and prospects. In Proceedings of the 28th International Joint Conference on Artificial Intelligence \(\lbrace\)IJCAI-19\(\rbrace\). International Joint Conferences on Artificial Intelligence Organization.
[78]
Michel Wedel and P. K. Kannan. 2016. Marketing analytics for data-rich environments. Journal of Marketing 80, 6 (2016), 97–121.
[79]
Jason Weston, Frédéric Ratle, Hossein Mobahi, and Ronan Collobert. 2012. Deep learning via semi-supervised embedding. In Neural Networks: Tricks of the Trade. Springer, 639–655.
[80]
Kaiquan Xu, Jason Chan, Anindya Ghose, and Sang Pil Han. 2017. Battle of the channels: The impact of tablets on digital commerce. Management Science 63, 5 (2017), 1469–1492.
[81]
Liu Yang, Ben Tan, Vincent W. Zheng, Kai Chen, and Qiang Yang. 2020. Federated recommendation systems. In Federated Learning. Springer, 225–239.
[82]
Zeping Yu, Jianxun Lian, Ahmad Mahmoody, Gongshen Liu, and Xing Xie. 2019. Adaptive user modeling with long and short-term preferences for personalized recommendation. In Proceedings of theInternational Joint Conference on Artificial Intelligence (IJCAI-19). 4213–4219.
[83]
Chen Zhang, Yu Xie, Hang Bai, Bin Yu, Weihong Li, and Yuan Gao. 2021b. A survey on federated learning. Knowledge-Based Systems 216 (2021), 106775.
[84]
Libo Zhang, Tiejian Luo, Fei Zhang, and Yanjun Wu. 2018. A recommendation model based on deep neural network. IEEE Access 6 (2018), 9454–9463.
[85]
Shunyuan Zhang, Nitin Mehta, Param Vir Singh, and Kannan Srinivasan. 2021a. Frontiers: Can an artificial intelligence algorithm mitigate racial economic inequality? An analysis in the context of airbnb. Marketing Science (2021). DOI:
[86]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM Computing Surveys (CSUR) 52, 1 (2019), 1–38.
[87]
Zhiqiang Zheng and Balaji Padmanabhan. 2006. Selectively acquiring customer information: A new data acquisition problem and an active learning-based solution. Management Science 52, 5 (2006), 697–712.
Index Terms
- Don’t Need All Eggs in One Basket: Reconstructing Composite Embeddings of Customers from Individual-Domain Embeddings
Recommendations
When to “Fire” Customers: Customer Cost-Based Pricing
The widespread adoption of activity-based costing enables firms to allocate common service costs to each customer, allowing for precise measurement of both the cost to serve a particular customer and the customer's profitability. In this paper, we ...
Modeling Customers and Products with Word Embeddings from Receipt Data
IDEAS '18: Proceedings of the 22nd International Database Engineering & Applications SymposiumFor many tasks in market research it is important to model customers and products as comparable instances. Usually, the integration of customers and products into one model is not trivial. In this paper, we will detail an approach for a combined vector ...
Competitive One-to-One Promotions
One-to-one promotions are possible when consumers are individually addressable and firms know something about each customer's preferences. We explore the competitive effects of one-to-one promotions in a model with two competing firms where the firms ...
Comments
Information & Contributors
Information
Published In
June 2023
178 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 March 2023
Online AM: 18 January 2023
Accepted: 21 November 2022
Revised: 16 November 2022
Received: 17 May 2022
Published in TMIS Volume 14, Issue 2
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 277Total Downloads
- Downloads (Last 12 months)71
- Downloads (Last 6 weeks)6
Reflects downloads up to 01 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format