Effect of voice imitation using voice conversion by avatar on customer service in Virtual Environments
Article No.: 53, Pages 1 - 2
Abstract
We investigate the impact of voice imitation on rapport building in customer service in a virtual environment(VE). We simulated a VE store and conducted a within-subject experiment in three customer service scenarios with 16 participants. The imitation condition used a voice generated by a machine learning model to reproduce the participant’s linguistic content, with the voice identity set midway between the participant and the salesperson. In a group of men, voice imitation significantly improved their impression of salespeople. The findings of this study can be used to design interpersonal services in VE with the help of salesperson avatar voice design.
Supplemental Material
MP4 File
Appendix(Demonstration video of imitated voice)
- Download
- 6.59 MB
References
[1]
Korrina A Duffy and Tanya L Chartrand. 2015. The extravert advantage: How and when extraverts build rapport with other people. Psychological Science 26, 11 (2015), 1795–1802.
[2]
Dwayne D Gremler and Kevin P Gwinner. 2000. Customer-employee rapport in service relationships. Journal of service research 3, 1 (2000), 82–104.
[3]
Joanna Hale and Antonia F De C Hamilton. 2016. Testing the relationship between mimicry, trust and rapport in virtual reality conversations. Scientific reports 6, 1 (2016), 35295.
[4]
Yinghao Aaron Li, Ali Zare, and Nima Mesgarani. 2021. Starganv2-vc: A diverse, unsupervised, non-parallel framework for natural-sounding voice conversion. arXiv preprint arXiv:2107.10394 (2021).
[5]
Nichola Lubold, Erin Walker, and Heather Pon-Barry. 2016. Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 255–262.
[6]
William W Maddux, Elizabeth Mullen, and Adam D Galinsky. 2008. Chameleons bake bigger pies and take bigger pieces: Strategic behavioral mimicry facilitates negotiation outcomes. Journal of Experimental Social Psychology 44, 2 (2008), 461–468.
[7]
Zhikang Peng, Zhiguo Hu, Xinyu Wang, Tiantian Jiao, Hanxiaoran Li, and Hongyan Liu. 2021. Gender context modulation on the self-enhancement effect of vocal attractiveness evaluation. PsyCh Journal 10, 6 (2021), 858–867.
Index Terms
- Effect of voice imitation using voice conversion by avatar on customer service in Virtual Environments
Index terms have been assigned to the content through auto-classification.
Recommendations
Avatar Voice Morphing to Match Subjective and Objective Self Voice Perception
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyWe investigated the effect of morphing the avatar’s voice from the user’s voice on its impressions. We also investigated whether the image of morphing differed between those who liked and disliked their voice. The experiment was conducted by morphing ...
Effect of Salesperson Avatar Automatically Mimicking Customer’s Nodding on the Enjoyment of Conversation in Virtual Environments
AHs '23: Proceedings of the Augmented Humans International Conference 2023As the VR industry continues to expand, one area gaining attention is its application in the retail sector. In customer service, a crucial aspect of retail, the skills of a salesperson are vital. However, research on VE in this field is still limited. ...
The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyThis paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...
Comments
Information & Contributors
Information
Published In
October 2023
542 pages
ISBN:9798400703287
DOI:10.1145/3611659
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 October 2023
Check for updates
Qualifiers
- Abstract
- Research
- Refereed limited
Funding Sources
Conference
VRST 2023: 29th ACM Symposium on Virtual Reality Software and Technology
October 9 - 11, 2023
Christchurch, New Zealand
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 83Total Downloads
- Downloads (Last 12 months)63
- Downloads (Last 6 weeks)5
Reflects downloads up to 12 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format