research-article

Towards Age-friendly E-commerce Through Crowd-Improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback

Authors:

Eng Siong Chng,

Frank Yunqing Guan,

Cyril LeungAuthors Info & Claims

ICCSE'17: Proceedings of the 2nd International Conference on Crowd Science and Engineering

Pages 127 - 135

https://doi.org/10.1145/3126973.3129306

Published: 06 July 2017 Publication History

Abstract

This paper presents an age-friendly system for improving the elderly's online shopping experience. Different from most related studies focusing on website design and content organization, we propose to integrate three assistive techniques to facilitate the elderly's browsing of products in E-commerce platforms, including the crowd-improved speech recognition, the multimodal search, and the personalized speech feedback. The first two techniques, namely, the crowd-improved speech recognition and the multimodal search, work together to allow the elderly search for desired products flexibly using either speech, an image, text, or any combination of them whichever are convenient for the elderly. The personalized speech feedback provides a speech summary of search result in a personalized voice. That is, the elderly are allowed to choose or even create their desired voices, and also can customize the voices in terms of pitch, speaking speed, and loudness. As a whole, the proposed system is expected to help and engage the elderly's E-commerce adoption. Testing on real-world E-commerce product datasets demonstrated the usability of the proposed system.

References

[1]

{n. d.}. Bing Voice Recognition (beta). ({n. d.}). https://datamarket.azure.com/dataset/bing/speechrecognition

[2]

{n. d.}. HTML5 Web Audio specification. ({n. d.}). http://www.w3.org/TR/webaudio

[3]

{n. d.}. Microsoft Speech Platform. ({n. d.}). https://msdn.microsoft.com/en-us/library/jj127858.aspx

[4]

PCWorld, 2009. China's Baidu Launches Portal for the Elderly. (PCWorld, 2009). http://www.pcworld.com/article/162914/article.html

[5]

Population Division, United Nations Department of Economic and Social Affairs, 2013. World Population Ageing 2013. (Population Division, United Nations Department of Economic and Social Affairs, 2013). http://www.un.org/en/development/desa/population/publications/pdf/ageing/WorldPopulationAgeing2013.pdf

[6]

Shirley Ann Becker. 2004. A study of web usability for older adults seeking online health resources. ACM Transactions on Computer-Human Interaction (TOCHI) 11, 4 (2004), 387--406.

Digital Library

[7]

Fadi Biadsy, Pedro J Moreno, and Martin Jansche. 2012. Google's cross-dialect Arabic voice search. In Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 4441--4444.

[8]

Veena Chattaraman, Wi-Suk Kwon, Juan E Gilbert, and Soo In Shim. 2011. Virtual agents in e-commerce: representational characteristics for seniors. Journal of Research in Interactive Marketing 5, 4 (2011), 276--297.

[9]

Leida Chen, Mark L Gillenson, and Daniel L Sherrell. 2004. Consumer acceptance of virtual stores: a theoretical model and critical success factors for virtual stores. ACM Sigmis Database 35, 2 (2004), 8--31.

Digital Library

[10]

Anna Dickinson, Peter Gregor, Louise McIver, Robin Hill, and Scott Milne. 2005. The Non Browser: helping older novice computer users to access the web. In Proceedings of the 2005 international conference on Accessible Design in the Digital World. British Computer Society, 18--18.

Digital Library

[11]

Anna Dickinson, Michael J Smith, John L Arnott, Alan F Newell, and Robin L Hill. 2007. Approaches to web search and navigation for older computer novices. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 281--290.

Digital Library

[12]

Daniel Erro and Antonio Moreno, Asunciónand Bonafonte. 2010. Voice conversion based on weighted frequency warping. IEEE Transactions on Audio, Speech, and Language Processing 18, 5 (2010), 922--931.

Digital Library

[13]

Alexander Mark Franz, Monika H Henzinger, Sergey Brin, and Brian Christopher Milch. 2006. Voice interface for a search engine. (April 11 2006). US Patent 7,027,987.

[14]

Ryoko Fukuda and Heiner Bubb. 2003. Eye tracking study on Web-use: Comparison between younger and elderly users in case of search task with electronic timetable service. PsychNology Journal 1, 3 (2003), 202--228.

[15]

Loren Groff, Corrina Liao, Barbara Chaparro, and Alex Chaparro. 1999. Exploring how the elderly use the web. Usability News 1, 2 (1999), 1--2.

[16]

Vicki L Hanson, Jonathan P Brezin, Susan Crayne, Simeon Keates, Rick Kjeldsen, John T Richards, Calvin Swart, and Shari Trewin. 2005. Improving Web accessibility through an enhanced open-source browser. IBM Systems Journal 44, 3 (2005), 573--588.

Digital Library

[17]

Vicki L Hanson and Susan Crayne. 2005. Personalization of Web browsing: adaptations to meet the needs of older adults. Universal Access in the Information Society 4, 1 (2005), 46--58.

Digital Library

[18]

Vicki L Hanson, John T Richards, and Chin Chin Lee. 2007. Web access for older adults: voice browsing? In Universal Acess in Human Computer Interaction. Coping with Diversity. Springer, 904--913.

Digital Library

[19]

Traci A Hart and Barbara Chaparro. 2004. Evaluation of Websites for Older Adults: How" Senior Friendly" are they. Usability News 6, 1 (2004), 12.

[20]

Ellen Helsper. 2009. The ageing internet: digital choice and exclusion among the elderly. Working with Older People 13, 4 (2009), 28--33.

[21]

Andreas Holzinger, Gig Searle, Thomas Kleinberger, Ahmed Seffah, and Homa Javahery. 2008. Investigating usability metrics for the design and development of applications for the elderly. Springer.

[22]

CE Hudson, CT Scialfa, R Diaz-Marino, J Laberge, and SD MacKillop. 2008. Effects of navigation aids on web performance in younger and older adults. Gerontechnology 7, 1 (2008), 3--21.

[23]

Liang Kang and Hua Dong. 2014. B2C Websites Usability for Chinese Senior Citizens. In Human-Computer Interaction. Applications and Services. Springer, 13--20.

[24]

Elaine Lawrence, Stephen Newton, Brian Corbitt, John Lawrence, Stephen Dann, and Theerasak Thanasankit. 2003. Internet commerce: digital models for business. John Wiley & Sons.

[25]

Lei Meng, Ah-Hwee Tan, Cyril Leung, Liqiang Nie, Tat-Seng Chua, and Chunyan Miao. 2015. Online multimodal co-indexing and retrieval of weakly labeled web image collections. In Proceedings of the ACM International Conference on Multimedia Retrieval. ACM, 219--226.

Digital Library

[26]

Lei Meng, Ah-Hwee Tan, and Dong Xu. 2014. Semi-supervised heterogeneous fusion for multimedia data co-clustering. IEEE Transactions on Knowledge and Data Engineering 26, 9 (2014), 2293--2306.

[27]

Björn Niehaves and Ralf Plattfaut. 2014. Internet adoption by the elderly: employing IS technology acceptance theories for understanding the age-related digital divide. European Journal of Information Systems 23, 6 (2014), 708--726.

[28]

Jakob Nielsen. 2013. Seniors as web users. Nielsen Norman Group. Accessed August (2013). https://www.nngroup.com/articles/usability-for-senior-citizens/

[29]

Chee Wei Phang, Juliana Sutanto, Atreyi Kankanhalli, Yan Li, Bernard CY Tan, and Hock-Hai Teo. 2006. Senior citizens' acceptance of information systems: A study in the context of e-government services. IEEE Transactions on Engineering Management 53, 4 (2006), 555--569.

[30]

Johan Schalkwyk, Doug Beeferman, Franccoise Beaufays, Bill Byrne, Ciprian Chelba, Mike Cohen, Maryam Kamvar, and Brian Strope. 2010. "Your Word is my Command: Google Search by Voice: A Case Study. In Advances in Speech Recognition. Springer, 61--90.

[31]

Terry J Smith. 2008. Senior citizens and e-commerce websites: The role of perceived usefulness, perceived ease of use, and web site usability. Informing Science: International Journal of an Emerging Transdiscipline 11 (2008), 59--83.

[32]

Arthur Tatnall and Jerzy Lepa. 2003. The Internet, e-commerce and older people: an actor-network approach to researching reasons for adoption and use. Logistics Information Management 16, 1 (2003), 56--63.

[33]

Xiaohai Tian, Zhizheng Wu, Siu Wa Lee, Nguyen Quy Hy, Eng Siong Chng, and Minghui Dong. 2015. Sparse representation for frequency warping based voice conversion. In in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 4235--4239.

[34]

Xiaohai Tian, Zhizheng Wu, Siu Wa Lee, Nguyen Quy Hy, Minghui Dong, and Eng Siong Chng. 2015. System Fusion for High-Performance Voice Conversion. In INTERSPEECH.

[35]

Tomoki Toda, Alan W Black, and Keiichi Tokuda. 2007. Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory. IEEE Transactions on Audio, Speech, and Language Processing 15, 8 (2007), 2222--2235.

Digital Library

[36]

Tomoki Toda, Hiroshi Saruwatari, and Kiyohiro Shikano. 2001. Voice conversion algorithm based on Gaussian mixture model with dynamic frequency warping of STRAIGHT spectrum. In Acoustics, Speech, and Signal Processing, 2001. Proceedings. (ICASSP'01). 2001 IEEE International Conference on, Vol. 2. IEEE, 841--844.

Digital Library

Cited By

Wang YQi ZLi XLiu JMeng XMeng L(2023)Multi-channel Attentive Weighting of Visual Frames for Multimodal Video Classification2023 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN54540.2023.10192036(1-8)Online publication date: 18-Jun-2023
https://doi.org/10.1109/IJCNN54540.2023.10192036
Liu AWang YWang XLiu AWang YWang X(2021)User-Generated Content Analysis for Customer Needs ElicitationData-Driven Engineering Design10.1007/978-3-030-88181-8_2(23-40)Online publication date: 10-Oct-2021
https://doi.org/10.1007/978-3-030-88181-8_2
Ajayi LAzeta AMisra SOdun-Ayo IAjayi PAzeta VAgrawal A(2021)Enhancing the Low Adoption Rate of M-commerce in Nigeria Through Yorùbá Voice TechnologyHybrid Intelligent Systems10.1007/978-3-030-73050-5_52(516-524)Online publication date: 17-Apr-2021
https://doi.org/10.1007/978-3-030-73050-5_52
Show More Cited By

Index Terms

Towards Age-friendly E-commerce Through Crowd-Improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback

Recommendations

Explicit Pitch Mapping for Improved Children's Speech Recognition

Recognizing children's speech on automatic speech recognition (ASR) systems developed using adults' speech is a very challenging task. As reported by several earlier works, a severely degraded recognition performance is observed in such ASR tasks. This ...
Speech-Input Speech-Output Communication for Dysarthric Speakers Using HMM-Based Speech Recognition and Adaptive Synthesis System

Dysarthria is a motor speech disorder that causes inability to control and coordinate one or more articulators. This makes it difficult for a dysarthric speaker to utter certain speech sound units, thereby producing poorly articulated, slurred, and ...
An improved automatic lipreading system to enhance speech recognition
CHI '88: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Current acoustic speech recognition technology performs well with very small vocabularies in noise or with large vocabularies in very low noise. Accurate acoustic speech recognition in noise with vocabularies over 100 words has yet to be achieved. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICCSE'17: Proceedings of the 2nd International Conference on Crowd Science and Engineering

July 2017

158 pages

ISBN:9781450353755

DOI:10.1145/3126973

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 July 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCSE'17

ICCSE'17: 2nd International Conference on Crowd Science and Engineering

July 6 - 9, 2017

Beijing, China

Acceptance Rates

ICCSE'17 Paper Acceptance Rate 24 of 66 submissions, 36%;

Overall Acceptance Rate 92 of 247 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
272
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang YQi ZLi XLiu JMeng XMeng L(2023)Multi-channel Attentive Weighting of Visual Frames for Multimodal Video Classification2023 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN54540.2023.10192036(1-8)Online publication date: 18-Jun-2023
https://doi.org/10.1109/IJCNN54540.2023.10192036
Liu AWang YWang XLiu AWang YWang X(2021)User-Generated Content Analysis for Customer Needs ElicitationData-Driven Engineering Design10.1007/978-3-030-88181-8_2(23-40)Online publication date: 10-Oct-2021
https://doi.org/10.1007/978-3-030-88181-8_2
Ajayi LAzeta AMisra SOdun-Ayo IAjayi PAzeta VAgrawal A(2021)Enhancing the Low Adoption Rate of M-commerce in Nigeria Through Yorùbá Voice TechnologyHybrid Intelligent Systems10.1007/978-3-030-73050-5_52(516-524)Online publication date: 17-Apr-2021
https://doi.org/10.1007/978-3-030-73050-5_52
Yu XMeng LTian XFauvel SHuang BGuan YShen ZMiao CLeung C(2018)Usability Analysis of the Novel Functions to Assist the Senior Customers in Online ShoppingSocial Computing and Social Media. User Experience and Behavior10.1007/978-3-319-91521-0_14(173-185)Online publication date: 31-May-2018
https://doi.org/10.1007/978-3-319-91521-0_14
Tian XMeng LLiu SShen ZChng ELeung CGuan FMiao C(2017)Novel Functional Technologies for Age-Friendly E-commerceHuman Aspects of IT for the Aged Population. Applications, Services and Contexts10.1007/978-3-319-58536-9_13(150-158)Online publication date: 14-May-2017
https://doi.org/10.1007/978-3-319-58536-9_13

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents