Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

How hand gestures influence the enjoyment in gamified mobile marketing

Published: 01 July 2019 Publication History
  • Get Citation Alerts
  • Highlights

    Two types of hand gestures—surface vs. motion gesture are investigated.
    Effects of gestures on enjoyment of marketing games are contingent on object visual presentation and reward setting.
    Surface gesture fits better with product picture and affects the enjoyment through mental simulation.
    Motion gesture interacts with reward uncertainty to impact the enjoyment through perceived control.

    Abstract

    With the rapid development of mobile technologies, gamification has been deployed pervasively on mobile platforms as an effective marketing tool. In this study, we focus on how mobile gesture technology influences consumer enjoyment of mobile marketing games by examining two types of hand gestures: surface and motion gestures. Considering the characteristics of hand gestures and embodied cognition theories, we propose that hand gestures influence the enjoyment of mobile marketing games with two other game elements: object visual presentation and reward setting. Specifically, the interaction between surface gesture (vs. motion gesture) and the object visual presentation of a real product picture (vs. symbolic brand logo image) leads to greater enjoyment of marketing games through mental simulation. Similarly, the interaction between motion gesture (vs. surface gesture) and reward setting of uncertainty (vs. certainty) leads to greater enjoyment of marketing games through perceived control. Three online experiments are conducted to support the proposed hypotheses. Results provide implications for marketing practitioners that hand gesture design should be aligned with congruent object visual presentation and reward setting in order to enhance consumer enjoyment of mobile marketing games. This study contributes to the extant literature of gamification, as well as human-computer interaction.

    References

    [1]
    K.L. Ailawadi, K. Gedenk, T. Langer, Y. Ma, S.A. Neslin, Consumer response to uncertain promotions: an empirical analysis of conditional rebates, Int. J. Res. Mark. 31 (2014) 94–106,.
    [2]
    S. Alavi, T. Bornemann, J. Wieseke, Gambled price discounts: a remedy to the negative side effects of regular price discounts, J. Mark. 79 (2015) 62–78,.
    [3]
    A. Bandura, Self-efficacy: toward a unifying theory of behavioral change, Psychol. Rev. 1 (1977) 139–161,.
    [4]
    L.W. Barsalou, Grounded cognition, Annu. Rev. Psychol. 59 (2008) 617–645,.
    [5]
    L.W. Barsalou, Perceptions of perceptual symbols, Behav. Brain Sci. 22 (1999) 637–660,.
    [6]
    A. Berger, T. Schlager, D.E. Sprott, A. Herrmann, Gamified interactions: whether, when, and how games facilitate self–brand connections, J. Acad. Mark. Sci. 3 (2017) 1–22,.
    [7]
    Business Insider (2013): Playing to win: mobile gamification done right. [WWW document]. URL https://www.businessinsider.com/gamification-in-the-mobile-landscape-2013-7.
    [8]
    J.T. Cacioppo, J.R. Priester, G.G. Berntson, Rudimentary determinants of attitudes II: arm flexion and extension have differential effects on attitudes, J. Pers. Soc. Psychol. 65 (1993) 5–17,.
    [9]
    A.M.C. Cañete, M.C. Hsu, C.P. Chen, Prominence of brand-related visual graphic contents in advergames, Int. J. Vis. Des. 7 (2014) 25–36,.
    [10]
    C.S. Carver, M.F. Scheier, Optimism, pessimism, and self-regulation, Optimism & Pessimism: Implications for Theory, Research, and Practice, 2001, pp. 31–51,.
    [11]
    D.B. Centerbar, G.L. Clore, Do approach-avoidance actions create attitudes?, Psychol. Sci. 17 (2006) 22–29,.
    [12]
    A. Cockburn, D. Ahlström, C. Gutwin, Understanding performance in touch selections: tap, drag and radial pointing drag with finger, stylus and mouse, Int. J. Hum. Comput. Stud. 70 (2012) 218–233,.
    [13]
    M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience, 1990,.
    [14]
    K.M. Cutright, A. Samper, Doing it the hard way: How low control drives preferences for high-Effort products and services, J. Consum. Res. 41 (2014) 730–745,.
    [15]
    F. Daiber, L. Li, A. Krüger, Designing gestures for mobile 3D gaming, in: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM ’12, 2012, p. 1,.
    [16]
    P.R. Darke, J.L. Freedman, Lucky events and beliefs in luck: paradoxical effects on confidence and risk-taking, Personal. Soc. Psychol. Bull. 23 (1997) 378–388,.
    [17]
    F.D. Davis, R.P. Bagozzi, P.R. Warshaw, Extrinsic and intrinsic motivation to use computers in the workplace, J. Appl. Soc. Psychol. 22 (1992) 1111–1132,.
    [18]
    S. Deterding, D. Dixon, R. Khaled, L. Nacke, From game design elements to gamefulness, in: Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek ’11, 2011, p. 9,.
    [19]
    C. Dweck, N.D. Reppucci, Learned helplessness and reinforcement responsibility in children, J. Pers. Soc. Psychol. 25 (1973) 109–116,.
    [20]
    A. Ejova, P. Delfabbro, D. Navarro, The illusion of control: structure, measurement and dependence on reinforcement frequency in the context of a laboratory gambling task, in: Proceedings of the 9th Conference of the Australasian Society for Cognitive Science, 2010,.
    [21]
    R.S. Elder, A. Krishna, The “visual depiction effect” in advertising: facilitating embodied mental simulation through product orientation, J. Consum. Res. 38 (2012) 988–1003,.
    [22]
    S.T. Fiske, B. Morling, L.E. Stevens, Controlling self and others: a theory of anxiety, mental control, and social control, Personal. Soc. Psychol. Bull. 22 (1996) 115–123,.
    [23]
    Forbes (2012): Getting apps right: how Domino's is beating the odds. [WWW Document]. URL https://www.forbes.com/sites/scottdavis/2012/06/21/getting-apps-right-how-dominos-is-beating-the-odds/#7ea411dd78a5.
    [24]
    C. Gerlach, I. Law, O.B. Paulson, When action turns into words. Activation of motor-based knowledge during categorization of manipulable objects, J. Cogn. Neurosci 14 (2002) 1230–1239,.
    [25]
    J.J.J. Gibson, The Ecological Approach to Visual Perception, Houghton Mifflin, Boston, 1979.
    [26]
    S.R. Giessner, T.W. Schubert, High in the hierarchy: how vertical location and judgments of leaders’ power are interrelated, Organ. Behav. Hum. Decis. Process. 104 (2007) 30–44,.
    [27]
    D.C. Glass, J.E. Singer, L.N. Friedman, Psychic cost of adaptation to an environmental stressor, J. Pers. Soc. Psychol. 12 (1969) 200,.
    [28]
    K. Goldsmith, O. Amir, Can uncertainty improve promotions?, J. Mark. Res. 47 (2010) 1070–1077,.
    [29]
    M.C. Green, T.C. Brock, G.F. Kaufman, Understanding media enjoyment: the role of transportation into narrative worlds, Commun. Theory (2004),.
    [30]
    C. Gutwin, R. Penner, Improving interpretation of remote gestures with telepointer traces, in: Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work - CSCW ’02, 2002,.
    [31]
    J. Hamari, Perspectives from behavioral economics to analyzing game design patterns: loss aversion in social games, in: Proceedings of the CHI 2011 Social Games Workshop, 2011.
    [32]
    J. Hamari, J. Koivisto, H. Sarsa, Does gamification work? - A literature review of empirical studies on gamification, in: Proceedings of the Annual Hawaii International Conference on System Sciences, 2014,.
    [33]
    E.T. Higgins, Beyond pleasure and pain: how motivation works, Beyond Pleasure and Pain: How Motivation Works, Oxford University Press, 2012,.
    [34]
    K. Hinckley, W. Buxton, S. Heo, M. Pahud, C. Holz, H. Benko, A. Sellen, R. Banks, K. O'Hara, G. Smyth, Pre-touch sensing for mobile interaction, in: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ’16, 2016, pp. 2869–2881,.
    [35]
    C.F. Hofacker, K. De Ruyter, N.H. Lurie, P. Manchanda, J. Donaldson, Gamification and mobile marketing effectiveness, J. Interact. Mark. 34 (2015) 25–36,.
    [36]
    J. Hou, Y. Nam, W. Peng, K.M. Lee, Effects of screen size, viewing angle, and players’ immersion tendencies on game experience, Comput. Human Behav. 28 (2012) 617–623,.
    [37]
    K. Huotari, J. Hamari, A definition for gamification: anchoring gamification in the service marketing literature, Electron. Mark. 27 (2017) 21–31,.
    [38]
    K. Huotari, J. Hamari, Defining gamification - a service marketing perspective, in: Proceeding of the 16th International Academic MindTrek Conference on - MindTrek ’12, 2012, p. 17,.
    [39]
    M. Jeannerod, Neural simulation of action: a unifying mechanism for motor cognition, NeuroImage 14 (2001) S103–S109,.
    [40]
    E.J. Jeong, C.J. Bohil, F.a Biocca, Brand logo placement in violent games. Effects of violence cues on memory and attitude through arousal and presence, J. Advert 40 (2011) 59–72,.
    [41]
    Y. Jiang, G.J. Gorn, M. Galli, A. Chattopadhyay, Does your company have the right logo? How and why circular- and angular-logo shapes influence brand attribute judgments, J. Consum. Res. 42 (2016) 709–726,.
    [42]
    N.B. Jostmann, D. Lakens, T.W. Schubert, Weight as an embodiment of importance, Psychol. Sci. 20 (2009) 1169–1174,.
    [43]
    A. Kalra, M. Shi, Consumer value-maximizing sweepstakes and contests, J. Mark. Res. 47 (2010) 287–300,.
    [44]
    M. Karam, M.C. Schraefel, A Taxonomy of Gestures in Human Computer Interactions, Eletronics Comput. Sci., 2005, pp. 1–45. Tech. Report https://doi.org/10.1.1.97.5474.
    [45]
    K. Kim, S.J.(Grace) Ahn, The role of gamification in enhancing intrinsic motivation to use a loyalty program, J. Interact. Mark. 40 (2017) 41–51,.
    [46]
    S. Kim, R.P. Chen, K. Zhang, Anthropomorphized helpers undermine autonomy and enjoyment in computer games, J. Consum. Res. (2016),.
    [47]
    D.L. King, A. Ejova, P.H. Delfabbro, Illusory control, gambling, and video gaming: an investigation of regular gamblers and video game players, J. Gambl. Stud. 28 (2012) 421–435,.
    [48]
    J. Komulainen, J. Tkatalo, M. Lehtonen, G. Nyman, Psychologically structured approach to user experience in games, in: Nordic Conference on Human-Computer Interaction 2008, 2008, pp. 487–490,.
    [49]
    H. Korhonen, M. Montola, J. Arrasvuori, Understanding playful user experience through digital games, in: International Conference on Designing Pleasurable Products and Interfaces, 2009, pp. 274–285.
    [50]
    S. Kratz, M. Rohs, K. Wolf, J. Müller, M. Wilhelm, C. Johansson, J. Tholander, J. Laaksolahti, Body, movement, gesture & tactility in interaction with mobile devices, in: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI ’11, Stockholm, Sweden, 2011, pp. 757–759,.
    [51]
    R. Ladouceur, M. Mayrand, Evaluation of the illusion of control : type of feedback, outcome sequence, and number of trials among regular and occasional gamblers, J. Psychol. Interdiscip. Appl. 117 (1984) 37046,.
    [52]
    G. Lakoff, Women, Fire, and Dangerous Things: What Categories Reveal about the Mind, University of Chicago Press, Chicago, 1987,.
    [53]
    G. Lakoff, M. Johnson, Metaphors We Live by, University of Chicago Press, Chicago, 1980.
    [54]
    E.J. Langer, Illusion of control, J. Personal. Soc. Psychol. 32 (1975) 311–328,.
    [55]
    S.C. Lee, B. Li, T. Starner, AirTouch: synchronizing in-air hand gesture and on-body tactile feedback to augment mobile gesture interaction, in: Proceedings - International Symposium on Wearable Computers, ISWC, IEEE, 2011, pp. 3–10,.
    [56]
    Y.H. Lee, C. Qiu, When uncertainty brings pleasure: the role of prospect imageability and mental imagery, J. Consum. Res. 36 (2009) 624–633,.
    [57]
    D. Liu, R. Santhanam, J. Webster, Toward meaningful engagement: a framework for design and research of gamified information systems, MIS Q 41 (2017) 1011–1034,.
    [58]
    A.C. Long, J.A. Landay, L.A. Rowe, Implications for a gesture design tool, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems the CHI Is the Limit - CHI ’99, 1999, pp. 40–47,.
    [59]
    D. MacInnis, L. Price, The role of imagery in information processing: review and extension, J. Consum. Res. 13 (1987) 473–491,.
    [60]
    McDonald China (2016): McDonald China public page on Weibo. [WWW Document]. URL https://weibo.com/mcdonaldsworlds.
    [61]
    R. McGloin, K.M. Farrar, M. Krcmar, The impact of controller naturalness on spatial presence, gamer enjoyment, and perceived realism in a tennis simulation video game, Presence Teleoperators Virtual Environ. 20 (2011) 309–324,.
    [62]
    J. Müller-Stewens, T. Schlager, G. Häubl, A. Herrmann, Gamified information presentation and consumer adoption of product innovations, J. Mark. 81 (2017) 8–24,.
    [63]
    K.C.M. Nuijten, A. De Regt, L. Calvi, A.L. Peeters, Subliminal advertising in shooter games: recognition effects of textual and pictorial brand logos, Int. J. Arts Technol. 6 (2013) 5–21,.
    [64]
    D. Pecher, I. Boot, S. Van Dantzig, Abstract concepts. Sensory-motor grounding, metaphors, and beyond, Psychol. Learn. Motiv. 54 (2011) 217–248,.
    [65]
    D. Pecher, S. Van Dantzig, R.A. Zwaan, R. Zeelenberg, Language comprehenders retain implied shape and orientation of objects, Q. J. Exp. Psychol. 62 (2009) 1108–1114,.
    [66]
    R.M. Ping, S. Dhillon, S.L. Beilock, Reach for what you like: the body's role in shaping preferences, Emot. Rev. 1 (2009) 140–150,.
    [67]
    W. Prinz, Perception and action planning, Eur. J. Cogn. Psychol. 9 (2010) 37–41.
    [68]
    F. Quek, D. McNeill, R. Bryll, S. Duncan, X.-F. Ma, C. Kirbas, K.E. McCullough, R. Ansari, Multimodal human discourse: gesture and speech, ACM Trans. Comput. Interact. 9 (2002) 171–193,.
    [69]
    R. Reczek, K.L. Haws, C.A. Summers, Lucky loyalty: the effect of consumer effort on predictions of randomly determined marketing outcomes, J. Consum. Res. 41 (2014) 1065–1077,.
    [70]
    D. Rempel, M.J. Camilleri, D.L. Lee, The design of hand gestures for human-computer interaction: lessons from sign language interpreters, Int. J. Hum. Comput. Stud. 72 (2014) 728–735,.
    [71]
    G. Richter, D.R. Raban, S. Rafaeli, Studying gamification: the effect of rewards and incentives on motivation, Gamification in Education and Business, Springer International Publishing, 2015, pp. 21–46,.
    [72]
    K. Robson, K. Plangger, J.H. Kietzmann, I. McCarthy, L. Pitt, Is it all a game? Understanding the principles of gamification, Bus. Horiz. 58 (2015) 411–420,.
    [73]
    J. Ruiz, Y. Li, E. Lank, User-defined motion gestures for mobile interaction, in: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI ’11, ACM Press, 2011, p. 197,.
    [74]
    J.L.G. Sánchez, F.L.G. Vela, F.M. Simarro, N. Padilla-Zea, Playability: analysing user experience in video games, Behav. Inf. Technol. 31 (2012) 1033–1054,.
    [75]
    J. Scheible, T. Ojala, P. Coulton, MobiToss, in: Proceeding of the 16th ACM International Conference on Multimedia - MM ’08, ACM Press, 2008, p. 957,.
    [76]
    J. Schell, The Art of Game Design: A Book of Lenses, 2015.
    [77]
    D.H. Schunk, Ability versus effort attributional feedback: differential effects on self-efficacy and achievement, J. Educ. Psychol. 75 (1983) 848–856,.
    [78]
    K. Seaborn, D.I. Fels, Gamification in theory and action: a survey, Int. J. Hum.-Comput. Stud. 74 (2015) 14–31,.
    [79]
    H. Shen, J. Sengupta, If you can't grab it, it won't grab you: the effect of restricting the dominant hand on target evaluations, J. Exp. Soc. Psychol. 48 (2012) 525–529,.
    [80]
    H. Shen, M. Zhang, A. Krishna, Computer interfaces and the “direct-touch” effect: can iPads increase the choice of hedonic food, J. Mark. Res. 53 (2016) 745–758.
    [81]
    L. Shen, A. Fishbach, C.K. Hsee, The motivating-uncertainty effect: uncertainty increases resource investment in the process of reward pursuit, J. Consum. Res. 41 (2015) 1301–1315,.
    [82]
    W.K. Simmons, A. Martin, L.W. Barsalou, Pictures of appetizing foods activate gustatory cortices for taste and reward, Cereb. Cortex 15 (2005) 1602,.
    [83]
    P. Skalski, R. Tamborini, A. Shelton, M. Buncher, P. Lindmark, Mapping the road to fun: natural video game controllers, presence, and game enjoyment, New Media Soc. 13 (2011) 224–242,.
    [84]
    E.A. Skinner, A guide to constructs of control, J. Pers. Soc. Psychol. 71 (1996) 549–570,.
    [85]
    P. Sweetser, P. Wyeth, GameFlow: a model for evaluating player enjoyment in games, Comput. Entertain. 3 (2005),. 3.
    [86]
    R. Tamborini, N.D. Bowman, Presence in video games, Immersed in Media Telepresence Theory, Measurement & Technology, 2010, pp. 87–109,.
    [87]
    R. Tamborini, P. Skalski, The role of presence in the experience of electronic games, Playing Video Games: Motives, Responses, and Consequences, 2006.
    [88]
    E. Thelen, L.B. Smith, A dynamic systems approach to the development of cognition and action, J. Cogn. Neurosci. 7 (1995) 512–514,.
    [89]
    M. Tucker, R. Ellis, The potentiation of grasp types during visual object categorization, Vis. Cogn. 8 (2001) 769–800,.
    [90]
    M. Tucker, R. Ellis, On the relations between seen objects and components of potential actions, J. Exp. Psychol. Hum. Percept. Perform. 24 (1998) 830–846,.
    [91]
    T. van Gelder, A. Clark, Being there: Putting brain, body and world together again, Philos. Rev. 107 (1998) 647,.
    [92]
    R.D. Vatavu, I.A. Zaiti, Automatic recognition of object size and shape via user-dependent measurements of the grasping hand, Int. J. Hum. Comput. Stud. 71 (2012) 590–607,.
    [93]
    P. Walsh, M.H. Zimmerman, G. Clavio, A.S. Williams, Comparing brand awareness levels of in-game advertising in sport video games featuring visual and verbal communication cues, Commun. Sport 2 (2013),.
    [94]
    R.J. Williamson, S.A. Brewster, R. Vennelakanti, Mo!Games: evaluating mobile gestures in the wild, in: Proceedings of the 15th ACM on International Conference on Multimodal Interaction - ICMI ’13, 2013, pp. 173–180,.
    [95]
    M. Wilson, Six views of embodied cognition, Cognition 9 (2002) 1–19,.
    [96]
    J.O. Wobbrock, M.R. Morris, A.D. Wilson, User-defined gestures for surface computing, in: Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 09, ACM Press, 2009, p. 1083,.
    [97]
    J.O. Wobbrock, B.A. Myers, H.H. Aung, The performance of hand postures in front- and back-of-device interaction for mobile computing, Int. J. Hum. Comput. Stud. 66 (2008) 857–875,.
    [98]
    J. Wu, D. Liu, The effects of trust and enjoyment on intention to play online games, J. Electron. Commer. Res. 8 (2007) 128–140.
    [99]
    M. Yi, Y. Hwang, Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model, Int. J. Hum. Comput. Stud. 59 (2003) 431–449,.
    [100]
    J.-W. Yoo, W. Hwang, H. Seok, S. Park, C. Kim, W. Choi, K. Park, Cocktail: exploiting bartenders’ gestures for mobile interaction, Int. J. Mob. Hum. Comput. Interact. 2 (2010) 44–57,.
    [101]
    R.J. Zatorre, A.R. Halpern, Mental concerts: musical imagery and auditory cortex, Neuron 47 (2005) 9–12,.
    [102]
    X. Zhao, H. Xie, X. Zou, Gaze-gesture interaction for mobile phones, in: Proceedings of the 2012 7th International Conference on Computing and Convergence Technology, 2012, pp. 1030–1033.
    [103]
    R.A. Zwaan, L.J. Taylor, Seeing, acting, understanding: motor resonance in language comprehension, J. Exp. Psychol. Gen. 135 (2006) 1–11,.

    Cited By

    View all
    • (2022)Brand Marketing Leveraging the Advantage of Emoji Pack Relying on Association Rule Algorithm in Data Mining TechnologyComputational Intelligence and Neuroscience10.1155/2022/35112112022Online publication date: 1-Jan-2022
    • (2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
    • (2022)Building blocks for creating enjoyable games—A systematic literature reviewInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102758159:COnline publication date: 1-Mar-2022
    • Show More Cited By

    Index Terms

    1. How hand gestures influence the enjoyment in gamified mobile marketing
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image International Journal of Human-Computer Studies
          International Journal of Human-Computer Studies  Volume 127, Issue C
          Jul 2019
          225 pages

          Publisher

          Academic Press, Inc.

          United States

          Publication History

          Published: 01 July 2019

          Author Tags

          1. Gesture interaction
          2. Mental simulation
          3. Perceived control
          4. Enjoyment
          5. Game design

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0

          Other Metrics

          Citations

          Cited By

          View all
          • (2022)Brand Marketing Leveraging the Advantage of Emoji Pack Relying on Association Rule Algorithm in Data Mining TechnologyComputational Intelligence and Neuroscience10.1155/2022/35112112022Online publication date: 1-Jan-2022
          • (2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
          • (2022)Building blocks for creating enjoyable games—A systematic literature reviewInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102758159:COnline publication date: 1-Mar-2022
          • (2019)Strengthening gamification studiesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2018.11.007127:C(1-6)Online publication date: 1-Jul-2019

          View Options

          View options

          Get Access

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media