research-article

Emotional Biosensing: Exploring Critical Alternatives

Authors:

Abigail De Kosnik,

Kimiko RyokaiAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 2, Issue CSCW

Article No.: 69, Pages 1 - 25

https://doi.org/10.1145/3274338

Published: 01 November 2018 Publication History

Abstract

Emotional biosensing is rising in daily life: Data and categories claim to know how people feel and suggest what they should do about it, while CSCW explores new biosensing possibilities. Prevalent approaches to emotional biosensing are too limited, focusing on the individual, optimization, and normative categorization. Conceptual shifts can help explore alternatives: toward materiality, from representation toward performativity, inter-action to intra-action, shifting biopolitics, and shifting affect/desire. We contribute (1) synthesizing wide-ranging conceptual lenses, providing analysis connecting them to emotional biosensing design, (2) analyzing selected design exemplars to apply these lenses to design research, and (3) offering our own recommendations for designers and design researchers. In particular we suggest humility in knowledge claims with emotional biosensing, prioritizing care and affirmation over self-improvement, and exploring alternative desires. We call for critically questioning and generatively re-imagining the role of data in configuring sensing, feeling, 'the good life,' and everyday experience.

References

[1]

Sara Ahmed. 2004. Affective Economies. Soc. Text 22, 2 (May 2004), 117--139.

[2]

Yoko Akama, Ann Light, and Simon Bowen. 2017. Mindfulness and Technology: Traces of A Middle Way. In Designing Interactive Systems, 345--355.

Digital Library

[3]

Kathryn Freeman Anderson. 2013. Diagnosing Discrimination: Stress from Perceived Racism and the Mental and Physical Health Effects. Sociol. Inq. 83, 1 (February 2013), 55--81.

[4]

Rain Ashford. 2014. Baroesque barometric skirt. In Proceedings of the 2014 ACM International Symposium on Wearable Computers: Adjunct Program (ISWC'14 Adjunct), 9--14.

Digital Library

[5]

Karen Barad. 2003. Posthumanist Performativity: Toward an Understanding of How Matter Comes to Matter. Signs 28, 3 (2003), 801--831.

[6]

Lisa Feldman Barrett. 2009. Variety is the spice of life: A psychological construction approach to understanding variability in emotion. Cogn. Emot. 23, 7 (November 2009), 1284--1306.

[7]

Tara Siegel Bernard. 2015. Giving Out Private Data for Discount in Insurance. The New York Times. Retrieved April 17, 2018 from https://www.nytimes.com/2015/04/08/your-money/giving-out-private-data-for-discount-in-insurance.html

[8]

Kirsten Boehner. 2009. Reflections on representation as response. interactions 16, 6 (November 2009), 28.

Digital Library

[9]

Kirsten Boehner, Rogério DePaula, Paul Dourish, and Phoebe Sengers. 2005. Affect: from information to interaction. In Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility (CC'05), 59--68.

Digital Library

[10]

Kirsten Boehner, Rogério DePaula, Paul Dourish, and Phoebe Sengers. 2007. How emotion is made and measured. Int. J. Hum.-Comput. Stud. 65, 4 (April 2007), 275--291.

Digital Library

[11]

Charlie Boothe. 2018. Potential teacher strike looms over West Virginia. Bluefield Daily Telegraph. Retrieved March 28, 2018 from http://www.bdtonline.com/news/potential-teacher-strike-looms-over-west-virginia/article_32f4a9f4-04a1-11e8-99f2-7f31dc816267.html

[12]

Chris Bopp, Ellie Harmon, and Amy Voida. 2017. Disempowered by Data: Nonprofits, Social Enterprises, and the Consequences of Data-Driven Work. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 3608--3619.

Digital Library

[13]

danah boyd and Kate Crawford. 2012. Critical Questions for Big Data: Provocations for a cultural, technological, and scholarly phenomenon. Inf. Commun. Soc. 15, 5 (June 2012), 662--679.

[14]

Tega Brain and Surya Mattu. Unfit Bits: The Guide. Retrieved April 17, 2018 from http://www.unfitbits.com/assets/UnfitBits-FullGuide-WebDownload.pdf

[15]

J. Buolamwini and T. Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of Machine Learning Research, 77--91.

[16]

Joy Buolamwini. 2016. The Algorithmic Justice League. MIT Media Lab. Retrieved June 24, 2018 from https://medium.com/mit-media-lab/the-algorithmic-justice-league-3cc4131c5148

[17]

Michel Callon. 1984. Some Elements of a Sociology of Translation: Domestication of the Scallops and the Fishermen of St Brieuc Bay. Sociol. Rev. 32, 1_suppl (May 1984), 196--233.

[18]

Rafael Calvo, Sidney D'Mello, Jonathan Gratch, and Arvid Kappas (Eds.). 2015. The Oxford Handbook of Affective Computing. Oxford University Press. Retrieved May 18, 2016 from http://www.oxfordhandbooks.com/view/10.1093/oxfordhb/9780199942237.001.0001/oxfordhb-9780199942237

Digital Library

[19]

Luca Canzian and Mirco Musolesi. 2015. Trajectories of Depression: Unobtrusive Monitoring of Depressive States by Means of Smartphone Mobility Traces Analysis. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15), 1293--1304.

Digital Library

[20]

Kate Crawford, Mary L. Gray, and Kate Miltner. 2014. Critiquing Big Data: Politics, Ethics, Epistemology. Int. J. Commun. 8, 0 (June 2014), 10.

[21]

Gilles Deleuze. 1992. Postscript on the Societies of Control. October 59, Winter (1992), 3--7.

[22]

Gilles Deleuze and Félix Guattari. 1987. A thousand plateaus: capitalism and schizophrenia. University of Minnesota Press, Minneapolis.

[23]

Laura Devendorf, Abigail De Kosnik, Kate Mattingly, and Kimiko Ryokai. 2016. Probing the Potential of Post-Anthropocentric 3D Printing. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16), 170--181.

Digital Library

[24]

Laura Devendorf, Joanne Lo, Noura Howell, Lin Lee Jung, Nan-Wei Gong, M. Emre Karagozler, Shiho Fukuhara, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. 'I don't want to wear a screen": Probing perceptions of and possibilities for dynamic displays on clothing. In Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems (CHI'16).

Digital Library

[25]

Laura Devendorf and Kimiko Ryokai. 2015. Being the Machine: Reconfiguring Agency and Control in Hybrid Fabrication. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2477--2486.

Digital Library

[26]

Paul Dourish and Melissa Mazmanian. 2011. Media as material: Information representations as material foundations for organizational practice. In Third International Symposium on Process Organization Studies.

[27]

Natasha Dow Schüll. 2016. Sensor technology and the time-series self. continent. 5, 1 (January 2016), 24--29.

[28]

Joseph Dumit. 2012. Drugs for life: how pharmaceutical companies define our health. Duke University Press, Durham.

[29]

Chris Elsden, Abigail C. Durrant, David Chatting, and David S. Kirk. 2017. Designing Documentary Informatics. In Proceedings of the 2017 Conference on Designing Interactive Systems Pages, 649--661.

Digital Library

[30]

Chris Elsden, Bettina Nissen, Andrew Garbett, David Chatting, David Kirk, and John Vines. 2016. Metadating: Exploring the Romance and Future of Personal Data. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 685--698.

Digital Library

[31]

Chris Elsden, Mark Selby, Abigail Durrant, and David Kirk. 2016. Fitter, Happier, More Productive: What to Ask of a Data-driven Life. interactions 23, 5 (August 2016), 45--49.

Digital Library

[32]

Petra Fagerberg, Anna Ståhl, and Kristina Höök. 2004. eMoto: Emotionally Engaging Interaction. Pers. Ubiquitous Comput 8, 5 (September 2004), 377--381.

[33]

Behnaz Farahi. 2015. Caress of the Gaze. Retrieved November 3, 2017 from http://behnazfarahi.com/caress-of-the-gaze/

[34]

Behnaz Farahi. 2017. Opale. Retrieved November 3, 2017 from http://behnazfarahi.com/opale/

[35]

Michel Foucault. 1995. Discipline and punish: the birth of the prison (2nd Vintage Books ed ed.). Vintage Books, New York.

[36]

Tyler Fox. 2014. Biolesce. Retrieved August 31, 2017 from http://www.tylersfox.com/487

[37]

Jonah Furman and Dan DiMaggio. 2018. West Virginia Teachers Launch Statewide Strike. Labor Notes. Retrieved March 28, 2018 from http://www.labornotes.org/2018/02/west-virginia-teachers-launch-statewide-strike

[38]

Amisha Gadani. 2010. Porcupine Defensive Dress. Retrieved December 15, 2017 from http://www.amishagadani.com/Work/porcupine/index.html

[39]

William Gaver. 2012. What Should We Expect from Research Through Design? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 937--946.

Digital Library

[40]

William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity As a Resource for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03), 233--240.

Digital Library

[41]

Elisa Giaccardi and Elvin Karana. 2015. Foundations of Materials Experience: An Approach for HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2447--2456.

Digital Library

[42]

Lisa Gitelman (Ed.). 2013. 'Raw data" is an oxymoron. The MIT Press, Cambridge, Massachusetts; London, England.

[43]

Charles Goodwin. 1994. Professional Vision. Am. Anthropol. 96, 3 (September 1994), 606--633.

[44]

Carol Graham. 2017. Happiness for All? Unequal Hopes and Lives in Pursuit of the American Dream. Princeton University Press, Princeton.

[45]

Kathleen Green. 2002. Stress Management Ideology and the Other Spaces of Women's Power. In Hop on Pop: The Politics and Pleasures of Popular Culture. Duke University Press, 670--679.

[46]

Donna Jeanne Haraway. 2016. Staying with the trouble: making kin in the Chthulucene. Duke University Press, Durham.

[47]

Jean Hardy and Silvia Lindtner. 2017. Constructing a Desiring User: Discourse, Rurality, and Design in Location-Based Social Networks. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 13--25.

Digital Library

[48]

Kate Hartman, Jackson McConnell, Boris Kourtoukov, Hillary Predko, and Izzie Colpitts-Campbell. 2015. Monarch: Self-Expression Through Wearable Kinetic Textiles. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15), 413--414.

Digital Library

[49]

Jennifer Healey. 2015. Physiological Sensing of Emotion. In The Oxford Handbook of Affective Computing, Rafael Calvo, Sidney D'Mello, Jonathan Gratch and Arvid Kappas (eds.). Oxford University Press. Retrieved May 18, 2016 from http://www.oxfordhandbooks.com/view/10.1093/oxfordhb/9780199942237.001.0001/oxfordhb-9780199942237-e-023

[50]

[email protected]. 2017. Gift-Wrap Peace of Mind This Christmas.

[51]

[email protected]. 2018. A Valentine's Day Gift of Calm.

[52]

Angela Helm. 2017. Black Women, Don't Throw Up Hands-Call the Bank of Hysteria to Vent. The Root. Retrieved June 23, 2018 from https://www.theroot.com/black-women-don-t-throw-up-hands-call-the-bank-of-hys-1821047581

[53]

Tad Hirsch, Kritzia Merced, Shrikanth Narayanan, Zac E. Imel, and David C. Atkins. 2017. Designing Contestability: Interaction Design, Machine Learning, and Mental Health. 95--99.

Digital Library

[54]

Bjørn Hofmann. 2001. The technological invention of disease. Med. Humanit. 27, 1 (June 2001), 10--19.

[55]

Sun-ha Hong. 2016. Data's Intimacy: Machinic Sensibility and the Quantified Self. Commun. 1 5, 1 (September 2016), 1--36.

[56]

Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 3131--3142.

Digital Library

[57]

Noura Howell, Laura Devendorf, Rundong (Kevin) Tian, Tomás Vega, Nan-Wei Gong, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. Biosignals as social cues: Ambiguity and emotional interpretation in social displays of skin conductance. In Designing Interactive Systems (DIS).

Digital Library

[58]

Noura Howell, Laura Devendorf, Tomás Vega Gálvez, Rundong Tian, and Kimiko Ryokai. 2018. Tensions of data-driven reflection: A case study of real-time emotional biosensing. In SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

[59]

Andrew Iliadis and Federica Russo. 2016. Critical data studies: An introduction. Big Data Soc. 3, 2 (November 2016), 1--7.

[60]

Malika Imhotep, Jess Liu, Becca Milman, and Phyllis Thai. 2018. The Bank of Hysteria. Retrieved June 23, 2018 from http://bcnm.berkeley.edu/news-research/2355/malika-imhotep-and-the-bank-of-hysteria-featured-on-the-root

[61]

Lucas Introna. 2014. Towards a post-human intra-actional account of sociomaterial agency (and morality). In The moral status of artefacts, Peter Kroes and Peter-Paul Verbeek (eds.). Springer, Dordrecht, 31--53.

[62]

Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3227--3236.

Digital Library

[63]

Jim Johnson. 1988. Mixing Humans and Nonhumans Together: The Sociology of a Door-Closer. Soc. Probl. 35, 3 (1988), 298--310.

[64]

Elizabeth Kaziunas, Mark S. Ackerman, Silvia Lindtner, and Joyce M. Lee. 2017. Caring Through Data: Attending to the Social and Emotional Experiences of Health Datafication. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 2260--2272.

Digital Library

[65]

R. Ketal. 1975. Affect, mood, emotion, and feeling: semantic considerations. Am. J. Psychiatry 132, 11 (November 1975), 1215--1217.

[66]

Susan Kozel. 2012. AffeXity: performing affect using augmented reality. Fibreculture J. 21, (2012), 72--96.

[67]

Lenneke Kuijer and Elisa Giaccardi. 2018. Co-performance: Conceptualizing the Role of Artificial Agency in the Design of Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), 125:1--125:13.

Digital Library

[68]

Jo Labanyi. 2010. Doing Things: Emotion, Affect, and Materiality. J. Span. Cult. Stud. 11, 3-4 (September 2010), 223--233.

[69]

Bruno Latour. 1999. Circulating Reference: Sampling the Soil in the Amazon Forest. In Pandora's Hope: Essays on the Reality of Science Studies. Harvard University Press, 24--79. Retrieved from http://www.amazon.ca/exec/obidos/redirect?tag=citeulike09-20&path=ASIN/067465336X

[70]

Bruno Latour. 2004. Why Has Critique Run out of Steam? From Matters of Fact to Matters of Concern. Crit. Inq. 30, 2 (January 2004), 225--248.

[71]

Antti Latvala, Ralf Kuja-Halkola, Catarina Almqvist, Henrik Larsson, and Paul Lichtenstein. 2015. A Longitudinal Study of Resting Heart Rate and Violent Criminality in More Than 700 000 Men. JAMA Psychiatry 72, 10 (October 2015), 971--978.

[72]

John Law. 2004. After method: mess in social science research. Routledge, London?; New York.

[73]

Lucian Leahu, Steve Schwenk, and Phoebe Sengers. 2008. Subjective Objectivity: Negotiating Emotional Meaning. In Proceedings of the 7th ACM Conference on Designing Interactive Systems (DIS'08) (DIS '08), 425--434.

Digital Library

[74]

Lucian Leahu and Phoebe Sengers. 2014. Freaky: performing hybrid human-machine emotion. In Proceedings of the 2014 conference on Designing interactive systems (DIS'14), 607--616.

Digital Library

[75]

Lucian Leahu, Phoebe Sengers, and Michael Mateas. 2008. Interactionist AI and the Promise of Ubicomp, or, How to Put Your Box in the World Without Putting the World in Your Box. In Proceedings of the 10th International Conference on Ubiquitous Computing (UbiComp '08), 134--143.

Digital Library

[76]

Ben Lerchin. Retrieved June 22, 2018 from http://benlerchin.com/

[77]

Robert Leston. 2015. Deleuze, Haraway, and the Radical Democracy of Desire. Configurations 23, 3 (October 2015), 355--376.

[78]

Silvia Lindtner and Seyram Avle. 2017. Tinkering with Governance: Technopolitics and the Economization of Citizenship. Proc ACM Hum-Comput Interact 1, CSCW (December 2017), 70:1--70:18.

Digital Library

[79]

Fannie Liu, Laura Dabbish, and Geoff Kaufman. 2017. Supporting Social Interactions with an Expressive Heart Rate Sharing Application. Proc ACM Interact Mob Wearable Ubiquitous Technol 1, 3 (September 2017), 77:1--77:26.

Digital Library

[80]

Fannie Liu, Laura Dabbish, and Geoff Kaufman. 2017. Can Biosignals be Expressive?: How Visualizations Affect Impression Formation from Shared Brain Activity. Proc. ACM Hum.-Comput. Interact. 1, CSCW (December 2017), 1--21.

Digital Library

[81]

Deborah Lupton. 2012. M-health and health promotion: The digital cyborg and surveillance society. Soc. Theory Health 10, 3 (August 2012), 229--244.

[82]

Deborah Lupton. 2016. The quantified self: a sociology of self-tracking. Polity, Cambridge, UK.

Digital Library

[83]

John MacCallum and Teoma Naccarato. 2015. The Impossibility of Control: Real-time Negotiations with the Heart. In Proceedings of the Conference on Electronic Visualisation and the Arts (EVA '15), 184--191.

Digital Library

[84]

Emily Martinez and Ben Lerchin. 2018. Queer AI. Retrieved June 22, 2018 from http://somethingnothing.me/queerai.html

[85]

Emily Martinez and Ben Lerchin. 2018. Queer AI Manifesto. Retrieved June 22, 2018 from http://www.queer.ai

[86]

Brian Massumi. 1995. The Autonomy of Affect. Cult. Crit. 31 (1995), 83--109.

[87]

D. McDuff, S. Gontarek, and R. Picard. 2014. Remote measurement of cognitive stress via heart rate variability. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2957--2960.

[88]

Nick Merrill and Coye Cheshire. 2016. Habits of the Heart(Rate): Social Interpretation of Biosignals in Two Interaction Contexts. In Proceedings of the 19th International Conference on Supporting Group Work (GROUP '16), 31--38.

Digital Library

[89]

Nick Merrill and Coye Cheshire. 2017. Trust Your Heart: Assessing Cooperation and Trust with Biosignals in Computer-Mediated Interactions. 2--12.

Digital Library

[90]

Jill Miller. Conflict Sculptures. Retrieved March 28, 2018 from https://www.jillmiller.net/

[91]

Ine Mols, Elise van den Hoven, and Berry Eggen. 2016. Technologies for Everyday Life Reflection: Illustrating a Design Space. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16), 53--61.

Digital Library

[92]

Phoebe Moore and Andrew Robinson. 2016. The quantified self: What counts in the neoliberal workplace, The quantified self: What counts in the neoliberal workplace. New Media Soc. 18, 11 (December 2016), 2774--2792.

[93]

Teoma Jackson Naccarato and John MacCallum. 2016. From representation to relationality: Bodies, biosensors and mediated environments. J. Dance Somat. Pract. 8, 1 (June 2016), 57--72.

[94]

Dawn Nafus. 2014. Stuck data, dead data, and disloyal data: the stops and starts in making numbers into social practices. Distinktion J. Soc. Theory 15, 2 (May 2014), 208--222.

[95]

Dawn Nafus. 2016. Introduction. In Quantified: Biosensing Technologies in Everyday Life, Dawn Nafus (ed.). MIT Press.

[96]

Dawn Nafus and Jamie Sherman. 2014. Big Data, Big Questions| This One Does Not Go Up To 11: The Quantified Self Movement as an Alternative Big Data Practice. Int. J. Commun. 8, 0 (June 2014), 11.

[97]

Gina Neff and Dawn Nafus. 2016. Self-tracking. MIT Press.

Digital Library

[98]

Safiya Umoja Noble and Sarah T. Roberts. 2016. Through Google-Colored Glass(es): Design, Emotion, Class, and Wearables as Commodity and Control. Media Stud. Publ. (2016).

[99]

A. Osman, J. Turcot, and R. E. Kaliouby. 2015. Supervised learning approach to remote heart rate estimation from facial videos. In 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 1--6.

[100]

Brian Parkinson. 2015. Emotions in Interpersonal Life. In The Oxford Handbook of Affective Computing, Rafael Calvo, Sidney D'Mello, Jonathan Gratch and Arvid Kappas (eds.). Oxford University Press. Retrieved May 18, 2016 from http://www.oxfordhandbooks.com/view/10.1093/oxfordhb/9780199942237.001.0001/oxfordhb-9780199942237-e-023

[101]

Rosalind W. Picard and Jocelyn Scheirer. 2001. The Galvactivator: A glove that senses and communicates skin conductivity. In Proceedings from the 9th International Conference on Human-Computer Interaction, 1538--1542.

[102]

James Pierce, Phoebe Sengers, Tad Hirsch, Tom Jenkins, William Gaver, and Carl DiSalvo. 2015. Expanding and Refining Design and Criticality in HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2083--2092.

Digital Library

[103]

Laura R. Pina, Sang-Wha Sien, Teresa Ward, Jason C. Yip, Sean A. Munson, James Fogarty, and Julie A. Kientz. 2017. From Personal Informatics to Family Informatics: Understanding Family Practices Around Health Monitoring. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 2300--2315.

Digital Library

[104]

Paul Rabinow and Nikolas Rose. 2006. Biopower Today. BioSocieties 1, 2 (June 2006), 195--217.

[105]

Andrew G Reece and Christopher M Danforth. 2017. Instagram photos reveal predictive markers of depression. EPJ Data Sci. 6, 1 (December 2017).

[106]

Nikolas Rose. 2001. The Politics of Life Itself. Theory Cult. Soc. 18, 6 (December 2001), 1--30.

[107]

Nikolas Rose. 2008. The value of life: somatic ethics & the spirit of biocapital. Daedalus 137, 1 (January 2008), 36--48.

[108]

Minna Ruckenstein and Natasha Dow Schüll. 2017. The Datafication of Health. Annu. Rev. Anthropol. 46, 1 (October 2017), 261--278.

[109]

Kimiko Ryokai, Elena Duran, Dina Bseiso, Noura Howell, and Ji Won Jun. 2017. Celebrating Laughter: Capturing and Sharing Tangible Representations of Laughter. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS '17 Companion), 202--206.

Digital Library

[110]

Kimiko Ryokai, Elena Duran, Noura Howell, Jonathan Gillick, and David Bamman. 2018. Capturing, Representing, and Interacting with Laughter. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

[111]

Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the Body!: Designing a Mobile Stress Management Application Encouraging Personal Reflection. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10), 47--56.

Digital Library

[112]

Thecla Schiphorst. 2011. Self-evidence: Applying Somatic Connoisseurship to Experience Design. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11), 145--160.

Digital Library

[113]

Natasha Dow Schüll. 2016. Data for life: Wearable technology and the design of self-care. BioSocieties 11, 3 (September 2016), 317--333.

[114]

Natasha Dow Schüll. 2017. Algorithmic Selves: Sensory Technology and the Mediation of Sentience. Retrieved December 14, 2017 from http://cstms.berkeley.edu/current-events/datasense-sensor-technology-and-the-mediation-of-sentience/

[115]

Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph 'Jofish" Kaye. 2005. Reflective Design. In Proceedings of the 4th Decennial Conference on Critical Computing (CC '05), 49--58.

Digital Library

[116]

Phoebe Sengers, Kirsten Boehner, Simeon Warner, and Tom Jenkins. 2005. Evaluating Affector: Co-Interpreting What 'Works." In CHI 2005 Workshop on Innovative Approaches to Evaluating Affective Interfaces.

[117]

Phoebe Sengers and Bill Gaver. 2006. Staying Open to Interpretation: Engaging Multiple Meanings in Design and Evaluation. In Proceedings of the 6th Conference on Designing Interactive Systems (DIS'06) (DIS '06), 99--108.

Digital Library

[118]

Sensoree (Collective), Kristin Neidlinger, Scott Minneman, Anthony Asterisk, and Erik Johnson. GER Mood Sweater. Retrieved March 21, 2016 from http://sensoree.com/artifacts/ger-mood-sweater/

[119]

Sensoree (Collective), Kristin Neidlinger, Grant Patterson, Nathan Tucker, and Machinic (Collective). NEUROTiQ. Retrieved March 21, 2016 from http://sensoree.com/artifacts/neurotiq/

[120]

Tamar Sharon. 2017. Self-Tracking for Health and the Quantified Self: Re-Articulating Autonomy, Solidarity, and Authenticity in an Age of Personalized Healthcare. Philos. Technol. 30, 1 (March 2017), 93--121.

[121]

Tamar Sharon and Dorien Zandbergen. 2017. From data fetishism to quantifying selves: Self-tracking practices and the other values of data. New Media Soc. 19, 11 (November 2017), 1695--1709.

[122]

Jamie Sherman. 2015. How Theory Matters: Benjamin, Foucault, and Quantified Self-Oh My! EPIC. Retrieved May 2, 2017 from https://www.epicpeople.org/how-theory-matters/

[123]

Eric Shouse. 2005. Feeling, Emotion, Affect. MC J. J. Media Cult. 8, 6 (2005). Retrieved December 17, 2016 from http://journal.media-culture.org.au/0512/03-shouse.php

[124]

Samarth Singhal, Carman Neustaedter, Yee Loong Ooi, Alissa N. Antle, and Brendan Matkin. 2017. Flex-N-Feel: The Design and Evaluation of Emotive Gloves for Couples to Support Touch Over Distance. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 98--110.

Digital Library

[125]

Petr Slovák, Joris Janssen, and Geraldine Fitzpatrick. 2012. Understanding Heart Rate Sharing: Towards Unpacking Physiosocial Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 859--868.

Digital Library

[126]

Petr Slovák, Paul Tennent, Stuart Reeves, and Geraldine Fitzpatrick. 2014. Exploring skin conductance synchronisation in everyday interactions. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI'14), 511--520.

Digital Library

[127]

Jaime Snyder, Mark Matthews, Jacqueline Chien, Pamara F. Chang, Emily Sun, Saeed Abdullah, and Geri Gay. 2015. MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW'15), 143--153.

Digital Library

[128]

Anna Ståhl, Kristina Höök, Martin Svensson, Alex S. Taylor, and Marco Combetto. 2009. Experiencing the Affective Diary. Pers. Ubiquitous Comput 13, 5 (June 2009), 365--378.

Digital Library

[129]

Kathleen Stewart. 2007. Ordinary affects. Duke University Press, Durham, NC.

[130]

Lucille Alice Suchman. 2007. Human-machine reconfigurations: plans and situated actions (2nd ed ed.). Cambridge University Press, Cambridge?; New York.

[131]

Melanie Swan. 2012. Health 2050: The Realization of Personalized Medicine through Crowdsourcing, the Quantified Self, and the Participatory Biocitizen. J. Pers. Med. 2, 3 (September 2012), 93--118.

[132]

Jakob Tholander, Maria Normark, and Chiara Rossitto. 2012. Understanding Agency in Interaction Design Materials. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2499--2508.

Digital Library

[133]

Chris Till. 2014. Exercise as Labour: Quantified Self and the Transformation of Exercise into Labour. Societies 4, 3 (August 2014), 446--462.

[134]

Alice Truong. 2014. This Google Glass App Will Detect Your Emotions, Then Relay Them Back To Retailers. Fast Company. Retrieved June 24, 2018 from https://www.fastcompany.com/3027342/this-google-glass-app-will-detect-your-emotions-then-relay-them-back-to-retailers

[135]

Haris Tsirmpas and Panagiotis Fatouros. 2018. Feel. Berkeley, CA.

[136]

Anna Vallgårda, Laurens Boer, Vasiliki Tsaknaki, and Dag Svanaes. 2016. Material Programming: A New Interaction Design Practice. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems (DIS '16 Companion), 149--152.

Digital Library

[137]

Anna Vallgårda and Johan Redström. 2007. Computational Composites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07), 513--522.

Digital Library

[138]

Peter-Paul Verbeek. 2006. Materializing Morality: Design Ethics and Technological Mediation. Sci. Technol. Hum. Values 31, 3 (May 2006), 361--380.

[139]

Jo Vermeulen, Lindsay MacDonald, Johannes Schöning, Russell Beale, and Sheelagh Carpendale. 2016. Heartefacts: Augmenting Mobile Video Sharing Using Wrist-Worn Heart Rate Sensors. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16), 712--723.

Digital Library

[140]

Jay Vidyarthi, Bernhard E. Riecke, and Diane Gromala. 2012. Sonic Cradle: Designing for an Immersive Experience of Meditation by Connecting Respiration to Music. In Proceedings of the Designing Interactive Systems Conference (DIS '12), 408--417.

Digital Library

[141]

Chen Wang, Xintong Zhu, Erik Geelhoed, Ian Biscoe, Thomas Röggla, and Pablo Cesar. 2016. How Are We Connected? - Measuring Audience Galvanic Skin Response of Connected Performances: 33--42.

[142]

McKenzie Wark. 2013. The Revolution of Everyday Life. In The Spectacle of Disintegration (First edition). Verso, Brooklyn, New York, 49--60.

[143]

Stephen Wensveen, Kees Overbeeke, and Tom Djajadiningrat. 2000. Touch Me, Hit Me and I Know How You Feel: A Design Approach to Emotionally Rich Interaction. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '00), 48--52.

Digital Library

[144]

Danielle Wilde. 2010. Swing That Thing: Moving to Move. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10), 303--304.

Digital Library

[145]

Danielle Wilde, Thecla Schiphorst, and Sietske Klooster. 2011. Move to Design/Design to Move: A Conversation About Designing for the Body. interactions 18, 4 (July 2011), 22--27.

Digital Library

[146]

Langdon Winner. 1980. Do Artifacts Have Politics? Daedalus 109, 1 (1980), 121--136.

[147]

Anouk Wipprecht. 2014. Synapse. Retrieved July 28, 2016 from https://i.materialise.com/blog/wearable-tech-just-got-smarter-anouk-wipprechts-intel-edison-powered-3d-printed-synapse-dress-logs-your-mood/

[148]

Anouk Wipprecht. Spider Dress 2.0. Retrieved December 26, 2015 from http://www.anoukwipprecht.nl/

[149]

Richmond Y. Wong, Nick Merrill, and John Chuang. 2018. When BCIs have APIs: Design Fictions of Brain-Computer Interface Adoption. In Designing Interactive Systems.

Digital Library

[150]

Richmond Y. Wong, Ellen Van Wyk, and James Pierce. 2017. Real-Fictional Entanglements: Using Science Fiction and Design Fiction to Interrogate Sensing Technologies. 567--579.

Digital Library

[151]

Geoffrey Woo. Biohacking in Silicon Valley ft. Melia Robinson. Retrieved October 28, 2017 from https://www.youtube.com/watch?v=q9EmairJAXU

[152]

Geoffrey Woo. Biohacking for Self-Actualization ft. Serge Faguet. Retrieved October 28, 2017 from https://www.youtube.com/watch?v=mNb5rB5at78

[153]

Bin Yu, Mathias Funk, Jun Hu, and Loe Feijs. 2017. StressTree: A Metaphorical Visualization for Biofeedback-assisted Stress Management. In Designing Interactive Systems, 333--337.

Digital Library

[154]

2014. Microsoft Band 2 Advertisement. Retrieved August 25, 2017 from https://i.imgur.com/tiC9ufb.jpg

[155]

2014. Prosthetic Technologies of Being: Monarch. Social Body Lab. Retrieved March 30, 2018 from https://www2.ocadu.ca/research/socialbody/project/prosthetic-technologies-of-being

[156]

2017. Otsuka and Proteus® Announce the First U.S. FDA Approval of a Digital Medicine System: Abilify MyCite® (aripiprazole tablets with sensor) - Proteus Digital Health. Retrieved December 14, 2017 from http://www.proteus.com/press-releases/otsuka-and-proteus-announce-the-first-us-fda-approval-of-a-digital-medicine-system-abilify-mycite/

[157]

2018. PART 4: The Moodmetric ring stress measurement and understanding the data -. Retrieved March 28, 2018 from http://www.moodmetric.com/stress-measurement-data/

[158]

Leaf Urban: The evolution of well-being. Bellabeat. Retrieved March 30, 2018 from https://webshop.bellabeat.com/pages/leaf-urban

[159]

Microsoft Band. Retrieved March 30, 2018 from https://www.microsoft.com/en-us/band

[160]

Affectiva Developer Portal: Metrics. Retrieved May 2, 2017 from http://developer.affectiva.com/metrics/

[161]

Department of Homeland Security Future Attribute Screening Technology Mobile Module (FAST M2) Overview. Public intelligence. Retrieved March 1, 2018 from https://publicintelligence.net/dhs-future-attribute-screening-technology-mobile-module-fast-m2-overview/

[162]

Press Announcements - FDA approves pill with sensor that digitally tracks if patients have ingested their medication. Retrieved December 14, 2017 from https://www.fda.gov/NewsEvents/Newsroom/PressAnnouncements/ucm584933.htm

[163]

Microsoft Band 2. Retrieved January 11, 2016 from https://www.microsoft.com/microsoft-band/en-us/features

[164]

Feel. World's first Emotion Sensor & Well-being Advisor. Retrieved January 12, 2016 from http://www.myfeel.co/

[165]

Spire Mindfulness. Spire. Retrieved September 14, 2016 from http://www.spire.io

[166]

Spire Healthtag. Spire. Retrieved March 28, 2018 from https://spire.io/pages/healthtag

[167]

Feel: How it works. Retrieved March 22, 2018 from https://www.myfeel.co/how-it-works

[168]

Oura: The Smart Ring That Helps You Get More Restorative Sleep. Retrieved March 6, 2018 from https://ouraring.com/

[169]

Moodmetric: Simplest solution to measure stress and recovery. Retrieved March 6, 2018 from http://www.moodmetric.com/

[170]

Humanyze - People Analytics. Better Performance. Humanyze. Retrieved March 28, 2018 from https://www.humanyze.com/

[171]

lowdown focus. Muse: the brain sensing headband. Retrieved April 17, 2018 from http://www.choosemuse.com/lowdown-focus/

[172]

mood Archives. Quantified Self. Retrieved March 25, 2018 from http://quantifiedself.com/mood/

[173]

Big Health. Big Health. Retrieved March 28, 2018 from https://www.bighealth.com/

[174]

Affectiva. Retrieved from http://www.affectiva.com/

[175]

Spire. Spire. Retrieved September 19, 2017 from http://www.spire.io

[176]

E4 wristband. Empatica Store. Retrieved September 18, 2017 from https://store.empatica.com/products/e4-wristband

[177]

Hussein Chalayan and Intel take stress tracking accessories to Paris Fashion Week. Wareable. Retrieved August 25, 2017 from https://www.wareable.com/fashion/hussein-chalayan-paris-fashion-week-wearable-tech-889

[178]

The Algorithmic Justice League. Retrieved June 24, 2018 from https://www.ajlunited.org/

[179]

Mother: Sen.se. Retrieved December 14, 2017 from https://sen.se/store/mother/

[180]

Fitbit OneTM Wireless Activity + Sleep Tracker. Retrieved December 14, 2017 from http://www.fitbit.com/one

[181]

HAPIfork: Eat slowly, lose weight, feel great! Retrieved December 14, 2017 from https://www.hapi.com/product/hapifork

Cited By

Stepanova EHaynes ATurmo Vidal LChiossi FEl Ali AQuintero LLuft YCampo Woytuk NMayer S(2024)Envisioning Ubiquitous Biosignal Interaction with MultimediaProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701609(495-500)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701609
Reed CBenito ACaspe FMcPherson A(2024)Shifting Ambiguity, Collapsing Indeterminacy: Designing with Data as Baradian ApparatusACM Transactions on Computer-Human Interaction10.1145/368904331:6(1-41)Online publication date: 6-Dec-2024
https://dl.acm.org/doi/10.1145/3689043
Howell NHartsoe WAmin JNamani V(2024)Reflective Design for Informal Participatory Algorithm Auditing: A Case Study with Emotion AIProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685411(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685411
Show More Cited By

Index Terms

Emotional Biosensing: Exploring Critical Alternatives
1. Human-centered computing
  1. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Tensions of Data-Driven Reflection: A Case Study of Real-Time Emotional Biosensing
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Biosensing displays, increasingly enrolled in emotional reflection, promise authoritative insight by presenting users' emotions as discrete categories. Rather than machines interpreting emotions, we sought to explore an alternative with emotional ...
Biosignals as Social Cues: Ambiguity and Emotional Interpretation in Social Displays of Skin Conductance
DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

This paper explores the social meaning of clothing-based displays of biosignals. How do friends make sense of their own and each other's skin conductance display in the context of a conversation? We developed Hint, a dynamic thermochromic t-shirt whose ...
Understanding Digitally-Mediated Empathy: An Exploration of Visual, Narrative, and Biosensory Informational Cues
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Digitally sharing our experiences engages a process of empathy shaped by available informational cues. Biosensory data is one informative cue, but the relationship to empathy is underexplored. In this study, we investigate this process by showing a ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 2, Issue CSCW

November 2018

4104 pages

EISSN:2573-0142

DOI:10.1145/3290265

Editors:
Karrie Karahalios
University of Illinois & Adobe
,
Andrés Monroy-Hernández
Snap Inc.
,
Airi Lampinen
Stockholm University
,
Geraldine Fitzpatrick
Vienna University of Technology

Issue’s Table of Contents

Copyright © 2018 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2018

Published in PACMHCI Volume 2, Issue CSCW

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
1,060
Total Downloads

Downloads (Last 12 months)153
Downloads (Last 6 weeks)12

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Stepanova EHaynes ATurmo Vidal LChiossi FEl Ali AQuintero LLuft YCampo Woytuk NMayer S(2024)Envisioning Ubiquitous Biosignal Interaction with MultimediaProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701609(495-500)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701609
Reed CBenito ACaspe FMcPherson A(2024)Shifting Ambiguity, Collapsing Indeterminacy: Designing with Data as Baradian ApparatusACM Transactions on Computer-Human Interaction10.1145/368904331:6(1-41)Online publication date: 6-Dec-2024
https://dl.acm.org/doi/10.1145/3689043
Howell NHartsoe WAmin JNamani V(2024)Reflective Design for Informal Participatory Algorithm Auditing: A Case Study with Emotion AIProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685411(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685411
Andalibi NStark LMcDuff DPicard RGratch JHowell NFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)What should we do with Emotion AI? Towards an Agenda for the Next 30 YearsCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3689135(98-101)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3689135
You CChen HChen PLai WYuan CBi N(2024)Toward Understanding the Impact of Visualized Focus Levels in Virtual Reality on User Presence and ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/36765278:MHCI(1-30)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676527
Jones LGrip GKennedy ENabil S(2024)A Year of Interaction Around Town: Gathering Traces with an Interactive Knitting Machine and Community Stitch MarkersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660736(1116-1133)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660736
Janicki SRiggs AHowell NSullivan AParvin NCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Sensing Bodies: Engaging Postcolonial Histories through More-than-Human InteractionsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633389(1-15)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633389
Perovich LZizzi NCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Feeling Data through Movement: Designing Somatic Data Experiences with DancersProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633371(1-11)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633371
Feng YGao MLi CYao ZMi H(2024)ExBreath: Explore the Expressive Breath System as Nonverbal Signs towards Semi-unintentional ExpressionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650870(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650870
Branford J(2024)An (E)Affective Bind: Situated Affectivity and the Prospect of Affect RecognitionIEEE Transactions on Affective Computing10.1109/TAFFC.2023.328106915:1(18-29)Online publication date: Jan-2024
https://doi.org/10.1109/TAFFC.2023.3281069
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents