Research Interests:
ABSTRACT—Most studies investigating the recognition of facial expressions have focused on static displays of in-tense expressions. Consequently, researchers may have underestimated the importance of motion in deciphering the subtle... more
ABSTRACT—Most studies investigating the recognition of facial expressions have focused on static displays of in-tense expressions. Consequently, researchers may have underestimated the importance of motion in deciphering the subtle expressions that permeate real-life situations. In two experiments, we examined the effect of motion on perception of subtle facial expressions and tested the hy-potheses that motion improves affect judgment by (a) providing denser sampling of expressions, (b) providing dynamic information, (c) facilitating configural process-ing, and (d) enhancing the perception of change. Partic-ipants viewed faces depicting subtle facial expressions in four modes (single-static, multi-static, dynamic, and first-last). Experiment 1 demonstrated a robust effect of motion and suggested that this effect was due to the dynamic
Pain is typically assessed by patient self-report. Self-reported pain, however, is difficult to interpret and may be impaired or in some circumstances (i.e., young children and the severely ill) not even possible. To circumvent these... more
Pain is typically assessed by patient self-report. Self-reported pain, however, is difficult to interpret and may be impaired or in some circumstances (i.e., young children and the severely ill) not even possible. To circumvent these problems behavioral scientists have identified reliable and valid facial indicators of pain. Hitherto, these methods have required manual measurement by highly skilled human observers. In this paper we explore an approach for automatically recognizing acute pain without the need for human observers. Specifically, our study was restricted to automatically detecting pain in adult patients with rotator cuff injuries. The system employed video input of the patients as they moved their affected and unaffected shoulder. Two types of ground truth were considered. Sequencelevel ground truth consisted of Likert-type ratings by skilled observers. Frame-level ground truth was calculated from presence/absence and intensity of facial actions previously associated wi...
The Search for Mediating and Moderating Effects in Psychological Research on Urban Society
Background Mobile health (mHealth) systems that support self-management can improve medical, functional, and psychosocial outcomes for individuals with disabilities and chronic conditions. The mHealth systems can potentially be expanded... more
Background Mobile health (mHealth) systems that support self-management can improve medical, functional, and psychosocial outcomes for individuals with disabilities and chronic conditions. The mHealth systems can potentially be expanded to support community integration. Objective The purposes of this study were to (1) partner with a community-based organization that supports community integration of individuals with disabilities; (2) identify software requirements needed to support community participation; and (3) iteratively refine an existing mHealth application to include new requirements. Methods Community Living and Support Services (CLASS), a nonprofit organization that serves individuals with disabilities in Pittsburgh, Pennsylvania, was identified as the focus group for this study. Key stakeholders within the Community Partners Program at CLASS proposed design requirements for an existing mHealth application, Interactive Mobile Health and Rehabilitation (iMHere) 2.0, that ha...
Research Interests:
I EMOTION ELICITATION 1. Emotion Elicitation Using Films 2. The International Affective Picture System (IAPS) in the Study of Emotion and Attention 3. The Directed Facial Action Task: Emotional Responses without Appraisal 4. Emotional... more
I EMOTION ELICITATION 1. Emotion Elicitation Using Films 2. The International Affective Picture System (IAPS) in the Study of Emotion and Attention 3. The Directed Facial Action Task: Emotional Responses without Appraisal 4. Emotional Behaviors As Emotional Stimuli 5. Probing Unconscious Emotional Processes: On Becoming a Successful Masketeer 6. Social Psychological Methods of Emotion Elicitation 7. Emotion Elicitation Using Dyadic Interaction Tasks 8. Combining Music with Thought to Change Mood 9. Emotion Elicited by Primary Reinforcers, and Following Stimulus-Reinforcement Association Learning 10. Emotion Elicitation with Neurological Patients II EMOTION ASSESSMENT 11. Assessing Positive and Negative via Self-Report 12. The Information-Processing Approach to Emotion Research 13. Observer-Based Measurement of Facial Expression with the Facial Action Coding System 14. Use of Automated Facial Image Analysis for Measurement of Emotion Expression 15. Measuring Emotion-Related Vocal Acoustics 16. The Specific Affect Coding System (SPAFF) 17. Continuous Measurement of Emotion: The Affect Rating Dial 18. Assessing Understanding and Appraisals During Emotional Experience in Everyday Life Situations 19. The Time Sampling Diary (TSD) of Emotional Experience in Everyday Life Situations 20. Methodological Considerations in the Study of Emotion Across Cultures 21. Considerations in Studying Emotion in Infants and Children 22. Conceptual, Theoretical, and Methodological Issues in Inferring Subjective Emotion Experience: Recommendations for Researchers III METHODS FOR UNDERSTANDING THE BIOLOGICAL BASES OF EMOTION 23. Studying Emotion in Animals: Methods, Materials, and Training 24. The Psychophysiological Laboratory 25. Investigating Human Emotion With Lesions and Intracranial Recording 26. Functional Magnetic Resonance Imaging and the Study of Emotion
Research Interests:
Research Interests:
Abstract 1. This chapter reviews the recent effort to examine, characterize, and corroborate actual cases in which recollections of allegedly forgotten sexual abuse have been reported. The authors' approach draws on cognitive... more
Abstract 1. This chapter reviews the recent effort to examine, characterize, and corroborate actual cases in which recollections of allegedly forgotten sexual abuse have been reported. The authors' approach draws on cognitive principles and uses as much methodological ...
Research Interests:
Facial attractiveness is associated with a variety of positive social characteristics including trustworthiness. Variations in smiling, such as the appearance of the Duchenne marker and increased intensity of expression, have likewise... more
Facial attractiveness is associated with a variety of positive social characteristics including trustworthiness. Variations in smiling, such as the appearance of the Duchenne marker and increased intensity of expression, have likewise been linked with positive judgments of trustworthiness. The study investigated the interaction of the effects of models' attractiveness and their smiling intensity on impressions of perceived trustworthiness. Participants rated the attractiveness and expressivity of neutral, low intensity, and high intensity smiling images of 45 women models. These images were also presented to a second group of participants who rated trustworthiness. Repeated measures analysis of covariance of the effects of attractiveness and manipulated smile intensity on trustworthiness indicated a main effect for smile intensity: increased smile intensity was associated with greater trustworthiness. Attractiveness also contributed to rated trustworthiness independently of smil...
Research Interests:
Research Interests:
Research Interests:
Research Interests:
Research Interests:
ABSTRACT—Most studies investigating the recognition,of facial expressions,have,focused on static displays of in- tense expressions. Consequently, researchers may have underestimated,the importance,of motion,in deciphering the subtle... more
ABSTRACT—Most studies investigating the recognition,of facial expressions,have,focused on static displays of in- tense expressions. Consequently, researchers may have underestimated,the importance,of motion,in deciphering the subtle expressions thatpermeate,real-life situations.In two experiments, we examined the effect of motion on perception,of subtle facial expressions and tested the hy- potheses,that motion,improves,affect judgment,by (a) providing denser sampling of expressions, (b) providing dynamic information, (c) facilitating configural
Research Interests:
Automatically recognizing pain from video is a very useful application as it has the potential to alert carers to patients that are in discomfort who would otherwise not be able to communicate such emotion (i.e young children, patients in... more
Automatically recognizing pain from video is a very useful application as it has the potential to alert carers to patients that are in discomfort who would otherwise not be able to communicate such emotion (i.e young children, patients in postoperative care etc.). In previous work [1], a "pain-no pain" system was developed which used an AAM-SVM approach to good effect. However, as with any task involving a large amount of video data, there are memory constraints that need to be adhered to and in the previous work this was compressing the temporal signal using K-means clustering in the training phase. In visual speech recognition, it is well known that the dynamics of the signal play a vital role in recognition. As pain recognition is very similar to the task of visual speech recognition (i.e. recognising visual facial actions), it is our belief that compressing the temporal signal reduces the likelihood of accurately recognising pain. In this paper, we show that by compres...
Research Interests:
Research Interests:
Although controversy surrounds the relative authenticity of discontinuous versus continuous memories of childhood sexual abuse (CSA), little is known about whether such memories differ in their likelihood of corroborative evidence.... more
Although controversy surrounds the relative authenticity of discontinuous versus continuous memories of childhood sexual abuse (CSA), little is known about whether such memories differ in their likelihood of corroborative evidence. Individuals reporting CSA memories were interviewed, and two independent raters attempted to find corroborative information for the allegations. Continuous CSA memories and discontinuous memories that were unexpectedly recalled outside therapy were more likely to be corroborated than anticipated discontinuous memories recovered in therapy. Evidence that suggestion during therapy possibly mediates these differences comes from the additional finding that individuals who recalled the memories outside therapy were markedly more surprised at the existence of their memories than were individuals who initially recalled the memories in therapy. These results indicate that discontinuous CSA memories spontaneously retrieved outside of therapy may be accurate, while...
Research Interests:
Research Interests:
Research Interests: Machine Learning, Image Analysis, Support Vector Machines, Facial expression, Rotator cuff, and 9 moreSupport vector machine, Validity and Reliability, Design and Development, Problem Behavior, Young Children, Ground Truth, Electrical And Electronic Engineering, Active Appearance Models, and Video Recording
Research Interests:
Research Interests:
During conversation, women tend to nod their heads more frequently and more vigorously than men. An individual speaking with a woman tends to nod his or her head more than when speaking with a man. Is this due to social expectation or due... more
During conversation, women tend to nod their heads more frequently and more vigorously than men. An individual speaking with a woman tends to nod his or her head more than when speaking with a man. Is this due to social expectation or due to coupled motion dynamics between the speakers? We present a novel methodology that allows us to randomly
Research Interests: Psychology, Cognitive Science, Experimental Psychology, Perception, Interpersonal Communication, and 23 moreNonverbal Communication, Motion perception, Speech Communication, Social Perception, Observation, Humans, Models, Computer Simulation, Movement, Human Body, Videoconferencing, Evaluation methods, Motion Tracking, Female, Male, Biological Motion, Perception and Action, Interpersonal Relations, Motion, Computer User Interface Design, Experimental, Top Down, and Reference Values
Research Interests:
Research Interests:
Research Interests:
Research Interests: Psychology, Cognitive Science, Experimental Psychology, Perception, Interpersonal Communication, and 23 moreNonverbal Communication, Motion perception, Speech Communication, Social Perception, Observation, Humans, Models, Computer Simulation, Movement, Human Body, Videoconferencing, Evaluation methods, Motion Tracking, Female, Male, Biological Motion, Perception and Action, Interpersonal Relations, Motion, Computer User Interface Design, Experimental, Top Down, and Reference Values
Research Interests:
Research Interests:
Research Interests:
Facial expression has been a focus of emotion research for over a hundred years (Darwin, 1872/1998). It is central to several leading theories of emotion (Ekman, 1992; Izard, 1977; Tomkins, 1962) and has been the focus of at times heated... more
Facial expression has been a focus of emotion research for over a hundred years (Darwin, 1872/1998). It is central to several leading theories of emotion (Ekman, 1992; Izard, 1977; Tomkins, 1962) and has been the focus of at times heated debate about issues in emotion science (Ekman, 1973, 1993; Fridlund, 1992; Russell, 1994). Facial expression figures prominently in research on almost every aspect of emotion, including psychophysiology (Levenson, Ekman, & Friesen, 1990), neural bases (Calder et al., 1996; Davidson, Ekman, ...
BACKGROUND People communicate not only by speech and written language but also by their tone of voice, the way they stand or move and their patterns of gaze. These modes of nonverbal behavior communicate emotion and often are referred to... more
BACKGROUND People communicate not only by speech and written language but also by their tone of voice, the way they stand or move and their patterns of gaze. These modes of nonverbal behavior communicate emotion and often are referred to as paralinguistic because they modify, substitute for, and improve the understanding of spoken communication. Of the various modes of nonverbal communication, the human face is especially important. Facial expressions can indicate emotion and pain, regulate social ...
Research Interests:
Facial expression has been a focus of emotion research for over a hundred years (Darwin, 1872/1998). It is central to several leading theories of emotion (Ekman, 1992; Izard, 1977; Tomkins, 1962) and has been the focus of at times heated... more
Facial expression has been a focus of emotion research for over a hundred years (Darwin, 1872/1998). It is central to several leading theories of emotion (Ekman, 1992; Izard, 1977; Tomkins, 1962) and has been the focus of at times heated debate about issues in emotion science (Ekman, 1973, 1993; Fridlund, 1992; Russell, 1994). Facial expression figures prominently in research on almost every aspect of emotion, including psychophysiology (Levenson, Ekman, & Friesen, 1990), neural bases (Calder et al., 1996; Davidson, Ekman, ...
Research Interests:
In this paper, we present results on experiments employing active appearance model (AAM) derived facial representations, for the task of facial action recognition. Experimental results demonstrate the benefit of AAM-derived... more
In this paper, we present results on experiments employing active appearance model (AAM) derived facial representations, for the task of facial action recognition. Experimental results demonstrate the benefit of AAM-derived representations on a spontaneous AU database containing" real-world" variation. Additionally, we explore a number of normalization methods for these representations which increase facial action recognition performance
Research Interests:
Most studies investigating the recognition of facial expressions have focused on static displays of intense expressions. Consequently, researchers may have underestimated the importance of motion in deciphering the subtle expressions that... more
Most studies investigating the recognition of facial expressions have focused on static displays of intense expressions. Consequently, researchers may have underestimated the importance of motion in deciphering the subtle expressions that permeate real-life situations. In two experiments, we examined the effect of motion on perception of subtle facial expressions and tested the hypotheses that motion improves affect judgment by (a) providing denser sampling of expressions,(b) providing dynamic information,(c) facilitating ...
Research Interests:
Past research on automatic facial expression analysis has focused mostly on the recognition of prototypic expressions of discrete emotions rather than on the analysis of dynamic changes over time, although the importance of temporal... more
Past research on automatic facial expression analysis has focused mostly on the recognition of prototypic expressions of discrete emotions rather than on the analysis of dynamic changes over time, although the importance of temporal dynamics of facial expressions for interpretation of the observed facial behavior has been acknowledged for over 20 years. For instance, it has been shown that the temporal dynamics of spontaneous and volitional smiles are fundamentally different from each other. In this work, we argue ...