Showing 1–14 of 14 results for author: Yanagisawa, H

Modeling arousal potential of epistemic emotions using Bayesian information gain: Inquiry cycle driven by free energy fluctuations

Authors: Hideyoshi Yanagisawa, Shimon Honda

Abstract: Epistemic emotions, such as curiosity and interest, drive the inquiry process. This study proposes a novel formulation of epistemic emotions such as curiosity and interest using two types of information gain generated by the principle of free energy minimization: Kullback-Leibler divergence(KLD) from Bayesian posterior to prior, which represents free energy reduction in recognition, and Bayesian s… ▽ More Epistemic emotions, such as curiosity and interest, drive the inquiry process. This study proposes a novel formulation of epistemic emotions such as curiosity and interest using two types of information gain generated by the principle of free energy minimization: Kullback-Leibler divergence(KLD) from Bayesian posterior to prior, which represents free energy reduction in recognition, and Bayesian surprise (BS), which represents the expected information gain by Bayesian prior update. By applying a Gaussian generative model with an additional uniform likelihood, we found that KLD and BS form an upward-convex function of surprise (minimized free energy and prediction error), similar to Berlyne's arousal potential functions, or the Wundt curve. We consider that the alternate maximization of BS and KLD generates an ideal inquiry cycle to approach the optimal arousal level with fluctuations in surprise, and that curiosity and interest drive to facilitate the cyclic process. We exhaustively analyzed the effects of prediction uncertainty (prior variance) and observation uncertainty (likelihood variance) on the peaks of the information gain function as optimal surprises. The results show that greater prediction uncertainty, meaning an open-minded attitude, and less observational uncertainty, meaning precise observation with attention, are expected to provide greater information gains through a greater range of exploration. The proposed mathematical framework unifies the free energy principle of the brain and the arousal potential theory to explain the Wundt curve as an information gain function and suggests an ideal inquiry process driven by epistemic emotions. △ Less

Submitted 13 December, 2023; originally announced January 2024.

Predictive Wand: a mathematical interface design for operations with delays

Authors: Masaki Isono, Hideyoshi Yanagisawa

Abstract: Action-feedback delay during operation reduces both task performance and sense of agency (SoA). In this study, using information-theoretic free energy, we formalized a novel mathematical model for explaining the influence of delay on both task performance and SoA in continuous operations. Based on the mathematical model, we propose a novel interface design called Predictive Wand for predicting fut… ▽ More Action-feedback delay during operation reduces both task performance and sense of agency (SoA). In this study, using information-theoretic free energy, we formalized a novel mathematical model for explaining the influence of delay on both task performance and SoA in continuous operations. Based on the mathematical model, we propose a novel interface design called Predictive Wand for predicting future outcomes to prevent task performance and SoA degradation resulting from response delays. Model-based simulations and operational experiments with participants confirmed that operational delay considerably reduces both task performance and SoA. Furthermore, the proposed Predictive Wand mitigates these problems. Our findings support the model-based interface design for continuous operations with delay to prevent task performance and SoA degradation. △ Less

Submitted 2 May, 2023; originally announced May 2023.

Journal ref: Journal of Mathematical Psychology, 120-121, 102859

Modeling the sense of presence of remote participants in hybrid communication and its application to the design of avatar robot behavior

Authors: Takuma Miyaguchi, Hideyoshi Yanagisawa

Abstract: We formulated the sense of the presence of a remote participant in hybrid communication using a Bayesian framework. We also applied the knowledge gained from the simulation with the Bayesian model to the avatar robot's intervention behavior and encouraged the local participants to speak by intervening in the remote participant's behavior using an avatar robot. We then modeled the influence of the… ▽ More We formulated the sense of the presence of a remote participant in hybrid communication using a Bayesian framework. We also applied the knowledge gained from the simulation with the Bayesian model to the avatar robot's intervention behavior and encouraged the local participants to speak by intervening in the remote participant's behavior using an avatar robot. We then modeled the influence of the avatar robot's behavior on the local participants' statements using an active inference framework that included the presence of a remote participant as a latent variable. Based on the simulation results, we designed the gaze behavior of an avatar robot. Finally, we examined the effectiveness of the designed gaze behavior of the avatar robot. The gaze behavior expressed more of the remote participant's attention and interest in local participants, but local participants expressed fewer opinions in the meeting tasks. The results suggest that gaze behavior increased the presence of the remote participant and discouraged the local participant from speaking in the context of the experimental task. We believe that presence has a sufficiently large influence on whether participants want to express an opinion. It is worth investigating the influence of presence and its control methods using Bayesian models. △ Less

Submitted 2 May, 2023; originally announced May 2023.

Proper Scoring Rules for Survival Analysis

Authors: Hiroki Yanagisawa

Abstract: Survival analysis is the problem of estimating probability distributions for future event times, which can be seen as a problem in uncertainty quantification. Although there are fundamental theories on strictly proper scoring rules for uncertainty quantification, little is known about those for survival analysis. In this paper, we investigate extensions of four major strictly proper scoring rules… ▽ More Survival analysis is the problem of estimating probability distributions for future event times, which can be seen as a problem in uncertainty quantification. Although there are fundamental theories on strictly proper scoring rules for uncertainty quantification, little is known about those for survival analysis. In this paper, we investigate extensions of four major strictly proper scoring rules for survival analysis and we prove that these extensions are proper under certain conditions, which arise from the discretization of the estimation of probability distributions. We also compare the estimation performances of these extended scoring rules by using real datasets, and the extensions of the logarithmic score and the Brier score performed the best. △ Less

Submitted 12 June, 2023; v1 submitted 30 April, 2023; originally announced May 2023.

Comments: Accepted at ICML 2023

Free energy model of emotional valence in dual-process perceptions

Authors: Hideyoshi Yanagisawa, Xiaoxiang Wu, Kazutaka Ueda, Takeo Kato

Abstract: An appropriate level of arousal induces positive emotions, and a high arousal potential may provoke negative emotions. To explain the effect of arousal on emotional valence, we propose a novel mathematical framework of arousal potential variations in the dual process of human cognition: automatic and controlled. A suitable mathematical formulation to explain the emotions in the dual process is sti… ▽ More An appropriate level of arousal induces positive emotions, and a high arousal potential may provoke negative emotions. To explain the effect of arousal on emotional valence, we propose a novel mathematical framework of arousal potential variations in the dual process of human cognition: automatic and controlled. A suitable mathematical formulation to explain the emotions in the dual process is still absent. Our model associates free energy with arousal potential and its variations to explain emotional valence. Decreasing and increasing free energy consequently induce positive and negative emotions, respectively. We formalize a transition from the automatic to the controlled process in the dual process as a change of Bayesian prior. Further, we model emotional valence using free energy increase (FI) when one tries changing one's Bayesian prior and its reduction (FR) when one succeeds in recognizing the same stimuli with a changed prior and define three emotions: "interest," "confusion," and "boredom" using the variations. The results of our mathematical analysis comparing various Gaussian model parameters reveals the following: 1) prediction error (PR) increases FR (representing "interest") when the first prior variance is greater than the second prior variance, 2) PR decreases FR when the first prior variance is less than the second prior variance, and 3) the distance between priors' means always increases FR. We also discuss the association of the outcomes with emotions in the controlled process. The proposed mathematical model provides a general framework for predicting and controlling emotional valence in the dual process that varies with viewpoint and stimuli, as well as for understanding the contradictions in the effects of arousal on the valence. △ Less

Submitted 21 October, 2022; v1 submitted 18 October, 2022; originally announced October 2022.

Journal ref: Neural Networks, 2023

Learning Bipedal Robot Locomotion from Human Movement

Authors: Michael Taylor, Sergey Bashkirov, Javier Fernandez Rico, Ike Toriyama, Naoyuki Miyada, Hideki Yanagisawa, Kensaku Ishizuka

Abstract: Teaching an anthropomorphic robot from human example offers the opportunity to impart humanlike qualities on its movement. In this work we present a reinforcement learning based method for teaching a real world bipedal robot to perform movements directly from human motion capture data. Our method seamlessly transitions from training in a simulation environment to executing on a physical robot with… ▽ More Teaching an anthropomorphic robot from human example offers the opportunity to impart humanlike qualities on its movement. In this work we present a reinforcement learning based method for teaching a real world bipedal robot to perform movements directly from human motion capture data. Our method seamlessly transitions from training in a simulation environment to executing on a physical robot without requiring any real world training iterations or offline steps. To overcome the disparity in joint configurations between the robot and the motion capture actor, our method incorporates motion re-targeting into the training process. Domain randomization techniques are used to compensate for the differences between the simulated and physical systems. We demonstrate our method on an internally developed humanoid robot with movements ranging from a dynamic walk cycle to complex balancing and waving. Our controller preserves the style imparted by the motion capture data and exhibits graceful failure modes resulting in safe operation for the robot. This work was performed for research purposes only. △ Less

Submitted 25 May, 2021; originally announced May 2021.

Comments: 8 pages, 12 figures, 1 table. Accepted to ICRA 2021. For supplementary video, see https://www.youtube.com/watch?v=k4oXPD4kVM0

Intrinsic motivation in virtual assistant interaction for fostering spontaneous interactions

Authors: Chang Li, Hideyoshi Yanagisawa

Abstract: With the growing utility of today's conversational virtual assistants, the importance of user motivation in human-AI interaction is becoming more obvious. However, previous studies in this and related fields, such as human-computer interaction and human-robot interaction, scarcely discussed intrinsic motivation and its affecting factors. Those studies either treated motivation as an inseparable co… ▽ More With the growing utility of today's conversational virtual assistants, the importance of user motivation in human-AI interaction is becoming more obvious. However, previous studies in this and related fields, such as human-computer interaction and human-robot interaction, scarcely discussed intrinsic motivation and its affecting factors. Those studies either treated motivation as an inseparable concept or focused on non-intrinsic motivation. The current study aims to cover intrinsic motivation by taking an affective-engineering approach. A novel motivation model is proposed, in which intrinsic motivation is affected by two factors that derive from user interactions with virtual assistants: expectation of capability and uncertainty. Experiments are conducted where these two factors are manipulated by making participants believe they are interacting with the smart speaker "Amazon Echo". Intrinsic motivation is measured both by using questionnaires and by covertly monitoring a five-minute free-choice period in the experimenter's absence, during which the participants could decide for themselves whether to interact with the virtual assistants. Results of the first experiment showed that high expectation engenders more intrinsically motivated interaction compared with low expectation. The results also suggested suppressive effects by uncertainty on intrinsic motivation, though we had not hypothesized before experiments. We then revised our hypothetical model of action selection accordingly and conducted a verification experiment of uncertainty's effects. Results of the verification experiment showed that reducing uncertainty encourages more interactions and causes the motivation behind these interactions to shift from non-intrinsic to intrinsic. △ Less

Submitted 13 October, 2020; originally announced October 2020.

Journal ref: PLoS ONE, 16(4), e0250326 (2021)

Information-Theoretic Free Energy as Emotion Potential: Emotional Valence as a Function of Complexity and Novelty

Authors: Hideyoshi Yanagisawa

Abstract: This study extends the mathematical model of emotion dimensions that we previously proposed (Yanagisawa, et al. 2019, Front Comput Neurosci) to consider perceived complexity as well as novelty, as a source of arousal potential. Berlyne's hedonic function of arousal potential (or the inverse U-shaped curve, the so-called Wundt curve) is assumed. We modeled the arousal potential as information conte… ▽ More This study extends the mathematical model of emotion dimensions that we previously proposed (Yanagisawa, et al. 2019, Front Comput Neurosci) to consider perceived complexity as well as novelty, as a source of arousal potential. Berlyne's hedonic function of arousal potential (or the inverse U-shaped curve, the so-called Wundt curve) is assumed. We modeled the arousal potential as information contents to be processed in the brain after sensory stimuli are perceived (or recognized), which we termed sensory surprisal. We mathematically demonstrated that sensory surprisal represents free energy, and it is equivalent to a summation of information gain (or information from novelty) and perceived complexity (or information from complexity), which are the collative variables forming the arousal potential. We demonstrated empirical evidence with visual stimuli (profile shapes of butterfly) supporting the hypothesis that the summation of perceived novelty and complexity shapes the inverse U-shaped beauty function. We discussed the potential of free energy as a mathematical principle explaining emotion initiators. △ Less

Submitted 23 March, 2020; originally announced March 2020.

Journal ref: Frontiers in Computational Neuroscience, 15, 107 (2021)

A methodology for multisensory product experience design using cross-modal effect: A case of SLR camera

Authors: Takuma Maki, Hideyoshi Yanagisawa

Abstract: Throughout the course of product experience, a user employs multiple senses, including vision, hearing, and touch. Previous cross-modal studies have shown that multiple senses interact with each other and change perceptions. In this paper, we propose a methodology for designing multisensory product experiences by applying cross-modal effect to simultaneous stimuli. In this methodology, we first ob… ▽ More Throughout the course of product experience, a user employs multiple senses, including vision, hearing, and touch. Previous cross-modal studies have shown that multiple senses interact with each other and change perceptions. In this paper, we propose a methodology for designing multisensory product experiences by applying cross-modal effect to simultaneous stimuli. In this methodology, we first obtain a model of the comprehensive cognitive structure of user's multisensory experience by applying Kansei modeling methodology and extract opportunities of cross-modal effect from the structure. Second, we conduct experiments on these cross-modal effects and formulate them by obtaining a regression curve through analysis. Finally, we find solutions to improve the product sensory experience from the regression model of the target cross-modal effects. We demonstrated the validity of the methodology with SLR cameras as a case study, which is a typical product with multisensory perceptions. △ Less

Submitted 7 July, 2019; originally announced July 2019.

Comments: Accepted to ICED2019

Effect of assistive method on the sense of fulfillment with agency: Modeling with flow and attribution theory

Authors: Dan Nanno, Hideyoshi Yanagisawa

Abstract: Several assistive technologies for users' operations have been recently developed. A user's sense of agency (SoA) decreases with increasing system assistance, possibly resulting in a decrease in the user's sense of fulfillment. This study aims to provide a design guideline for an assistive method to maintain and improve the sense of fulfillment with SoA. We propose a mathematical model describing… ▽ More Several assistive technologies for users' operations have been recently developed. A user's sense of agency (SoA) decreases with increasing system assistance, possibly resulting in a decrease in the user's sense of fulfillment. This study aims to provide a design guideline for an assistive method to maintain and improve the sense of fulfillment with SoA. We propose a mathematical model describing the mechanisms by which the assistive method affects SoA and SoA induces a sense of fulfillment. The experience in the flow state is assumed to be a sense of fulfillment. The assistance effect on the skill-challenge plane in flow theory is defined as an increase in skill and decrease in challenge. The factor that separates the two effects from attribution theory is the locus of causality, which is matched to the judgement of agency (JoA) from the two-step account of agency. We hypothesized that the assistance increases the perception of skill and sense of fulfillment is greater when the locus of causality is internal, rather than external. To verify this hypothesis, a game task experiment was conducted with assistance that varied with the ease of recognition. We hypothesized that a player's JoA is internal for hard-to-recognize assistance, resulting in a high sense of fulfillment. Experimental results supported this hypothesis. △ Less

Submitted 7 July, 2019; v1 submitted 3 July, 2019; originally announced July 2019.

Comments: PrePrint submitted to ASME

Quantitative evaluation of sense of discrepancy to operation response using event-related potential

Authors: Kazutaka Ueda, Yuki Sakai, Hideyoshi Yanagisawa

Abstract: This study aimed to develop a method to evaluate the sense of discrepancy to the operation response quantitatively. We examined the availability of event-related potential (P300), which is considered to reflect attention to stimulation, to evaluate the sense of discrepancy to the product response to the user's action. In the experiment using subjective evaluation and P300 to investigate the sense… ▽ More This study aimed to develop a method to evaluate the sense of discrepancy to the operation response quantitatively. We examined the availability of event-related potential (P300), which is considered to reflect attention to stimulation, to evaluate the sense of discrepancy to the product response to the user's action. In the experiment using subjective evaluation and P300 to investigate the sense of discrepancy due to the lack of operation response (sound and vibration) to the shutter operation of the mirrorless single-lens camera, it was confirmed that P300 amplitude corresponds to the degree of the subjective sense of discrepancy. Our results showed that the P300 amplitude could evaluate the sense of discrepancy to the operation response. △ Less

Submitted 3 July, 2019; originally announced July 2019.

Comments: Submitted to iDECON2019

Mathematical Model of Emotional Habituation to Novelty: Modeling with Bayesian Update and Information Theory

Authors: Takahiro Sekoguchi, Yuki Sakai, Hideyoshi Yanagisawa

Abstract: Novelty is an important factor of creativity in product design. Acceptance of novelty, however, depends on one's emotions. Yanagisawa, the last author, and his colleagues previously developed a mathematical model of emotional dimensions associated with novelty such as arousal (surprise) and valence. The model formalized arousal as Bayesian information gain and valence as a function of arousal base… ▽ More Novelty is an important factor of creativity in product design. Acceptance of novelty, however, depends on one's emotions. Yanagisawa, the last author, and his colleagues previously developed a mathematical model of emotional dimensions associated with novelty such as arousal (surprise) and valence. The model formalized arousal as Bayesian information gain and valence as a function of arousal based on Berlyne's arousal potential theory. One becomes accustomed to novelty by repeated exposure. This so-called habituation to novelty is important in the design of long-term product experience. We herein propose a mathematical model of habituation to novelty based on the emotional dimension model. We formalized the habituation as a decrement in information gain from a novel event through Bayesian update. We derived the information gained from the repeated exposure of a novel stimulus as a function of three parameters: initial prediction error, initial uncertainty, and noise of sensory stimulus. With the proposed model, we discovered an interaction effect of the initial prediction error and initial uncertainty on habituation. Furthermore, we demonstrate that a range of positive emotions on prediction errors shift toward becoming more novel by repeated exposure. △ Less

Submitted 7 July, 2019; v1 submitted 2 July, 2019; originally announced July 2019.

Comments: PrePrint submitted to IEEE SMC 2019

Sampler for Composition Ratio by Markov Chain Monte Carlo

Authors: Yachiko Obara, Tetsuro Morimura, Hiroki Yanagisawa

Abstract: Invention involves combination, or more precisely, ratios of composition. According to Thomas Edison, "Genius is one percent inspiration and 99 percent perspiration" is an example. In many situations, researchers and inventors already have a variety of data and manage to create something new by using it, but the key problem is how to select and combine knowledge. In this paper, we propose a new Ma… ▽ More Invention involves combination, or more precisely, ratios of composition. According to Thomas Edison, "Genius is one percent inspiration and 99 percent perspiration" is an example. In many situations, researchers and inventors already have a variety of data and manage to create something new by using it, but the key problem is how to select and combine knowledge. In this paper, we propose a new Markov chain Monte Carlo (MCMC) algorithm to generate composition ratios, nonnegative-integer-valued vectors with two properties: (i) the sum of the elements of each vector is constant, and (ii) only a small number of elements is nonzero. These constraints make it difficult for existing MCMC algorithms to sample composition ratios. The key points of our approach are (1) designing an appropriate target distribution by using a condition on the number of nonzero elements, and (2) changing values only between a certain pair of elements in each iteration. Through an experiment on creating a new cocktail, we show that the combination of the proposed method with supervised learning can solve a creative problem. △ Less

Submitted 28 June, 2019; v1 submitted 16 June, 2019; originally announced June 2019.

Comments: 8 pages, 4 figures

Strategy-Proof Approximation Algorithms for the Stable Marriage Problem with Ties and Incomplete Lists

Authors: Koki Hamada, Shuichi Miyazaki, Hiroki Yanagisawa

Abstract: In the stable marriage problem (SM), a mechanism that always outputs a stable matching is called a stable mechanism. One of the well-known stable mechanisms is the man-oriented Gale-Shapley algorithm (MGS). MGS has a good property that it is strategy-proof to the men's side, i.e., no man can obtain a better outcome by falsifying a preference list. We call such a mechanism a man-strategy-proof mech… ▽ More In the stable marriage problem (SM), a mechanism that always outputs a stable matching is called a stable mechanism. One of the well-known stable mechanisms is the man-oriented Gale-Shapley algorithm (MGS). MGS has a good property that it is strategy-proof to the men's side, i.e., no man can obtain a better outcome by falsifying a preference list. We call such a mechanism a man-strategy-proof mechanism. Unfortunately, MGS is not a woman-strategy-proof mechanism. Roth has shown that there is no stable mechanism that is simultaneously man-strategy-proof and woman-strategy-proof, which is known as Roth's impossibility theorem. In this paper, we extend these results to the stable marriage problem with ties and incomplete lists (SMTI). Since SMTI is an extension of SM, Roth's impossibility theorem takes over to SMTI. Therefore, we focus on the one-sided-strategy-proofness. In SMTI, one instance can have stable matchings of different sizes, and it is natural to consider the problem of finding a largest stable matching, known as MAX SMTI. Thus we incorporate the notion of approximation ratio used in the theory of approximation algorithms. We say that a stable-mechanism is $c$-approximate-stable mechanism if it always returns a stable matching of size at least $1/c$ of a largest one. We also consider a restricted variant of MAX SMTI, which we call MAX SMTI-1TM, where only men's lists can contain ties. Our results are summarized as follows: (i) MAX SMTI admits both a man-strategy-proof 2-approximate-stable mechanism and a woman-strategy-proof 2-approximate-stable mechanism. (ii) MAX SMTI-1TM admits a woman-strategy-proof 2-approximate-stable mechanism. (iii) MAX SMTI-1TM admits a man-strategy-proof 1.5-approximate-stable mechanism. All these results are tight in terms of approximation ratios. Also, all these strategy-proofness results apply for strategy-proofness against coalitions. △ Less

Submitted 14 February, 2019; originally announced February 2019.