The Web is becoming more and more a wide software framework on which each one can compose and use... more The Web is becoming more and more a wide software framework on which each one can compose and use contents, software applications and services. It can offer adequate computational resources to manage the complexity implied by the use of the five senses when involved in human machine interaction. The core of the paper describes how SOA (Service Oriented Architecture) can support multimodal interaction by pushing the I/O processing and reasoning to the cloud, improving naturalness. The benefits of cloud computing for multimodal interaction have been identified by emphasizing the flexibility and scalability of a SOA, and its characteristics to provide a more holistic view of interaction according to the variety of situations and users.
The paper aims to provide a method to analyse and observe the characteristics that distinguish th... more The paper aims to provide a method to analyse and observe the characteristics that distinguish the individual communication style such as the voice intonation, the size and slant used in handwriting and the trait, pressure and dimension used for sketching. These features are referred to as Communication Extensional Features. Observing from the Communication Extensional Features, the user’s behavioural features, such as the communicative intention, the social style and personality traits can be extracted. These behavioural features are referred to as Communication Intentional Features. For the extraction of Communication Intentional Features, a method based on Hidden Markov Models is provided in the paper. The Communication Intentional Features have been extracted at the modal and multimodal level; this represents an important novelty provided by the paper. The accuracy of the method was tested both at modal and multimodal levels. The evaluation process results indicate an accuracy o...
Governance and Sustainability of Responsible Research and Innovation Processes
The MARINA project was funded by the European Union’s Horizon 2020 Research and Innovation Progra... more The MARINA project was funded by the European Union’s Horizon 2020 Research and Innovation Programme with the aim to create an all-inclusive Knowledge Sharing Platform for catalysing and federating the convergence of already existing networks, communities, online platforms and services by addressing marine research issues and topics according to Responsible Research and Innovation (RRI) principles. Several marine research issues and topics have been discussed in the 17 Mobilisation and Mutual Learning work-shops during the first year of the project. This paper shows the results of the first series of workshops analysed according to RRI principles and societal and marine challenges.
This paper deals with classifying ambiguities for Multimodal Languages. It evolves the classifica... more This paper deals with classifying ambiguities for Multimodal Languages. It evolves the classifications and the methods of the literature on ambiguities for Natural Language and Visual Language, empirically defining an original classification of ambiguities for multimodal interaction using a linguistic perspective. This classification distinguishes between Semantic and Syntactic multimodal ambiguities and their subclasses, which are intercepted using a rule-based method implemented in a software module. The experimental results have achieved an accuracy of the obtained classification compared to the expected one, which are defined by the human judgment, of 94.6% for the semantic ambiguities classes, and 92.1% for the syntactic ambiguities classes.
International Journal of Web and Grid Services, 2007
Istituto di Ricerca sulla Popolazione e le Politiche Sociali Consiglio Nazionale delle Ricerche V... more Istituto di Ricerca sulla Popolazione e le Politiche Sociali Consiglio Nazionale delle Ricerche Via Nizza 128, 00198 Rome, Italy Fax: +39–06–8583–4506 E-mail: mc.caschera@irpps.cnr.it E-mail: Fernando.ferri@irpps.cnr.it E-mail: patrizia.grifoni@irpps.cnr.it *Corresponding ...
ABSTRACT The deep financial and economic crisis, which still characterizes these years, requires ... more ABSTRACT The deep financial and economic crisis, which still characterizes these years, requires searching for tools in order to enhance knowledge sharing, creativity and innovation. The Internet is one of these tools that represents a practically infinite source of resources. In this perspective, the KnowInG project, funded by the STC programme MED, is aimed at developing the KnowInG Resource Centre (KRC), a sociotechnical system that works as a multiplier of innovation. KRC was conceived as a crowdsourcing platform allowing people, universities, research centres, organizations and companies to be active actors of creative and innovation processes from a local to a transnational level.
ABSTRACT During the design of multimodal interaction environments, the use of a corpus of multimo... more ABSTRACT During the design of multimodal interaction environments, the use of a corpus of multimodal sentences is very important in order to achieve various tasks of multimodal interaction. In last decade, several researchers addressed the creation of multimodal corpora for English, French, and various other languages. However, from the analysis of these multimodal corpora, there clearly is a lack of multimodal corpora for Italian. This paper describes the building process of an Italian multimodal corpus. Starting from the manual analysis of multimedia dialogues, this process extracts different multimodal data, i.e. speech and gestures, which are used to generate grammar rules and to train the multimodal interpreter in order to set the framework for the multimodal corpus building. Following that, the set framework is used to annotate semi-automatically multimodal information, such as syntactic roles and semantics, on new dialogues to be included in the corpus.
The Web is becoming more and more a wide software framework on which each one can compose and use... more The Web is becoming more and more a wide software framework on which each one can compose and use contents, software applications and services. It can offer adequate computational resources to manage the complexity implied by the use of the five senses when involved in human machine interaction. The core of the paper describes how SOA (Service Oriented Architecture) can support multimodal interaction by pushing the I/O processing and reasoning to the cloud, improving naturalness. The benefits of cloud computing for multimodal interaction have been identified by emphasizing the flexibility and scalability of a SOA, and its characteristics to provide a more holistic view of interaction according to the variety of situations and users.
The paper aims to provide a method to analyse and observe the characteristics that distinguish th... more The paper aims to provide a method to analyse and observe the characteristics that distinguish the individual communication style such as the voice intonation, the size and slant used in handwriting and the trait, pressure and dimension used for sketching. These features are referred to as Communication Extensional Features. Observing from the Communication Extensional Features, the user’s behavioural features, such as the communicative intention, the social style and personality traits can be extracted. These behavioural features are referred to as Communication Intentional Features. For the extraction of Communication Intentional Features, a method based on Hidden Markov Models is provided in the paper. The Communication Intentional Features have been extracted at the modal and multimodal level; this represents an important novelty provided by the paper. The accuracy of the method was tested both at modal and multimodal levels. The evaluation process results indicate an accuracy o...
Governance and Sustainability of Responsible Research and Innovation Processes
The MARINA project was funded by the European Union’s Horizon 2020 Research and Innovation Progra... more The MARINA project was funded by the European Union’s Horizon 2020 Research and Innovation Programme with the aim to create an all-inclusive Knowledge Sharing Platform for catalysing and federating the convergence of already existing networks, communities, online platforms and services by addressing marine research issues and topics according to Responsible Research and Innovation (RRI) principles. Several marine research issues and topics have been discussed in the 17 Mobilisation and Mutual Learning work-shops during the first year of the project. This paper shows the results of the first series of workshops analysed according to RRI principles and societal and marine challenges.
This paper deals with classifying ambiguities for Multimodal Languages. It evolves the classifica... more This paper deals with classifying ambiguities for Multimodal Languages. It evolves the classifications and the methods of the literature on ambiguities for Natural Language and Visual Language, empirically defining an original classification of ambiguities for multimodal interaction using a linguistic perspective. This classification distinguishes between Semantic and Syntactic multimodal ambiguities and their subclasses, which are intercepted using a rule-based method implemented in a software module. The experimental results have achieved an accuracy of the obtained classification compared to the expected one, which are defined by the human judgment, of 94.6% for the semantic ambiguities classes, and 92.1% for the syntactic ambiguities classes.
International Journal of Web and Grid Services, 2007
Istituto di Ricerca sulla Popolazione e le Politiche Sociali Consiglio Nazionale delle Ricerche V... more Istituto di Ricerca sulla Popolazione e le Politiche Sociali Consiglio Nazionale delle Ricerche Via Nizza 128, 00198 Rome, Italy Fax: +39–06–8583–4506 E-mail: mc.caschera@irpps.cnr.it E-mail: Fernando.ferri@irpps.cnr.it E-mail: patrizia.grifoni@irpps.cnr.it *Corresponding ...
ABSTRACT The deep financial and economic crisis, which still characterizes these years, requires ... more ABSTRACT The deep financial and economic crisis, which still characterizes these years, requires searching for tools in order to enhance knowledge sharing, creativity and innovation. The Internet is one of these tools that represents a practically infinite source of resources. In this perspective, the KnowInG project, funded by the STC programme MED, is aimed at developing the KnowInG Resource Centre (KRC), a sociotechnical system that works as a multiplier of innovation. KRC was conceived as a crowdsourcing platform allowing people, universities, research centres, organizations and companies to be active actors of creative and innovation processes from a local to a transnational level.
ABSTRACT During the design of multimodal interaction environments, the use of a corpus of multimo... more ABSTRACT During the design of multimodal interaction environments, the use of a corpus of multimodal sentences is very important in order to achieve various tasks of multimodal interaction. In last decade, several researchers addressed the creation of multimodal corpora for English, French, and various other languages. However, from the analysis of these multimodal corpora, there clearly is a lack of multimodal corpora for Italian. This paper describes the building process of an Italian multimodal corpus. Starting from the manual analysis of multimedia dialogues, this process extracts different multimodal data, i.e. speech and gestures, which are used to generate grammar rules and to train the multimodal interpreter in order to set the framework for the multimodal corpus building. Following that, the set framework is used to annotate semi-automatically multimodal information, such as syntactic roles and semantics, on new dialogues to be included in the corpus.
Uploads
Papers by Chiara Caschera