-
Uniqueness Analysis of Controllability Scores and Their Application to Brain Networks
Authors:
Kazuhiro Sato,
Ryohei Kawamura
Abstract:
Assessing centrality in network systems is critical for understanding node importance and guiding decision-making processes. In dynamic networks, incorporating a controllability perspective is essential for identifying key nodes. This paper focuses on the Volumetric Controllability Score (VCS) and Average Energy Controllability Score (AECS) as centrality measures for selecting control nodes in lin…
▽ More
Assessing centrality in network systems is critical for understanding node importance and guiding decision-making processes. In dynamic networks, incorporating a controllability perspective is essential for identifying key nodes. This paper focuses on the Volumetric Controllability Score (VCS) and Average Energy Controllability Score (AECS) as centrality measures for selecting control nodes in linear dynamical network systems. We prove the uniqueness of VCS and AECS for any linear time-invariant system, enhancing their applicability beyond previously recognized cases. This ensures their interpretability, comparability, and reproducibility across different researchers. Our analysis reveals substantial differences between VCS and AECS in linear systems with symmetric and skew-symmetric transition matrices. Moreover, numerical experiments using real-world data indicate that VCS and AECS assessments in brain networks, modeled as Laplacian dynamics, exhibit contrasting trends.
△ Less
Submitted 6 August, 2024;
originally announced August 2024.
-
GHOST: Grounded Human Motion Generation with Open Vocabulary Scene-and-Text Contexts
Authors:
Zoltán Á. Milacski,
Koichiro Niinuma,
Ryosuke Kawamura,
Fernando de la Torre,
László A. Jeni
Abstract:
The connection between our 3D surroundings and the descriptive language that characterizes them would be well-suited for localizing and generating human motion in context but for one problem. The complexity introduced by multiple modalities makes capturing this connection challenging with a fixed set of descriptors. Specifically, closed vocabulary scene encoders, which require learning text-scene…
▽ More
The connection between our 3D surroundings and the descriptive language that characterizes them would be well-suited for localizing and generating human motion in context but for one problem. The complexity introduced by multiple modalities makes capturing this connection challenging with a fixed set of descriptors. Specifically, closed vocabulary scene encoders, which require learning text-scene associations from scratch, have been favored in the literature, often resulting in inaccurate motion grounding. In this paper, we propose a method that integrates an open vocabulary scene encoder into the architecture, establishing a robust connection between text and scene. Our two-step approach starts with pretraining the scene encoder through knowledge distillation from an existing open vocabulary semantic image segmentation model, ensuring a shared text-scene feature space. Subsequently, the scene encoder is fine-tuned for conditional motion generation, incorporating two novel regularization losses that regress the category and size of the goal object. Our methodology achieves up to a 30% reduction in the goal object distance metric compared to the prior state-of-the-art baseline model on the HUMANISE dataset. This improvement is demonstrated through evaluations conducted using three implementations of our framework and a perceptual study. Additionally, our method is designed to seamlessly accommodate future 2D segmentation methods that provide per-pixel text-aligned features for distillation.
△ Less
Submitted 8 April, 2024;
originally announced May 2024.
-
Meta Avatar Robot Cafe: Linking Physical and Virtual Cybernetic Avatars to Provide Physical Augmentation for People with Disabilities
Authors:
Yoichi Yamazaki,
Tsukuto Yamada,
Hiroki Nomura,
Nobuaki Hosoda,
Ryoma Kawamura,
Kazuaki Takeuchi,
Hiroaki Kato,
Ryuma Niiyama,
Kentaro Yoshifuji
Abstract:
Meta avatar robot cafe is a cafe that fuses cyberspace and physical space to create new encounters with people. We create a place where people with disabilities who have difficulty going out can freely switch between their physical bodies and virtual bodies, and communicate their presence and warmth to each other.
Meta avatar robot cafe is a cafe that fuses cyberspace and physical space to create new encounters with people. We create a place where people with disabilities who have difficulty going out can freely switch between their physical bodies and virtual bodies, and communicate their presence and warmth to each other.
△ Less
Submitted 18 July, 2022;
originally announced August 2022.
-
High-power laser experiment forming a supercritical collisionless shock in a magnetized uniform plasma at rest
Authors:
Ryo Yamazaki,
S. Matsukiyo,
T. Morita,
S. J. Tanaka,
T. Umeda,
K. Aihara,
M. Edamoto,
S. Egashira,
R. Hatsuyama,
T. Higuchi,
T. Hihara,
Y. Horie,
M. Hoshino,
A. Ishii,
N. Ishizaka,
Y. Itadani,
T. Izumi,
S. Kambayashi,
S. Kakuchi,
N. Katsuki,
R. Kawamura,
Y. Kawamura,
S. Kisaka,
T. Kojima,
A. Konuma
, et al. (29 additional authors not shown)
Abstract:
We present a new experimental method to generate quasi-perpendicular supercritical magnetized collisionless shocks. In our experiment, ambient nitrogen (N) plasma is at rest and well-magnetized, and it has uniform mass density. The plasma is pushed by laser-driven ablation aluminum (Al) plasma. Streaked optical pyrometry and spatially resolved laser collective Thomson scattering clarify structures…
▽ More
We present a new experimental method to generate quasi-perpendicular supercritical magnetized collisionless shocks. In our experiment, ambient nitrogen (N) plasma is at rest and well-magnetized, and it has uniform mass density. The plasma is pushed by laser-driven ablation aluminum (Al) plasma. Streaked optical pyrometry and spatially resolved laser collective Thomson scattering clarify structures of plasma density and temperatures, which are compared with one-dimensional particle-in-cell simulations. It is indicated that just after the laser irradiation, the Al plasma is magnetized by a self-generated Biermann battery field, and the plasma slaps the incident N plasma. The compressed external field in the N plasma reflects N ions, leading to counter-streaming magnetized N flows. Namely we identify the edge of the reflected N ions. Such interacting plasmas form a magnetized collisionless shock.
△ Less
Submitted 7 February, 2022; v1 submitted 19 January, 2022;
originally announced January 2022.
-
A Transfer Learning Pipeline for Educational Resource Discovery with Application in Leading Paragraph Generation
Authors:
Irene Li,
Thomas George,
Alexander Fabbri,
Tammy Liao,
Benjamin Chen,
Rina Kawamura,
Richard Zhou,
Vanessa Yan,
Swapnil Hingmire,
Dragomir Radev
Abstract:
Effective human learning depends on a wide selection of educational materials that align with the learner's current understanding of the topic. While the Internet has revolutionized human learning or education, a substantial resource accessibility barrier still exists. Namely, the excess of online information can make it challenging to navigate and discover high-quality learning materials. In this…
▽ More
Effective human learning depends on a wide selection of educational materials that align with the learner's current understanding of the topic. While the Internet has revolutionized human learning or education, a substantial resource accessibility barrier still exists. Namely, the excess of online information can make it challenging to navigate and discover high-quality learning materials. In this paper, we propose the educational resource discovery (ERD) pipeline that automates web resource discovery for novel domains. The pipeline consists of three main steps: data collection, feature extraction, and resource classification. We start with a known source domain and conduct resource discovery on two unseen target domains via transfer learning. We first collect frequent queries from a set of seed documents and search on the web to obtain candidate resources, such as lecture slides and introductory blog posts. Then we introduce a novel pretrained information retrieval deep neural network model, query-document masked language modeling (QD-MLM), to extract deep features of these candidate resources. We apply a tree-based classifier to decide whether the candidate is a positive learning resource. The pipeline achieves F1 scores of 0.94 and 0.82 when evaluated on two similar but novel target domains. Finally, we demonstrate how this pipeline can benefit an application: leading paragraph generation for surveys. This is the first study that considers various web resources for survey generation, to the best of our knowledge. We also release a corpus of 39,728 manually labeled web resources and 659 queries from NLP, Computer Vision (CV), and Statistics (STATS).
△ Less
Submitted 6 January, 2022;
originally announced January 2022.
-
CLICKER: A Computational LInguistics Classification Scheme for Educational Resources
Authors:
Swapnil Hingmire,
Irene Li,
Rena Kawamura,
Benjamin Chen,
Alexander Fabbri,
Xiangru Tang,
Yixin Liu,
Thomas George,
Tammy Liao,
Wai Pan Wong,
Vanessa Yan,
Richard Zhou,
Girish K. Palshikar,
Dragomir Radev
Abstract:
A classification scheme of a scientific subject gives an overview of its body of knowledge. It can also be used to facilitate access to research articles and other materials related to the subject. For example, the ACM Computing Classification System (CCS) is used in the ACM Digital Library search interface and also for indexing computer science papers. We observed that a comprehensive classificat…
▽ More
A classification scheme of a scientific subject gives an overview of its body of knowledge. It can also be used to facilitate access to research articles and other materials related to the subject. For example, the ACM Computing Classification System (CCS) is used in the ACM Digital Library search interface and also for indexing computer science papers. We observed that a comprehensive classification system like CCS or Mathematics Subject Classification (MSC) does not exist for Computational Linguistics (CL) and Natural Language Processing (NLP). We propose a classification scheme -- CLICKER for CL/NLP based on the analysis of online lectures from 77 university courses on this subject. The currently proposed taxonomy includes 334 topics and focuses on educational aspects of CL/NLP; it is based primarily, but not exclusively, on lecture notes from NLP courses. We discuss how such a taxonomy can help in various real-world applications, including tutoring platforms, resource retrieval, resource recommendation, prerequisite chain learning, and survey generation.
△ Less
Submitted 15 December, 2021;
originally announced December 2021.
-
Surfer100: Generating Surveys From Web Resources, Wikipedia-style
Authors:
Irene Li,
Alexander Fabbri,
Rina Kawamura,
Yixin Liu,
Xiangru Tang,
Jaesung Tae,
Chang Shen,
Sally Ma,
Tomoe Mizutani,
Dragomir Radev
Abstract:
Fast-developing fields such as Artificial Intelligence (AI) often outpace the efforts of encyclopedic sources such as Wikipedia, which either do not completely cover recently-introduced topics or lack such content entirely. As a result, methods for automatically producing content are valuable tools to address this information overload. We show that recent advances in pretrained language modeling c…
▽ More
Fast-developing fields such as Artificial Intelligence (AI) often outpace the efforts of encyclopedic sources such as Wikipedia, which either do not completely cover recently-introduced topics or lack such content entirely. As a result, methods for automatically producing content are valuable tools to address this information overload. We show that recent advances in pretrained language modeling can be combined for a two-stage extractive and abstractive approach for Wikipedia lead paragraph generation. We extend this approach to generate longer Wikipedia-style summaries with sections and examine how such methods struggle in this application through detailed studies with 100 reference human-collected surveys. This is the first study on utilizing web resources for long Wikipedia-style summaries to the best of our knowledge.
△ Less
Submitted 22 June, 2022; v1 submitted 12 December, 2021;
originally announced December 2021.
-
Neural text normalization leveraging similarities of strings and sounds
Authors:
Riku Kawamura,
Tatsuya Aoki,
Hidetaka Kamigaito,
Hiroya Takamura,
Manabu Okumura
Abstract:
We propose neural models that can normalize text by considering the similarities of word strings and sounds. We experimentally compared a model that considers the similarities of both word strings and sounds, a model that considers only the similarity of word strings or of sounds, and a model without the similarities as a baseline. Results showed that leveraging the word string similarity succeede…
▽ More
We propose neural models that can normalize text by considering the similarities of word strings and sounds. We experimentally compared a model that considers the similarities of both word strings and sounds, a model that considers only the similarity of word strings or of sounds, and a model without the similarities as a baseline. Results showed that leveraging the word string similarity succeeded in dealing with misspellings and abbreviations, and taking into account the sound similarity succeeded in dealing with phonetic substitutions and emphasized characters. So that the proposed models achieved higher F$_1$ scores than the baseline.
△ Less
Submitted 4 November, 2020;
originally announced November 2020.
-
Action Units Recognition by Pairwise Deep Architecture
Authors:
Junya Saito,
Ryosuke Kawamura,
Akiyoshi Uchida,
Sachihiro Youoku,
Yuushi Toyoda,
Takahisa Yamamoto,
Xiaoyu Mi,
Kentaro Murase
Abstract:
In this paper, we propose a new automatic Action Units (AUs) recognition method used in a competition, Affective Behavior Analysis in-the-wild (ABAW). Our method tackles a problem of AUs label inconsistency among subjects by using pairwise deep architecture. While the baseline score is 0.31, our method achieved 0.67 in validation dataset of the competition.
In this paper, we propose a new automatic Action Units (AUs) recognition method used in a competition, Affective Behavior Analysis in-the-wild (ABAW). Our method tackles a problem of AUs label inconsistency among subjects by using pairwise deep architecture. While the baseline score is 0.31, our method achieved 0.67 in validation dataset of the competition.
△ Less
Submitted 2 October, 2020; v1 submitted 1 October, 2020;
originally announced October 2020.
-
A Multi-term and Multi-task Analyzing Framework for Affective Analysis in-the-wild
Authors:
Sachihiro Youoku,
Yuushi Toyoda,
Takahisa Yamamoto,
Junya Saito,
Ryosuke Kawamura,
Xiaoyu Mi,
Kentaro Murase
Abstract:
Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition method focusing on valence-arousal (VA) and expression (EXP) that was submitted to the Affective Behavior Analysis in-the-wild (ABAW) 2020 Contest. Since we consi…
▽ More
Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition method focusing on valence-arousal (VA) and expression (EXP) that was submitted to the Affective Behavior Analysis in-the-wild (ABAW) 2020 Contest. Since we considered that affective behaviors have many observable features that have their own time frames, we introduced multiple optimized time windows (short-term, middle-term, and long-term) into our analyzing framework for extracting feature parameters from video data. Moreover, multiple modality data are used, including action units, head poses, gaze, posture, and ResNet 50 or Efficient NET features, and are optimized during the extraction of these features. Then, we generated affective recognition models for each time window and ensembled these models together. Also, we fussed the valence, arousal, and expression models together to enable the multi-task learning, considering the fact that the basic psychological states behind facial expressions are closely related to each another. In the validation set, our model achieved a valence-arousal score of 0.498 and a facial expression score of 0.471. These verification results reveal that our proposed framework can improve estimation accuracy and robustness effectively.
△ Less
Submitted 2 October, 2020; v1 submitted 29 September, 2020;
originally announced September 2020.
-
A Preliminary Study for Identification of Additive Manufactured Objects with Transmitted Images
Authors:
Kenta Yamamoto,
Ryota Kawamura,
Kazuki Takazawa,
Hiroyuki Osone,
Yoichi Ochiai
Abstract:
Additive manufacturing has the potential to become a standard method for manufacturing products, and product information is indispensable for the item distribution system. While most products are given barcodes to the exterior surfaces, research on embedding barcodes inside products is underway. This is because additive manufacturing makes it possible to carry out manufacturing and information add…
▽ More
Additive manufacturing has the potential to become a standard method for manufacturing products, and product information is indispensable for the item distribution system. While most products are given barcodes to the exterior surfaces, research on embedding barcodes inside products is underway. This is because additive manufacturing makes it possible to carry out manufacturing and information adding at the same time, and embedding information inside does not impair the exterior appearance of the product. However, products that have not been embedded information can not be identified, and embedded information can not be rewritten later. In this study, we have developed a product identification system that does not require embedding barcodes inside. This system uses a transmission image of the product which contains information of each product such as different inner support structures and manufacturing errors. We have shown through experiments that if datasets of transmission images are available, objects can be identified with an accuracy of over 90%. This result suggests that our approach can be useful for identifying objects without embedded information.
△ Less
Submitted 25 May, 2020;
originally announced May 2020.
-
Itinerant Ferromagnetism in layered crystals LaCoOX (X = P, As)
Authors:
Hiroshi Yanagi,
Ryuto Kawamura,
Toshio Kamiya,
Yoichi Kamihara,
Masahiro Hirano,
Tetsuya Nakamura,
Hitoshi Osawa,
Hideo Hosono
Abstract:
The electronic and magnetic properties of cobalt-based layered oxypnictides, LaCoOX (X = P, As), are investigated. LaCoOP and LaCoOAs show metallic type conduction, and the Fermi edge is observed by hard x-ray photoelectron spectroscopy. Ferromagnetic transitions occur at 43 K for LaCoOP and 66 K for LaCoOAs. Above the transition temperatures, temperature dependence of the magnetic susceptibilit…
▽ More
The electronic and magnetic properties of cobalt-based layered oxypnictides, LaCoOX (X = P, As), are investigated. LaCoOP and LaCoOAs show metallic type conduction, and the Fermi edge is observed by hard x-ray photoelectron spectroscopy. Ferromagnetic transitions occur at 43 K for LaCoOP and 66 K for LaCoOAs. Above the transition temperatures, temperature dependence of the magnetic susceptibility follows the Curie-Weiss law. X-ray magnetic circular dichroism (XMCD) is observed at the Co L2,3-edge, but not at the other edges. The calculated electronic structure shows a spin polarized ground state. These results indicate that LaCoOX are itinerant ferromagnets and suggest that their magnetic properties are governed by spin fluctuation.
△ Less
Submitted 1 June, 2008;
originally announced June 2008.
