Showing 1–11 of 11 results for author: Fukumoto, K

LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs

Authors: LLM-jp, :, Akiko Aizawa, Eiji Aramaki, Bowen Chen, Fei Cheng, Hiroyuki Deguchi, Rintaro Enomoto, Kazuki Fujii, Kensuke Fukumoto, Takuya Fukushima, Namgi Han, Yuto Harada, Chikara Hashimoto, Tatsuya Hiraoka, Shohei Hisada, Sosuke Hosokawa, Lu Jie, Keisuke Kamata, Teruhito Kanazawa, Hiroki Kanezashi, Hiroshi Kataoka, Satoru Katsumata, Daisuke Kawahara, Seiya Kawano , et al. (57 additional authors not shown)

Abstract: This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its… ▽ More This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its activities, and technical reports on the LLMs developed by LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Not Linearly Correlated, But Dependent: A Family of Normal Mode Copulas

Authors: Kentaro Fukumoto

Abstract: When scholars study joint distributions of multiple variables, copulas are useful. However, if the variables are not linearly correlated with each other yet are still not independent, most of conventional copulas are not up to the task. Examples include (inversed) U-shaped relationships and heteroskedasticity. To fill this gap, this manuscript sheds new light on a little-known copula, which I call… ▽ More When scholars study joint distributions of multiple variables, copulas are useful. However, if the variables are not linearly correlated with each other yet are still not independent, most of conventional copulas are not up to the task. Examples include (inversed) U-shaped relationships and heteroskedasticity. To fill this gap, this manuscript sheds new light on a little-known copula, which I call the "normal mode copula." I characterize the copula's properties and show that the copula is asymmetric and nonmonotonic under certain conditions. I also apply the copula to a dataset about U.S. House vote share and campaign expenditure to demonstrate that the normal mode copula has better performance than other conventional copulas. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 26 pages, 3 figures

MSC Class: 62H05

Clustering of Time-Varying Graphs Based on Temporal Label Smoothness

Authors: Katsuki Fukumoto, Koki Yamada, Yuichi Tanaka, Hoi-To Wai

Abstract: We propose a node clustering method for time-varying graphs based on the assumption that the cluster labels are changed smoothly over time. Clustering is one of the fundamental tasks in many science and engineering fields including signal processing, machine learning, and data mining. Although most existing studies focus on the clustering of nodes in static graphs, we often encounter time-varying… ▽ More We propose a node clustering method for time-varying graphs based on the assumption that the cluster labels are changed smoothly over time. Clustering is one of the fundamental tasks in many science and engineering fields including signal processing, machine learning, and data mining. Although most existing studies focus on the clustering of nodes in static graphs, we often encounter time-varying graphs for time-series data, e.g., social networks, brain functional connectivity, and point clouds. In this paper, we formulate a node clustering of time-varying graphs as an optimization problem based on spectral clustering, with a smoothness constraint of the node labels. We solve the problem with a primal-dual splitting algorithm. Experiments on synthetic and real-world time-varying graphs are performed to validate the effectiveness of the proposed approach. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Real-time Sampling-based Model Predictive Control based on Reverse Kullback-Leibler Divergence and Its Adaptive Acceleration

Authors: Taisuke Kobayashi, Kota Fukumoto

Abstract: Sampling-based model predictive control (MPC) can be applied to versatile robotic systems. However, the real-time control with it is a big challenge due to its unstable updates and poor convergence. This paper tackles this challenge with a novel derivation from reverse Kullback-Leibler divergence, which has a mode-seeking behavior and is likely to find one of the sub-optimal solutions early. With… ▽ More Sampling-based model predictive control (MPC) can be applied to versatile robotic systems. However, the real-time control with it is a big challenge due to its unstable updates and poor convergence. This paper tackles this challenge with a novel derivation from reverse Kullback-Leibler divergence, which has a mode-seeking behavior and is likely to find one of the sub-optimal solutions early. With this derivation, a weighted maximum likelihood estimation with positive/negative weights is obtained, solving by mirror descent (MD) algorithm. While the negative weights eliminate unnecessary actions, that requires to develop a practical implementation that avoids the interference with positive/negative updates based on rejection sampling. In addition, although the convergence of MD can be accelerated with Nesterov's acceleration method, it is modified for the proposed MPC with a heuristic of a step size adaptive to the noise estimated in update amounts. In the real-time simulations, the proposed method can solve more tasks statistically than the conventional method and accomplish more complex tasks only with a CPU due to the improved acceleration. In addition, its applicability is also demonstrated in a variable impedance control of a force-driven mobile robot. https://youtu.be/D8bFMzct1XM △ Less

Submitted 8 December, 2022; originally announced December 2022.

Comments: 12 pages, 12 figures

Application of Reversible Data Hiding for Printing with Special Color Inks to Preserve Compatibility with Normal Printing

Authors: Kotoko Hiraoka, Kensuke Fukumoto, Takashi Yamazoe, Norimichi Tsumura, Satoshi Kaneko, Wataru Arai, Shoko Imaizumi

Abstract: We propose an efficient framework with compatibility between normal printing and printing with special color inks in this paper. Special color inks can be used for printing to represent some particular colors and specific optical properties, which are difficult to express using only CMYK inks. Special color layers are required in addition to the general color layer for printing with special color… ▽ More We propose an efficient framework with compatibility between normal printing and printing with special color inks in this paper. Special color inks can be used for printing to represent some particular colors and specific optical properties, which are difficult to express using only CMYK inks. Special color layers are required in addition to the general color layer for printing with special color inks. We introduce a reversible data hiding (RDH) method to embed the special color layers into the general color layer without visible artifacts. The proposed method can realize both normal printing and printing with special color inks by using a single layer. Our experimental results show that the quality of the marked image is virtually identical to that of the original image, i.e., the general color layer. △ Less

Submitted 3 March, 2021; originally announced March 2021.

Comments: 8 pages

Journal ref: IEEJ Trans. Electr. Inf. & Syst., vol.141, no.2, pp.155-162, February 2021

73Ge-NMR/NQR Investigation of Magnetic Properties of URhGe

Authors: Hisashi Kotegawa, Kenta Fukumoto, Toshihiro Toyama, Hideki Tou, Hisatomo Harima, Atsushi Harada, Yoshio Kitaoka, Yoshinori Haga, Etsuji Yamamoto, Yoshichika Onuki, Kohei M. Itoh, Eugene E. Haller

Abstract: We report 73Ge-NMR and NQR results for ferromagnetic (FM) superconductor URhGe. The magnitude and direction of the internal field, H_int, and parameters of the electric field gradient at the Ge site were determined experimentally. Using powdered polycrystalline samples oriented by different methods, the field dependences of NMR shift and nuclear spin relaxation rates for H_0 // c (easy axis) and H… ▽ More We report 73Ge-NMR and NQR results for ferromagnetic (FM) superconductor URhGe. The magnitude and direction of the internal field, H_int, and parameters of the electric field gradient at the Ge site were determined experimentally. Using powdered polycrystalline samples oriented by different methods, the field dependences of NMR shift and nuclear spin relaxation rates for H_0 // c (easy axis) and H_0 // b were obtained. From the NMR shifts for H_0 // b, we confirmed a gradual suppression of the Curie temperature and observed a phase separation near the spin reorientation. The observation of the phase separation gives microscopic evidence that the spin reorientation under H_0 // b is of first order at low temperatures. The nuclear spin-lattice relaxation rate 1/T_1 indicates that the magnetic fluctuations are suppressed for H_0 // c, whereas the fluctuations remain strongly for H_0 // b. The enhancements of both 1/T_1T and the nuclear spin-spin relaxation rate 1/T_2 for H_0 // b toward the spin reorientation field suggest that the field-induced superconductivity in URhGe emerges under the magnetic fluctuations along the b axis and the c axis. △ Less

Submitted 16 March, 2015; originally announced March 2015.

Comments: 7 pages, 10 figures, to be published in J. Phys. Soc. Jpn

Huge magneto-crystalline anisotropy of x-ray linear dichroism observed on Co/FeMn bilayers

Authors: W. Kuch, F. Offi, L. I. Chelaru, J. Wang, K. Fukumoto, M. Kotsugi, J. Kirschner, J. Kunes

Abstract: We present an x-ray spectromicroscopic investigation of single-crystalline magnetic FeMn/Co bilayers on Cu(001), using X-ray magnetic circular (XMCD) and linear (XMLD) dichroism at the Co and Fe L3 absorption edges in combination with photoelectron emission microscopy (PEEM). Using the magnetic coupling between the ferromagnetic Co layer and the antiferromagnetic FeMn layer we are able to produc… ▽ More We present an x-ray spectromicroscopic investigation of single-crystalline magnetic FeMn/Co bilayers on Cu(001), using X-ray magnetic circular (XMCD) and linear (XMLD) dichroism at the Co and Fe L3 absorption edges in combination with photoelectron emission microscopy (PEEM). Using the magnetic coupling between the ferromagnetic Co layer and the antiferromagnetic FeMn layer we are able to produce magnetic domains with two different crystallographic orientations of the magnetic easy axis within the same sample at the same time. We find a huge difference in the XMLD contrast between the two types of magnetic domains, which we discuss in terms of intrinsic magneto-crystalline anisotropy of XMLD of the Co layer. We also demonstrate that due to the high sensitivity of the method, the small number of induced ferromagnetic Fe moments at the FeMn-Co interface is sufficient to obtain magnetic contrast from XMLD in a metallic system. △ Less

Submitted 2 April, 2007; originally announced April 2007.

Journal ref: Phys. Rev. B 75, 224406 (2007)

Influence of topography and Co domain walls on the magnetization reversal of the FeNi layer in FeNi/Al$\_2$O$\_3$/Co magnetic tunnel junctions

Authors: Fabien Romanens, Jan Vogel, Wolfgang Kuch, Keiki Fukumoto, Julio Camarero, Stefania Pizzini, Marlio Bonfim, Frédéric Petroff

Abstract: We have studied the magnetization reversal dynamics of FeNi/Al$\_2$O$\_3$/Co magnetic tunnel junctions deposited on step-bunched Si substrates using magneto-optical Kerr effect and time-resolved x-ray photoelectron emission microscopy combined with x-ray magnetic circular dichroism (XMCD-PEEM). Different reversal mechanisms have been found depending on the substrate miscut angle. Larger terraces… ▽ More We have studied the magnetization reversal dynamics of FeNi/Al$\_2$O$\_3$/Co magnetic tunnel junctions deposited on step-bunched Si substrates using magneto-optical Kerr effect and time-resolved x-ray photoelectron emission microscopy combined with x-ray magnetic circular dichroism (XMCD-PEEM). Different reversal mechanisms have been found depending on the substrate miscut angle. Larger terraces (smaller miscut angles) lead to a higher nucleation density and stronger domain wall pinning. The width of domain walls with respect to the size of the terraces seems to play an important role in the reversal. We used the element selectivity of XMCD-PEEM to reveal the strong influence of the stray field of domain walls in the hard magnetic layer on the magnetic switching of the soft magnetic layer. △ Less

Submitted 6 October, 2006; originally announced October 2006.

Comments: 8 Pages, 7 Figures

Dynamics of magnetic domain wall motion after nucleation: Dependence on the wall energy

Authors: Keiki Fukumoto, Wolfgang Kuch, Jan Vogel, Fabien Romanens, Stefania Pizzini, Julio Camarero, Marlio Bonfim, Jürgen Kirschner

Abstract: The dynamics of magnetic domain wall motion in the FeNi layer of a FeNi/Al2O3/Co trilayer has been investigated by a combination of x-ray magnetic circular dichroism, photoelectron emission microscopy, and a stroboscopic pump-probe technique. The nucleation of domains and subsequent expansion by domain wall motion in the FeNi layer during nanosecond-long magnetic field pulses was observed in the… ▽ More The dynamics of magnetic domain wall motion in the FeNi layer of a FeNi/Al2O3/Co trilayer has been investigated by a combination of x-ray magnetic circular dichroism, photoelectron emission microscopy, and a stroboscopic pump-probe technique. The nucleation of domains and subsequent expansion by domain wall motion in the FeNi layer during nanosecond-long magnetic field pulses was observed in the viscous regime up to the Walker limit field. We attribute an observed delay of domain expansion to the influence of the domain wall energy that acts against the domain expansion and that plays an important role when domains are small. △ Less

Submitted 7 February, 2006; originally announced February 2006.

Comments: Accepted for publication in Physical Review Letters

Influence of domain wall interactions on nanosecond switching in magnetic tunnel junctions

Authors: Jan Vogel, Wolfgang Kuch, Riccardo Hertel, Julio Camarero, Keiki Fukumoto, Fabien Romanens, Stefania Pizzini, Marlio Bonfim, Frédéric Petroff, Alain Fontaine, Jürgen Kirschner

Abstract: We have obtained microscopic evidence of the influence of domain wall stray fields on the nanosecond magnetization switching in magnetic trilayer systems. The nucleation barrier initiating the magnetic switching of the soft magnetic Fe20Ni80 layer in magnetic tunnel junction-like FeNi/Al2O3/Co trilayers is considerably lowered by stray fields generated by domain walls present in the hard magneti… ▽ More We have obtained microscopic evidence of the influence of domain wall stray fields on the nanosecond magnetization switching in magnetic trilayer systems. The nucleation barrier initiating the magnetic switching of the soft magnetic Fe20Ni80 layer in magnetic tunnel junction-like FeNi/Al2O3/Co trilayers is considerably lowered by stray fields generated by domain walls present in the hard magnetic Co layer. This internal bias field can significantly increase the local switching speed of the soft layer. The effect is visualized using nanosecond time- and layer-resolved magnetic domain imaging and confirmed by micromagnetic simulations. △ Less

Submitted 1 September, 2005; originally announced September 2005.

Comments: 5 Pages, 3 Figures. Submitted to Physical Review Letters

Journal ref: Physical Review B 72 (2005) 220402

Interplay between magnetic anisotropy and interlayer coupling in nanosecond magnetization reversal of spin-valve trilayers

Authors: Jan Vogel, Wolfgang Kuch, Julio Camarero, Keiki Fukumoto, Yan Pennec, Stefania Pizzini, Marlio Bonfim, Frédéric Petroff, Alain Fontaine, Jürgen Kirschner

Abstract: The influence of magnetic anisotropy on nanosecond magnetization reversal in coupled FeNi/Cu/Co trilayers was studied using a photoelectron emission microscope combined with x-ray magnetic circular dicroism. In quasi-isotropic samples the reversal of the soft FeNi layer is determined by domain wall pinning that leads to the formation of small and irregular domains. In samples with uniaxial magne… ▽ More The influence of magnetic anisotropy on nanosecond magnetization reversal in coupled FeNi/Cu/Co trilayers was studied using a photoelectron emission microscope combined with x-ray magnetic circular dicroism. In quasi-isotropic samples the reversal of the soft FeNi layer is determined by domain wall pinning that leads to the formation of small and irregular domains. In samples with uniaxial magnetic anisotropy, the domains are larger and the influence of local interlayer coupling dominates the domain structure and the reversal of the FeNi layer. △ Less

Submitted 10 May, 2005; originally announced May 2005.

Journal ref: Physical Review B 71 (2005) 060404(R)