Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Showing 1–23 of 23 results for author: Oda, Y

.
  1. arXiv:2407.03963  [pdf, other

    cs.CL cs.AI

    LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs

    Authors: LLM-jp, :, Akiko Aizawa, Eiji Aramaki, Bowen Chen, Fei Cheng, Hiroyuki Deguchi, Rintaro Enomoto, Kazuki Fujii, Kensuke Fukumoto, Takuya Fukushima, Namgi Han, Yuto Harada, Chikara Hashimoto, Tatsuya Hiraoka, Shohei Hisada, Sosuke Hosokawa, Lu Jie, Keisuke Kamata, Teruhito Kanazawa, Hiroki Kanezashi, Hiroshi Kataoka, Satoru Katsumata, Daisuke Kawahara, Seiya Kawano , et al. (57 additional authors not shown)

    Abstract: This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its… ▽ More

    Submitted 4 July, 2024; originally announced July 2024.

  2. arXiv:2406.17185  [pdf, other

    cs.CL

    Vaporetto: Efficient Japanese Tokenization Based on Improved Pointwise Linear Classification

    Authors: Koichi Akabe, Shunsuke Kanda, Yusuke Oda, Shinsuke Mori

    Abstract: This paper proposes an approach to improve the runtime efficiency of Japanese tokenization based on the pointwise linear classification (PLC) framework, which formulates the whole tokenization process as a sequence of linear classification problems. Our approach optimizes tokenization by leveraging the characteristics of the PLC framework and the task definition. Our approach involves (1) composin… ▽ More

    Submitted 24 June, 2024; originally announced June 2024.

  3. arXiv:2311.11690  [pdf, other

    cs.PL cs.AI cs.CL cs.SE

    Refactoring Programs Using Large Language Models with Few-Shot Examples

    Authors: Atsushi Shirafuji, Yusuke Oda, Jun Suzuki, Makoto Morishita, Yutaka Watanobe

    Abstract: A less complex and more straightforward program is a crucial factor that enhances its maintainability and makes writing secure and bug-free programs easier. However, due to its heavy workload and the risks of breaking the working programs, programmers are reluctant to do code refactoring, and thus, it also causes the loss of potential learning experiences. To mitigate this, we demonstrate the appl… ▽ More

    Submitted 20 November, 2023; originally announced November 2023.

    Comments: 10 pages, 10 figures, accepted to the 30th Asia-Pacific Software Engineering Conference (APSEC 2023)

  4. arXiv:2306.14583  [pdf, ps, other

    cs.CL cs.AI cs.SE

    Exploring the Robustness of Large Language Models for Solving Programming Problems

    Authors: Atsushi Shirafuji, Yutaka Watanobe, Takumi Ito, Makoto Morishita, Yuki Nakamura, Yusuke Oda, Jun Suzuki

    Abstract: Using large language models (LLMs) for source code has recently gained attention. LLMs, such as Transformer-based models like Codex and ChatGPT, have been shown to be highly capable of solving a wide range of programming problems. However, the extent to which LLMs understand problem descriptions and generate programs accordingly or just retrieve source code from the most relevant problem in traini… ▽ More

    Submitted 26 June, 2023; originally announced June 2023.

  5. Quantum Crosstalk Robust Quantum Control

    Authors: Zeyuan Zhou, Ryan Sitler, Yasuo Oda, Kevin Schultz, Gregory Quiroz

    Abstract: The prevalence of quantum crosstalk in current quantum devices poses challenges for achieving high-fidelity quantum logic operations and reliable quantum processing. Through quantum control theory, we develop an analytical condition for achieving crosstalk-robust single-qubit control of multi-qubit systems. We examine the effects of quantum crosstalk via a cumulant expansion and develop a conditio… ▽ More

    Submitted 20 November, 2022; v1 submitted 11 August, 2022; originally announced August 2022.

    Journal ref: Phys. Rev. Lett. 131, 210802 (2023)

  6. Engineering faster double-array Aho-Corasick automata

    Authors: Shunsuke Kanda, Koichi Akabe, Yusuke Oda

    Abstract: Multiple pattern matching in strings is a fundamental problem in text processing applications such as regular expressions or tokenization. This paper studies efficient implementations of double-array Aho-Corasick automata (DAACs), data structures for quickly performing the multiple pattern matching. The practical performance of DAACs is improved by carefully designing the data structure, and many… ▽ More

    Submitted 23 June, 2024; v1 submitted 27 July, 2022; originally announced July 2022.

    Comments: Accepted by Software: Practice and Experience (Accepted version)

    Journal ref: Software: Practice and Experience (SPE), 53(6): 1332-1361, 2023

  7. arXiv:2206.03504  [pdf, other

    quant-ph

    Optimally Band-Limited Noise Filtering for Single Qubit Gates

    Authors: Yasuo Oda, Dennis Lucarelli, Kevin Schultz, B. David Clader, Gregory Quiroz

    Abstract: We introduce a quantum control protocol that produces smooth, experimentally implementable control sequences optimized to combat temporally correlated noise for single qubit systems. The control ansatz is specifically chosen to be a functional expansion of discrete prolate spheroidal sequences, a discrete time basis known to be optimally concentrated in time and frequency, and quite attractive whe… ▽ More

    Submitted 27 January, 2023; v1 submitted 7 June, 2022; originally announced June 2022.

    Comments: 26 pages, 12 figures

    Journal ref: Phys. Rev. Applied 19, 014062 (2023)

  8. arXiv:2205.09295  [pdf, other

    cs.CL

    Are Prompt-based Models Clueless?

    Authors: Pride Kavumba, Ryo Takahashi, Yusuke Oda

    Abstract: Finetuning large pre-trained language models with a task-specific head has advanced the state-of-the-art on many natural language understanding benchmarks. However, models with a task-specific head require a lot of training data, making them susceptible to learning and exploiting dataset-specific superficial cues that do not generalize to other datasets. Prompting has reduced the data requirement… ▽ More

    Submitted 19 May, 2022; v1 submitted 18 May, 2022; originally announced May 2022.

  9. Quantum Control Noise Spectroscopy with Optimal Suppression of Dephasing

    Authors: Vivian Maloney, Yasuo Oda, Gregory Quiroz, B. David Clader, Leigh M. Norris

    Abstract: We extend quantum noise spectroscopy (QNS) of amplitude control noise to settings where dephasing noise or detuning errors make significant contributions to qubit dynamics. Previous approaches to characterize amplitude noise are limited by their vulnerability to low-frequency dephasing noise and static detuning errors, which can overwhelm the target control noise signal and introduce bias into est… ▽ More

    Submitted 5 May, 2023; v1 submitted 22 April, 2022; originally announced April 2022.

    Comments: 14 pages + appendices, 7 figures

  10. The failure of cut-elimination in cyclic proof for first-order logic with inductive definitions

    Authors: Yukihiro Oda, James Brotherston, Makoto Tatsuta

    Abstract: A cyclic proof system is a proof system whose proof figure is a tree with cycles. The cut-elimination in a proof system is fundamental. It is conjectured that the cut-elimination in the cyclic proof system for first-order logic with inductive definitions does not hold. This paper shows that the conjecture is correct by giving a sequent not provable without the cut rule but provable in the cyclic p… ▽ More

    Submitted 14 February, 2024; v1 submitted 22 June, 2021; originally announced June 2021.

    Comments: 18 pages

    Journal ref: Journal of Logic and Computation, 2023;, exad068

  11. arXiv:1910.13299  [pdf, other

    cs.CL

    Findings of the Third Workshop on Neural Generation and Translation

    Authors: Hiroaki Hayashi, Yusuke Oda, Alexandra Birch, Ioannis Konstas, Andrew Finch, Minh-Thang Luong, Graham Neubig, Katsuhito Sudoh

    Abstract: This document describes the findings of the Third Workshop on Neural Generation and Translation, held in concert with the annual conference of the Empirical Methods in Natural Language Processing (EMNLP 2019). First, we summarize the research trends of papers presented in the proceedings. Second, we describe the results of the two shared tasks 1) efficient neural machine translation (NMT) where pa… ▽ More

    Submitted 29 October, 2019; v1 submitted 29 October, 2019; originally announced October 2019.

    Comments: Fixed the metadata (author list)

  12. arXiv:1806.02940  [pdf, other

    cs.CL

    Findings of the Second Workshop on Neural Machine Translation and Generation

    Authors: Alexandra Birch, Andrew Finch, Minh-Thang Luong, Graham Neubig, Yusuke Oda

    Abstract: This document describes the findings of the Second Workshop on Neural Machine Translation and Generation, held in concert with the annual conference of the Association for Computational Linguistics (ACL 2018). First, we summarize the research trends of papers presented in the proceedings, and note that there is particular interest in linguistic structure, domain adaptation, data augmentation, hand… ▽ More

    Submitted 18 June, 2018; v1 submitted 7 June, 2018; originally announced June 2018.

    Comments: WNMT 2018

  13. arXiv:1712.00148  [pdf, ps, other

    gr-qc astro-ph.IM physics.ins-det

    Construction of KAGRA: an Underground Gravitational Wave Observatory

    Authors: T. Akutsu, M. Ando, S. Araki, A. Araya, T. Arima, N. Aritomi, H. Asada, Y. Aso, S. Atsuta, K. Awai, L. Baiotti, M. A. Barton, D. Chen, K. Cho, K. Craig, R. DeSalvo, K. Doi, K. Eda, Y. Enomoto, R. Flaminio, S. Fujibayashi, Y. Fujii, M. -K. Fujimoto, M. Fukushima, T. Furuhata , et al. (202 additional authors not shown)

    Abstract: Major construction and initial-phase operation of a second-generation gravitational-wave detector KAGRA has been completed. The entire 3-km detector is installed underground in a mine in order to be isolated from background seismic vibrations on the surface. This allows us to achieve a good sensitivity at low frequencies and high stability of the detector. Bare-bones equipment for the interferomet… ▽ More

    Submitted 11 December, 2017; v1 submitted 30 November, 2017; originally announced December 2017.

    Comments: Resolution of some figures has been decreased from its original version submitted to a journal

    Journal ref: Progress of Theoretical and Experimental Physics, Vol 2018, 1, 013F01

  14. arXiv:1706.05765  [pdf, other

    cs.CL

    An Empirical Study of Mini-Batch Creation Strategies for Neural Machine Translation

    Authors: Makoto Morishita, Yusuke Oda, Graham Neubig, Koichiro Yoshino, Katsuhito Sudoh, Satoshi Nakamura

    Abstract: Training of neural machine translation (NMT) models usually uses mini-batches for efficiency purposes. During the mini-batched training process, it is necessary to pad shorter sentences in a mini-batch to be equal in length to the longest sentence therein for efficient computation. Previous work has noted that sorting the corpus based on the sentence length before making mini-batches reduces the a… ▽ More

    Submitted 18 June, 2017; originally announced June 2017.

    Comments: 8 pages, accepted to the First Workshop on Neural Machine Translation

  15. arXiv:1704.06918  [pdf, ps, other

    cs.CL

    Neural Machine Translation via Binary Code Prediction

    Authors: Yusuke Oda, Philip Arthur, Graham Neubig, Koichiro Yoshino, Satoshi Nakamura

    Abstract: In this paper, we propose a new method for calculating the output layer in neural machine translation systems. The method is based on predicting a binary code for each word and can reduce computation time/memory requirements of the output layer to be logarithmic in vocabulary size in the best case. In addition, we also introduce two advanced approaches to improve the robustness of the proposed mod… ▽ More

    Submitted 23 April, 2017; originally announced April 2017.

    Comments: Accepted as a long paper at ACL2017

  16. arXiv:1701.03980  [pdf, other

    stat.ML cs.CL cs.MS

    DyNet: The Dynamic Neural Network Toolkit

    Authors: Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin

    Abstract: We describe DyNet, a toolkit for implementing neural network models based on dynamic declaration of network structure. In the static declaration strategy that is used in toolkits like Theano, CNTK, and TensorFlow, the user first defines a computation graph (a symbolic representation of the computation), and then examples are fed into an engine that executes this computation and computes its deriva… ▽ More

    Submitted 14 January, 2017; originally announced January 2017.

    Comments: 33 pages

  17. Point-contact spectroscopy of the heavy-fermion superconductor CePt$_{3}$Si

    Authors: R. Onuki, A. Sumiyama, Y. Oda, T. Yasuda, R. Settai, Y. Onuki

    Abstract: Differential resistance spectra (${\rm d}V/{\rm d}I-V$ characteristics) have been measured for point-contacts between the heavy-fermion superconductor (HFS) CePt$_{3}$Si and a normal metal. Some contacts show a peak at V=0 that is characteristic of HFS coexisting with a magnetic order such as UPd$_2$Al$_3$, UNi$_2$Al$_3$ and URu$_2$Si$_2$. The evolution of the peak occurs well above the antiferr… ▽ More

    Submitted 15 January, 2009; originally announced January 2009.

    Comments: 9 pages, 5 figures, To be published in J. Phys.: Condens. Matter

  18. arXiv:0811.4011  [pdf, ps, other

    cond-mat.str-el cond-mat.supr-con

    Electrical Resistivity and Thermal Expansion Measurements of URu2Si2 under Pressure

    Authors: Gaku Motoyama, Nobuyuki Yokoyama, Akihiko Sumiyama, Yasukage Oda

    Abstract: We carried out simultaneous measurements of electrical resistivity and thermal expansion of the heavy-fermion compound URu2Si2 under pressure using a single crystal. We observed a phase transition anomaly between hidden (HO) and antiferromagnetic (AFM) ordered states at TM in the temperature dependence of both measurements. For the electrical resistivity, the anomaly at TM was very small compare… ▽ More

    Submitted 24 November, 2008; originally announced November 2008.

    Comments: 4 pages, 4 figures

  19. arXiv:0802.2759  [pdf, ps, other

    cond-mat.str-el

    Specific Heat Study of Magnetic and Superconducting Transitions in CePt3Si

    Authors: Gaku Motoyama, Katsuhiro Maeda, Yasukage Oda

    Abstract: Measurements of specific heat between 80 mK to 4 K and electrical resistivity between 80 mK to 10 K were carried out for polycrystalline CePt3Si samples cut into small pieces (typically $\sim $10 mg). In the specific heat measurements, we observed an antiferromagnetic transition jump at TN = 2.2 K for all the samples, while the heights have large variations. As regards superconductivity, we obse… ▽ More

    Submitted 20 February, 2008; originally announced February 2008.

    Comments: 5 pages, 4 figures

    Journal ref: J. Phys. Soc. Jpn. Vol.77 (2008)

  20. arXiv:0709.0834  [pdf, ps, other

    cond-mat.supr-con

    AC/DC Susceptibility of the Heavy-Fermion Superconductor CePt3Si under Pressure

    Authors: Yoshihiro Aoki, Akihiko Sumiyama, Gaku Motoyama, Yasukage Oda, Yasuda Settai, Yoshichika Onuki

    Abstract: We have investigated the pressure dependence of ac and dc susceptibilities of the heavy-fermion superconductor CePt3Si (Tc= 0.75 K) that coexists with antiferromagnetism (TN = 2.2 K). As hydrostatic pressure is increased, Tc first decreases rapidly, then rather slowly near the critical pressure Pc = 0.6 GPa and shows a stronger decrease again at higher pressures, where Pc is the pressure at whic… ▽ More

    Submitted 6 September, 2007; originally announced September 2007.

    Comments: 4 pages with 5 figures. This paper will be published in J. Phys. Soc. Jpn

  21. arXiv:cond-mat/0409638  [pdf, ps, other

    cond-mat.supr-con cond-mat.str-el

    NMR study of electronic state in CePt3Si

    Authors: K. Ueda, K. Hamamoto, T. Kohara, G. Motoyama, Y. Oda

    Abstract: In this article, we report the temperature dependence of spin-lattice relaxation rates at two Pt sites and one Si site in CePt3Si with a non-centrosymmetric structure center. 1/T1 for both Pt sites between 2 K and 300 K and 1/T1 of Si above 3 K might be explained by the contributions from the low-lying crystal-electric-field level and the quasiparticle due to the hybridization between the ground… ▽ More

    Submitted 24 September, 2004; originally announced September 2004.

    Comments: 2 pages with 2 EPS figures. uses phb-proc4-auth.cls. Accepted for publication in Physica B

  22. Proximity-induced superconductivity in platinum metals

    Authors: D. Katayama, A. Sumiyama, Y. Oda

    Abstract: The diamagnetism of platinum metals (N: Rh, Pt, Pd), which is induced by the proximity effect of a superconductor (S: Nb), has been investigated for N-S double layers. Notwithstanding the strong spin fluctuation in platinum metals, the screening distance ρin N increases with a decrease in temperature and reaches a value which is expected in comparison with ρin Cu. When magnetic impurities are in… ▽ More

    Submitted 26 August, 2003; originally announced August 2003.

    Comments: 4 pages, 4 figures, to be published in Phys. Rev. B

    Journal ref: Phys. Rev. B 68, 132502 (2003)

  23. arXiv:cond-mat/0011176  [pdf, ps, other

    cond-mat.supr-con

    Diamagnetic Response of Normal-Superconducting Double Layers

    Authors: A. Sumiyama, T. Endo, Y. Nakagawa, Y. Oda

    Abstract: The diamagnetism of a normal metal (N: Cu or Au), which is induced by the proximity effect of a superconductor (S: Nb), has been investigated for N-S double layers, which are formed by a thin-film deposition process. Detailed studies of samples, which have different electronic mean-free path \ell_N in N, suggest that \ell_N should be controlled by the impurity concentration rather than the mecha… ▽ More

    Submitted 10 November, 2000; originally announced November 2000.

    Comments: 5 pages, 6 Postscript figures, to be published in J. Phys. Soc. Jpn

    Journal ref: J. Phys. Soc. Jpn. 70 (2001) 228.