Showing 1–50 of 7,585 results for author: Kim, S

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU

Authors: Yan Li, So-Eon Kim, Seong-Bae Park, Soyeon Caren Han

Abstract: Although Large Language Models(LLMs) can generate coherent and contextually relevant text, they often struggle to recognise the intent behind the human user's query. Natural Language Understanding (NLU) models, however, interpret the purpose and key information of user's input to enable responsive interactions. Existing NLU models generally map individual utterances to a dual-level semantic frame,… ▽ More Although Large Language Models(LLMs) can generate coherent and contextually relevant text, they often struggle to recognise the intent behind the human user's query. Natural Language Understanding (NLU) models, however, interpret the purpose and key information of user's input to enable responsive interactions. Existing NLU models generally map individual utterances to a dual-level semantic frame, involving sentence-level intent and word-level slot labels. However, real-life conversations primarily consist of multi-turn conversations, involving the interpretation of complex and extended dialogues. Researchers encounter challenges addressing all facets of multi-turn dialogue conversations using a unified single NLU model. This paper introduces a novel approach, MIDAS, leveraging a multi-level intent, domain, and slot knowledge distillation for multi-turn NLU. To achieve this, we construct distinct teachers for varying levels of conversation knowledge, namely, sentence-level intent detection, word-level slot filling, and conversation-level domain classification. These teachers are then fine-tuned to acquire specific knowledge of their designated levels. A multi-teacher loss is proposed to facilitate the combination of these multi-level teachers, guiding a student model in multi-turn dialogue tasks. The experimental results demonstrate the efficacy of our model in improving the overall multi-turn conversation understanding, showcasing the potential for advancements in NLU models through the incorporation of multi-level dialogue knowledge distillation techniques. △ Less

Submitted 15 August, 2024; originally announced August 2024.

UV-Plane Beam Mapping for Non-Terrestrial Networks in 3GPP System-Level Simulations

Authors: Dong-Hyun Jung, Sucheol Kim, Miyeon Lee, Joon-Gyu Ryu, Junil Choi

Abstract: Due to the high altitudes and large beam sizes of satellites, the curvature of the Earth's surface can impact system-level performance. To consider this, 3GPP introduces the UV-plane beam mapping for system-level simulations of non-terrestrial networks (NTNs). This paper aims to provide a comprehensive understanding of how beams and user equipments (UEs) are placed on the UV-plane and subsequently… ▽ More Due to the high altitudes and large beam sizes of satellites, the curvature of the Earth's surface can impact system-level performance. To consider this, 3GPP introduces the UV-plane beam mapping for system-level simulations of non-terrestrial networks (NTNs). This paper aims to provide a comprehensive understanding of how beams and user equipments (UEs) are placed on the UV-plane and subsequently mapped to the Earth's surface. We present a general process of projecting UEs on the UV-plane onto the Earth's surface. This process could offer a useful guideline for beam and UE deployment when evaluating the system-level performance of NTNs. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 5 pages, 9 figures, 1 table

Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translation

Authors: Seon-Hoon Kim, Dae-won Chung

Abstract: Synthetic Aperture Radar (SAR) imaging technology provides the unique advantage of being able to collect data regardless of weather conditions and time. However, SAR images exhibit complex backscatter patterns and speckle noise, which necessitate expertise for interpretation. To deal with this challenge, research has been conducted on translating SAR images into optical-like representations to aid… ▽ More Synthetic Aperture Radar (SAR) imaging technology provides the unique advantage of being able to collect data regardless of weather conditions and time. However, SAR images exhibit complex backscatter patterns and speckle noise, which necessitate expertise for interpretation. To deal with this challenge, research has been conducted on translating SAR images into optical-like representations to aid the interpretation of SAR data. Nevertheless, existing studies have predominantly utilized low-resolution satellite imagery datasets and have largely been based on Generative Adversarial Network (GAN) which are known for their training instability and low fidelity. To overcome these limitations of low-resolution data usage and GAN-based approaches, this paper introduces a conditional image-to-image translation approach based on Brownian Bridge Diffusion Model (BBDM). We conducted comprehensive experiments on the MSAW dataset, a paired SAR and optical images collection of 0.5m Very-High-Resolution (VHR) images. The experimental results indicate that our method surpasses both the Conditional Diffusion Model (CDM) and the GAN-based models in diverse perceptual quality metrics. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 5 pages, 2 figures, 1 table

Coupling between electrons and charge density wave fluctuation and its possible role in superconductivity

Authors: Yeonghoon Lee, Yeahan Sur, Sunghun Kim, Jaehun Cha, Jounghoon Hyun, Chan-young Lim, Makoto Hashimoto, Donghui Lu, Younsik Kim, Soonsang Huh, Changyoung Kim, Shinichiro Ideta, Kiyohisa Tanaka, Kee Hoon Kim, Yeongkwan Kim

Abstract: In most of charge density wave (CDW) systems of different material classes, ranging from traditional correlated systems in low-dimension to recent topological systems with Kagome lattice, superconductivity emerges when the system is driven toward the quantum critical point (QCP) of CDW via external parameters of doping and pressure. Despite this rather universal trend, the essential hinge between… ▽ More In most of charge density wave (CDW) systems of different material classes, ranging from traditional correlated systems in low-dimension to recent topological systems with Kagome lattice, superconductivity emerges when the system is driven toward the quantum critical point (QCP) of CDW via external parameters of doping and pressure. Despite this rather universal trend, the essential hinge between CDW and superconductivity has not been established yet. Here, the evidence of coupling between electron and CDW fluctuation is reported, based on a temperature- and intercalation-dependent kink in the angle-resolved photoemission spectra of 2H-PdxTaSe2. Kinks are observed only when the system is in the CDW phase, regardless of whether a long- or short-range order is established. Notably, the coupling strength is enhanced upon long-range CDW suppression, albeit the coupling energy scale is reduced. Interestingly, estimation of the superconducting critical temperature by incorporating the observed coupling characteristics into McMillan's equation yields result closely resembling the known values of the superconducting dome. Our results thus highlight a compelling possibility that this new coupling mediates Cooper pairs, which provides new insights on the competing relationship not only for CDW, but also for other competing orders. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 20 pages, 4 figures for the main text. To be published in Advanced Science

Cropper: Vision-Language Model for Image Cropping through In-Context Learning

Authors: Seung Hyun Lee, Junjie Ke, Yinxiao Li, Junfeng He, Steven Hickson, Katie Datsenko, Sangpil Kim, Ming-Hsuan Yang, Irfan Essa, Feng Yang

Abstract: The goal of image cropping is to identify visually appealing crops within an image. Conventional methods rely on specialized architectures trained on specific datasets, which struggle to be adapted to new requirements. Recent breakthroughs in large vision-language models (VLMs) have enabled visual in-context learning without explicit training. However, effective strategies for vision downstream ta… ▽ More The goal of image cropping is to identify visually appealing crops within an image. Conventional methods rely on specialized architectures trained on specific datasets, which struggle to be adapted to new requirements. Recent breakthroughs in large vision-language models (VLMs) have enabled visual in-context learning without explicit training. However, effective strategies for vision downstream tasks with VLMs remain largely unclear and underexplored. In this paper, we propose an effective approach to leverage VLMs for better image cropping. First, we propose an efficient prompt retrieval mechanism for image cropping to automate the selection of in-context examples. Second, we introduce an iterative refinement strategy to iteratively enhance the predicted crops. The proposed framework, named Cropper, is applicable to a wide range of cropping tasks, including free-form cropping, subject-aware cropping, and aspect ratio-aware cropping. Extensive experiments and a user study demonstrate that Cropper significantly outperforms state-of-the-art methods across several benchmarks. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Sharp quantitative stability estimates for critical points of fractional Sobolev inequalities

Authors: Haixia Chen, Seunghyeok Kim, Juncheng Wei

Abstract: By developing a unified approach based on integral representations, we establish sharp quantitative stability estimates for critical points of the fractional Sobolev inequalities induced by the embedding $\dot{H}^s({\mathbb R}^n) \hookrightarrow L^{2n \over n-2s}({\mathbb R}^n)$ in the whole range of $s \in (0,\frac{n}{2})$. By developing a unified approach based on integral representations, we establish sharp quantitative stability estimates for critical points of the fractional Sobolev inequalities induced by the embedding $\dot{H}^s({\mathbb R}^n) \hookrightarrow L^{2n \over n-2s}({\mathbb R}^n)$ in the whole range of $s \in (0,\frac{n}{2})$. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 36 pages; comments welcome

See It All: Contextualized Late Aggregation for 3D Dense Captioning

Authors: Minjung Kim, Hyung Suk Lim, Seung Hwan Kim, Soonyoung Lee, Bumsoo Kim, Gunhee Kim

Abstract: 3D dense captioning is a task to localize objects in a 3D scene and generate descriptive sentences for each object. Recent approaches in 3D dense captioning have adopted transformer encoder-decoder frameworks from object detection to build an end-to-end pipeline without hand-crafted components. However, these approaches struggle with contradicting objectives where a single query attention has to s… ▽ More 3D dense captioning is a task to localize objects in a 3D scene and generate descriptive sentences for each object. Recent approaches in 3D dense captioning have adopted transformer encoder-decoder frameworks from object detection to build an end-to-end pipeline without hand-crafted components. However, these approaches struggle with contradicting objectives where a single query attention has to simultaneously view both the tightly localized object regions and contextual environment. To overcome this challenge, we introduce SIA (See-It-All), a transformer pipeline that engages in 3D dense captioning with a novel paradigm called late aggregation. SIA simultaneously decodes two sets of queries-context query and instance query. The instance query focuses on localization and object attribute descriptions, while the context query versatilely captures the region-of-interest of relationships between multiple objects or with the global scene, then aggregated afterwards (i.e., late aggregation) via simple distance-based measures. To further enhance the quality of contextualized caption generation, we design a novel aggregator to generate a fully informed caption based on the surrounding context, the global environment, and object instances. Extensive experiments on two of the most widely-used 3D dense captioning datasets demonstrate that our proposed method achieves a significant improvement over prior methods. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: Accepted to ACL 2024 Findings

Correlators for pseudo Hermitian systems

Authors: Yao Bai, Ting-Long Feng, Suro Kim, Cheng-Yang Lee, Lei-Hua Liu, Wangping Zhao, Siyi Zhou

Abstract: Pseudo-Hermitian system is a class of non-Hermitian system with Hamiltonian satisfying the condition $η^{-1}H^\daggerη=H$. We develop the in-in and Schwinger Keldysh formalism to calculate cosmological correlators for pseudo-Hermitian systems. We study a model consists of massive symplectic fermions coupled to the primordial curvature perturbation. The three-point function for the primordial curva… ▽ More Pseudo-Hermitian system is a class of non-Hermitian system with Hamiltonian satisfying the condition $η^{-1}H^\daggerη=H$. We develop the in-in and Schwinger Keldysh formalism to calculate cosmological correlators for pseudo-Hermitian systems. We study a model consists of massive symplectic fermions coupled to the primordial curvature perturbation. The three-point function for the primordial curvature perturbation is computed up to one-loop and compared to earlier work where the loop correction comes from a massive scalar boson. The two results differ by a minus sign. Therefore, the one loop correction to the three-point function cannot be used to distinguished scalar bosons and symplectic fermions. To conclude, we discuss possibilities where the scalar bosons and symplectic fermions may be distinguished. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 19 pages, 2 figures

Rethinking Open-Vocabulary Segmentation of Radiance Fields in 3D Space

Authors: Hyunjee Lee, Youngsik Yun, Jeongmin Bae, Seoha Kim, Youngjung Uh

Abstract: Understanding the 3D semantics of a scene is a fundamental problem for various scenarios such as embodied agents. While NeRFs and 3DGS excel at novel-view synthesis, previous methods for understanding their semantics have been limited to incomplete 3D understanding: their segmentation results are 2D masks and their supervision is anchored at 2D pixels. This paper revisits the problem set to pursue… ▽ More Understanding the 3D semantics of a scene is a fundamental problem for various scenarios such as embodied agents. While NeRFs and 3DGS excel at novel-view synthesis, previous methods for understanding their semantics have been limited to incomplete 3D understanding: their segmentation results are 2D masks and their supervision is anchored at 2D pixels. This paper revisits the problem set to pursue a better 3D understanding of a scene modeled by NeRFs and 3DGS as follows. 1) We directly supervise the 3D points to train the language embedding field. It achieves state-of-the-art accuracy without relying on multi-scale language embeddings. 2) We transfer the pre-trained language field to 3DGS, achieving the first real-time rendering speed without sacrificing training time or accuracy. 3) We introduce a 3D querying and evaluation protocol for assessing the reconstructed geometry and semantics together. Code, checkpoints, and annotations will be available online. Project page: https://hyunji12.github.io/Open3DRF △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: Project page: https://hyunji12.github.io/Open3DRF

An Adaptive Importance Sampling for Locally Stable Point Processes

Authors: Hee-Geon Kang, Sunggon Kim

Abstract: The problem of finding the expected value of a statistic of a locally stable point process in a bounded region is addressed. We propose an adaptive importance sampling for solving the problem. In our proposal, we restrict the importance point process to the family of homogeneous Poisson point processes, which enables us to generate quickly independent samples of the importance point process. The o… ▽ More The problem of finding the expected value of a statistic of a locally stable point process in a bounded region is addressed. We propose an adaptive importance sampling for solving the problem. In our proposal, we restrict the importance point process to the family of homogeneous Poisson point processes, which enables us to generate quickly independent samples of the importance point process. The optimal intensity of the importance point process is found by applying the cross-entropy minimization method. In the proposed scheme, the expected value of the function and the optimal intensity are iteratively estimated in an adaptive manner. We show that the proposed estimator converges to the target value almost surely, and prove the asymptotic normality of it. We explain how to apply the proposed scheme to the estimation of the intensity of a stationary pairwise interaction point process. The performance of the proposed scheme is compared numerically with the Markov chain Monte Carlo simulation and the perfect sampling. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Pragmatic inference of scalar implicature by LLMs

Authors: Ye-eun Cho, Seong mook Kim

Abstract: This study investigates how Large Language Models (LLMs), particularly BERT (Devlin et al., 2019) and GPT-2 (Radford et al., 2019), engage in pragmatic inference of scalar implicature, such as some. Two sets of experiments were conducted using cosine similarity and next sentence/token prediction as experimental methods. The results in experiment 1 showed that, both models interpret some as pragmat… ▽ More This study investigates how Large Language Models (LLMs), particularly BERT (Devlin et al., 2019) and GPT-2 (Radford et al., 2019), engage in pragmatic inference of scalar implicature, such as some. Two sets of experiments were conducted using cosine similarity and next sentence/token prediction as experimental methods. The results in experiment 1 showed that, both models interpret some as pragmatic implicature not all in the absence of context, aligning with human language processing. In experiment 2, in which Question Under Discussion (QUD) was presented as a contextual cue, BERT showed consistent performance regardless of types of QUDs, while GPT-2 encountered processing difficulties since a certain type of QUD required pragmatic inference for implicature. The findings revealed that, in terms of theoretical approaches, BERT inherently incorporates pragmatic implicature not all within the term some, adhering to Default model (Levinson, 2000). In contrast, GPT-2 seems to encounter processing difficulties in inferring pragmatic implicature within context, consistent with Context-driven model (Sperber and Wilson, 2002). △ Less

Submitted 13 August, 2024; originally announced August 2024.

Comments: This research was presented at the Association for Computational Linguistics conference, held on August 11-16

Infant Type Ia Supernovae from the KMTNet I. Multi-Color Evolution and Populations

Authors: Yuan Qi Ni, Dae-Sik Moon, Maria R. Drout, Youngdae Lee, Patrick Sandoval, Jeehye Shin, Hong Soo Park, Sang Chul Kim, Kyuseok Oh

Abstract: We conduct a systematic analysis of the early multi-band light curves and colors of 19 Type Ia Supernovae (SNe) from the Korea Microlensing Telescope Network SN Program, including 16 previously unpublished events. Seven are detected $\lesssim$ 1 day since the estimated epoch of first light and the rest within $\lesssim$ 3 days. Some show excess emission within $<$ 0.5 days to $\sim$ 2 days, but mo… ▽ More We conduct a systematic analysis of the early multi-band light curves and colors of 19 Type Ia Supernovae (SNe) from the Korea Microlensing Telescope Network SN Program, including 16 previously unpublished events. Seven are detected $\lesssim$ 1 day since the estimated epoch of first light and the rest within $\lesssim$ 3 days. Some show excess emission within $<$ 0.5 days to $\sim$ 2 days, but most show pure power-law rises. The colors are initially diverse before $\sim$ 5 days, but converge to a similar color at $\sim$ 10 days. We identify at least three populations based on 2--5-day color evolution: (1) "early-blues" exhibit slowly-evolving colors consistent with a $\sim$ 17,000 K blackbody; (2) "early-reds" have initially blue $B-V$ and red $V-i$ colors that cannot simultaneously be fit with a blackbody -- likely due to suppression of $B$- and $i$-band flux by Fe II/III and Ca II -- and evolve more rapidly; and (3) "early-yellows" evolve blueward, consistent with thermal heating from $\sim$ 8,000 to 13,000 K. The distributions of early-blue and early-red colors are compatible with them being either distinct populations -- with early-reds comprising (60 $\pm$ 15)% of them -- or extreme ends of one continuous population; whereas the early-yellow population identified here is clearly distinct. Compared to the other populations, early-blues in our sample differ by exhibiting excess emission within 1--2 days, nearly constant peak brightness regardless of $ΔM_{15}(B)$ after standardization, and shallower Si II features. Early-blues also prefer star-forming host environments, while early-yellows and, to a lesser extent, early-reds prefer quiescent ones. These preferences appear to indicate at least two Type Ia SN production channels based on stellar population age, while early-reds and early-blues may still share a common origin. △ Less

Submitted 12 August, 2024; originally announced August 2024.

Comments: Submitted for publication in ApJ. 48 pages, 29 figures, 7 tables

On the Completely Positive Approximation Property for Non-Unital Operator Systems and the Boundary Condition for the Zero Map

Authors: Se-Jin Kim

Abstract: The purpose of this paper is two-fold: firstly, we give a characterization on the level of non-unital operator systems for when the zero map is a boundary representation. As a consequence, we show that a non-unital operator system arising from the direct limit of C*-algebras under positive maps is a C*-algebra if and only if its unitization is a C*-algebra. Secondly, we show that the completely po… ▽ More The purpose of this paper is two-fold: firstly, we give a characterization on the level of non-unital operator systems for when the zero map is a boundary representation. As a consequence, we show that a non-unital operator system arising from the direct limit of C*-algebras under positive maps is a C*-algebra if and only if its unitization is a C*-algebra. Secondly, we show that the completely positive approximation property and the completely contractive approximation property of a non-unital operator system is equivalent to its bidual being an injective von Neumann algebra. This implies in particular that all non-unital operator systems with the completely contractive approximation property must necessarily admit an abundance of positive elements. △ Less

Submitted 12 August, 2024; originally announced August 2024.

Enhancing Dialogue Speech Recognition with Robust Contextual Awareness via Noise Representation Learning

Authors: Wonjun Lee, San Kim, Gary Geunbae Lee

Abstract: Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and agent interactions for transcribing subsequent utterances has been proposed. This method incorporates the transcription of the user's speech and the agent's resp… ▽ More Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and agent interactions for transcribing subsequent utterances has been proposed. This method incorporates the transcription of the user's speech and the agent's response as model input, using the accumulated context generated by each turn. However, this context is susceptible to ASR errors because it is generated by the ASR model in an auto-regressive fashion. Such noisy context can further degrade the benefits of context input, resulting in suboptimal ASR performance. In this paper, we introduce Context Noise Representation Learning (CNRL) to enhance robustness against noisy context, ultimately improving dialogue speech recognition accuracy. To maximize the advantage of context awareness, our approach includes decoder pre-training using text-based dialogue data and noise representation learning for a context encoder. Based on the evaluation of speech dialogues, our method shows superior results compared to baselines. Furthermore, the strength of our approach is highlighted in noisy environments where user speech is barely audible due to real-world noise, relying on contextual information to transcribe the input accurately. △ Less

Submitted 12 August, 2024; originally announced August 2024.

Comments: 11 pages, 2 figures, Accepted to SIGDIAL2024

Quantum Support Vector Machine-Based Classification of GPS Signal Reception Conditions

Authors: Suhui Jeong, Sanghyun Kim, Jiwon Seo

Abstract: Global Positioning System (GPS) plays a critical role in navigation by utilizing satellite signals, but its accuracy in urban environments is often compromised by signal obstructions. Previous research has categorized GPS reception conditions into line-of-sight (LOS), non-line-of-sight (NLOS), and LOS+NLOS scenarios to enhance accuracy. This paper introduces a novel approach using quantum support… ▽ More Global Positioning System (GPS) plays a critical role in navigation by utilizing satellite signals, but its accuracy in urban environments is often compromised by signal obstructions. Previous research has categorized GPS reception conditions into line-of-sight (LOS), non-line-of-sight (NLOS), and LOS+NLOS scenarios to enhance accuracy. This paper introduces a novel approach using quantum support vector machines (QSVM) with a ZZ feature map and fidelity quantum kernel to classify urban GPS signal reception conditions, comparing its performance against classical SVM methods. While classical SVM has been previously explored for this purpose, our study is the first to apply QSVM to this classification task. We conducted experiments using datasets from two distinct urban locations to train and evaluate SVM and QSVM models. Our results demonstrate that QSVM achieves superior classification accuracy compared to classical SVM for urban GPS signal datasets. Additionally, we emphasize the importance of appropriately scaling raw data when utilizing QSVM. △ Less

Submitted 11 August, 2024; originally announced August 2024.

Comments: Submitted to IEEE QCE 2024

Efficient and Versatile Robust Fine-Tuning of Zero-shot Models

Authors: Sungyeon Kim, Boseung Jeong, Donghyun Kim, Suha Kwak

Abstract: Large-scale image-text pre-trained models enable zero-shot classification and provide consistent accuracy across various data distributions. Nonetheless, optimizing these models in downstream tasks typically requires fine-tuning, which reduces generalization to out-of-distribution (OOD) data and demands extensive computational resources. We introduce Robust Adapter (R-Adapter), a novel method for… ▽ More Large-scale image-text pre-trained models enable zero-shot classification and provide consistent accuracy across various data distributions. Nonetheless, optimizing these models in downstream tasks typically requires fine-tuning, which reduces generalization to out-of-distribution (OOD) data and demands extensive computational resources. We introduce Robust Adapter (R-Adapter), a novel method for fine-tuning zero-shot models to downstream tasks while simultaneously addressing both these issues. Our method integrates lightweight modules into the pre-trained model and employs novel self-ensemble techniques to boost OOD robustness and reduce storage expenses substantially. Furthermore, we propose MPM-NCE loss designed for fine-tuning on vision-language downstream tasks. It ensures precise alignment of multiple image-text pairs and discriminative feature learning. By extending the benchmark for robust fine-tuning beyond classification to include diverse tasks such as cross-modal retrieval and open vocabulary segmentation, we demonstrate the broad applicability of R-Adapter. Our extensive experiments demonstrate that R-Adapter achieves state-of-the-art performance across a diverse set of tasks, tuning only 13% of the parameters of the CLIP encoders. △ Less

Submitted 11 August, 2024; originally announced August 2024.

Comments: Accepted to ECCV 2024

Emergence of Meron Kekulé lattices in twisted Néel antiferromagnets

Authors: Kyoung-Min Kim, Se Kwon Kim

Abstract: A Kekulé lattice is an exotic, distorted lattice structure distinguished by alternating bond lengths in contrast to naturally formed atomic crystals. While this structure has been explored through atomic crystals and metamaterials, the possibility of forming a Kekulé lattice from topological solitons in magnetic systems has remained elusive. Here, we propose twisted bilayer easy-plane Néel antifer… ▽ More A Kekulé lattice is an exotic, distorted lattice structure distinguished by alternating bond lengths in contrast to naturally formed atomic crystals. While this structure has been explored through atomic crystals and metamaterials, the possibility of forming a Kekulé lattice from topological solitons in magnetic systems has remained elusive. Here, we propose twisted bilayer easy-plane Néel antiferromagnets as a promising platform for achieving a "Meron Kekulé lattice" -- a distorted topological soliton lattice comprised of antiferromagnetic merons as its lattice elements. Using atomistic spin simulations on these magnets, we demonstrate that due to the moiré-induced intricate pattern of interlayer exchange coupling, the cores of these merons are stabilized into the Kekulé-O pattern with different intracell and intercell bond lengths across moiré supercells, hence forming a Meron Kekulé lattice. Furthermore, we showcase that the two bond lengths of the Meron Kekulé lattice can be fine-tuned by adjusting the twist angle and specifics of the interlayer exchange coupling, suggesting extensive control over the meron lattice configuration in contrast to conventional magnetic systems. These discoveries pave the way for exploring topological solitons with distinctive Kekulé attributes, offering intriguing opportunities at the intersection of topological solitons and Kekulé physics. △ Less

Submitted 10 August, 2024; originally announced August 2024.

Comments: Supplementary Information is included in the published version

Electroweak Primordial Magnetic Blackhole: Cosmic Production and Physical Implication

Authors: Y. M. Cho, Sang-Woo Kim, Seung Hun Oh

Abstract: The electroweak monopole, when coupled to gravity, turns to the Reissner-Nordstrom type primordial magnetic blackhole whose mass is bounded below, with the lower bound $M_P \sqrt α$. This changes the overall picture of the monopole production mechanism in the early universe drastically and has deep implications in cosmolpgy. In particular, this enhances the possibility that the electroweak monopol… ▽ More The electroweak monopole, when coupled to gravity, turns to the Reissner-Nordstrom type primordial magnetic blackhole whose mass is bounded below, with the lower bound $M_P \sqrt α$. This changes the overall picture of the monopole production mechanism in the early universe drastically and has deep implications in cosmolpgy. In particular, this enhances the possibility that the electroweak monopoles turned to the primordial magnetic blackholes could become the seed of stellar objects and galaxies, and account for the dark matter of the universe. Moreover, this tells that we have a new type of primordial blackhole different from the popular primordial blackhole in cosmology, the electroweak primordial magnetic blackhole based on a totally different production mechanism. We discuss the physical implications of the electroweak primordial magnetic blackhole. △ Less

Submitted 14 August, 2024; v1 submitted 10 August, 2024; originally announced August 2024.

VACoDe: Visual Augmented Contrastive Decoding

Authors: Sihyeon Kim, Boryeong Cho, Sangmin Bae, Sumyeong Ahn, Se-Young Yun

Abstract: Despite the astonishing performance of recent Large Vision-Language Models (LVLMs), these models often generate inaccurate responses. To address this issue, previous studies have focused on mitigating hallucinations by employing contrastive decoding (CD) with augmented images, which amplifies the contrast with the original image. However, these methods have limitations, including reliance on a sin… ▽ More Despite the astonishing performance of recent Large Vision-Language Models (LVLMs), these models often generate inaccurate responses. To address this issue, previous studies have focused on mitigating hallucinations by employing contrastive decoding (CD) with augmented images, which amplifies the contrast with the original image. However, these methods have limitations, including reliance on a single augmentation, which is restrictive for certain tasks, as well as the high cost of using external knowledge. In this study, we address these limitations by exploring how to utilize multiple image augmentations. Through extensive experiments, we observed that different augmentations produce varying levels of contrast depending on the task. Based on this observation, we introduce a novel method called VACoDe, Visual Augmented Contrastive Decoding. This method adaptively selects the augmentation with the highest contrast for each task using the proposed softmax distance metric. Our empirical tests show that \alg outperforms previous methods and improves output quality in various vision-language tasks. Additionally, VACoDe can be universally applied across different model types and sizes without additional training or the use of external models and data. △ Less

Submitted 26 July, 2024; originally announced August 2024.

Comments: 10 pages, 7 figures

MSC Class: 68T01 ACM Class: I.2.0

Non-Fermi liquid to charge-transfer Mott insulator in flat bands of copper-doped lead apatite

Authors: Sun-Woo Kim, Kristjan Haule, Gheorghe Lucian Pascut, Bartomeu Monserrat

Abstract: Copper-doped lead apatite, called LK-99, was initially claimed to be a room temperature superconductor driven by flat electron bands, but was later found to be a wide gap insulator. Despite the lack of room temperature superconductivity, there is growing evidence that LK-99 and related compounds host various strong electron correlation phenomena arising from their flat electron bands. Depending on… ▽ More Copper-doped lead apatite, called LK-99, was initially claimed to be a room temperature superconductor driven by flat electron bands, but was later found to be a wide gap insulator. Despite the lack of room temperature superconductivity, there is growing evidence that LK-99 and related compounds host various strong electron correlation phenomena arising from their flat electron bands. Depending on the copper doping site and crystal structure, LK-99 can exhibit two distinct flat bands crossing the Fermi level in the non-interacting limit: either a single or two entangled flat bands. We explore potential correlated metallic and insulating phases in the flat bands of LK-99 compounds by constructing their correlation phase diagrams, and find both non-Fermi liquid and Mott insulating states. We demonstrate that LK-99 is a charge-transfer Mott insulator driven by strong electron correlations, regardless of the flat band type. We also find that the non-Fermi liquid state in the multi-flat band system exhibits strange metal behaviour, while the corresponding state in the single flat band system exhibits pseudogap behaviour. Our findings align with available experimental observations and provide crucial insights into the correlation phenomenology of LK-99 and related compounds that could arise independently of superconductivity. Overall, our research highlights that LK-99 and related compounds offer a compelling platform for investigating correlation physics in flat band systems. △ Less

Submitted 9 August, 2024; originally announced August 2024.

Comments: 5 figures + Supplementary information

Spatial Affordance-aware Interactable Subspace Allocation for Mixed Reality Telepresence

Authors: Dooyoung Kim, Seonji Kim, Selin Choi, Woontack Woo

Abstract: To enable remote Virtual Reality (VR) and Augmented Reality (AR) clients to collaborate as if they were in the same space during Mixed Reality (MR) telepresence, it is essential to overcome spatial heterogeneity and generate a unified shared collaborative environment by integrating remote spaces into a target host space. Especially when multiple remote users connect, a large shared space is necess… ▽ More To enable remote Virtual Reality (VR) and Augmented Reality (AR) clients to collaborate as if they were in the same space during Mixed Reality (MR) telepresence, it is essential to overcome spatial heterogeneity and generate a unified shared collaborative environment by integrating remote spaces into a target host space. Especially when multiple remote users connect, a large shared space is necessary for people to maintain their personal space while collaborating, but the existing simple intersection method leads to the creation of narrow shared spaces as the number of remote spaces increases. To robustly align to the host space even as the number of remote spaces increases, we propose a spatial affordance-aware interactable subspace allocation algorithm. The key concept of our approach is to consider the perceivable and interactable areas separately, where every user views the same mutual space, but each remote user has a different interactable subspace, considering their location and spatial affordance. We conducted an evaluation with 900 space combinations, varying the number of remote spaces as two, four, and six, and results show our method outperformed in securing wide interactable mutual space and instantiating users compared to the other spatial matching methods. Our work enables multiple clients from diverse remote locations to access the AR host's space, allowing them to interact directly with the table, wall, or floor by aligning their physical subspaces within a connected mutual space. △ Less

Submitted 8 August, 2024; originally announced August 2024.

Comments: Accepted at the 2024 IEEE ISMAR Conference. 10 pages, 6 figures

LaDiMo: Layer-wise Distillation Inspired MoEfier

Authors: Sungyoon Kim, Youngjun Kim, Kihyo Moon, Minsung Jang

Abstract: The advent of large language models has revolutionized natural language processing, but their increasing complexity has led to substantial training costs, resource demands, and environmental impacts. In response, sparse Mixture-of-Experts (MoE) models have emerged as a promising alternative to dense models. Since training MoE models from scratch can be prohibitively expensive, recent studies have… ▽ More The advent of large language models has revolutionized natural language processing, but their increasing complexity has led to substantial training costs, resource demands, and environmental impacts. In response, sparse Mixture-of-Experts (MoE) models have emerged as a promising alternative to dense models. Since training MoE models from scratch can be prohibitively expensive, recent studies have explored leveraging knowledge from pre-trained non-MoE models. However, existing approaches have limitations, such as requiring significant hardware resources and data. We propose a novel algorithm, LaDiMo, which efficiently converts a Transformer-based non-MoE model into a MoE model with minimal additional training cost. LaDiMo consists of two stages: layer-wise expert construction and routing policy decision. By harnessing the concept of Knowledge Distillation, we compress the model and rapidly recover its performance. Furthermore, we develop an adaptive router that optimizes inference efficiency by profiling the distribution of routing weights and determining a layer-wise policy that balances accuracy and latency. We demonstrate the effectiveness of our method by converting the LLaMA2-7B model to a MoE model using only 100K tokens, reducing activated parameters by over 20% while keeping accuracy. Our approach offers a flexible and efficient solution for building and deploying MoE models. △ Less

Submitted 8 August, 2024; originally announced August 2024.

Comments: 21 pages, 10 figures

HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detection

Authors: Juho Jung, Chaewon Kang, Jeewoo Yoon, Seungbae Kim, Jinyoung Han

Abstract: The utilization of automated depression detection significantly enhances early intervention for individuals experiencing depression. Despite numerous proposals on automated depression detection using recorded clinical interview videos, limited attention has been paid to considering the hierarchical structure of the interview questions. In clinical interviews for diagnosing depression, clinicians u… ▽ More The utilization of automated depression detection significantly enhances early intervention for individuals experiencing depression. Despite numerous proposals on automated depression detection using recorded clinical interview videos, limited attention has been paid to considering the hierarchical structure of the interview questions. In clinical interviews for diagnosing depression, clinicians use a structured questionnaire that includes routine baseline questions and follow-up questions to assess the interviewee's condition. This paper introduces HiQuE (Hierarchical Question Embedding network), a novel depression detection framework that leverages the hierarchical relationship between primary and follow-up questions in clinical interviews. HiQuE can effectively capture the importance of each question in diagnosing depression by learning mutual information across multiple modalities. We conduct extensive experiments on the widely-used clinical interview data, DAIC-WOZ, where our model outperforms other state-of-the-art multimodal depression detection models and emotion recognition models, showcasing its clinical utility in depression detection. △ Less

Submitted 7 August, 2024; originally announced August 2024.

Comments: 11 pages, 6 figures, Proceedings of the 33rd ACM International Conference on Information and Knowledge Management (CIKM '24)

Journal ref: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management (CIKM '24), October 21-25, 2024, Boise, ID, USA

EXAONE 3.0 7.8B Instruction Tuned Language Model

Authors: LG AI Research, :, Soyoung An, Kyunghoon Bae, Eunbi Choi, Stanley Jungkyu Choi, Yemuk Choi, Seokhee Hong, Yeonjung Hong, Junwon Hwang, Hyojin Jeon, Gerrard Jeongwon Jo, Hyunjik Jo, Jiyeon Jung, Yountae Jung, Euisoon Kim, Hyosang Kim, Joonkee Kim, Seonghwan Kim, Soyeon Kim, Sunkyoung Kim, Yireun Kim, Youchul Kim, Edward Hwayoung Lee, Haeju Lee , et al. (14 additional authors not shown)

Abstract: We introduce EXAONE 3.0 instruction-tuned language model, the first open model in the family of Large Language Models (LLMs) developed by LG AI Research. Among different model sizes, we publicly release the 7.8B instruction-tuned model to promote open research and innovations. Through extensive evaluations across a wide range of public and in-house benchmarks, EXAONE 3.0 demonstrates highly compet… ▽ More We introduce EXAONE 3.0 instruction-tuned language model, the first open model in the family of Large Language Models (LLMs) developed by LG AI Research. Among different model sizes, we publicly release the 7.8B instruction-tuned model to promote open research and innovations. Through extensive evaluations across a wide range of public and in-house benchmarks, EXAONE 3.0 demonstrates highly competitive real-world performance with instruction-following capability against other state-of-the-art open models of similar size. Our comparative analysis shows that EXAONE 3.0 excels particularly in Korean, while achieving compelling performance across general tasks and complex reasoning. With its strong real-world effectiveness and bilingual proficiency, we hope that EXAONE keeps contributing to advancements in Expert AI. Our EXAONE 3.0 instruction-tuned model is available at https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct △ Less

Submitted 13 August, 2024; v1 submitted 7 August, 2024; originally announced August 2024.

Effect of neutrino electromagnetic properties on the quasielastic neutral-current neutrino-nucleus scattering

Authors: K. S. Kim, P. T. P. Hutauruk, Seung-il Nam, Chang Ho Hyun

Abstract: In the quasielastic region, we investigate the effect of neutrino electromagnetic properties constrained from the recent experiments on the electroweak neutral current reaction process of the neutrino-$^{12}$C scattering. For a relativistic description of the nuclear dynamics, we employ the relativistic mean-field model, which has been proven to describe the data nicely in the quasielastic region.… ▽ More In the quasielastic region, we investigate the effect of neutrino electromagnetic properties constrained from the recent experiments on the electroweak neutral current reaction process of the neutrino-$^{12}$C scattering. For a relativistic description of the nuclear dynamics, we employ the relativistic mean-field model, which has been proven to describe the data nicely in the quasielastic region. In the present work, we analyze the influence beyond the Standard Model by considering the neutrino magnetic and electric dipole form factors and charge radius on the neutrino electroweak interactions within $^{12}$C. To this end, we use the values of the neutrino charge radius and the magnetic moment at the squared four momentum transfer $Q^2=0$ obtained from the recent experiments and calculate the neutrino differential cross section of the neutrino-$^{12}$C scattering. We find that the effect of the charge radius and the electric dipole form factor is very small, but the role of the magnetic dipole form factor is sensitive to $Q^2$ and becomes sizable at small momentum transfer. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Comments: 15 pages, 4 figures

Segment Anything in Medical Images and Videos: Benchmark and Deployment

Authors: Jun Ma, Sumin Kim, Feifei Li, Mohammed Baharoon, Reza Asakereh, Hongwei Lyu, Bo Wang

Abstract: Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a comprehensive benchmarking of the Segment Anything Model 2 (SAM2) across 11 medical image modalities and videos and point out its strengths and weaknesses by comparing… ▽ More Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a comprehensive benchmarking of the Segment Anything Model 2 (SAM2) across 11 medical image modalities and videos and point out its strengths and weaknesses by comparing it to SAM1 and MedSAM. Then, we develop a transfer learning pipeline and demonstrate SAM2 can be quickly adapted to medical domain by fine-tuning. Furthermore, we implement SAM2 as a 3D slicer plugin and Gradio API for efficient 3D image and video segmentation. The code has been made publicly available at \url{https://github.com/bowang-lab/MedSAM}. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Evolution of Star Cluster Within Galaxy using Self-consistent Hybrid Hydro/N-body Simulation

Authors: Yongseok Jo, Seoyoung Kim, Ji-hoon Kim, Greg L. Bryan

Abstract: We introduce a GPU-accelerated hybrid hydro/N-body code (Enzo-N) designed to address the challenges of concurrently simulating star clusters and their parent galaxies. This task has been exceedingly challenging, primarily due to the considerable computational time required, which stems from the substantial scale difference between galaxies (~ 0.1 Mpc) and star clusters (~ pc). Yet, this significan… ▽ More We introduce a GPU-accelerated hybrid hydro/N-body code (Enzo-N) designed to address the challenges of concurrently simulating star clusters and their parent galaxies. This task has been exceedingly challenging, primarily due to the considerable computational time required, which stems from the substantial scale difference between galaxies (~ 0.1 Mpc) and star clusters (~ pc). Yet, this significant scale separation means that particles within star clusters perceive those outside the star cluster in a semi-stationary state. By leveraging this aspect, we integrate the direct N-body code (Nbody6++GPU) into the cosmological (magneto-)hydrodynamic code (Enzo) through the utilization of the semi-stationary background acceleration approximation. We solve the dynamics of particles within star clusters using the direct N-body solver with regularization for few-body interactions, while evolving particles outside -- dark matter, gas, and stars -- using the particle-mesh gravity solver and hydrodynamic methods. We demonstrate that Enzo-N successfully simulates the co-evolution of star clusters and their parent galaxies, capturing phenomena such as core collapse of the star cluster and tidal stripping due to galactic tides. This comprehensive framework opens up new possibilities for studying the evolution of star clusters within galaxies, offering insights that were previously inaccessible. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Comments: 15 pages, 13 figures, Accepted for publication in ApJ

VizECGNet: Visual ECG Image Network for Cardiovascular Diseases Classification with Multi-Modal Training and Knowledge Distillation

Authors: Ju-Hyeon Nam, Seo-Hyung Park, Su Jung Kim, Sang-Chul Lee

Abstract: An electrocardiogram (ECG) captures the heart's electrical signal to assess various heart conditions. In practice, ECG data is stored as either digitized signals or printed images. Despite the emergence of numerous deep learning models for digitized signals, many hospitals prefer image storage due to cost considerations. Recognizing the unavailability of raw ECG signals in many clinical settings,… ▽ More An electrocardiogram (ECG) captures the heart's electrical signal to assess various heart conditions. In practice, ECG data is stored as either digitized signals or printed images. Despite the emergence of numerous deep learning models for digitized signals, many hospitals prefer image storage due to cost considerations. Recognizing the unavailability of raw ECG signals in many clinical settings, we propose VizECGNet, which uses only printed ECG graphics to determine the prognosis of multiple cardiovascular diseases. During training, cross-modal attention modules (CMAM) are used to integrate information from two modalities - image and signal, while self-modality attention modules (SMAM) capture inherent long-range dependencies in ECG data of each modality. Additionally, we utilize knowledge distillation to improve the similarity between two distinct predictions from each modality stream. This innovative multi-modal deep learning architecture enables the utilization of only ECG images during inference. VizECGNet with image input achieves higher performance in precision, recall, and F1-Score compared to signal-based ECG classification models, with improvements of 3.50%, 8.21%, and 7.38%, respectively. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Comments: Accepted in International Conference on Image Processing (ICIP) 2024

Integrating Model-Based Footstep Planning with Model-Free Reinforcement Learning for Dynamic Legged Locomotion

Authors: Ho Jae Lee, Seungwoo Hong, Sangbae Kim

Abstract: In this work, we introduce a control framework that combines model-based footstep planning with Reinforcement Learning (RL), leveraging desired footstep patterns derived from the Linear Inverted Pendulum (LIP) dynamics. Utilizing the LIP model, our method forward predicts robot states and determines the desired foot placement given the velocity commands. We then train an RL policy to track the foo… ▽ More In this work, we introduce a control framework that combines model-based footstep planning with Reinforcement Learning (RL), leveraging desired footstep patterns derived from the Linear Inverted Pendulum (LIP) dynamics. Utilizing the LIP model, our method forward predicts robot states and determines the desired foot placement given the velocity commands. We then train an RL policy to track the foot placements without following the full reference motions derived from the LIP model. This partial guidance from the physics model allows the RL policy to integrate the predictive capabilities of the physics-informed dynamics and the adaptability characteristics of the RL controller without overfitting the policy to the template model. Our approach is validated on the MIT Humanoid, demonstrating that our policy can achieve stable yet dynamic locomotion for walking and turning. We further validate the adaptability and generalizability of our policy by extending the locomotion task to unseen, uneven terrain. During the hardware deployment, we have achieved forward walking speeds of up to 1.5 m/s on a treadmill and have successfully performed dynamic locomotion maneuvers such as 90-degree and 180-degree turns. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Comments: 8 pages

Generalized Gaussian Temporal Difference Error For Uncertainty-aware Reinforcement Learning

Authors: Seyeon Kim, Joonhun Lee, Namhoon Cho, Sungjun Han, Seungeon Baek

Abstract: Conventional uncertainty-aware temporal difference (TD) learning methods often rely on simplistic assumptions, typically including a zero-mean Gaussian distribution for TD errors. Such oversimplification can lead to inaccurate error representations and compromised uncertainty estimation. In this paper, we introduce a novel framework for generalized Gaussian error modeling in deep reinforcement lea… ▽ More Conventional uncertainty-aware temporal difference (TD) learning methods often rely on simplistic assumptions, typically including a zero-mean Gaussian distribution for TD errors. Such oversimplification can lead to inaccurate error representations and compromised uncertainty estimation. In this paper, we introduce a novel framework for generalized Gaussian error modeling in deep reinforcement learning, applicable to both discrete and continuous control settings. Our framework enhances the flexibility of error distribution modeling by incorporating higher-order moments, particularly kurtosis, thereby improving the estimation and mitigation of data-dependent noise, i.e., aleatoric uncertainty. We examine the influence of the shape parameter of the generalized Gaussian distribution (GGD) on aleatoric uncertainty and provide a closed-form expression that demonstrates an inverse relationship between uncertainty and the shape parameter. Additionally, we propose a theoretically grounded weighting scheme to fully leverage the GGD. To address epistemic uncertainty, we enhance the batch inverse variance weighting by incorporating bias reduction and kurtosis considerations, resulting in improved robustness. Extensive experimental evaluations using policy gradient algorithms demonstrate the consistent efficacy of our method, showcasing significant performance improvements. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Field-Tunable Valley Coupling and Localization in a Dodecagonal Semiconductor Quasicrystal

Authors: Zhida Liu, Qiang Gao, Yanxing Li, Xiaohui Liu, Fan Zhang, Dong Seob Kim, Yue Ni, Miles Mackenzie, Hamza Abudayyeh, Kenji Watanabe, Takashi Taniguchi, Chih-Kang Shih, Eslam Khalaf, Xiaoqin Li

Abstract: Quasicrystals are characterized by atomic arrangements possessing long-range order without periodicity. Van der Waals (vdW) bilayers provide a unique opportunity to controllably vary atomic alignment between two layers from a periodic moiré crystal to an aperiodic quasicrystal. Here, we reveal a remarkable consequence of the unique atomic arrangement in a dodecagonal WSe2 quasicrystal: the K and Q… ▽ More Quasicrystals are characterized by atomic arrangements possessing long-range order without periodicity. Van der Waals (vdW) bilayers provide a unique opportunity to controllably vary atomic alignment between two layers from a periodic moiré crystal to an aperiodic quasicrystal. Here, we reveal a remarkable consequence of the unique atomic arrangement in a dodecagonal WSe2 quasicrystal: the K and Q valleys in separate layers are brought arbitrarily close in momentum space via higher-order Umklapp scatterings. A modest perpendicular electric field is sufficient to induce strong interlayer K-Q hybridization, manifested as a new hybrid excitonic doublet. Concurrently, we observe the disappearance of the trion resonance and attribute it to quasicrystal potential driven localization. Our findings highlight the remarkable attribute of incommensurate systems to bring any pair of momenta into close proximity, thereby introducing a novel aspect to valley engineering. △ Less

Submitted 4 August, 2024; originally announced August 2024.

Comments: 12 pages, 12 figures

Safe Semi-Supervised Contrastive Learning Using In-Distribution Data as Positive Examples

Authors: Min Gu Kwak, Hyungu Kahng, Seoung Bum Kim

Abstract: Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal; however, their performances are significantly degraded in class distribution mismatch scenarios where out-of-distribution (OOD) data exist in the unlabeled data. Previ… ▽ More Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal; however, their performances are significantly degraded in class distribution mismatch scenarios where out-of-distribution (OOD) data exist in the unlabeled data. Previous safe semi-supervised learning studies have addressed this problem by making OOD data less likely to affect training based on labeled data. However, even if the studies effectively filter out the unnecessary OOD data, they can lose the basic information that all data share regardless of class. To this end, we propose to apply a self-supervised contrastive learning approach to fully exploit a large amount of unlabeled data. We also propose a contrastive loss function with coefficient schedule to aggregate as an anchor the labeled negative examples of the same class into positive examples. To evaluate the performance of the proposed method, we conduct experiments on image classification datasets - CIFAR-10, CIFAR-100, Tiny ImageNet, and CIFAR-100+Tiny ImageNet - under various mismatch ratios. The results show that self-supervised contrastive learning significantly improves classification accuracy. Moreover, aggregating the in-distribution examples produces better representation and consequently further improves classification accuracy. △ Less

Submitted 3 August, 2024; originally announced August 2024.

Access and sustainment of ELMy H-mode operation for ITER Pre-Fusion Power Operation plasmas using JINTRAC

Authors: E. Tholerus, L. Garzotti, V. Parail, Y. Baranov, X. Bonnin, G. Corrigan, F. Eriksson, D. Farina, L. Figini, D. M. Harting, S. H. Kim, F. Koechl, A. Loarte, E. Militello Asp, H. Nordman, S. D. Pinches, A. R. Polevoi, P. Strand

Abstract: In the initial stages of ITER operation, ELM mitigation systems need to be commissioned. This requires controlled flat-top operation in type-I ELMy H-mode regimes. Hydrogen or helium plasma discharges are used exclusively in these stages to ensure negligible production of neutrons from fusion reactions. With the expected higher L-H power threshold of hydrogen and helium plasmas compared to corresp… ▽ More In the initial stages of ITER operation, ELM mitigation systems need to be commissioned. This requires controlled flat-top operation in type-I ELMy H-mode regimes. Hydrogen or helium plasma discharges are used exclusively in these stages to ensure negligible production of neutrons from fusion reactions. With the expected higher L-H power threshold of hydrogen and helium plasmas compared to corresponding D and D/T plasmas, it is uncertain whether available auxiliary power systems are sufficient to operate in stable type-I ELMy H-mode. This has been investigated using integrated core and edge/SOL/divertor modelling with JINTRAC. Assuming that the L-H power threshold is well captured by the Martin08 scaling law, the presented simulations have found that 30 MW of ECRH power is likely required for the investigated hydrogen plasma scenarios, rather than the originally planned 20 MW in the 2016 Staged Approach ITER Baseline. However, past experiments have shown that a small helium fraction (~10 %) can considerably reduce the hydrogen plasma L-H power threshold. Assuming that these results extrapolate to ITER operation regimes, the 7.5MA/2.65T hydrogen plasma scenario is likely to access stable type-I ELMy H-mode operation also at 20 MW of ECRH. △ Less

Submitted 2 August, 2024; originally announced August 2024.

Comments: 22 pages, 10 figures

Privacy-Preserving Split Learning with Vision Transformers using Patch-Wise Random and Noisy CutMix

Authors: Seungeun Oh, Sihun Baek, Jihong Park, Hyelin Nam, Praneeth Vepakomma, Ramesh Raskar, Mehdi Bennis, Seong-Lyun Kim

Abstract: In computer vision, the vision transformer (ViT) has increasingly superseded the convolutional neural network (CNN) for improved accuracy and robustness. However, ViT's large model sizes and high sample complexity make it difficult to train on resource-constrained edge devices. Split learning (SL) emerges as a viable solution, leveraging server-side resources to train ViTs while utilizing private… ▽ More In computer vision, the vision transformer (ViT) has increasingly superseded the convolutional neural network (CNN) for improved accuracy and robustness. However, ViT's large model sizes and high sample complexity make it difficult to train on resource-constrained edge devices. Split learning (SL) emerges as a viable solution, leveraging server-side resources to train ViTs while utilizing private data from distributed devices. However, SL requires additional information exchange for weight updates between the device and the server, which can be exposed to various attacks on private training data. To mitigate the risk of data breaches in classification tasks, inspired from the CutMix regularization, we propose a novel privacy-preserving SL framework that injects Gaussian noise into smashed data and mixes randomly chosen patches of smashed data across clients, coined DP-CutMixSL. Our analysis demonstrates that DP-CutMixSL is a differentially private (DP) mechanism that strengthens privacy protection against membership inference attacks during forward propagation. Through simulations, we show that DP-CutMixSL improves privacy protection against membership inference attacks, reconstruction attacks, and label inference attacks, while also improving accuracy compared to DP-SL and DP-MixSL. △ Less

Submitted 2 August, 2024; originally announced August 2024.

Comments: 23 pages, 11 figures, 8 tables, to be published in Transactions on Machine Learning Research (TMLR)

Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments

Authors: Sangwoo Shin, Seunghyun Kim, Youngsoo Jang, Moontae Lee, Honguk Woo

Abstract: In embodied instruction-following (EIF), the integration of pretrained language models (LMs) as task planners emerges as a significant branch, where tasks are planned at the skill level by prompting LMs with pretrained skills and user instructions. However, grounding these pretrained skills in different domains remains challenging due to their intricate entanglement with the domain-specific knowle… ▽ More In embodied instruction-following (EIF), the integration of pretrained language models (LMs) as task planners emerges as a significant branch, where tasks are planned at the skill level by prompting LMs with pretrained skills and user instructions. However, grounding these pretrained skills in different domains remains challenging due to their intricate entanglement with the domain-specific knowledge. To address this challenge, we present a semantic skill grounding (SemGro) framework that leverages the hierarchical nature of semantic skills. SemGro recognizes the broad spectrum of these skills, ranging from short-horizon low-semantic skills that are universally applicable across domains to long-horizon rich-semantic skills that are highly specialized and tailored for particular domains. The framework employs an iterative skill decomposition approach, starting from the higher levels of semantic skill hierarchy and then moving downwards, so as to ground each planned skill to an executable level within the target domain. To do so, we use the reasoning capabilities of LMs for composing and decomposing semantic skills, as well as their multi-modal extension for assessing the skill feasibility in the target domain. Our experiments in the VirtualHome benchmark show the efficacy of SemGro in 300 cross-domain EIF scenarios. △ Less

Submitted 2 August, 2024; originally announced August 2024.

Hierarchically Structured Neural Bones for Reconstructing Animatable Objects from Casual Videos

Authors: Subin Jeon, In Cho, Minsu Kim, Woong Oh Cho, Seon Joo Kim

Abstract: We propose a new framework for creating and easily manipulating 3D models of arbitrary objects using casually captured videos. Our core ingredient is a novel hierarchy deformation model, which captures motions of objects with a tree-structured bones. Our hierarchy system decomposes motions based on the granularity and reveals the correlations between parts without exploiting any prior structural k… ▽ More We propose a new framework for creating and easily manipulating 3D models of arbitrary objects using casually captured videos. Our core ingredient is a novel hierarchy deformation model, which captures motions of objects with a tree-structured bones. Our hierarchy system decomposes motions based on the granularity and reveals the correlations between parts without exploiting any prior structural knowledge. We further propose to regularize the bones to be positioned at the basis of motions, centers of parts, sufficiently covering related surfaces of the part. This is achieved by our bone occupancy function, which identifies whether a given 3D point is placed within the bone. Coupling the proposed components, our framework offers several clear advantages: (1) users can obtain animatable 3D models of the arbitrary objects in improved quality from their casual videos, (2) users can manipulate 3D models in an intuitive manner with minimal costs, and (3) users can interactively add or delete control points as necessary. The experimental results demonstrate the efficacy of our framework on diverse instances, in reconstruction quality, interpretability and easier manipulation. Our code is available at https://github.com/subin6/HSNB. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Comments: ECCV 2024 accepted

The Llama 3 Herd of Models

Authors: Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurelien Rodriguez, Austen Gregerson, Ava Spataru, Baptiste Roziere, Bethany Biron, Binh Tang , et al. (510 additional authors not shown)

Abstract: Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical… ▽ More Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development. △ Less

Submitted 15 August, 2024; v1 submitted 31 July, 2024; originally announced July 2024.

Extended Fiducial Inference: Toward an Automated Process of Statistical Inference

Authors: Faming Liang, Sehwan Kim, Yan Sun

Abstract: While fiducial inference was widely considered a big blunder by R.A. Fisher, the goal he initially set --`inferring the uncertainty of model parameters on the basis of observations' -- has been continually pursued by many statisticians. To this end, we develop a new statistical inference method called extended Fiducial inference (EFI). The new method achieves the goal of fiducial inference by leve… ▽ More While fiducial inference was widely considered a big blunder by R.A. Fisher, the goal he initially set --`inferring the uncertainty of model parameters on the basis of observations' -- has been continually pursued by many statisticians. To this end, we develop a new statistical inference method called extended Fiducial inference (EFI). The new method achieves the goal of fiducial inference by leveraging advanced statistical computing techniques while remaining scalable for big data. EFI involves jointly imputing random errors realized in observations using stochastic gradient Markov chain Monte Carlo and estimating the inverse function using a sparse deep neural network (DNN). The consistency of the sparse DNN estimator ensures that the uncertainty embedded in observations is properly propagated to model parameters through the estimated inverse function, thereby validating downstream statistical inference. Compared to frequentist and Bayesian methods, EFI offers significant advantages in parameter estimation and hypothesis testing. Specifically, EFI provides higher fidelity in parameter estimation, especially when outliers are present in the observations; and eliminates the need for theoretical reference distributions in hypothesis testing, thereby automating the statistical inference process. EFI also provides an innovative framework for semi-supervised learning. △ Less

Submitted 31 July, 2024; originally announced July 2024.

Accelerating Image Super-Resolution Networks with Pixel-Level Classification

Authors: Jinho Jeong, Jinwoo Kim, Younghyun Jo, Seon Joo Kim

Abstract: In recent times, the need for effective super-resolution (SR) techniques has surged, especially for large-scale images ranging 2K to 8K resolutions. For DNN-based SISR, decomposing images into overlapping patches is typically necessary due to computational constraints. In such patch-decomposing scheme, one can allocate computational resources differently based on each patch's difficulty to further… ▽ More In recent times, the need for effective super-resolution (SR) techniques has surged, especially for large-scale images ranging 2K to 8K resolutions. For DNN-based SISR, decomposing images into overlapping patches is typically necessary due to computational constraints. In such patch-decomposing scheme, one can allocate computational resources differently based on each patch's difficulty to further improve efficiency while maintaining SR performance. However, this approach has a limitation: computational resources is uniformly allocated within a patch, leading to lower efficiency when the patch contain pixels with varying levels of restoration difficulty. To address the issue, we propose the Pixel-level Classifier for Single Image Super-Resolution (PCSR), a novel method designed to distribute computational resources adaptively at the pixel level. A PCSR model comprises a backbone, a pixel-level classifier, and a set of pixel-level upsamplers with varying capacities. The pixel-level classifier assigns each pixel to an appropriate upsampler based on its restoration difficulty, thereby optimizing computational resource usage. Our method allows for performance and computational cost balance during inference without re-training. Our experiments demonstrate PCSR's advantage over existing patch-distributing methods in PSNR-FLOP trade-offs across different backbone models and benchmarks. The code is available at https://github.com/3587jjh/PCSR. △ Less

Submitted 31 July, 2024; originally announced July 2024.

Comments: Accepted by ECCV 2024

Constraint maps: singularities vs free boundaries

Authors: Alessio Figalli, André Guerra, Sunghan Kim, Henrik Shahgholian

Abstract: Energy-minimizing constraint maps are a natural extension of the obstacle problem within a vectorial framework. Due to inherent topological constraints, these maps manifest a diverse structure that includes singularities similar to harmonic maps, branch points reminiscent of minimal surfaces, and the intricate free-boundary behavior of the obstacle problem. The complexity of these maps poses signi… ▽ More Energy-minimizing constraint maps are a natural extension of the obstacle problem within a vectorial framework. Due to inherent topological constraints, these maps manifest a diverse structure that includes singularities similar to harmonic maps, branch points reminiscent of minimal surfaces, and the intricate free-boundary behavior of the obstacle problem. The complexity of these maps poses significant challenges to their analysis. In this paper, we first focus on constraint maps with uniformly convex obstacles and establish continuity (and therefore higher-order regularity) within a uniform neighborhood of the free boundary. More precisely, thanks to a new quantitative unique continuation principle near singularities (which is new even in the setting of classical harmonic maps), we prove that, in the uniformly convex setting, topological singularities can only lie in the interior of the contact set. We then establish the optimality of this result. Second, while exploring the structure of the free boundary, we investigate the presence of branch points and show how they lead to completely new types of singularities not present in the scalar case. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Comments: 61 pages, 8 figures

Apple Intelligence Foundation Language Models

Authors: Tom Gunter, Zirui Wang, Chong Wang, Ruoming Pang, Andy Narayanan, Aonan Zhang, Bowen Zhang, Chen Chen, Chung-Cheng Chiu, David Qiu, Deepak Gopinath, Dian Ang Yap, Dong Yin, Feng Nan, Floris Weers, Guoli Yin, Haoshuo Huang, Jianyu Wang, Jiarui Lu, John Peebles, Ke Ye, Mark Lee, Nan Du, Qibin Chen, Quentin Keunebroek , et al. (130 additional authors not shown)

Abstract: We present foundation language models developed to power Apple Intelligence features, including a ~3 billion parameter model designed to run efficiently on devices and a large server-based language model designed for Private Cloud Compute. These models are designed to perform a wide range of tasks efficiently, accurately, and responsibly. This report describes the model architecture, the data used… ▽ More We present foundation language models developed to power Apple Intelligence features, including a ~3 billion parameter model designed to run efficiently on devices and a large server-based language model designed for Private Cloud Compute. These models are designed to perform a wide range of tasks efficiently, accurately, and responsibly. This report describes the model architecture, the data used to train the model, the training process, how the models are optimized for inference, and the evaluation results. We highlight our focus on Responsible AI and how the principles are applied throughout the model development. △ Less

Submitted 29 July, 2024; originally announced July 2024.

Safeguard Text-to-Image Diffusion Models with Human Feedback Inversion

Authors: Sanghyun Kim, Seohyeon Jung, Balhae Kim, Moonseok Choi, Jinwoo Shin, Juho Lee

Abstract: This paper addresses the societal concerns arising from large-scale text-to-image diffusion models for generating potentially harmful or copyrighted content. Existing models rely heavily on internet-crawled data, wherein problematic concepts persist due to incomplete filtration processes. While previous approaches somewhat alleviate the issue, they often rely on text-specified concepts, introducin… ▽ More This paper addresses the societal concerns arising from large-scale text-to-image diffusion models for generating potentially harmful or copyrighted content. Existing models rely heavily on internet-crawled data, wherein problematic concepts persist due to incomplete filtration processes. While previous approaches somewhat alleviate the issue, they often rely on text-specified concepts, introducing challenges in accurately capturing nuanced concepts and aligning model knowledge with human understandings. In response, we propose a framework named Human Feedback Inversion (HFI), where human feedback on model-generated images is condensed into textual tokens guiding the mitigation or removal of problematic images. The proposed framework can be built upon existing techniques for the same purpose, enhancing their alignment with human judgment. By doing so, we simplify the training objective with a self-distillation-based technique, providing a strong baseline for concept removal. Our experimental results demonstrate our framework significantly reduces objectionable content generation while preserving image quality, contributing to the ethical deployment of AI in the public sphere. △ Less

Submitted 17 July, 2024; originally announced July 2024.

Comments: ECCV 2024. 56 pages, 24 figures. Caution: This paper contains discussions and examples related to harmful content, including text and images. Reader discretion is advised. Code is available at https://github.com/nannullna/safeguard-hfi

ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learning

Authors: Hosung Lee, Sejin Kim, Seungpil Lee, Sanha Hwang, Jihwan Lee, Byung-Jun Lee, Sundong Kim

Abstract: This paper introduces ARCLE, an environment designed to facilitate reinforcement learning research on the Abstraction and Reasoning Corpus (ARC). Addressing this inductive reasoning benchmark with reinforcement learning presents these challenges: a vast action space, a hard-to-reach goal, and a variety of tasks. We demonstrate that an agent with proximal policy optimization can learn individual ta… ▽ More This paper introduces ARCLE, an environment designed to facilitate reinforcement learning research on the Abstraction and Reasoning Corpus (ARC). Addressing this inductive reasoning benchmark with reinforcement learning presents these challenges: a vast action space, a hard-to-reach goal, and a variety of tasks. We demonstrate that an agent with proximal policy optimization can learn individual tasks through ARCLE. The adoption of non-factorial policies and auxiliary losses led to performance enhancements, effectively mitigating issues associated with action spaces and goal attainment. Based on these insights, we propose several research directions and motivations for using ARCLE, including MAML, GFlowNets, and World Models. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Comments: Accepted by CoLLAs 2024, Project page: https://github.com/confeitoHS/arcle

Generalizing AI-driven Assessment of Immunohistochemistry across Immunostains and Cancer Types: A Universal Immunohistochemistry Analyzer

Authors: Biagio Brattoli, Mohammad Mostafavi, Taebum Lee, Wonkyung Jung, Jeongun Ryu, Seonwook Park, Jongchan Park, Sergio Pereira, Seunghwan Shin, Sangjoon Choi, Hyojin Kim, Donggeun Yoo, Siraj M. Ali, Kyunghyun Paeng, Chan-Young Ock, Soo Ick Cho, Seokhwi Kim

Abstract: Despite advancements in methodologies, immunohistochemistry (IHC) remains the most utilized ancillary test for histopathologic and companion diagnostics in targeted therapies. However, objective IHC assessment poses challenges. Artificial intelligence (AI) has emerged as a potential solution, yet its development requires extensive training for each cancer and IHC type, limiting versatility. We dev… ▽ More Despite advancements in methodologies, immunohistochemistry (IHC) remains the most utilized ancillary test for histopathologic and companion diagnostics in targeted therapies. However, objective IHC assessment poses challenges. Artificial intelligence (AI) has emerged as a potential solution, yet its development requires extensive training for each cancer and IHC type, limiting versatility. We developed a Universal IHC (UIHC) analyzer, an AI model for interpreting IHC images regardless of tumor or IHC types, using training datasets from various cancers stained for PD-L1 and/or HER2. This multi-cohort trained model outperforms conventional single-cohort models in interpreting unseen IHCs (Kappa score 0.578 vs. up to 0.509) and consistently shows superior performance across different positive staining cutoff values. Qualitative analysis reveals that UIHC effectively clusters patches based on expression levels. The UIHC model also quantitatively assesses c-MET expression with MET mutations, representing a significant advancement in AI application in the era of personalized medicine and accumulating novel biomarkers. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Distributed Quantum Approximate Optimization Algorithm on Integrated High-Performance Computing and Quantum Computing Systems for Large-Scale Optimization

Authors: Seongmin Kim, Tengfei Luo, Eungkyu Lee, In-Saeng Suh

Abstract: Quantum approximated optimization algorithm (QAOA) has shown promise for solving combinatorial optimization problems by providing quantum speedup on near-term gate-based quantum computing systems. However, QAOA faces challenges in optimizing variational parameters for high-dimensional problems due to the large number of qubits required and the complexity of deep circuits, which limit its scalabili… ▽ More Quantum approximated optimization algorithm (QAOA) has shown promise for solving combinatorial optimization problems by providing quantum speedup on near-term gate-based quantum computing systems. However, QAOA faces challenges in optimizing variational parameters for high-dimensional problems due to the large number of qubits required and the complexity of deep circuits, which limit its scalability for real-world applications. In this study, we propose a distributed QAOA (DQAOA), which leverages a high-performance computing-quantum computing (HPC-QC) integrated system. DQAOA leverages distributed computing strategies to decompose a large job into smaller tasks, which are then processed on the HPC-QC system. The global solution is iteratively updated by aggregating sub-solutions obtained from DQAOA, allowing convergence toward the optimal solution. We demonstrate that DQAOA can handle considerably large-scale optimization problems (e.g., 1,000-bit problem) achieving high accuracy (~99%) and short time-to-solution (~276 s). To apply this algorithm to material science, we further develop an active learning algorithm integrated with our DQAOA (AL-DQAOA), which involves machine learning, DQAOA, and active data production in an iterative loop. We successfully optimize photonic structures using AL-DQAOA, indicating that solving real-world optimization problems using gate-based quantum computing is feasible with our strategies. We expect the proposed DQAOA to be applicable to a wide range of optimization problems and AL-DQAOA to find broader applications in material design. △ Less

Submitted 29 July, 2024; originally announced July 2024.

Purification and correction of quantum channels by commutation-derived quantum filters

Authors: Sowmitra Das, Jinzhao Sun, Michael Hanks, Bálint Koczor, M. S. Kim

Abstract: Reducing the effect of errors is essential for reliable quantum computation. Quantum error mitigation (QEM) and quantum error correction (QEC) are two frameworks that have been proposed to address this task, each with its respective challenges: sampling costs and inability to recover the state for QEM, and qubit overheads for QEC. In this work, we combine ideas from these two frameworks and introd… ▽ More Reducing the effect of errors is essential for reliable quantum computation. Quantum error mitigation (QEM) and quantum error correction (QEC) are two frameworks that have been proposed to address this task, each with its respective challenges: sampling costs and inability to recover the state for QEM, and qubit overheads for QEC. In this work, we combine ideas from these two frameworks and introduce an information-theoretic machinery called a quantum filter that can purify or correct quantum channels. We provide an explicit construction of a filter that can correct arbitrary types of noise in an $n$-qubit Clifford circuit using $2n$ ancillary qubits based on a commutation-derived error detection circuit. We also show that this filtering scheme can partially purify noise in non-Clifford gates (e.g. T and CCZ gates). In contrast to QEC, this scheme works in an error-reduction sense because it does not require prior encoding of the input state into a QEC code and requires only a single instance of the target channel. Under the assumptions of clean ancillary qubits, this scheme overcomes the exponential sampling overhead in QEM because it can deterministically correct the error channel without discarding any result. We further propose an ancilla-efficient Pauli filter which can remove nearly all the low-weight Pauli components of the error channel in a Clifford circuit using only 2 ancillary qubits similar to flag error correction codes. We prove that for local depolarising noise, this filter can achieve a quadratic reduction in the {average} infidelity of the channel. The Pauli filter can also be used to convert an unbiased error channel into a completely biased error channel and thus is compatible with biased-noise QEC codes which have high code capacity. These examples demonstrate the utility of the quantum filter as an efficient error-reduction technique. △ Less

Submitted 29 July, 2024; originally announced July 2024.

Comments: 25 pages, 17 figures

Explicit formulas related to Euler's product expansion for cosine function

Authors: Taekyun Kim, Dae San Kim

Abstract: In this paper, we derive by using elementary methods some continued fractions, certain identities involving derivatives of tanx, several expressions for log coshx and an identity for π2, from a series expansion of tan x, which gives the product expansion of the cosine function. In this paper, we derive by using elementary methods some continued fractions, certain identities involving derivatives of tanx, several expressions for log coshx and an identity for π2, from a series expansion of tan x, which gives the product expansion of the cosine function. △ Less

Submitted 29 July, 2024; originally announced July 2024.

Comments: 13 pages

MSC Class: 11A55; 11B68

Motion Manifold Flow Primitives for Language-Guided Trajectory Generation

Authors: Yonghyeon Lee, Byeongho Lee, Seungyeon Kim, Frank C. Park

Abstract: Developing text-based robot trajectory generation models is made particularly difficult by the small dataset size, high dimensionality of the trajectory space, and the inherent complexity of the text-conditional motion distribution. Recent manifold learning-based methods have partially addressed the dimensionality and dataset size issues, but struggle with the complex text-conditional distribution… ▽ More Developing text-based robot trajectory generation models is made particularly difficult by the small dataset size, high dimensionality of the trajectory space, and the inherent complexity of the text-conditional motion distribution. Recent manifold learning-based methods have partially addressed the dimensionality and dataset size issues, but struggle with the complex text-conditional distribution. In this paper we propose a text-based trajectory generation model that attempts to address all three challenges while relying on only a handful of demonstration trajectory data. Our key idea is to leverage recent flow-based models capable of capturing complex conditional distributions, not directly in the high-dimensional trajectory space, but rather in the low-dimensional latent coordinate space of the motion manifold, with deliberately designed regularization terms to ensure smoothness of motions and robustness to text variations. We show that our {\it Motion Manifold Flow Primitive (MMFP)} framework can accurately generate qualitatively distinct motions for a wide range of text inputs, significantly outperforming existing methods. △ Less

Submitted 28 July, 2024; originally announced July 2024.

Comments: 12 pages, 10 figures, under review

Magicity versus superfluidity around $^{28}$O viewed from the study of $^{30}$F

Authors: J. Kahlbow, T. Aumann, O. Sorlin, Y. Kondo, T. Nakamura, F. Nowacki, A. Revel, N. L. Achouri, H. Al Falou, L. Atar, H. Baba, K. Boretzky, C. Caesar, D. Calvet, H. Chae, N. Chiga, A. Corsi, F. Delaunay, A. Delbart, Q. Deshayes, Z. Dombradi, C. A. Douma, Z. Elekes, I. Gasparic, J. -M. Gheller , et al. (62 additional authors not shown)

Abstract: The neutron-rich unbound fluorine isotope $^{30}$F$_{21}$ has been observed for the first time by measuring its neutron decay at the SAMURAI spectrometer (RIBF, RIKEN) in the quasi-free proton knockout reaction of $^{31}$Ne nuclei at 235 MeV/nucleon. The mass and thus one-neutron-separation energy of $^{30}$F has been determined to be $S_n = -472\pm 58 \mathrm{(stat.)} \pm 33 \mathrm{(sys.)}$ keV… ▽ More The neutron-rich unbound fluorine isotope $^{30}$F$_{21}$ has been observed for the first time by measuring its neutron decay at the SAMURAI spectrometer (RIBF, RIKEN) in the quasi-free proton knockout reaction of $^{31}$Ne nuclei at 235 MeV/nucleon. The mass and thus one-neutron-separation energy of $^{30}$F has been determined to be $S_n = -472\pm 58 \mathrm{(stat.)} \pm 33 \mathrm{(sys.)}$ keV from the measurement of its invariant-mass spectrum. The absence of a sharp drop in $S_n$($^{30}$F) shows that the ``magic'' $N=20$ shell gap is not restored close to $^{28}$O, which is in agreement with our shell-model calculations that predict a near degeneracy between the neutron $d$ and $fp$ orbitals, with the $1p_{3/2}$ and $1p_{1/2}$ orbitals becoming more bound than the $0f_{7/2}$ one. This degeneracy and reordering of orbitals has two potential consequences: $^{28}$O behaves like a strongly superfluid nucleus with neutron pairs scattering across shells, and both $^{29,31}$F appear to be good two-neutron halo-nucleus candidates. △ Less

Submitted 27 July, 2024; originally announced July 2024.

Comments: 9 pages, 2 figures, accepted for publication in Physical Review Letters

PIV3CAMS: a multi-camera dataset for multiple computer vision problems and its application to novel view-point synthesis

Authors: Sohyeong Kim, Martin Danelljan, Radu Timofte, Luc Van Gool, Jean-Philippe Thiran

Abstract: The modern approaches for computer vision tasks significantly rely on machine learning, which requires a large number of quality images. While there is a plethora of image datasets with a single type of images, there is a lack of datasets collected from multiple cameras. In this thesis, we introduce Paired Image and Video data from three CAMeraS, namely PIV3CAMS, aimed at multiple computer vision… ▽ More The modern approaches for computer vision tasks significantly rely on machine learning, which requires a large number of quality images. While there is a plethora of image datasets with a single type of images, there is a lack of datasets collected from multiple cameras. In this thesis, we introduce Paired Image and Video data from three CAMeraS, namely PIV3CAMS, aimed at multiple computer vision tasks. The PIV3CAMS dataset consists of 8385 pairs of images and 82 pairs of videos taken from three different cameras: Canon D5 Mark IV, Huawei P20, and ZED stereo camera. The dataset includes various indoor and outdoor scenes from different locations in Zurich (Switzerland) and Cheonan (South Korea). Some of the computer vision applications that can benefit from the PIV3CAMS dataset are image/video enhancement, view interpolation, image matching, and much more. We provide a careful explanation of the data collection process and detailed analysis of the data. The second part of this thesis studies the usage of depth information in the view synthesizing task. In addition to the regeneration of a current state-of-the-art algorithm, we investigate several proposed alternative models that integrate depth information geometrically. Through extensive experiments, we show that the effect of depth is crucial in small view changes. Finally, we apply our model to the introduced PIV3CAMS dataset to synthesize novel target views as an example application of PIV3CAMS. △ Less

Submitted 26 July, 2024; originally announced July 2024.