-
Semi-supervised reference-based sketch extraction using a contrastive learning framework
Authors:
Chang Wook Seo,
Amirsaman Ashtari,
Junyong Noh
Abstract:
Sketches reflect the drawing style of individual artists; therefore, it is important to consider their unique styles when extracting sketches from color images for various applications. Unfortunately, most existing sketch extraction methods are designed to extract sketches of a single style. Although there have been some attempts to generate various style sketches, the methods generally suffer fro…
▽ More
Sketches reflect the drawing style of individual artists; therefore, it is important to consider their unique styles when extracting sketches from color images for various applications. Unfortunately, most existing sketch extraction methods are designed to extract sketches of a single style. Although there have been some attempts to generate various style sketches, the methods generally suffer from two limitations: low quality results and difficulty in training the model due to the requirement of a paired dataset. In this paper, we propose a novel multi-modal sketch extraction method that can imitate the style of a given reference sketch with unpaired data training in a semi-supervised manner. Our method outperforms state-of-the-art sketch extraction methods and unpaired image translation methods in both quantitative and qualitative evaluations.
△ Less
Submitted 19 July, 2024;
originally announced July 2024.
-
Stylized Face Sketch Extraction via Generative Prior with Limited Data
Authors:
Kwan Yun,
Kwanggyoon Seo,
Chang Wook Seo,
Soyeon Yoon,
Seongcheol Kim,
Soohyun Ji,
Amirsaman Ashtari,
Junyong Noh
Abstract:
Facial sketches are both a concise way of showing the identity of a person and a means to express artistic intention. While a few techniques have recently emerged that allow sketches to be extracted in different styles, they typically rely on a large amount of data that is difficult to obtain. Here, we propose StyleSketch, a method for extracting high-resolution stylized sketches from a face image…
▽ More
Facial sketches are both a concise way of showing the identity of a person and a means to express artistic intention. While a few techniques have recently emerged that allow sketches to be extracted in different styles, they typically rely on a large amount of data that is difficult to obtain. Here, we propose StyleSketch, a method for extracting high-resolution stylized sketches from a face image. Using the rich semantics of the deep features from a pretrained StyleGAN, we are able to train a sketch generator with 16 pairs of face and the corresponding sketch images. The sketch generator utilizes part-based losses with two-stage learning for fast convergence during training for high-quality sketch extraction. Through a set of comparisons, we show that StyleSketch outperforms existing state-of-the-art sketch extraction methods and few-shot image adaptation methods for the task of extracting high-resolution abstract face sketches. We further demonstrate the versatility of StyleSketch by extending its use to other domains and explore the possibility of semantic editing. The project page can be found in https://kwanyun.github.io/stylesketch_project.
△ Less
Submitted 17 March, 2024;
originally announced March 2024.
-
Case report: Abnormal radiation dose rate measurement near Fukushima Daiichi nuclear power plant
Authors:
Young Chan Seo
Abstract:
This paper presents the results of radiation dose rate measurements taken by the author in various locations in South Korea and Japan, including near the Fukushima Daiichi nuclear power plant site. Air dose rates were measured in Seoul, during a flight over the East Sea, in Fukushima Prefecture, and in Tokyo using a calibrated survey instrument. The measurements were compared with reference values…
▽ More
This paper presents the results of radiation dose rate measurements taken by the author in various locations in South Korea and Japan, including near the Fukushima Daiichi nuclear power plant site. Air dose rates were measured in Seoul, during a flight over the East Sea, in Fukushima Prefecture, and in Tokyo using a calibrated survey instrument. The measurements were compared with reference values from official sources or previous studies. The author discovered that the majority of the measurements fell within the normal range of environmental radiation, except for an unusually high dose rate at Tomioka Station, which is approximately 10 km away from the Fukushima Daiichi nuclear plant. The author recommends that Japanese institutions conduct more precise measurements in the vicinity of the nuclear accident sites.
△ Less
Submitted 8 January, 2024;
originally announced February 2024.
-
Representative Feature Extraction During Diffusion Process for Sketch Extraction with One Example
Authors:
Kwan Yun,
Youngseo Kim,
Kwanggyoon Seo,
Chang Wook Seo,
Junyong Noh
Abstract:
We introduce DiffSketch, a method for generating a variety of stylized sketches from images. Our approach focuses on selecting representative features from the rich semantics of deep features within a pretrained diffusion model. This novel sketch generation method can be trained with one manual drawing. Furthermore, efficient sketch extraction is ensured by distilling a trained generator into a st…
▽ More
We introduce DiffSketch, a method for generating a variety of stylized sketches from images. Our approach focuses on selecting representative features from the rich semantics of deep features within a pretrained diffusion model. This novel sketch generation method can be trained with one manual drawing. Furthermore, efficient sketch extraction is ensured by distilling a trained generator into a streamlined extractor. We select denoising diffusion features through analysis and integrate these selected features with VAE features to produce sketches. Additionally, we propose a sampling scheme for training models using a conditional generative approach. Through a series of comparisons, we verify that distilled DiffSketch not only outperforms existing state-of-the-art sketch extraction methods but also surpasses diffusion-based stylization methods in the task of extracting sketches.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Public Perceptions of Fukushima Food Products in South Korea and Its dispute Resolution: A Comparative Study on East Asia
Authors:
Young Chan Seo
Abstract:
This paper analyzes the excessive risk perception of Korea as one of the causes of the international dispute over the import of Fukushima food between Korea and Japan. To do this, it compares the perception of Fukushima food among Koreans and people from other countries through a survey and identifies the factors that affect the perception through a linear regression analysis. As a result, it find…
▽ More
This paper analyzes the excessive risk perception of Korea as one of the causes of the international dispute over the import of Fukushima food between Korea and Japan. To do this, it compares the perception of Fukushima food among Koreans and people from other countries through a survey and identifies the factors that affect the perception through a linear regression analysis. As a result, it finds that Koreans have a higher negative perception of Fukushima food than people from other countries and that this is related to the level of knowledge about radiation and the evaluation of the Fukushima nuclear power plant accident response. It also presents the subjective opinion of the author that political conflicts between Korea and Japan may affect the perception gap and international disputes. This paper proposes a model of risk perception and decision-making process for Fukushima food and emphasizes the need to improve the risk perception of Koreans through public education and publicity campaigns.
△ Less
Submitted 16 October, 2023;
originally announced October 2023.
-
Chiral electroluminescence from thin-film perovskite metacavities
Authors:
Seongheon Kim,
Soo-Chan An,
Younggon Kim,
Yun Seop Shin,
Alexander A. Antonov,
In Cheol Seo,
Byung Hoon Woo,
Yeonsoo Lim,
Maxim V. Gorkunov,
Yuri S. Kivshar,
Jin Young Kim,
Young Chul Jun
Abstract:
Chiral light sources realized in ultracompact device platforms are highly desirable for various applications. Among active media employed for thin-film emission devices, lead-halide perovskites have been extensively studied for photoluminescence due to their exceptional properties. However, up to date, there have been no demonstrations of chiral electroluminescence with a substantial degree of cir…
▽ More
Chiral light sources realized in ultracompact device platforms are highly desirable for various applications. Among active media employed for thin-film emission devices, lead-halide perovskites have been extensively studied for photoluminescence due to their exceptional properties. However, up to date, there have been no demonstrations of chiral electroluminescence with a substantial degree of circular polarization (DCP), being critical for the development of practical devices. Here, we propose a new concept of chiral light sources based on a thin-film perovskite metacavity and experimentally demonstrate chiral electroluminescence with DCP approaching 0.38. We design a metacavity created by a metal and a dielectric metasurface supporting photonic eigenstates with close-to-maximum chiral response. Chiral cavity modes facilitate asymmetric electroluminescence of pairs of left and right circularly polarized waves propagating in the opposite oblique directions. The proposed ultracompact light sources are especially advantageous for many applications requiring chiral light beams of both helicities.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
A Survey on Password Guessing
Authors:
Lam Tran,
Thuc Nguyen,
Changho Seo,
Hyunil Kim,
Deokjai Choi
Abstract:
Text password has served as the most popular method for user authentication so far, and is not likely to be totally replaced in foreseeable future. Password authentication offers several desirable properties (e.g., low-cost, highly available, easy-to-implement, reusable). However, it suffers from a critical security issue mainly caused by the inability to memorize complicated strings of humans. Us…
▽ More
Text password has served as the most popular method for user authentication so far, and is not likely to be totally replaced in foreseeable future. Password authentication offers several desirable properties (e.g., low-cost, highly available, easy-to-implement, reusable). However, it suffers from a critical security issue mainly caused by the inability to memorize complicated strings of humans. Users tend to choose easy-to-remember passwords which are not uniformly distributed in the key space. Thus, user-selected passwords are susceptible to guessing attacks. In order to encourage and support users to use strong passwords, it is necessary to simulate automated password guessing methods to determine the passwords' strength and identify weak passwords. A large number of password guessing models have been proposed in the literature. However, little attention was paid to the task of providing a systematic survey which is necessary to review the state-of-the-art approaches, identify gaps, and avoid duplicate studies. Motivated by that, we conduct a comprehensive survey on all password guessing studies presented in the literature from 1979 to 2022. We propose a generic methodology map to present an overview of existing methods. Then, we explain each representative approach in detail. The experimental procedures and available datasets used to evaluate password guessing models are summarized, and the reported performances of representative studies are compared. Finally, the current limitations and the open problems as future research directions are discussed. We believe that this survey is helpful to both experts and newcomers who are interested in password security
△ Less
Submitted 25 December, 2022; v1 submitted 16 December, 2022;
originally announced December 2022.
-
Honeycomb oxide heterostructure: a new platform for Kitaev quantum spin liquid
Authors:
Baekjune Kang,
Miju Park,
Sehwan Song,
Seunghyun Noh,
Daeseong Choe,
Minsik Kong,
Minjae Kim,
Choongwon Seo,
Eun Kyo Ko,
Gangsan Yi,
Jung-woo Yoo,
Sungkyun Park,
Jong Mok Ok,
Changhee Sohn
Abstract:
Kitaev quantum spin liquid, massively quantum entangled states, is so scarce in nature that searching for new candidate systems remains a great challenge. Honeycomb heterostructure could be a promising route to realize and utilize such an exotic quantum phase by providing additional controllability of Hamiltonian and device compatibility, respectively. Here, we provide epitaxial honeycomb oxide th…
▽ More
Kitaev quantum spin liquid, massively quantum entangled states, is so scarce in nature that searching for new candidate systems remains a great challenge. Honeycomb heterostructure could be a promising route to realize and utilize such an exotic quantum phase by providing additional controllability of Hamiltonian and device compatibility, respectively. Here, we provide epitaxial honeycomb oxide thin film Na3Co2SbO6, a candidate of Kitaev quantum spin liquid proposed recently. We found a spin glass and antiferromagnetic ground states depending on Na stoichiometry, signifying not only the importance of Na vacancy control but also strong frustration in Na3Co2SbO6. Despite its classical ground state, the field-dependent magnetic susceptibility shows remarkable scaling collapse with a single critical exponent, which can be interpreted as evidence of quantum criticality. Its electronic ground state and derived spin Hamiltonian from spectroscopies are consistent with the predicted Kitaev model. Our work provides a unique route to the realization and utilization of Kitaev quantum spin liquid.
△ Less
Submitted 8 February, 2023; v1 submitted 10 November, 2022;
originally announced November 2022.
-
Ranking-Enhanced Unsupervised Sentence Representation Learning
Authors:
Yeon Seonwoo,
Guoyin Wang,
Changmin Seo,
Sajal Choudhary,
Jiwei Li,
Xiang Li,
Puyang Xu,
Sunghyun Park,
Alice Oh
Abstract:
Unsupervised sentence representation learning has progressed through contrastive learning and data augmentation methods such as dropout masking. Despite this progress, sentence encoders are still limited to using only an input sentence when predicting its semantic vector. In this work, we show that the semantic meaning of a sentence is also determined by nearest-neighbor sentences that are similar…
▽ More
Unsupervised sentence representation learning has progressed through contrastive learning and data augmentation methods such as dropout masking. Despite this progress, sentence encoders are still limited to using only an input sentence when predicting its semantic vector. In this work, we show that the semantic meaning of a sentence is also determined by nearest-neighbor sentences that are similar to the input sentence. Based on this finding, we propose a novel unsupervised sentence encoder, RankEncoder. RankEncoder predicts the semantic vector of an input sentence by leveraging its relationship with other sentences in an external corpus, as well as the input sentence itself. We evaluate RankEncoder on semantic textual benchmark datasets. From the experimental results, we verify that 1) RankEncoder achieves 80.07% Spearman's correlation, a 1.1% absolute improvement compared to the previous state-of-the-art performance, 2) RankEncoder is universally applicable to existing unsupervised sentence embedding methods, and 3) RankEncoder is specifically effective for predicting the similarity scores of similar sentence pairs.
△ Less
Submitted 18 May, 2023; v1 submitted 9 September, 2022;
originally announced September 2022.
-
Context-based Virtual Adversarial Training for Text Classification with Noisy Labels
Authors:
Do-Myoung Lee,
Yeachan Kim,
Chang-gyun Seo
Abstract:
Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial training (VAT) attracts attention as it could further improve the generalization of DNNs in semi-supervised learning. The driving force behind VAT is to prevent the models from overf…
▽ More
Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial training (VAT) attracts attention as it could further improve the generalization of DNNs in semi-supervised learning. The driving force behind VAT is to prevent the models from overfitting data points by enforcing consistency between the inputs and the perturbed inputs. This strategy could be helpful in learning from noisy labels if it prevents neural models from learning noisy samples while encouraging the models to generalize clean samples. In this paper, we propose context-based virtual adversarial training (ConVAT) to prevent a text classifier from overfitting to noisy labels. Unlike the previous works, the proposed method performs the adversarial training at the context level rather than the inputs. It makes the classifier not only learn its label but also its contextual neighbors, which alleviates the learning from noisy labels by preserving contextual semantics on each data point. We conduct extensive experiments on four text classification datasets with two types of label noises. Comprehensive experimental results clearly show that the proposed method works quite well even with extremely noisy settings.
△ Less
Submitted 29 May, 2022;
originally announced June 2022.
-
Farthest-point Voronoi diagrams in the presence of rectangular obstacles
Authors:
Mincheol Kim,
Chanyang Seo,
Taehoon Ahn,
Hee-Kap Ahn
Abstract:
We present an algorithm to compute the geodesic $L_1$ farthest-point Voronoi diagram of $m$ point sites in the presence of $n$ rectangular obstacles in the plane. It takes $O(nm+n \log n + m\log m)$ construction time using $O(nm)$ space. This is the first optimal algorithm for constructing the farthest-point Voronoi diagram in the presence of obstacles. We can construct a data structure in the sam…
▽ More
We present an algorithm to compute the geodesic $L_1$ farthest-point Voronoi diagram of $m$ point sites in the presence of $n$ rectangular obstacles in the plane. It takes $O(nm+n \log n + m\log m)$ construction time using $O(nm)$ space. This is the first optimal algorithm for constructing the farthest-point Voronoi diagram in the presence of obstacles. We can construct a data structure in the same construction time and space that answers a farthest-neighbor query in $O(\log(n+m))$ time.
△ Less
Submitted 7 March, 2022;
originally announced March 2022.
-
Sub-Chain Beam for mmWave Devices: A Trade-off between Power Saving and Beam Correspondence
Authors:
Jianhua Mo,
Daehee Park,
Boon Loong Ng,
Vutha Va,
Anum Ali,
Chonghwa Seo,
Jianzhong Charlie Zhang
Abstract:
Beam correspondence, or downlink-uplink (DL-UL) beam reciprocity, refers to the assumption that the best beams in the DL are also the best beams in the UL. This is an important assumption that allows the existing beam management framework in 5G to rely heavily on DL beam sweeping and avoid UL beam sweeping: UL beams are inferred from the measurements of the DL reference signals. Beam correspondenc…
▽ More
Beam correspondence, or downlink-uplink (DL-UL) beam reciprocity, refers to the assumption that the best beams in the DL are also the best beams in the UL. This is an important assumption that allows the existing beam management framework in 5G to rely heavily on DL beam sweeping and avoid UL beam sweeping: UL beams are inferred from the measurements of the DL reference signals. Beam correspondence holds when the radio configurations are symmetric in the DL and UL. However, as mmWave technology matures, the DL and the UL face different constraints often breaking the beam correspondence. For example, power constraints may require a UE to activate only a portion of its antenna array for UL transmission, while still activating the full array for DL reception. Meanwhile, if the UL beam with sub-array, named as sub-chain beam in this paper, has a similar radiation pattern as the DL beam, the beam correspondence can still hold. This paper proposes methods for sub-chain beam codebook design to achieve a trade-off between the power saving and beam correspondence.
△ Less
Submitted 22 December, 2021;
originally announced December 2021.
-
SiReN: Sign-Aware Recommendation Using Graph Neural Networks
Authors:
Changwon Seo,
Kyeong-Joong Jeong,
Sungsu Lim,
Won-Yong Shin
Abstract:
In recent years, many recommender systems using network embedding (NE) such as graph neural networks (GNNs) have been extensively studied in the sense of improving recommendation accuracy. However, such attempts have focused mostly on utilizing only the information of positive user-item interactions with high ratings. Thus, there is a challenge on how to make use of low rating scores for represent…
▽ More
In recent years, many recommender systems using network embedding (NE) such as graph neural networks (GNNs) have been extensively studied in the sense of improving recommendation accuracy. However, such attempts have focused mostly on utilizing only the information of positive user-item interactions with high ratings. Thus, there is a challenge on how to make use of low rating scores for representing users' preferences since low ratings can be still informative in designing NE-based recommender systems. In this study, we present SiReN, a new sign-aware recommender system based on GNN models. Specifically, SiReN has three key components: 1) constructing a signed bipartite graph for more precisely representing users' preferences, which is split into two edge-disjoint graphs with positive and negative edges each, 2) generating two embeddings for the partitioned graphs with positive and negative edges via a GNN model and a multi-layer perceptron (MLP), respectively, and then using an attention model to obtain the final embeddings, and 3) establishing a sign-aware Bayesian personalized ranking (BPR) loss function in the process of optimization. Through comprehensive experiments, we empirically demonstrate that SiReN consistently outperforms state-of-the-art NE-aided recommendation methods.
△ Less
Submitted 18 May, 2022; v1 submitted 19 August, 2021;
originally announced August 2021.
-
Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects
Authors:
Eungyeup Kim,
Sanghyeon Lee,
Jeonghoon Park,
Somi Choi,
Choonghyun Seo,
Jaegul Choo
Abstract:
Deep neural networks for automatic image colorization often suffer from the color-bleeding artifact, a problematic color spreading near the boundaries between adjacent objects. Such color-bleeding artifacts debase the reality of generated outputs, limiting the applicability of colorization models in practice. Although previous approaches have attempted to address this problem in an automatic manne…
▽ More
Deep neural networks for automatic image colorization often suffer from the color-bleeding artifact, a problematic color spreading near the boundaries between adjacent objects. Such color-bleeding artifacts debase the reality of generated outputs, limiting the applicability of colorization models in practice. Although previous approaches have attempted to address this problem in an automatic manner, they tend to work only in limited cases where a high contrast of gray-scale values are given in an input image. Alternatively, leveraging user interactions would be a promising approach for solving this color-breeding artifacts. In this paper, we propose a novel edge-enhancing network for the regions of interest via simple user scribbles indicating where to enhance. In addition, our method requires a minimal amount of effort from users for their satisfactory enhancement. Experimental results demonstrate that our interactive edge-enhancing approach effectively improves the color-bleeding artifacts compared to the existing baselines across various datasets.
△ Less
Submitted 21 September, 2021; v1 submitted 4 July, 2021;
originally announced July 2021.
-
Ultrafast dynamics in the Lifshitz-type 5${d}$ pyrochlore antiferromagnet Cd$_{2}$Os$_{2}$O$_{7}$
Authors:
Inho Kwak,
Min-Cheol Lee,
Byung Cheol Park,
Choong H. Kim,
Bumjoo Lee,
C. W. Seo,
J. Yamaura,
Z. Hiroi,
Tae Won Noh,
K. W. Kim
Abstract:
We investigate the ultrafast dynamics of Cd$_2$Os$_2$O$_7$, a prototype material showing a Lifshitz-type transition as a function of temperature. In the paramagnetic metallic state, the photo-reflectivity shows a sub-picosecond relaxation, followed by a featureless small offset. In the antiferromagnetic state slightly below $T_N$, however, the photo-reflectivity resurges over hundreds of picosecon…
▽ More
We investigate the ultrafast dynamics of Cd$_2$Os$_2$O$_7$, a prototype material showing a Lifshitz-type transition as a function of temperature. In the paramagnetic metallic state, the photo-reflectivity shows a sub-picosecond relaxation, followed by a featureless small offset. In the antiferromagnetic state slightly below $T_N$, however, the photo-reflectivity resurges over hundreds of picoseconds, which goes beyond the usual realm of the effective-temperature model. Our observations are consistent with the Lifshitz phase transition of Cd$_2$Os$_2$O$_7$ driven by the evolution of the local magnetic moment.
△ Less
Submitted 28 November, 2019;
originally announced November 2019.
-
Strong spin-phonon coupling unveiled by coherent phonon oscillations in Ca2RuO4
Authors:
Min-Cheol Lee,
Choong H. Kim,
Inho Kwak,
C. W. Seo,
C. H. Sohn,
F. Nakamura,
C. Sow,
Y. Maeno,
E. -A. Kim,
T. W. Noh,
K. W. Kim
Abstract:
We utilize near-infrared femtosecond pulses to investigate coherent phonon oscillations of Ca2RuO4. The coherent Ag phonon mode of the lowest frequency changes abruptly not only its amplitude but also the oscillation-phase as the spin order develops. In addition, the phonon mode shows a redshift entering the magnetically ordered state, which indicates a spin-phonon coupling in the system. Density…
▽ More
We utilize near-infrared femtosecond pulses to investigate coherent phonon oscillations of Ca2RuO4. The coherent Ag phonon mode of the lowest frequency changes abruptly not only its amplitude but also the oscillation-phase as the spin order develops. In addition, the phonon mode shows a redshift entering the magnetically ordered state, which indicates a spin-phonon coupling in the system. Density functional theory calculations reveal that the Ag oscillations result in octahedral tilting distortions, which are exactly in sync with the lattice deformation driven by the magnetic ordering. We suggest that the structural distortions by the spin-phonon coupling can induce the unusual oscillation-phase shift between impulsive and displacive type oscillations.
△ Less
Submitted 24 June, 2018; v1 submitted 8 December, 2017;
originally announced December 2017.
