Showing 1–50 of 123 results for author: Xing, W

Figure it Out: Analyzing-based Jailbreak Attack on Large Language Models

Authors: Shi Lin, Rongchang Li, Xun Wang, Changting Lin, Wenpeng Xing, Meng Han

Abstract: The rapid development of Large Language Models (LLMs) has brought remarkable generative capabilities across diverse tasks. However, despite the impressive achievements, these LLMs still have numerous inherent vulnerabilities, particularly when faced with jailbreak attacks. By investigating jailbreak attacks, we can uncover hidden weaknesses in LLMs and inform the development of more robust defense… ▽ More The rapid development of Large Language Models (LLMs) has brought remarkable generative capabilities across diverse tasks. However, despite the impressive achievements, these LLMs still have numerous inherent vulnerabilities, particularly when faced with jailbreak attacks. By investigating jailbreak attacks, we can uncover hidden weaknesses in LLMs and inform the development of more robust defense mechanisms to fortify their security. In this paper, we further explore the boundary of jailbreak attacks on LLMs and propose Analyzing-based Jailbreak (ABJ). This effective jailbreak attack method takes advantage of LLMs' growing analyzing and reasoning capability and reveals their underlying vulnerabilities when facing analyzing-based tasks. We conduct a detailed evaluation of ABJ across various open-source and closed-source LLMs, which achieves 94.8% attack success rate (ASR) and 1.06 attack efficiency (AE) on GPT-4-turbo-0409, demonstrating state-of-the-art attack effectiveness and efficiency. Our research highlights the importance of prioritizing and enhancing the safety of LLMs to mitigate the risks of misuse. The code is publicly available at hhttps://github.com/theshi-1128/ABJ-Attack. Warning: This paper contains examples of LLMs that might be offensive or harmful. △ Less

Submitted 13 August, 2024; v1 submitted 23 July, 2024; originally announced July 2024.

Beyond the Yield Barrier: Variational Importance Sampling Yield Analysis

Authors: Yanfang Liu, Lei He, Wei W. Xing

Abstract: Optimal mean shift vector (OMSV)-based importance sampling methods have long been prevalent in yield estimation and optimization as an industry standard. However, most OMSV-based methods are designed heuristically without a rigorous understanding of their limitations. To this end, we propose VIS, the first variational analysis framework for yield problems, enabling a systematic refinement for OMSV… ▽ More Optimal mean shift vector (OMSV)-based importance sampling methods have long been prevalent in yield estimation and optimization as an industry standard. However, most OMSV-based methods are designed heuristically without a rigorous understanding of their limitations. To this end, we propose VIS, the first variational analysis framework for yield problems, enabling a systematic refinement for OMSV. For instance, VIS reveals that the classic OMSV is suboptimal, and the optimal/true OMSV should always stay beyond the failure boundary, which enables a free improvement for all OMSV-based methods immediately. Using VIS, we show a progressive refinement for the classic OMSV including incorporation of full covariance in closed form, adjusting for asymmetric failure distributions, and capturing multiple failure regions, each of which contributes to a progressive improvement of more than 2x. Inheriting the simplicity of OMSV, the proposed method retains simplicity and robustness yet achieves up to 29.03x speedup over the state-of-the-art (SOTA) methods. We also demonstrate how the SOTA yield optimization, ASAIS, can immediately benefit from our True OMSV, delivering a 1.20x and 1.27x improvement in performance and efficiency, respectively, without additional computational overhead. △ Less

Submitted 30 June, 2024; originally announced July 2024.

Comments: 2024 43rd ACM/IEEE International Conference on Computer-Aided Design (ICCAD)

MSC Class: 68U07 ACM Class: J.6

Personalized federated learning based on feature fusion

Authors: Wolong Xing, Zhenkui Shi, Hongyan Peng, Xiantao Hu, Xianxian Li

Abstract: Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform better for tasks on each client. Communication bottlenecks, data heterogeneity, and model heterogeneity have been common challenges in federated learning. In t… ▽ More Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform better for tasks on each client. Communication bottlenecks, data heterogeneity, and model heterogeneity have been common challenges in federated learning. In this work, we considered a label distribution skew problem, a type of data heterogeneity easily overlooked. In the context of classification, we propose a personalized federated learning approach called pFedPM. In our process, we replace traditional gradient uploading with feature uploading, which helps reduce communication costs and allows for heterogeneous client models. These feature representations play a role in preserving privacy to some extent. We use a hyperparameter $a$ to mix local and global features, which enables us to control the degree of personalization. We also introduced a relation network as an additional decision layer, which provides a non-linear learnable classifier to predict labels. Experimental results show that, with an appropriate setting of $a$, our scheme outperforms several recent FL methods on MNIST, FEMNIST, and CRIFAR10 datasets and achieves fewer communications. △ Less

Submitted 24 June, 2024; originally announced June 2024.

KATO: Knowledge Alignment and Transfer for Transistor Sizing of Different Design and Technology

Authors: Wei W. Xing, Weijian Fan, Zhuohua Liu, Yuan Yao, Yuanqi Hu

Abstract: Automatic transistor sizing in circuit design continues to be a formidable challenge. Despite that Bayesian optimization (BO) has achieved significant success, it is circuit-specific, limiting the accumulation and transfer of design knowledge for broader applications. This paper proposes (1) efficient automatic kernel construction, (2) the first transfer learning across different circuits and tech… ▽ More Automatic transistor sizing in circuit design continues to be a formidable challenge. Despite that Bayesian optimization (BO) has achieved significant success, it is circuit-specific, limiting the accumulation and transfer of design knowledge for broader applications. This paper proposes (1) efficient automatic kernel construction, (2) the first transfer learning across different circuits and technology nodes for BO, and (3) a selective transfer learning scheme to ensure only useful knowledge is utilized. These three novel components are integrated into BO with Multi-objective Acquisition Ensemble (MACE) to form Knowledge Alignment and Transfer Optimization (KATO) to deliver state-of-the-art performance: up to 2x simulation reduction and 1.2x design improvement over the baselines. △ Less

Submitted 19 April, 2024; originally announced April 2024.

Comments: 6 pages, received by DAC2024

Rethink Arbitrary Style Transfer with Transformer and Contrastive Learning

Authors: Zhanjie Zhang, Jiakai Sun, Guangyuan Li, Lei Zhao, Quanwei Zhang, Zehua Lan, Haolin Yin, Wei Xing, Huaizhong Lin, Zhiwen Zuo

Abstract: Arbitrary style transfer holds widespread attention in research and boasts numerous practical applications. The existing methods, which either employ cross-attention to incorporate deep style attributes into content attributes or use adaptive normalization to adjust content features, fail to generate high-quality stylized images. In this paper, we introduce an innovative technique to improve the q… ▽ More Arbitrary style transfer holds widespread attention in research and boasts numerous practical applications. The existing methods, which either employ cross-attention to incorporate deep style attributes into content attributes or use adaptive normalization to adjust content features, fail to generate high-quality stylized images. In this paper, we introduce an innovative technique to improve the quality of stylized images. Firstly, we propose Style Consistency Instance Normalization (SCIN), a method to refine the alignment between content and style features. In addition, we have developed an Instance-based Contrastive Learning (ICL) approach designed to understand the relationships among various styles, thereby enhancing the quality of the resulting stylized images. Recognizing that VGG networks are more adept at extracting classification features and need to be better suited for capturing style features, we have also introduced the Perception Encoder (PE) to capture style features. Extensive experiments demonstrate that our proposed method generates high-quality stylized images and effectively prevents artifacts compared with the existing state-of-the-art methods. △ Less

Submitted 21 April, 2024; originally announced April 2024.

Comments: Accepted by CVIU

Study of bottom quark dynamics via non-prompt $D^0$ and $J/ψ$ in Pb+Pb collisions at $\sqrt{s_\mathrm{NN}}=5.02$ TeV

Authors: Wen-Jing Xing, Shu-Qing Li, Shanshan Cao, Guang-You Qin

Abstract: We study bottom quark energy loss via the nuclear modification factor ($R_\mathrm{AA}$) and elliptic flow ($v_2$) of non-prompt $D^0$ and $J/ψ$ in relativistic heavy-ion collisions at the LHC. The space-time profile of quark-gluon plasma is obtained from the CLVisc hydrodynamics simulation, the dynamical evolution of heavy quarks inside the color deconfined QCD medium is simulated using a linear B… ▽ More We study bottom quark energy loss via the nuclear modification factor ($R_\mathrm{AA}$) and elliptic flow ($v_2$) of non-prompt $D^0$ and $J/ψ$ in relativistic heavy-ion collisions at the LHC. The space-time profile of quark-gluon plasma is obtained from the CLVisc hydrodynamics simulation, the dynamical evolution of heavy quarks inside the color deconfined QCD medium is simulated using a linear Boltzmann transport model that combines Yukawa and string potentials of heavy-quark-medium interactions, the hadronization of heavy quarks is performed using a hybrid coalescence-fragmentation model, and the decay of $B$ mesons is simulated via PYTHIA. Using this numerical framework, we calculate the transverse momentum ($p_\mathrm{T}$) dependent $R_\mathrm{AA}$ and $v_2$ of direct $D$ mesons, $B$ mesons, and non-prompt $D^0$ and $J/ψ$ from $B$ meson decay in Pb+Pb collisions at $\sqrt{s_\mathrm{NN}}=5.02$ TeV. We find the mass hierarchy of the nuclear modification of prompt $D$ and $B$ mesons depends on their $p_\mathrm{T}$. Both $R_\mathrm{AA}$ and $v_2$ of heavy flavor particles show strong $p_\mathrm{T}$ and centrality dependences due to the interplay between parton energy loss, medium geometry and flow, and hadronization of heavy quarks. Non-prompt $D^0$ and $J/ψ$ share similar patterns of $R_\mathrm{AA}$ and $v_2$ to $B$ mesons except for a $p_\mathrm{T}$ shift during the decay processes. Therefore, future more precise measurements on non-prompt $D^0$ and $J/ψ$ can help further pin down the bottom quark dynamics inside the quark-gluon plasma. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Comments: 11 pages,8 figures

Towards Highly Realistic Artistic Style Transfer via Stable Diffusion with Step-aware and Layer-aware Prompt

Authors: Zhanjie Zhang, Quanwei Zhang, Huaizhong Lin, Wei Xing, Juncheng Mo, Shuaicheng Huang, Jinheng Xie, Guangyuan Li, Junsheng Luan, Lei Zhao, Dalong Zhang, Lixia Chen

Abstract: Artistic style transfer aims to transfer the learned artistic style onto an arbitrary content image, generating artistic stylized images. Existing generative adversarial network-based methods fail to generate highly realistic stylized images and always introduce obvious artifacts and disharmonious patterns. Recently, large-scale pre-trained diffusion models opened up a new way for generating highl… ▽ More Artistic style transfer aims to transfer the learned artistic style onto an arbitrary content image, generating artistic stylized images. Existing generative adversarial network-based methods fail to generate highly realistic stylized images and always introduce obvious artifacts and disharmonious patterns. Recently, large-scale pre-trained diffusion models opened up a new way for generating highly realistic artistic stylized images. However, diffusion model-based methods generally fail to preserve the content structure of input content images well, introducing some undesired content structure and style patterns. To address the above problems, we propose a novel pre-trained diffusion-based artistic style transfer method, called LSAST, which can generate highly realistic artistic stylized images while preserving the content structure of input content images well, without bringing obvious artifacts and disharmonious style patterns. Specifically, we introduce a Step-aware and Layer-aware Prompt Space, a set of learnable prompts, which can learn the style information from the collection of artworks and dynamically adjusts the input images' content structure and style pattern. To train our prompt space, we propose a novel inversion method, called Step-ware and Layer-aware Prompt Inversion, which allows the prompt space to learn the style information of the artworks collection. In addition, we inject a pre-trained conditional branch of ControlNet into our LSAST, which further improved our framework's ability to maintain content structure. Extensive experiments demonstrate that our proposed method can generate more highly realistic artistic stylized images than the state-of-the-art artistic style transfer methods. △ Less

Submitted 12 August, 2024; v1 submitted 17 April, 2024; originally announced April 2024.

Comments: Accepted by IJCAI2024

Rethinking Diffusion Model for Multi-Contrast MRI Super-Resolution

Authors: Guangyuan Li, Chen Rao, Juncheng Mo, Zhanjie Zhang, Wei Xing, Lei Zhao

Abstract: Recently, diffusion models (DM) have been applied in magnetic resonance imaging (MRI) super-resolution (SR) reconstruction, exhibiting impressive performance, especially with regard to detailed reconstruction. However, the current DM-based SR reconstruction methods still face the following issues: (1) They require a large number of iterations to reconstruct the final image, which is inefficient an… ▽ More Recently, diffusion models (DM) have been applied in magnetic resonance imaging (MRI) super-resolution (SR) reconstruction, exhibiting impressive performance, especially with regard to detailed reconstruction. However, the current DM-based SR reconstruction methods still face the following issues: (1) They require a large number of iterations to reconstruct the final image, which is inefficient and consumes a significant amount of computational resources. (2) The results reconstructed by these methods are often misaligned with the real high-resolution images, leading to remarkable distortion in the reconstructed MR images. To address the aforementioned issues, we propose an efficient diffusion model for multi-contrast MRI SR, named as DiffMSR. Specifically, we apply DM in a highly compact low-dimensional latent space to generate prior knowledge with high-frequency detail information. The highly compact latent space ensures that DM requires only a few simple iterations to produce accurate prior knowledge. In addition, we design the Prior-Guide Large Window Transformer (PLWformer) as the decoder for DM, which can extend the receptive field while fully utilizing the prior knowledge generated by DM to ensure that the reconstructed MR image remains undistorted. Extensive experiments on public and clinical datasets demonstrate that our DiffMSR outperforms state-of-the-art methods. △ Less

Submitted 6 April, 2024; originally announced April 2024.

Comments: 14 pages, 12 figures, Accepted by CVPR2024

SGDM: Static-Guided Dynamic Module Make Stronger Visual Models

Authors: Wenjie Xing, Zhenchao Cui, Jing Qi

Abstract: The spatial attention mechanism has been widely used to improve object detection performance. However, its operation is currently limited to static convolutions lacking content-adaptive features. This paper innovatively approaches from the perspective of dynamic convolution. We propose Razor Dynamic Convolution (RDConv) to address thetwo flaws in dynamic weight convolution, making it hard to imple… ▽ More The spatial attention mechanism has been widely used to improve object detection performance. However, its operation is currently limited to static convolutions lacking content-adaptive features. This paper innovatively approaches from the perspective of dynamic convolution. We propose Razor Dynamic Convolution (RDConv) to address thetwo flaws in dynamic weight convolution, making it hard to implement in spatial mechanism: 1) it is computation-heavy; 2) when generating weights, spatial information is disregarded. Firstly, by using Razor Operation to generate certain features, we vastly reduce the parameters of the entire dynamic convolution operation. Secondly, we added a spatial branch inside RDConv to generate convolutional kernel parameters with richer spatial information. Embedding dynamic convolution will also bring the problem of sensitivity to high-frequency noise. We propose the Static-Guided Dynamic Module (SGDM) to address this limitation. By using SGDM, we utilize a set of asymmetric static convolution kernel parameters to guide the construction of dynamic convolution. We introduce the mechanism of shared weights in static convolution to solve the problem of dynamic convolution being sensitive to high-frequency noise. Extensive experiments illustrate that multiple different object detection backbones equipped with SGDM achieve a highly competitive boost in performance(e.g., +4% mAP with YOLOv5n on VOC and +1.7% mAP with YOLOv8n on COCO) with negligible parameter increase(i.e., +0.33M on YOLOv5n and +0.19M on YOLOv8n). △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: 16 pages, 4 figures

Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation

Authors: Tianyi Chu, Wei Xing, Jiafu Chen, Zhizhong Wang, Jiakai Sun, Lei Zhao, Haibo Chen, Huaizhong Lin

Abstract: Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or style transfer. On the other hand, GAN-based diverse image generative methods require retraining/fine-tuning the network or designing complex noise injection f… ▽ More Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or style transfer. On the other hand, GAN-based diverse image generative methods require retraining/fine-tuning the network or designing complex noise injection functions, which is computationally expensive, task-specific, or struggle to generate high-quality results. Given that many deterministic conditional image generative models have been able to produce high-quality yet fixed results, we raise an intriguing question: is it possible for pre-trained deterministic conditional image generative models to generate diverse results without changing network structures or parameters? To answer this question, we re-examine the conditional image generation tasks from the perspective of adversarial attack and propose a simple and efficient plug-in projected gradient descent (PGD) like method for diverse and controllable image generation. The key idea is attacking the pre-trained deterministic generative models by adding a micro perturbation to the input condition. In this way, diverse results can be generated without any adjustment of network structures or fine-tuning of the pre-trained models. In addition, we can also control the diverse results to be generated by specifying the attack direction according to a reference text or image. Our work opens the door to applying adversarial attack to low-level vision tasks, and experiments on various conditional image generation tasks demonstrate the effectiveness and superiority of the proposed method. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: 9 pages, 7 figures, accepted by AAAI24

PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping

Authors: Jiafu Chen, Wei Xing, Jiakai Sun, Tianyi Chu, Yiling Huang, Boyan Ji, Lei Zhao, Huaizhong Lin, Haibo Chen, Zhizhong Wang

Abstract: 3D scene stylization refers to transform the appearance of a 3D scene to match a given style image, ensuring that images rendered from different viewpoints exhibit the same style as the given style image, while maintaining the 3D consistency of the stylized scene. Several existing methods have obtained impressive results in stylizing 3D scenes. However, the models proposed by these methods need to… ▽ More 3D scene stylization refers to transform the appearance of a 3D scene to match a given style image, ensuring that images rendered from different viewpoints exhibit the same style as the given style image, while maintaining the 3D consistency of the stylized scene. Several existing methods have obtained impressive results in stylizing 3D scenes. However, the models proposed by these methods need to be re-trained when applied to a new scene. In other words, their models are coupled with a specific scene and cannot adapt to arbitrary other scenes. To address this issue, we propose a novel 3D scene stylization framework to transfer an arbitrary style to an arbitrary scene, without any style-related or scene-related re-training. Concretely, we first map the appearance of the 3D scene into a 2D style pattern space, which realizes complete disentanglement of the geometry and appearance of the 3D scene and makes our model be generalized to arbitrary 3D scenes. Then we stylize the appearance of the 3D scene in the 2D style pattern space via a prompt-based 2D stylization algorithm. Experimental results demonstrate that our proposed framework is superior to SOTA methods in both visual quality and generalization. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: Accepted to AAAI 2024

Globalized distributionally robust optimization with multi core sets

Authors: Yueyao Li, Chenglong Bao, Wenxun Xing

Abstract: It is essential to capture the true probability distribution of uncertain data in the distributionally robust optimization (DRO). The uncertain data presents multimodality in numerous application scenarios, in the sense that the probability density function of the uncertain data has two or more modes (local maximums). In this paper, we propose a globalized distributionally robust optimization fram… ▽ More It is essential to capture the true probability distribution of uncertain data in the distributionally robust optimization (DRO). The uncertain data presents multimodality in numerous application scenarios, in the sense that the probability density function of the uncertain data has two or more modes (local maximums). In this paper, we propose a globalized distributionally robust optimization framework with multiple core sets (MGDRO) to handle the multimodal data. This framework captures the multimodal structure via a penalty function composed of the minimum distances from the random vector to all core sets. Under some assumptions, the MGDRO model can be reformulated as tractable semi-definite programs for both moment-based and metric-based ambiguity sets. We applied the MGDRO models to a multi-product newswendor problem with multimodal demands. The numerical results turn out that the MGDRO models outperform traditional DRO models and other multimodal models greatly. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Quenching and flow of charm and bottom quarks via semi-leptonic decay of $D$ and $B$ mesons in Pb+Pb collisions at the LHC

Authors: Shu-Qing Li, Wen-Jing Xing, Shanshan Cao, Guang-You Qin

Abstract: Heavy flavor particles provide important probes of the microscopic structure and thermodynamic properties of the quark-gluon plasma (QGP) produced in high-energy nucleus-nucleus collisions. We study the energy loss and flow of charm and bottom quarks inside the QGP via the nuclear modification factor ($R_\mathrm{AA}$) and elliptic flow coefficient ($v_2$) of their decayed leptons in heavy-ion coll… ▽ More Heavy flavor particles provide important probes of the microscopic structure and thermodynamic properties of the quark-gluon plasma (QGP) produced in high-energy nucleus-nucleus collisions. We study the energy loss and flow of charm and bottom quarks inside the QGP via the nuclear modification factor ($R_\mathrm{AA}$) and elliptic flow coefficient ($v_2$) of their decayed leptons in heavy-ion collisions at the LHC. The dynamical evolution of the QGP is performed using the (3+1)-dimensional viscous hydrodynamics model CLVisc; the evolution of heavy quarks inside the QGP is simulated with our improved Langevin model that takes into account both collisional and radiative energy loss of heavy quarks; the hadronization of heavy quarks is simulated via our hybrid coalescence-fragmentation model; and the semi-leptonic decay of $D$ and $B$ mesons is simulated via PYTHIA. By using the same spatial diffusion coefficient for charm and bottom quarks, we obtain smaller $R_\mathrm{AA}$ and larger $v_2$ of charm decayed leptons than bottom decayed leptons, indicating stronger energy loss of charm quarks than bottom quarks inside the QGP within our current model setup. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Comments: 9 pages, 4 figures

3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos

Authors: Jiakai Sun, Han Jiao, Guangyuan Li, Zhanjie Zhang, Lei Zhao, Wei Xing

Abstract: Constructing photo-realistic Free-Viewpoint Videos (FVVs) of dynamic scenes from multi-view videos remains a challenging endeavor. Despite the remarkable advancements achieved by current neural rendering techniques, these methods generally require complete video sequences for offline training and are not capable of real-time rendering. To address these constraints, we introduce 3DGStream, a method… ▽ More Constructing photo-realistic Free-Viewpoint Videos (FVVs) of dynamic scenes from multi-view videos remains a challenging endeavor. Despite the remarkable advancements achieved by current neural rendering techniques, these methods generally require complete video sequences for offline training and are not capable of real-time rendering. To address these constraints, we introduce 3DGStream, a method designed for efficient FVV streaming of real-world dynamic scenes. Our method achieves fast on-the-fly per-frame reconstruction within 12 seconds and real-time rendering at 200 FPS. Specifically, we utilize 3D Gaussians (3DGs) to represent the scene. Instead of the naïve approach of directly optimizing 3DGs per-frame, we employ a compact Neural Transformation Cache (NTC) to model the translations and rotations of 3DGs, markedly reducing the training time and storage required for each FVV frame. Furthermore, we propose an adaptive 3DG addition strategy to handle emerging objects in dynamic scenes. Experiments demonstrate that 3DGStream achieves competitive performance in terms of rendering speed, image quality, training time, and model storage when compared with state-of-the-art methods. △ Less

Submitted 11 June, 2024; v1 submitted 3 March, 2024; originally announced March 2024.

Comments: CVPR 2024 Accepted (Highlight). Project Page: https://sjojok.github.io/3dgstream

Broadband transmissive polarization rotator by gradiently-twisted $α$-MoO$_3$

Authors: Songyan Hou, Hao Hu, Zhihong Liu, Weichuan Xing, Jincheng Zhang

Abstract: Polarization engineering has been proven to enhance the capabilities of light manipulation and thus facilitate the development of integrated photonic devices. In this study, we introduce a polarization rotator based on gradiently-twisted $α$-MoO$_3$ thin film, that works for the mid infrared range and functions in a transmission mode. To be specific, the proposed device is constructed by gradientl… ▽ More Polarization engineering has been proven to enhance the capabilities of light manipulation and thus facilitate the development of integrated photonic devices. In this study, we introduce a polarization rotator based on gradiently-twisted $α$-MoO$_3$ thin film, that works for the mid infrared range and functions in a transmission mode. To be specific, the proposed device is constructed by gradiently-twisted $α$-MoO$_3$ multilayers with a subwavelength thickness of only 5 microns, namely, one-third of the working wavelength. Our analytical calculation demonstrates the efficacy of this subwavelength thin film rotator in converting a linearly polarized wave into its orthogonal counterpart, thanks to its chiral nature. The twisted $α$-MoO$_3$ multilayers exhibit the capability to significantly manipulate dispersion characteristics while maintaining low optical losses, thereby enabling a wide bandwidth exceeding 2.5 THz with a polarization ratio surpassing 17 dB. Moreover, the operational frequency can be adjusted across a 3.4 THz range by altering the incident angle of the incident waves. This adaptable design, characterized by its polarization versatility, can be customized to suit practical applications within wireless communication, radar systems, optical switching, and imaging technologies. △ Less

Submitted 2 March, 2024; originally announced March 2024.

Comments: Accepted by Applied Physics Letters

Tunable double notch filter on thin-film lithium niobate platform

Authors: Songyan Hou, Hao Hu, Zhihong Liu, Weichuan Xing, Jincheng Zhang, Yue Hao

Abstract: Tunable optical filter at the chip scale plays a crucial role in fulfilling the need for the reconfigurability in channel routing, optical switching, and wavelength division multiplexing systems. In this letter, we propose a tunable double notch filter on thin-film lithium niobate using dual micro-ring architecture. This unique integrated filter is essential for complex photonic integrated circuit… ▽ More Tunable optical filter at the chip scale plays a crucial role in fulfilling the need for the reconfigurability in channel routing, optical switching, and wavelength division multiplexing systems. In this letter, we propose a tunable double notch filter on thin-film lithium niobate using dual micro-ring architecture. This unique integrated filter is essential for complex photonic integrated circuits, along with multiple channels and various frequency spacing. With only one loaded voltage, the device demonstrates a wide frequency spacing tunability from 16.1 GHz to 89.9 GHz by reversely tunning the resonances of the two micro-rings while the center wavelength between the two resonances remains unaltered. Moreover, by utilizing the pronounced electro-optic properties of lithium niobate, associated with the tight light confinement nanophotonic waveguides, the device demonstrates a spacing tunability of 0.82 GHz/V and a contrast of 10~16 dB. In addition, the device has an ultracompact footprint of 0.0248 mm2. △ Less

Submitted 2 March, 2024; originally announced March 2024.

Comments: accepted by Optics Letters

Charmed hadron chemistry and flow in heavy and light ion collisions at the LHC

Authors: Yu-Fei Liu, Wen-Jing Xing, Xiang-Yu Wu, Shanshan Cao, Guang-You Qin, Shu-Qing Li

Abstract: We study the charmed meson and baryon production and elliptic flow in ultra-relativistic nucleus-nucleus collisions at the LHC energies. The space-time evolution of quark-gluon plasma (QGP) produced in these energetic collisions is obtained via the (3+1)-dimensional CLVisc hydrodynamics model, the heavy quark dynamics inside the QGP is simulated using an improved Langevin model that incorporates b… ▽ More We study the charmed meson and baryon production and elliptic flow in ultra-relativistic nucleus-nucleus collisions at the LHC energies. The space-time evolution of quark-gluon plasma (QGP) produced in these energetic collisions is obtained via the (3+1)-dimensional CLVisc hydrodynamics model, the heavy quark dynamics inside the QGP is simulated using an improved Langevin model that incorporates both elastic and inelastic parton energy loss processes, and the heavy quark hadronization is simulated utilizing a comprehensive coalescence-fragmentation model. Using our combined approach, we first calculate charmed hadron ratios, $Λ_c/D^0$ and $D_s/D^0$, as well as their elliptic flow ($v_2$) as a function of transverse momentum ($p_T$) for different centralities in Pb+Pb collisions at $\sqrt{s_{NN}}=5.02$~TeV. Due to strangeness enhancement and parton coalescence effects, $D_s/D^0$ and $Λ_c/D^0$ ratios increase from peripheral to central collisions, and such centrality dependence for $Λ_c/D^0$ is stronger than $D_s/D^0$. We further predict the $p_T$ and centrality dependences of charmed hadron chemistry and $v_2$ in smaller Xe+Xe, Ar+Ar and O+O collisions at the LHC energies. Strong centrality and system size dependences for $Λ_c/D^0$ and $D_s/D^0$ ratios are observed across four collision systems. As for charmed hadron flow, both system size and collision geometry are important to understand the centrality dependence of $v_2$ in different collision systems. Our study provides a significant reference for studying heavy quark evolution and hadronizaiton in large and small systems in relativistic nuclear collisions. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Comments: 12 pages, 10 figures

ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt Bank

Authors: Zhanjie Zhang, Quanwei Zhang, Guangyuan Li, Wei Xing, Lei Zhao, Jiakai Sun, Zehua Lan, Junsheng Luan, Yiling Huang, Huaizhong Lin

Abstract: Artistic style transfer aims to repaint the content image with the learned artistic style. Existing artistic style transfer methods can be divided into two categories: small model-based approaches and pre-trained large-scale model-based approaches. Small model-based approaches can preserve the content strucuture, but fail to produce highly realistic stylized images and introduce artifacts and dish… ▽ More Artistic style transfer aims to repaint the content image with the learned artistic style. Existing artistic style transfer methods can be divided into two categories: small model-based approaches and pre-trained large-scale model-based approaches. Small model-based approaches can preserve the content strucuture, but fail to produce highly realistic stylized images and introduce artifacts and disharmonious patterns; Pre-trained large-scale model-based approaches can generate highly realistic stylized images but struggle with preserving the content structure. To address the above issues, we propose ArtBank, a novel artistic style transfer framework, to generate highly realistic stylized images while preserving the content structure of the content images. Specifically, to sufficiently dig out the knowledge embedded in pre-trained large-scale models, an Implicit Style Prompt Bank (ISPB), a set of trainable parameter matrices, is designed to learn and store knowledge from the collection of artworks and behave as a visual prompt to guide pre-trained large-scale models to generate highly realistic stylized images while preserving content structure. Besides, to accelerate training the above ISPB, we propose a novel Spatial-Statistical-based self-Attention Module (SSAM). The qualitative and quantitative experiments demonstrate the superiority of our proposed method over state-of-the-art artistic style transfer methods. △ Less

Submitted 11 December, 2023; originally announced December 2023.

Comments: Accepted by AAAI2024

Hy-Tracker: A Novel Framework for Enhancing Efficiency and Accuracy of Object Tracking in Hyperspectral Videos

Authors: Mohammad Aminul Islam, Wangzhi Xing, Jun Zhou, Yongsheng Gao, Kuldip K. Paliwal

Abstract: Hyperspectral object tracking has recently emerged as a topic of great interest in the remote sensing community. The hyperspectral image, with its many bands, provides a rich source of material information of an object that can be effectively used for object tracking. While most hyperspectral trackers are based on detection-based techniques, no one has yet attempted to employ YOLO for detecting an… ▽ More Hyperspectral object tracking has recently emerged as a topic of great interest in the remote sensing community. The hyperspectral image, with its many bands, provides a rich source of material information of an object that can be effectively used for object tracking. While most hyperspectral trackers are based on detection-based techniques, no one has yet attempted to employ YOLO for detecting and tracking the object. This is due to the presence of multiple spectral bands, the scarcity of annotated hyperspectral videos, and YOLO's performance limitation in managing occlusions, and distinguishing object in cluttered backgrounds. Therefore, in this paper, we propose a novel framework called Hy-Tracker, which aims to bridge the gap between hyperspectral data and state-of-the-art object detection methods to leverage the strengths of YOLOv7 for object tracking in hyperspectral videos. Hy-Tracker not only introduces YOLOv7 but also innovatively incorporates a refined tracking module on top of YOLOv7. The tracker refines the initial detections produced by YOLOv7, leading to improved object-tracking performance. Furthermore, we incorporate Kalman-Filter into the tracker, which addresses the challenges posed by scale variation and occlusion. The experimental results on hyperspectral benchmark datasets demonstrate the effectiveness of Hy-Tracker in accurately tracking objects across frames. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Conditional Generative Representation for Black-Box Optimization with Implicit Constraints

Authors: Wenqian Xing, Jungho Lee, Chong Liu, Shixiang Zhu

Abstract: Black-box optimization (BBO) has become increasingly relevant for tackling complex decision-making problems, especially in public policy domains such as police districting. However, its broader application in public policymaking is hindered by the complexity of defining feasible regions and the high-dimensionality of decisions. This paper introduces a novel BBO framework, termed as the Conditional… ▽ More Black-box optimization (BBO) has become increasingly relevant for tackling complex decision-making problems, especially in public policy domains such as police districting. However, its broader application in public policymaking is hindered by the complexity of defining feasible regions and the high-dimensionality of decisions. This paper introduces a novel BBO framework, termed as the Conditional And Generative Black-box Optimization (CageBO). This approach leverages a conditional variational autoencoder to learn the distribution of feasible decisions, enabling a two-way mapping between the original decision space and a simplified, constraint-free latent space. The CageBO efficiently handles the implicit constraints often found in public policy applications, allowing for optimization in the latent space while evaluating objectives in the original space. We validate our method through a case study on large-scale police districting problems in Atlanta, Georgia. Our results reveal that our CageBO offers notable improvements in performance and efficiency compared to the baselines. △ Less

Submitted 22 May, 2024; v1 submitted 27 October, 2023; originally announced October 2023.

ADMM Training Algorithms for Residual Networks: Convergence, Complexity and Parallel Training

Authors: Jintao Xu, Yifei Li, Wenxun Xing

Abstract: We design a series of serial and parallel proximal point (gradient) ADMMs for the fully connected residual networks (FCResNets) training problem by introducing auxiliary variables. Convergence of the proximal point version is proven based on a Kurdyka-Lojasiewicz (KL) property analysis framework, and we can ensure a locally R-linear or sublinear convergence rate depending on the different ranges o… ▽ More We design a series of serial and parallel proximal point (gradient) ADMMs for the fully connected residual networks (FCResNets) training problem by introducing auxiliary variables. Convergence of the proximal point version is proven based on a Kurdyka-Lojasiewicz (KL) property analysis framework, and we can ensure a locally R-linear or sublinear convergence rate depending on the different ranges of the Kurdyka-Lojasiewicz (KL) exponent, in which a necessary auxiliary function is constructed to realize our goal. Moreover, the advantages of the parallel implementation in terms of lower time complexity and less (per-node) memory consumption are analyzed theoretically. To the best of our knowledge, this is the first work analyzing the convergence, convergence rate, time complexity and (per-node) runtime memory requirement of the ADMM applied in the FCResNets training problem theoretically. Experiments are reported to show the high speed, better performance, robustness and potential in the deep network training tasks. Finally, we present the advantage and potential of our parallel training in large-scale problems. △ Less

Submitted 23 October, 2023; originally announced October 2023.

A Parallel-in-time Method Based on Preconditioner for Biot's Model

Authors: Zeyuan Zhou, Huipeng Gu, Guoliang Ju, Wei Xing

Abstract: We proposed a parallel-in-time method based on preconditioner for Biot's consolidation model in poroelasticity. In order to achieve a fast and stable convergence for the matrix system of the Biot's model, we design two preconditioners with approximations of the Schur complement. The parallel-in-time method employs an inverted time-stepping scheme that iterates to solve the preconditioned linear sy… ▽ More We proposed a parallel-in-time method based on preconditioner for Biot's consolidation model in poroelasticity. In order to achieve a fast and stable convergence for the matrix system of the Biot's model, we design two preconditioners with approximations of the Schur complement. The parallel-in-time method employs an inverted time-stepping scheme that iterates to solve the preconditioned linear system in the outer loop and advances the time step in the inner loop. This allows us to parallelize the iterations with a theoretical parallel efficiency that approaches 1 as the number of time steps and spatial steps grows. We demonstrate the stability, accuracy, and linear speedup of our method on HPC platform through numerical experiments. △ Less

Submitted 16 October, 2023; originally announced October 2023.

Equation Discovery with Bayesian Spike-and-Slab Priors and Efficient Kernels

Authors: Da Long, Wei W. Xing, Aditi S. Krishnapriyan, Robert M. Kirby, Shandian Zhe, Michael W. Mahoney

Abstract: Discovering governing equations from data is important to many scientific and engineering applications. Despite promising successes, existing methods are still challenged by data sparsity and noise issues, both of which are ubiquitous in practice. Moreover, state-of-the-art methods lack uncertainty quantification and/or are costly in training. To overcome these limitations, we propose a novel equa… ▽ More Discovering governing equations from data is important to many scientific and engineering applications. Despite promising successes, existing methods are still challenged by data sparsity and noise issues, both of which are ubiquitous in practice. Moreover, state-of-the-art methods lack uncertainty quantification and/or are costly in training. To overcome these limitations, we propose a novel equation discovery method based on Kernel learning and BAyesian Spike-and-Slab priors (KBASS). We use kernel regression to estimate the target function, which is flexible, expressive, and more robust to data sparsity and noises. We combine it with a Bayesian spike-and-slab prior -- an ideal Bayesian sparse distribution -- for effective operator selection and uncertainty quantification. We develop an expectation-propagation expectation-maximization (EP-EM) algorithm for efficient posterior inference and function estimation. To overcome the computational challenge of kernel regression, we place the function values on a mesh and induce a Kronecker product construction, and we use tensor algebra to enable efficient computation and optimization. We show the advantages of KBASS on a list of benchmark ODE and PDE discovery tasks. △ Less

Submitted 21 April, 2024; v1 submitted 8 October, 2023; originally announced October 2023.

Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference

Authors: Zachary Levonian, Chenglu Li, Wangda Zhu, Anoushka Gade, Owen Henkel, Millie-Ellen Postle, Wanli Xing

Abstract: For middle-school math students, interactive question-answering (QA) with tutors is an effective way to learn. The flexibility and emergent capabilities of generative large language models (LLMs) has led to a surge of interest in automating portions of the tutoring process - including interactive QA to support conceptual discussion of mathematical concepts. However, LLM responses to math questions… ▽ More For middle-school math students, interactive question-answering (QA) with tutors is an effective way to learn. The flexibility and emergent capabilities of generative large language models (LLMs) has led to a surge of interest in automating portions of the tutoring process - including interactive QA to support conceptual discussion of mathematical concepts. However, LLM responses to math questions can be incorrect or mismatched to the educational context - such as being misaligned with a school's curriculum. One potential solution is retrieval-augmented generation (RAG), which involves incorporating a vetted external knowledge source in the LLM prompt to increase response quality. In this paper, we designed prompts that retrieve and use content from a high-quality open-source math textbook to generate responses to real student questions. We evaluate the efficacy of this RAG system for middle-school algebra and geometry QA by administering a multi-condition survey, finding that humans prefer responses generated using RAG, but not when responses are too grounded in the textbook content. We argue that while RAG is able to improve response quality, designers of math QA systems must consider trade-offs between generating responses preferred by students and responses closely matched to specific educational resources. △ Less

Submitted 10 November, 2023; v1 submitted 4 October, 2023; originally announced October 2023.

Comments: 6 pages, presented at NeurIPS'23 Workshop on Generative AI for Education (GAIED)

Simultaneous Synchronization and Calibration for Wide-baseline Stereo Event Cameras

Authors: Wanli Xing, Shijie Lin, Guangze Zheng, Yanjun Du, Jia Pan

Abstract: Event-based cameras are increasingly utilized in various applications, owing to their high temporal resolution and low power consumption. However, a fundamental challenge arises when deploying multiple such cameras: they operate on independent time systems, leading to temporal misalignment. This misalignment can significantly degrade performance in downstream applications. Traditional solutions, w… ▽ More Event-based cameras are increasingly utilized in various applications, owing to their high temporal resolution and low power consumption. However, a fundamental challenge arises when deploying multiple such cameras: they operate on independent time systems, leading to temporal misalignment. This misalignment can significantly degrade performance in downstream applications. Traditional solutions, which often rely on hardware-based synchronization, face limitations in compatibility and are impractical for long-distance setups. To address these challenges, we propose a novel algorithm that exploits the motion of objects in the shared field of view to achieve millisecond-level synchronization among multiple event-based cameras. Our method also concurrently estimates extrinsic parameters. We validate our approach in both simulated and real-world indoor/outdoor scenarios, demonstrating successful synchronization and accurate extrinsic parameters estimation. △ Less

Submitted 29 September, 2023; originally announced September 2023.

Multi-Resolution Active Learning of Fourier Neural Operators

Authors: Shibo Li, Xin Yu, Wei Xing, Mike Kirby, Akil Narayan, Shandian Zhe

Abstract: Fourier Neural Operator (FNO) is a popular operator learning framework. It not only achieves the state-of-the-art performance in many tasks, but also is efficient in training and prediction. However, collecting training data for the FNO can be a costly bottleneck in practice, because it often demands expensive physical simulations. To overcome this problem, we propose Multi-Resolution Active learn… ▽ More Fourier Neural Operator (FNO) is a popular operator learning framework. It not only achieves the state-of-the-art performance in many tasks, but also is efficient in training and prediction. However, collecting training data for the FNO can be a costly bottleneck in practice, because it often demands expensive physical simulations. To overcome this problem, we propose Multi-Resolution Active learning of FNO (MRA-FNO), which can dynamically select the input functions and resolutions to lower the data cost as much as possible while optimizing the learning efficiency. Specifically, we propose a probabilistic multi-resolution FNO and use ensemble Monte-Carlo to develop an effective posterior inference algorithm. To conduct active learning, we maximize a utility-cost ratio as the acquisition function to acquire new examples and resolutions at each step. We use moment matching and the matrix determinant lemma to enable tractable, efficient utility computation. Furthermore, we develop a cost annealing framework to avoid over-penalizing high-resolution queries at the early stage. The over-penalization is severe when the cost difference is significant between the resolutions, which renders active learning often stuck at low-resolution queries and inferior performance. Our method overcomes this problem and applies to general multi-fidelity active learning and optimization problems. We have shown the advantage of our method in several benchmark operator learning tasks. The code is available at https://github.com/shib0li/MRA-FNO. △ Less

Submitted 28 March, 2024; v1 submitted 29 September, 2023; originally announced September 2023.

Semidefinite Programming Approximation for a Matrix Optimization Problem over an Uncertain Linear System

Authors: Jintao Xu, Shu-Cherng Fang, Wenxun Xing

Abstract: A matrix optimization problem over an uncertain linear system on finite horizon (abbreviated as MOPUL) is studied, in which the uncertain transition matrix is regarded as a decision variable. This problem is in general NP-hard. By using the given reference values of system outputs at each stage, we develop a polynomial-time solvable semidefinite programming (SDP) approximation model for the proble… ▽ More A matrix optimization problem over an uncertain linear system on finite horizon (abbreviated as MOPUL) is studied, in which the uncertain transition matrix is regarded as a decision variable. This problem is in general NP-hard. By using the given reference values of system outputs at each stage, we develop a polynomial-time solvable semidefinite programming (SDP) approximation model for the problem. The upper bound of the cumulative error between reference outputs and the optimal outputs of the approximation model is theoretically analyzed. Two special cases associated with specific applications are considered. The quality of the SDP approximate solutions in terms of feasibility and optimality is also analyzed. Results of numerical experiments are presented to show the influences of perturbed noises at reference outputs and control levels on the performance of SDP approximation. △ Less

Submitted 30 October, 2023; v1 submitted 24 September, 2023; originally announced September 2023.

MSC Class: 90C22; 90C26; 90C30; 90C59; 93C05

StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models

Authors: Zhizhong Wang, Lei Zhao, Wei Xing

Abstract: Content and style (C-S) disentanglement is a fundamental problem and critical challenge of style transfer. Existing approaches based on explicit definitions (e.g., Gram matrix) or implicit learning (e.g., GANs) are neither interpretable nor easy to control, resulting in entangled representations and less satisfying results. In this paper, we propose a new C-S disentangled framework for style trans… ▽ More Content and style (C-S) disentanglement is a fundamental problem and critical challenge of style transfer. Existing approaches based on explicit definitions (e.g., Gram matrix) or implicit learning (e.g., GANs) are neither interpretable nor easy to control, resulting in entangled representations and less satisfying results. In this paper, we propose a new C-S disentangled framework for style transfer without using previous assumptions. The key insight is to explicitly extract the content information and implicitly learn the complementary style information, yielding interpretable and controllable C-S disentanglement and style transfer. A simple yet effective CLIP-based style disentanglement loss coordinated with a style reconstruction prior is introduced to disentangle C-S in the CLIP image space. By further leveraging the powerful style removal and generative ability of diffusion models, our framework achieves superior results than state of the art and flexible C-S disentanglement and trade-off control. Our work provides new insights into the C-S disentanglement in style transfer and demonstrates the potential of diffusion models for learning well-disentangled C-S characteristics. △ Less

Submitted 15 August, 2023; originally announced August 2023.

Comments: Accepted by ICCV 2023

Seeking the Yield Barrier: High-Dimensional SRAM Evaluation Through Optimal Manifold

Authors: Yanfang Liu, Guohao Dai, Wei W. Xing

Abstract: Being able to efficiently obtain an accurate estimate of the failure probability of SRAM components has become a central issue as model circuits shrink their scale to submicrometer with advanced technology nodes. In this work, we revisit the classic norm minimization method. We then generalize it with infinite components and derive the novel optimal manifold concept, which bridges the surrogate-ba… ▽ More Being able to efficiently obtain an accurate estimate of the failure probability of SRAM components has become a central issue as model circuits shrink their scale to submicrometer with advanced technology nodes. In this work, we revisit the classic norm minimization method. We then generalize it with infinite components and derive the novel optimal manifold concept, which bridges the surrogate-based and importance sampling (IS) yield estimation methods. We then derive a sub-optimal manifold, optimal hypersphere, which leads to an efficient sampling method being aware of the failure boundary called onion sampling. Finally, we use a neural coupling flow (which learns from samples like a surrogate model) as the IS proposal distribution. These combinations give rise to a novel yield estimation method, named Optimal Manifold Important Sampling (OPTIMIS), which keeps the advantages of the surrogate and IS methods to deliver state-of-the-art performance with robustness and consistency, with up to 3.5x in efficiency and 3x in accuracy over the best of SOTA methods in High-dimensional SRAM evaluation. △ Less

Submitted 28 July, 2023; originally announced July 2023.

Comments: 2023 60th ACM/IEEE Design Automation Conference(DAC)

MSC Class: 68U07 ACM Class: J.6

Reexamining charm versus bottom quark energy loss inside a color-deconfined medium

Authors: Yichao Dang, Wen-Jing Xing, Shanshan Cao, Guang-You Qin

Abstract: The general intuition that heavier partons suffer weaker energy loss inside a quark-gluon plasma (QGP) medium is critically re-examined. Within a linear Boltzmann transport model that includes both Yukawa and string types of interactions between heavy quarks and the QGP, we find that while the radiative energy loss is suppressed by the parton mass, heavier partons can experience stronger string po… ▽ More The general intuition that heavier partons suffer weaker energy loss inside a quark-gluon plasma (QGP) medium is critically re-examined. Within a linear Boltzmann transport model that includes both Yukawa and string types of interactions between heavy quarks and the QGP, we find that while the radiative energy loss is suppressed by the parton mass, heavier partons can experience stronger string potential scatterings with the medium. Their competition may result in less energy loss of bottom quarks than charm quarks at low transverse momentum ($p_\mathrm{T}$) but an inverse order at high $p_\mathrm{T}$. Our model calculation shows a weaker nuclear modification on bottom particles than charm particles at low $p_\mathrm{T}$, as observed by both RHIC and LHC experiments, but predicts an opposite hierarchy at high $p_\mathrm{T}$. A larger momentum space transport coefficient ($\hat{q}$) and a smaller spatial diffusion coefficient ($D_\mathrm{s}$) are found for bottom quarks than for charm quarks. △ Less

Submitted 16 July, 2024; v1 submitted 27 July, 2023; originally announced July 2023.

Comments: 9 pages, 7 figures

Journal ref: Phys.Rev.C 109 (2024) 6, 064901

Singularity Categories of Higher Nakayama Algebras

Authors: Wei Xing

Abstract: For a higher Nakayama algebra $A$ in the sense of Jasso-Külshammer, we show that the singularity category of $A$ is triangulated equivalent to the stable module category of a self-injective higher Nakayama algebra. This generalizes a similar result for usual Nakayama algebras due to Shen. Our proof relies on the existence of $d\mathbb{Z}$-cluster tilting subcategories in the module category of… ▽ More For a higher Nakayama algebra $A$ in the sense of Jasso-Külshammer, we show that the singularity category of $A$ is triangulated equivalent to the stable module category of a self-injective higher Nakayama algebra. This generalizes a similar result for usual Nakayama algebras due to Shen. Our proof relies on the existence of $d\mathbb{Z}$-cluster tilting subcategories in the module category of $A$ and the result of Kvamme that each $d\mathbb{Z}$-cluster tilting subcategory of $A$ induces a $d\mathbb{Z}$-cluster tilting subcategory in its singularity category. Moreover, our result provides many concrete examples of the triangulated Auslander-Iyama correspondence introduced by Jasso-Muro, namely, there is a bijective correspondence between the equivalence classes of the singularity categories of $d$-Nakayama algebras with its basic $d\mathbb{Z}$-cluster tilting object and the isomorphism classes of self-injective $(d+1)$-Nakayama algebras. △ Less

Submitted 12 June, 2023; originally announced June 2023.

Comments: 23 pages

Differentiable Multi-Fidelity Fusion: Efficient Learning of Physics Simulations with Neural Architecture Search and Transfer Learning

Authors: Yuwen Deng, Wang Kang, Wei W. Xing

Abstract: With rapid progress in deep learning, neural networks have been widely used in scientific research and engineering applications as surrogate models. Despite the great success of neural networks in fitting complex systems, two major challenges still remain: i) the lack of generalization on different problems/datasets, and ii) the demand for large amounts of simulation data that are computationally… ▽ More With rapid progress in deep learning, neural networks have been widely used in scientific research and engineering applications as surrogate models. Despite the great success of neural networks in fitting complex systems, two major challenges still remain: i) the lack of generalization on different problems/datasets, and ii) the demand for large amounts of simulation data that are computationally expensive. To resolve these challenges, we propose the differentiable \mf (DMF) model, which leverages neural architecture search (NAS) to automatically search the suitable model architecture for different problems, and transfer learning to transfer the learned knowledge from low-fidelity (fast but inaccurate) data to high-fidelity (slow but accurate) model. Novel and latest machine learning techniques such as hyperparameters search and alternate learning are used to improve the efficiency and robustness of DMF. As a result, DMF can efficiently learn the physics simulations with only a few high-fidelity training samples, and outperform the state-of-the-art methods with a significant margin (with up to 58$\%$ improvement in RMSE) based on a variety of synthetic and practical benchmark problems. △ Less

Submitted 12 June, 2023; originally announced June 2023.

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Authors: Jiakai Sun, Zhanjie Zhang, Tianyi Chu, Guangyuan Li, Lei Zhao, Wei Xing

Abstract: Traditional inverse rendering techniques are based on textured meshes, which naturally adapts to modern graphics pipelines, but costly differentiable multi-bounce Monte Carlo (MC) ray tracing poses challenges for modeling global illumination. Recently, neural fields has demonstrated impressive reconstruction quality but falls short in modeling indirect illumination. In this paper, we introduce a s… ▽ More Traditional inverse rendering techniques are based on textured meshes, which naturally adapts to modern graphics pipelines, but costly differentiable multi-bounce Monte Carlo (MC) ray tracing poses challenges for modeling global illumination. Recently, neural fields has demonstrated impressive reconstruction quality but falls short in modeling indirect illumination. In this paper, we introduce a simple yet efficient inverse rendering framework that combines the strengths of both methods. Specifically, given pre-trained neural field representing the scene, we can obtain an initial estimate of the signed distance field (SDF) and create a Neural Radiance Cache (NRC), an enhancement over the traditional radiance cache used in real-time rendering. By using the former to initialize differentiable marching tetrahedrons (DMTet) and the latter to model indirect illumination, we can compute the global illumination via single-bounce differentiable MC ray tracing and jointly optimize the geometry, material, and light through back propagation. Experiments demonstrate that, compared to previous methods, our approach effectively prevents indirect illumination effects from being baked into materials, thus obtaining the high-quality reconstruction of triangle mesh, Physically-Based (PBR) materials, and High Dynamic Range (HDR) light probe. △ Less

Submitted 26 May, 2023; originally announced May 2023.

Electromagnetic form factors for nucleons in short-range correlations

Authors: Wanli Xing, Xuan-Gong Wang, Anthony W. Thomas

Abstract: Recent experimental studies have led to the suggestion that short-range correlations may be a major contributor to the nuclear EMC effect. This hypothesis requires that the structure function for nucleons involved in short-range correlations should be heavily suppressed compared to that of a free nucleon. Based on calculations performed within an AdS/QCD motivated, light-front quark-diquark model,… ▽ More Recent experimental studies have led to the suggestion that short-range correlations may be a major contributor to the nuclear EMC effect. This hypothesis requires that the structure function for nucleons involved in short-range correlations should be heavily suppressed compared to that of a free nucleon. Based on calculations performed within an AdS/QCD motivated, light-front quark-diquark model, we find that this large suppression of the nucleon structure function leads to a strong suppression of the nucleon elastic form factors. △ Less

Submitted 20 March, 2024; v1 submitted 23 May, 2023; originally announced May 2023.

Comments: 6 pages, 6 figures, 2 tables

Report number: ADP-23-13/T1222

Target-free Extrinsic Calibration of Event-LiDAR Dyad using Edge Correspondences

Authors: Wanli Xing, Shijie Lin, Lei Yang, Jia Pan

Abstract: Calibrating the extrinsic parameters of sensory devices is crucial for fusing multi-modal data. Recently, event cameras have emerged as a promising type of neuromorphic sensors, with many potential applications in fields such as mobile robotics and autonomous driving. When combined with LiDAR, they can provide more comprehensive information about the surrounding environment. Nonetheless, due to th… ▽ More Calibrating the extrinsic parameters of sensory devices is crucial for fusing multi-modal data. Recently, event cameras have emerged as a promising type of neuromorphic sensors, with many potential applications in fields such as mobile robotics and autonomous driving. When combined with LiDAR, they can provide more comprehensive information about the surrounding environment. Nonetheless, due to the distinctive representation of event cameras compared to traditional frame-based cameras, calibrating them with LiDAR presents a significant challenge. In this paper, we propose a novel method to calibrate the extrinsic parameters between a dyad of an event camera and a LiDAR without the need for a calibration board or other equipment. Our approach takes advantage of the fact that when an event camera is in motion, changes in reflectivity and geometric edges in the environment trigger numerous events, which can also be captured by LiDAR. Our proposed method leverages the edges extracted from events and point clouds and correlates them to estimate extrinsic parameters. Experimental results demonstrate that our proposed method is highly robust and effective in various scenes. △ Less

Submitted 6 May, 2023; originally announced May 2023.

VGOS: Voxel Grid Optimization for View Synthesis from Sparse Inputs

Authors: Jiakai Sun, Zhanjie Zhang, Jiafu Chen, Guangyuan Li, Boyan Ji, Lei Zhao, Wei Xing, Huaizhong Lin

Abstract: Neural Radiance Fields (NeRF) has shown great success in novel view synthesis due to its state-of-the-art quality and flexibility. However, NeRF requires dense input views (tens to hundreds) and a long training time (hours to days) for a single scene to generate high-fidelity images. Although using the voxel grids to represent the radiance field can significantly accelerate the optimization proces… ▽ More Neural Radiance Fields (NeRF) has shown great success in novel view synthesis due to its state-of-the-art quality and flexibility. However, NeRF requires dense input views (tens to hundreds) and a long training time (hours to days) for a single scene to generate high-fidelity images. Although using the voxel grids to represent the radiance field can significantly accelerate the optimization process, we observe that for sparse inputs, the voxel grids are more prone to overfitting to the training views and will have holes and floaters, which leads to artifacts. In this paper, we propose VGOS, an approach for fast (3-5 minutes) radiance field reconstruction from sparse inputs (3-10 views) to address these issues. To improve the performance of voxel-based radiance field in sparse input scenarios, we propose two methods: (a) We introduce an incremental voxel training strategy, which prevents overfitting by suppressing the optimization of peripheral voxels in the early stage of reconstruction. (b) We use several regularization techniques to smooth the voxels, which avoids degenerate solutions. Experiments demonstrate that VGOS achieves state-of-the-art performance for sparse inputs with super-fast convergence. Code will be available at https://github.com/SJoJoK/VGOS. △ Less

Submitted 2 June, 2023; v1 submitted 26 April, 2023; originally announced April 2023.

Comments: IJCAI 2023 Accepted (Main Track)

Preparation of multiphoton high-dimensional GHZ state

Authors: Wen-Bo Xing, Xiao-Min Hu, Yu Guo, Bi-Heng Liu, Chuan-Feng Li, Guang-Can Guo

Abstract: Multipartite high-dimensional entanglement presents different physics from multipartite two-dimensional entanglement. However, how to prepare multipartite high-dimensional entanglement is still a challenge with linear optics. In this paper, a multiphoton GHZ state with arbitrary dimensions preparation protocol is proposed in optical systems. In this protocol, we use auxiliary entanglements to real… ▽ More Multipartite high-dimensional entanglement presents different physics from multipartite two-dimensional entanglement. However, how to prepare multipartite high-dimensional entanglement is still a challenge with linear optics. In this paper, a multiphoton GHZ state with arbitrary dimensions preparation protocol is proposed in optical systems. In this protocol, we use auxiliary entanglements to realize a high-dimensional entanglement gate, so that high-dimensional entangled pairs can be connected into a multipartite high-dimensional GHZ state. Specifically, we give an example of using photons' path degree of freedom to prepare a 4-particle 3-dimensional GHZ state. Our method can be extended to other degrees of freedom and can generate arbitrary GHZ entanglement in any dimension. △ Less

Submitted 26 July, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

Comments: 10 pages, 3 figures

Journal ref: Opt. Express 31, 24887-24896 (2023)

Generalized Hypercube Queuing Models with Overlapping Service Regions

Authors: Shixiang Zhu, Wenqian Xing, Yao Xie

Abstract: We present a generalized hypercube queuing model, building upon the original model by Larson 1974, focusing on its application to overlapping service regions such as police beats. To design a service region, we need to capture the workload and police car operation, a type of mobile server. The traditional hypercube queuing model excels in capturing systems' dynamics with light traffic, as it prima… ▽ More We present a generalized hypercube queuing model, building upon the original model by Larson 1974, focusing on its application to overlapping service regions such as police beats. To design a service region, we need to capture the workload and police car operation, a type of mobile server. The traditional hypercube queuing model excels in capturing systems' dynamics with light traffic, as it primarily considers whether each server is busy or idle. However, contemporary service operations often experience saturation, in which each server in the system can only process a subset of calls and a queue in front of each server is allowed. Hence, the simple binary status for each server becomes inadequate, prompting the need for a more intricate state space analysis. Our proposed model addresses this problem using a Markov model with a large state space represented by non-negative integer-valued vectors. By leveraging the sparsity structure of the transition matrix, where transitions occur between states whose vectors differ by one in the $\ell_1$ distance, we can solve the steady-state distribution of states efficiently. This solution can then be used to evaluate general performance metrics for the service system. We validate our model's effectiveness through simulations of various artificial service systems. We also apply our model to the Atlanta police operation system, which faces challenges such as increased workload, significant staff shortages, and the impact of boundary effects among crime incidents. Using real 911 calls-for-service data, our analysis indicates that the police operations system with permitted overlapping patrols can significantly mitigate these problems, leading to more effective police force deployment. △ Less

Submitted 11 January, 2024; v1 submitted 5 April, 2023; originally announced April 2023.

Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learning

Authors: Zhiwen Zuo, Lei Zhao, Ailin Li, Zhizhong Wang, Zhanjie Zhang, Jiafu Chen, Wei Xing, Dongming Lu

Abstract: This paper presents a new adversarial training framework for image inpainting with segmentation confusion adversarial training (SCAT) and contrastive learning. SCAT plays an adversarial game between an inpainting generator and a segmentation network, which provides pixel-level local training signals and can adapt to images with free-form holes. By combining SCAT with standard global adversarial tr… ▽ More This paper presents a new adversarial training framework for image inpainting with segmentation confusion adversarial training (SCAT) and contrastive learning. SCAT plays an adversarial game between an inpainting generator and a segmentation network, which provides pixel-level local training signals and can adapt to images with free-form holes. By combining SCAT with standard global adversarial training, the new adversarial training framework exhibits the following three advantages simultaneously: (1) the global consistency of the repaired image, (2) the local fine texture details of the repaired image, and (3) the flexibility of handling images with free-form holes. Moreover, we propose the textural and semantic contrastive learning losses to stabilize and improve our inpainting model's training by exploiting the feature representation space of the discriminator, in which the inpainting images are pulled closer to the ground truth images but pushed farther from the corrupted images. The proposed contrastive losses better guide the repaired images to move from the corrupted image data points to the real image data points in the feature representation space, resulting in more realistic completed images. We conduct extensive experiments on two benchmark datasets, demonstrating our model's effectiveness and superiority both qualitatively and quantitatively. △ Less

Submitted 23 March, 2023; originally announced March 2023.

Comments: Accepted to AAAI2023, Oral

Flavor hierarchy of parton energy loss in quark-gluon plasma from a Bayesian analysis

Authors: Wen-Jing Xing, Shanshan Cao, Guang-You Qin

Abstract: The quenching of light and heavy flavor hadrons in relativistic heavy-ion collisions probes the color and flavor dependences of parton energy loss through a color-deconfined quark-gluon plasma (QGP), and thus reveals the properties of QCD matter at extremely high density and temperature. By combining a next-to-leading order perturbative QCD calculation of parton production, a general ansatz of par… ▽ More The quenching of light and heavy flavor hadrons in relativistic heavy-ion collisions probes the color and flavor dependences of parton energy loss through a color-deconfined quark-gluon plasma (QGP), and thus reveals the properties of QCD matter at extremely high density and temperature. By combining a next-to-leading order perturbative QCD calculation of parton production, a general ansatz of parton energy loss functions and parton fragmentation functions, we calculate the nuclear modification of various hadron species -- charged hadrons, $D$ mesons and $B$-decayed $J/ψ$ -- over a wide transverse momentum regime. Comparing our calculations to the experimental data using the Bayesian statistical analysis, we perform a first simultaneous extraction of the energy loss functions of gluons ($g$), light quarks ($q$), charm quarks ($c$) and bottom quarks ($b$) inside the QGP. We find that the average parton energy loss at high energies follows the expected hierarchy of $\langle ΔE_g \rangle > \langle ΔE_q \rangle \sim \langle ΔE_c \rangle > \langle ΔE_b \rangle$, while the parton energy loss distribution can further test the QCD calculations of parton interaction with the dense nuclear matter. We also find that the reduction of experimental uncertainties can significantly improve the precision of the extracted parton energy loss functions inside the QGP. △ Less

Submitted 18 April, 2024; v1 submitted 22 March, 2023; originally announced March 2023.

Comments: 7 pages, 5 figures

Journal ref: Phys.Lett.B 850 (2024) 138523

GAR: Generalized Autoregression for Multi-Fidelity Fusion

Authors: Yuxin Wang, Zheng Xing, Wei W. Xing

Abstract: In many scientific research and engineering applications where repeated simulations of complex systems are conducted, a surrogate is commonly adopted to quickly estimate the whole system. To reduce the expensive cost of generating training examples, it has become a promising approach to combine the results of low-fidelity (fast but inaccurate) and high-fidelity (slow but accurate) simulations. Des… ▽ More In many scientific research and engineering applications where repeated simulations of complex systems are conducted, a surrogate is commonly adopted to quickly estimate the whole system. To reduce the expensive cost of generating training examples, it has become a promising approach to combine the results of low-fidelity (fast but inaccurate) and high-fidelity (slow but accurate) simulations. Despite the fast developments of multi-fidelity fusion techniques, most existing methods require particular data structures and do not scale well to high-dimensional output. To resolve these issues, we generalize the classic autoregression (AR), which is wildly used due to its simplicity, robustness, accuracy, and tractability, and propose generalized autoregression (GAR) using tensor formulation and latent features. GAR can deal with arbitrary dimensional outputs and arbitrary multifidelity data structure to satisfy the demand of multi-fidelity fusion for complex problems; it admits a fully tractable likelihood and posterior requiring no approximate inference and scales well to high-dimensional problems. Furthermore, we prove the autokrigeability theorem based on GAR in the multi-fidelity case and develop CIGAR, a simplified GAR with the exact predictive mean accuracy with computation reduction by a factor of d 3, where d is the dimensionality of the output. The empirical assessment includes many canonical PDEs and real scientific examples and demonstrates that the proposed method consistently outperforms the SOTA methods with a large margin (up to 6x improvement in RMSE) with only a couple high-fidelity training samples. △ Less

Submitted 13 January, 2023; originally announced January 2023.

High-Dimensional Yield Estimation using Shrinkage Deep Features and Maximization of Integral Entropy Reduction

Authors: Shuo Yin, Guohao Dai, Wei W. Xing

Abstract: Despite the fast advances in high-sigma yield analysis with the help of machine learning techniques in the past decade, one of the main challenges, the curse of dimensionality, which is inevitable when dealing with modern large-scale circuits, remains unsolved. To resolve this challenge, we propose an absolute shrinkage deep kernel learning, ASDK, which automatically identifies the dominant proces… ▽ More Despite the fast advances in high-sigma yield analysis with the help of machine learning techniques in the past decade, one of the main challenges, the curse of dimensionality, which is inevitable when dealing with modern large-scale circuits, remains unsolved. To resolve this challenge, we propose an absolute shrinkage deep kernel learning, ASDK, which automatically identifies the dominant process variation parameters in a nonlinear-correlated deep kernel and acts as a surrogate model to emulate the expensive SPICE simulation. To further improve the yield estimation efficiency, we propose a novel maximization of approximated entropy reduction for an efficient model update, which is also enhanced with parallel batch sampling for parallel computing, making it ready for practical deployment. Experiments on SRAM column circuits demonstrate the superiority of ASDK over the state-of-the-art (SOTA) approaches in terms of accuracy and efficiency with up to 10.3x speedup over SOTA methods. △ Less

Submitted 5 December, 2022; originally announced December 2022.

MSC Class: 68U07 ACM Class: J.6

Journal ref: ASPDAC 2023, January, Tokyo, Japan

Enhanced Gaussian Process Dynamical Models with Knowledge Transfer for Long-term Battery Degradation Forecasting

Authors: Wei W. Xing, Ziyang Zhang, Akeel A. Shah

Abstract: Predicting the end-of-life or remaining useful life of batteries in electric vehicles is a critical and challenging problem, predominantly approached in recent years using machine learning to predict the evolution of the state-of-health during repeated cycling. To improve the accuracy of predictive estimates, especially early in the battery lifetime, a number of algorithms have incorporated featur… ▽ More Predicting the end-of-life or remaining useful life of batteries in electric vehicles is a critical and challenging problem, predominantly approached in recent years using machine learning to predict the evolution of the state-of-health during repeated cycling. To improve the accuracy of predictive estimates, especially early in the battery lifetime, a number of algorithms have incorporated features that are available from data collected by battery management systems. Unless multiple battery data sets are used for a direct prediction of the end-of-life, which is useful for ball-park estimates, such an approach is infeasible since the features are not known for future cycles. In this paper, we develop a highly-accurate method that can overcome this limitation, by using a modified Gaussian process dynamical model (GPDM). We introduce a kernelised version of GPDM for a more expressive covariance structure between both the observable and latent coordinates. We combine the approach with transfer learning to track the future state-of-health up to end-of-life. The method can incorporate features as different physical observables, without requiring their values beyond the time up to which data is available. Transfer learning is used to improve learning of the hyperparameters using data from similar batteries. The accuracy and superiority of the approach over modern benchmarks algorithms including a Gaussian process model and deep convolutional and recurrent networks are demonstrated on three data sets, particularly at the early stages of the battery lifetime. △ Less

Submitted 2 June, 2023; v1 submitted 3 December, 2022; originally announced December 2022.

Quenching jets increases their flavor

Authors: Chathuranga Sirimanna, Ismail Soudi, Gojko Vujanovic, Wen-Jing Xing, Shanshan Cao, Abhijit Majumder

Abstract: The widespread notion that jets quenched in a Quark-Gluon-Plasma (QGP) are similar in their parton flavor composition to jets in vacuum is critically examined. We demonstrate that while the soft to semi-hard [low to intermediate transverse momentum ($p_T$)] sector of vacuum jets are predominantly bosonic i.e., composed of gluons, \emph{sufficiently} quenched jets can have an intermediate momentum… ▽ More The widespread notion that jets quenched in a Quark-Gluon-Plasma (QGP) are similar in their parton flavor composition to jets in vacuum is critically examined. We demonstrate that while the soft to semi-hard [low to intermediate transverse momentum ($p_T$)] sector of vacuum jets are predominantly bosonic i.e., composed of gluons, \emph{sufficiently} quenched jets can have an intermediate momentum sector that is predominantly fermionic, dominated by quarks and antiquarks. We demonstrate, using leading order perturbative QCD processes, that the rate of flavor conversion from a gluon traversing the QGP as part of a jet, to a quark or antiquark, versus the reverse process, grows steadily with falling $p_T$. Simple diagrammatic estimates are followed by a variety of realistic simulations in static media. The relation of this increase in flavor to the observed baryon enhancement at intermediate $p_T$ is studied in a fully realistic simulation. △ Less

Submitted 16 May, 2023; v1 submitted 28 November, 2022; originally announced November 2022.

Comments: 17 pages, 14 figures

MicroAST: Towards Super-Fast Ultra-Resolution Arbitrary Style Transfer

Authors: Zhizhong Wang, Lei Zhao, Zhiwen Zuo, Ailin Li, Haibo Chen, Wei Xing, Dongming Lu

Abstract: Arbitrary style transfer (AST) transfers arbitrary artistic styles onto content images. Despite the recent rapid progress, existing AST methods are either incapable or too slow to run at ultra-resolutions (e.g., 4K) with limited resources, which heavily hinders their further applications. In this paper, we tackle this dilemma by learning a straightforward and lightweight model, dubbed MicroAST. Th… ▽ More Arbitrary style transfer (AST) transfers arbitrary artistic styles onto content images. Despite the recent rapid progress, existing AST methods are either incapable or too slow to run at ultra-resolutions (e.g., 4K) with limited resources, which heavily hinders their further applications. In this paper, we tackle this dilemma by learning a straightforward and lightweight model, dubbed MicroAST. The key insight is to completely abandon the use of cumbersome pre-trained Deep Convolutional Neural Networks (e.g., VGG) at inference. Instead, we design two micro encoders (content and style encoders) and one micro decoder for style transfer. The content encoder aims at extracting the main structure of the content image. The style encoder, coupled with a modulator, encodes the style image into learnable dual-modulation signals that modulate both intermediate features and convolutional filters of the decoder, thus injecting more sophisticated and flexible style signals to guide the stylizations. In addition, to boost the ability of the style encoder to extract more distinct and representative style signals, we also introduce a new style signal contrastive loss in our model. Compared to the state of the art, our MicroAST not only produces visually superior results but also is 5-73 times smaller and 6-18 times faster, for the first time enabling super-fast (about 0.5 seconds) AST at 4K ultra-resolutions. Code is available at https://github.com/EndyWon/MicroAST. △ Less

Submitted 28 November, 2022; originally announced November 2022.

Comments: Accepted by AAAI 2023

Interactions between heavy quarks and tilted QGP fireballs in 200 AGeV Au+Au collisions

Authors: Ze-Fang Jiang, Shanshan Cao, Wen-Jing Xing, Xiaowen Li, Ben-Wei Zhang

Abstract: Heavy quark observables are applied to probe the initial energy density distribution with violation of longitudinal boost invariance produced in relativistic heavy-ion collisions. Using an improved Langevin model coupled to a (3+1)-dimensional viscous hydrodynamic model, we study the nuclear modification factor ($R_\text{AA}$), directed flow ($v_1$) and elliptic flow ($v_2$) coefficients of heavy… ▽ More Heavy quark observables are applied to probe the initial energy density distribution with violation of longitudinal boost invariance produced in relativistic heavy-ion collisions. Using an improved Langevin model coupled to a (3+1)-dimensional viscous hydrodynamic model, we study the nuclear modification factor ($R_\text{AA}$), directed flow ($v_1$) and elliptic flow ($v_2$) coefficients of heavy mesons and their decayed electrons at the RHIC energy. We find that the counter-clockwise tilt of the nuclear matter in the reaction plane results in a positive (negative) heavy flavor $v_1$ in the backward (forward) rapidity region, whose magnitude increases with the heavy quark transverse momentum. The difference in the heavy flavor $R_\text{AA}$ between different angular regions is also proposed as a complementary tool to characterize the asymmetry of the medium profile. Our model results are consistent with currently available data at RHIC and provide predictions that can be tested by future measurements. △ Less

Submitted 12 September, 2022; v1 submitted 9 September, 2022; originally announced September 2022.

Comments: 10 pages, 6 figures, comments are welcome

Convergence Rates of Training Deep Neural Networks via Alternating Minimization Methods

Authors: Jintao Xu, Chenglong Bao, Wenxun Xing

Abstract: Training deep neural networks (DNNs) is an important and challenging optimization problem in machine learning due to its non-convexity and non-separable structure. The alternating minimization (AM) approaches split the composition structure of DNNs and have drawn great interest in the deep learning and optimization communities. In this paper, we propose a unified framework for analyzing the conver… ▽ More Training deep neural networks (DNNs) is an important and challenging optimization problem in machine learning due to its non-convexity and non-separable structure. The alternating minimization (AM) approaches split the composition structure of DNNs and have drawn great interest in the deep learning and optimization communities. In this paper, we propose a unified framework for analyzing the convergence rate of AM-type network training methods. Our analysis is based on the non-monotone $j$-step sufficient decrease conditions and the Kurdyka-Lojasiewicz (KL) property, which relaxes the requirement of designing descent algorithms. We show the detailed local convergence rate if the KL exponent $θ$ varies in $[0,1)$. Moreover, the local R-linear convergence is discussed under a stronger $j$-step sufficient decrease condition. △ Less

Submitted 4 April, 2023; v1 submitted 30 August, 2022; originally announced August 2022.

MSC Class: 49M37; 90C26; 90C52

AesUST: Towards Aesthetic-Enhanced Universal Style Transfer

Authors: Zhizhong Wang, Zhanjie Zhang, Lei Zhao, Zhiwen Zuo, Ailin Li, Wei Xing, Dongming Lu

Abstract: Recent studies have shown remarkable success in universal style transfer which transfers arbitrary visual styles to content images. However, existing approaches suffer from the aesthetic-unrealistic problem that introduces disharmonious patterns and evident artifacts, making the results easy to spot from real paintings. To address this limitation, we propose AesUST, a novel Aesthetic-enhanced Univ… ▽ More Recent studies have shown remarkable success in universal style transfer which transfers arbitrary visual styles to content images. However, existing approaches suffer from the aesthetic-unrealistic problem that introduces disharmonious patterns and evident artifacts, making the results easy to spot from real paintings. To address this limitation, we propose AesUST, a novel Aesthetic-enhanced Universal Style Transfer approach that can generate aesthetically more realistic and pleasing results for arbitrary styles. Specifically, our approach introduces an aesthetic discriminator to learn the universal human-delightful aesthetic features from a large corpus of artist-created paintings. Then, the aesthetic features are incorporated to enhance the style transfer process via a novel Aesthetic-aware Style-Attention (AesSA) module. Such an AesSA module enables our AesUST to efficiently and flexibly integrate the style patterns according to the global aesthetic channel distribution of the style image and the local semantic spatial distribution of the content image. Moreover, we also develop a new two-stage transfer training strategy with two aesthetic regularizations to train our model more effectively, further improving stylization performance. Extensive experiments and user studies demonstrate that our approach synthesizes aesthetically more harmonious and realistic results than state of the art, greatly narrowing the disparity with real artist-created paintings. Our code is available at https://github.com/EndyWon/AesUST. △ Less

Submitted 27 August, 2022; originally announced August 2022.

Comments: Accepted by ACM MM 2022

A Preliminary Data-driven Analysis of Common Errors Encountered by Novice SPARC Programmers

Authors: Zach Hansen, Hanxiang Du, Wanli Xing, Rory Eckel, Justin Lugo, Yuanlin Zhang

Abstract: Answer Set Programming (ASP), a modern development of Logic Programming, enables a natural integration of Computing with STEM subjects. This integration addresses a widely acknowledged challenge in K-12 education, and early empirical results on ASP-based integration are promising. Although ASP is considered a simple language when compared with imperative programming languages, programming errors c… ▽ More Answer Set Programming (ASP), a modern development of Logic Programming, enables a natural integration of Computing with STEM subjects. This integration addresses a widely acknowledged challenge in K-12 education, and early empirical results on ASP-based integration are promising. Although ASP is considered a simple language when compared with imperative programming languages, programming errors can still be a significant barrier for students. This is particularly true for K-12 students who are novice users of ASP. Categorizing errors and measuring their difficulty has yielded insights into imperative languages like Java. However, little is known about the types and difficulty of errors encountered by K-12 students using ASP. To address this, we collected high school student programs submitted during a 4-session seminar teaching an ASP language known as SPARC. From error messages in this dataset, we identify a collection of error classes, and measure how frequently each class occurs and how difficult it is to resolve. △ Less

Submitted 5 August, 2022; originally announced August 2022.

Comments: In Proceedings ICLP 2022, arXiv:2208.02685

Journal ref: EPTCS 364, 2022, pp. 12-24

Globalized distributionally robust optimization based on samples

Authors: Yueyao Li, Wenxun Xing

Abstract: It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability distribution. In terms of the information of the perturbed data, it is essential to estimate an appropriate support set of the probability distribution in formulat… ▽ More It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability distribution. In terms of the information of the perturbed data, it is essential to estimate an appropriate support set of the probability distribution in formulating DRO models. In this paper, we introduce two globalized distributionally robust optimization (GDRO) models which choose a core set based on data and a sample space containing the core set to balance the degree of robustness and conservatism at the same time. The degree of conservatism can be controlled by the expected distance of random parameters from the core set. Under some assumptions, we further reformulate several GDRO models into tractable semi-definite programs. In addition, numerical experiments are provided showing the relationship between the optimal objective values of the GDRO models and the size of the sample space and the core set. △ Less

Submitted 5 May, 2022; originally announced May 2022.