Showing 1–50 of 103,723 results for author: Zhang

ScalingFilter: Assessing Data Quality through Inverse Utilization of Scaling Laws

Authors: Ruihang Li, Yixuan Wei, Miaosen Zhang, Nenghai Yu, Han Hu, Houwen Peng

Abstract: High-quality data is crucial for the pre-training performance of large language models. Unfortunately, existing quality filtering methods rely on a known high-quality dataset as reference, which can introduce potential bias and compromise diversity. In this paper, we propose ScalingFilter, a novel approach that evaluates text quality based on the perplexity difference between two language models t… ▽ More High-quality data is crucial for the pre-training performance of large language models. Unfortunately, existing quality filtering methods rely on a known high-quality dataset as reference, which can introduce potential bias and compromise diversity. In this paper, we propose ScalingFilter, a novel approach that evaluates text quality based on the perplexity difference between two language models trained on the same data, thereby eliminating the influence of the reference dataset in the filtering process. An theoretical analysis shows that ScalingFilter is equivalent to an inverse utilization of scaling laws. Through training models with 1.3B parameters on the same data source processed by various quality filters, we find ScalingFilter can improve zero-shot performance of pre-trained models in downstream tasks. To assess the bias introduced by quality filtering, we introduce semantic diversity, a metric of utilizing text embedding models for semantic representations. Extensive experiments reveal that semantic diversity is a reliable indicator of dataset diversity, and ScalingFilter achieves an optimal balance between downstream performance and semantic diversity. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Benchmarking the Capabilities of Large Language Models in Transportation System Engineering: Accuracy, Consistency, and Reasoning Behaviors

Authors: Usman Syed, Ethan Light, Xingang Guo, Huan Zhang, Lianhui Qin, Yanfeng Ouyang, Bin Hu

Abstract: In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, GPT-4o, Claude 3.5 Sonnet, Claude 3 Opus, Gemini 1.5 Pro, Llama 3, and Llama 3.1 in solving some selected undergraduate-level transportation engineering problems. We introduce TransportBench, a benchmark dataset that includes a sample of transportation engineering problems on a wide range of… ▽ More In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, GPT-4o, Claude 3.5 Sonnet, Claude 3 Opus, Gemini 1.5 Pro, Llama 3, and Llama 3.1 in solving some selected undergraduate-level transportation engineering problems. We introduce TransportBench, a benchmark dataset that includes a sample of transportation engineering problems on a wide range of subjects in the context of planning, design, management, and control of transportation systems. This dataset is used by human experts to evaluate the capabilities of various commercial and open-sourced LLMs, especially their accuracy, consistency, and reasoning behaviors, in solving transportation engineering problems. Our comprehensive analysis uncovers the unique strengths and limitations of each LLM, e.g. our analysis shows the impressive accuracy and some unexpected inconsistent behaviors of Claude 3.5 Sonnet in solving TransportBench problems. Our study marks a thrilling first step toward harnessing artificial general intelligence for complex transportation challenges. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Dynamical Accretion Flows -- ALMAGAL: Flows along filamentary structures in high-mass star-forming clusters

Authors: M. R. A. Wells, H. Beuther, S. Molinari, P. Schilke, C. Battersby, P. Ho, Á. Sánchez-Monge, B. Jones, M. B. Scheuck, J. Syed, C. Gieser, R. Kuiper, D. Elia, A. Coletta, A. Traficante, J. Wallace, A. J. Rigby, R. S. Klessen, Q. Zhang, S. Walch, M. T. Beltrán, Y. Tang, G. A. Fuller, D. C. Lis, T. Möller , et al. (25 additional authors not shown)

Abstract: We use data from the ALMA Evolutionary Study of High Mass Protocluster Formation in the Galaxy (ALMAGAL) survey to study 100 ALMAGAL regions at $\sim$ 1\arcsec~ resolution located between $\sim$ 2 and 6~kpc distance. Using ALMAGAL $\sim$ 1.3mm line and continuum data we estimate flow rates onto individual cores. We focus specifically on flow rates along filamentary structures associated with these… ▽ More We use data from the ALMA Evolutionary Study of High Mass Protocluster Formation in the Galaxy (ALMAGAL) survey to study 100 ALMAGAL regions at $\sim$ 1\arcsec~ resolution located between $\sim$ 2 and 6~kpc distance. Using ALMAGAL $\sim$ 1.3mm line and continuum data we estimate flow rates onto individual cores. We focus specifically on flow rates along filamentary structures associated with these cores. Our primary analysis is centered around position velocity cuts in H$_2$CO (3$_{0,3}$ - 2$_{0,2}$) which allow us to measure the velocity fields, surrounding these cores. Combining this work with column density estimates we derive the flow rates along the extended filamentary structures associated with cores in these regions. We select a sample of 100 ALMAGAL regions covering four evolutionary stages from quiescent to protostellar, Young Stellar Objects (YSOs), and \HII~regions (25 each). Using dendrogram and line analysis, we identify a final sample of 182 cores in 87 regions. In this paper, we present 728 flow rates for our sample (4 per core), analysed in the context of evolutionary stage, distance from the core, and core mass. On average, for the whole sample, we derive flow rates on the order of $\sim$10$^{-4}$ M$_{sun}$yr$^{-1}$ with estimated uncertainties of $\pm$50\%. We see increasing differences in the values among evolutionary stages, most notably between the less evolved (quiescent/protostellar) and more evolved (YSO/\HII~region) sources. We also see an increasing trend as we move further away from the centre of these cores. We also find a clear relationship between the flow rates and core masses $\sim$M$^{2/3}$ which is in line with the result expected from the tidal-lobe accretion mechanism. Overall, we see increasing trends in the relationships between the flow rate and the three investigated parameters; evolutionary stage, distance from the core, and core mass. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 11 pages, 11 figures, accepted for publication in A&A

SLCA++: Unleash the Power of Sequential Fine-tuning for Continual Learning with Pre-training

Authors: Gengwei Zhang, Liyuan Wang, Guoliang Kang, Ling Chen, Yunchao Wei

Abstract: In recent years, continual learning with pre-training (CLPT) has received widespread interest, instead of its traditional focus of training from scratch. The use of strong pre-trained models (PTMs) can greatly facilitate knowledge transfer and alleviate catastrophic forgetting, but also suffers from progressive overfitting of pre-trained knowledge into specific downstream tasks. A majority of curr… ▽ More In recent years, continual learning with pre-training (CLPT) has received widespread interest, instead of its traditional focus of training from scratch. The use of strong pre-trained models (PTMs) can greatly facilitate knowledge transfer and alleviate catastrophic forgetting, but also suffers from progressive overfitting of pre-trained knowledge into specific downstream tasks. A majority of current efforts often keep the PTMs frozen and incorporate task-specific prompts to instruct representation learning, coupled with a prompt selection process for inference. However, due to the limited capacity of prompt parameters, this strategy demonstrates only sub-optimal performance in continual learning. In comparison, tuning all parameters of PTMs often provides the greatest potential for representation learning, making sequential fine-tuning (Seq FT) a fundamental baseline that has been overlooked in CLPT. To this end, we present an in-depth analysis of the progressive overfitting problem from the lens of Seq FT. Considering that the overly fast representation learning and the biased classification layer constitute this particular problem, we introduce the advanced Slow Learner with Classifier Alignment (SLCA++) framework to unleash the power of Seq FT, serving as a strong baseline approach for CLPT. Our approach involves a Slow Learner to selectively reduce the learning rate of backbone parameters, and a Classifier Alignment to align the disjoint classification layers in a post-hoc fashion. We further enhance the efficacy of SL with a symmetric cross-entropy loss, as well as employ a parameter-efficient strategy to implement Seq FT with SLCA++. Across a variety of continual learning scenarios on image classification benchmarks, our approach provides substantial improvements and outperforms state-of-the-art methods by a large margin. Code: https://github.com/GengDavid/SLCA. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: This paper is an extension of our ICCV 23 paper (arXiv:2303.05118)

Tunable polar distortions and magnetism in Gd$_x$La$_{1-x}$PtSb epitaxial films

Authors: Dongxue Du, Cheyu Zhang, Jingrui Wei, Yujia Teng, Konrad Genser, Paul M. Voyles, Karin M. Rabe, Jason K. Kawasaki

Abstract: Hexagonal $ABC$ intermetallics are predicted to have tunable ferroelectric, topological, and magnetic properties as a function of the polar buckling of $BC$ atomic planes. We report the impact of isovalent lanthanide substitution on the buckling, structural phase transitions, and electronic and magnetic properties of Gd$_x$La$_{1-x}$PtSb films grown by molecular beam epitaxy (MBE) on c-plane sapph… ▽ More Hexagonal $ABC$ intermetallics are predicted to have tunable ferroelectric, topological, and magnetic properties as a function of the polar buckling of $BC$ atomic planes. We report the impact of isovalent lanthanide substitution on the buckling, structural phase transitions, and electronic and magnetic properties of Gd$_x$La$_{1-x}$PtSb films grown by molecular beam epitaxy (MBE) on c-plane sapphire substrates. The Gd$_x$La$_{1-x}$PtSb films form a solid solution from x = 0 to 1 and retain the polar hexagonal structure ($P6_3 mc$) out to $x \leq 0.95$. With increasing $x$, the PtSb buckling increases and the out of plane lattice constant $c$ decreases due to the lanthanide contraction. While hexagonal LaPtSb is a highly conductive polar metal, the carrier density decreases with $x$ until an abrupt phase transition to a zero band overlap semimetal is found for cubic GdPtSb at $x=1$. The magnetic susceptibility peaks at small but finite $x$, which we attribute to Ruderman Kittel Kasuya Yosida (RKKY) coupling between localized $4f$ moments, whose concentration increases with $x$, and free carriers that decrease with $x$. Samples with $x\geq 0.3$ show antiferromagnetic Curie-Weiss behavior and a Neel temperature that increases with $x$. The Gd$_x$La$_{1-x}$PtSb system provides opportunities to dramatically alter the polar buckling and concentration of local $4f$ moments, for tuning chiral spin textures and topological phases. △ Less

Submitted 15 August, 2024; originally announced August 2024.

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts

Authors: Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Ustun, Acyr Locatelli

Abstract: The Mixture of Experts (MoE) framework has become a popular architecture for large language models due to its superior performance over dense models. However, training MoEs from scratch in a large-scale regime is prohibitively expensive. Existing methods mitigate this by pre-training multiple dense expert models independently and using them to initialize an MoE. This is done by using experts' feed… ▽ More The Mixture of Experts (MoE) framework has become a popular architecture for large language models due to its superior performance over dense models. However, training MoEs from scratch in a large-scale regime is prohibitively expensive. Existing methods mitigate this by pre-training multiple dense expert models independently and using them to initialize an MoE. This is done by using experts' feed-forward network (FFN) to initialize the MoE's experts while merging other parameters. However, this method limits the reuse of dense model parameters to only the FFN layers, thereby constraining the advantages when "upcycling" these models into MoEs. We propose BAM (Branch-Attend-Mix), a simple yet effective method that addresses this shortcoming. BAM makes full use of specialized dense models by not only using their FFN to initialize the MoE layers but also leveraging experts' attention parameters fully by initializing them into a soft-variant of Mixture of Attention (MoA) layers. We explore two methods for upcycling attention parameters: 1) initializing separate attention experts from dense models including all attention parameters for the best model performance; and 2) sharing key and value parameters across all experts to facilitate for better inference efficiency. To further improve efficiency, we adopt a parallel attention transformer architecture to MoEs, which allows the attention experts and FFN experts to be computed concurrently. Our experiments on seed models ranging from 590 million to 2 billion parameters demonstrate that BAM surpasses baselines in both perplexity and downstream task performance, within the same computational and data constraints. △ Less

Submitted 15 August, 2024; originally announced August 2024.

IVHS via Kuznetsov components and categorical Torelli theorems for weighted hypersurfaces

Authors: Xun Lin, Jørgen Vold Rennemo, Shizhuo Zhang

Abstract: We study the categorical Torelli theorem for smooth (weighted) hypersurfaces in (weighted) projective spaces via the Hochschild--Serre algebra of its Kuznetsov component. In the first part of the paper, we show that a natural graded subalgebra of the Hochschild--Serre algebra of the Kuznetsov component of a degree $d$ weighted hypersurface in $\mathbb{P}(a_0,\ldots,a_n)$ reconstructs the graded su… ▽ More We study the categorical Torelli theorem for smooth (weighted) hypersurfaces in (weighted) projective spaces via the Hochschild--Serre algebra of its Kuznetsov component. In the first part of the paper, we show that a natural graded subalgebra of the Hochschild--Serre algebra of the Kuznetsov component of a degree $d$ weighted hypersurface in $\mathbb{P}(a_0,\ldots,a_n)$ reconstructs the graded subalgebra of the Jacobian ring generated by the degree $t:=\mathrm{gcd}(d,Σ_{i=0}^na_i)$ piece under mild assumptions. Using results of Donagi and Cox--Green, this gives a categorical Torelli theorem for most smooth hypersurfaces $Y$ of degree $d \le n$ in $\mathbb{P}^n$ such that $d$ does not divide $n+1$ (the exception being the cases of the form $(d,n) = (4, 4k + 2)$, for which a result of Voisin lets us deduce a generic categorical Torelli theorem when $k \ge 150$). Next, we show that the Jacobian ring of the Veronese double cone can be reconstructed from its graded subalgebra of even degree, thus proving a categorical Torelli theorem for the Veronese double cone. In the second part, we rebuild the infinitesimal Variation of Hodge structures of a series of (weighted) hypersurfaces from their Kuznetsov components via the Hochschild--Serre algebra. As a result, we prove categorical Torelli theorems for two classes of (weighted) hypersurfaces: $(1):$ Generalized Veronese double cone; $(2):$ Certain $k$-sheeted covering of $\mathbb{P}^n$, when they are generic. Then, we prove a refined categorical Torelli theorem for a Fano variety whose Kuznetsov component is a Calabi--Yau category of dimension $2m+1$. Finally, we prove the actual categorical Torelli theorem for generalized Veronese double cone and $k$-sheeted covering of $\mathbb{P}^n$. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 28 pages, comments are very welcome

MSC Class: Primary 14F05; secondary 14J45; 14D20; 14D23

A Conflicts-free, Speed-lossless KAN-based Reinforcement Learning Decision System for Interactive Driving in Roundabouts

Authors: Zhihao Lin, Zhen Tian, Qi Zhang, Ziyang Ye, Hanyang Zhuang, Jianglin Lan

Abstract: Safety and efficiency are crucial for autonomous driving in roundabouts, especially in the context of mixed traffic where autonomous vehicles (AVs) and human-driven vehicles coexist. This paper introduces a learning-based algorithm tailored to foster safe and efficient driving behaviors across varying levels of traffic flows in roundabouts. The proposed algorithm employs a deep Q-learning network… ▽ More Safety and efficiency are crucial for autonomous driving in roundabouts, especially in the context of mixed traffic where autonomous vehicles (AVs) and human-driven vehicles coexist. This paper introduces a learning-based algorithm tailored to foster safe and efficient driving behaviors across varying levels of traffic flows in roundabouts. The proposed algorithm employs a deep Q-learning network to effectively learn safe and efficient driving strategies in complex multi-vehicle roundabouts. Additionally, a KAN (Kolmogorov-Arnold network) enhances the AVs' ability to learn their surroundings robustly and precisely. An action inspector is integrated to replace dangerous actions to avoid collisions when the AV interacts with the environment, and a route planner is proposed to enhance the driving efficiency and safety of the AVs. Moreover, a model predictive control is adopted to ensure stability and precision of the driving actions. The results show that our proposed system consistently achieves safe and efficient driving whilst maintaining a stable training process, as evidenced by the smooth convergence of the reward function and the low variance in the training curves across various traffic flows. Compared to state-of-the-art benchmarks, the proposed algorithm achieves a lower number of collisions and reduced travel time to destination. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 15 pages, 12 figures, submitted to an IEEE journal

Equivalent Characterizations of the Aubin Property for Nonlinear Semidefinite Programming

Authors: Liang Chen, Ruoning Chen, Defeng Sun, Liping Zhang

Abstract: In this paper, we study the Aubin property of the Karush-Kuhn-Tucker solution mapping for the nonlinear semidefinite programming (NLSDP) problem at a locally optimal solution. In the literature, it is known that the Aubin property implies the constraint nondegeneracy by Fusek [SIAM J. Optim. 23 (2013), pp. 1041-1061] and the second-order sufficient condition by Ding et al. [SIAM J. Optim. 27 (2017… ▽ More In this paper, we study the Aubin property of the Karush-Kuhn-Tucker solution mapping for the nonlinear semidefinite programming (NLSDP) problem at a locally optimal solution. In the literature, it is known that the Aubin property implies the constraint nondegeneracy by Fusek [SIAM J. Optim. 23 (2013), pp. 1041-1061] and the second-order sufficient condition by Ding et al. [SIAM J. Optim. 27 (2017), pp. 67-90]. Based on the Mordukhovich criterion, here we further prove that the strong second-order sufficient condition is also necessary for the Aubin property to hold. Consequently, several equivalent conditions including the strong regularity are established for NLSDP's Aubin property. Together with the recent progress made by Chen et al. on the equivalence between the Aubin property and the strong regularity for nonlinear second-order cone programming [arXiv:2406.13798v1 (2024)], this paper constitutes a significant step forward in characterizing the Aubin property for general non-polyhedral $C^2$-cone reducible constrained optimization problems. △ Less

Submitted 15 August, 2024; originally announced August 2024.

MSC Class: 49J53; 90C22; 90C31; 90C46

DaRec: A Disentangled Alignment Framework for Large Language Model and Recommender System

Authors: Xihong Yang, Heming Jing, Zixing Zhang, Jindong Wang, Huakang Niu, Shuaiqiang Wang, Yu Lu, Junfeng Wang, Dawei Yin, Xinwang Liu, En Zhu, Defu Lian, Erxue Min

Abstract: Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models, employing techniques like contrastive learning for representation alignment. In this work, we prove that directly aligning the representations of LLMs and colla… ▽ More Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models, employing techniques like contrastive learning for representation alignment. In this work, we prove that directly aligning the representations of LLMs and collaborative models is sub-optimal for enhancing downstream recommendation tasks performance, based on the information theorem. Consequently, the challenge of effectively aligning semantic representations between collaborative models and LLMs remains unresolved. Inspired by this viewpoint, we propose a novel plug-and-play alignment framework for LLMs and collaborative models. Specifically, we first disentangle the latent representations of both LLMs and collaborative models into specific and shared components via projection layers and representation regularization. Subsequently, we perform both global and local structure alignment on the shared representations to facilitate knowledge transfer. Additionally, we theoretically prove that the specific and shared representations contain more pertinent and less irrelevant information, which can enhance the effectiveness of downstream recommendation tasks. Extensive experimental results on benchmark datasets demonstrate that our method is superior to existing state-of-the-art algorithms. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius

Authors: Xuehao Wang, Weisen Jiang, Shuai Fu, Yu Zhang

Abstract: Sharpness-aware minimization (SAM) is to improve model generalization by searching for flat minima in the loss landscape. The SAM update consists of one step for computing the perturbation and the other for computing the update gradient. Within the two steps, the choice of the perturbation radius is crucial to the performance of SAM, but finding an appropriate perturbation radius is challenging. I… ▽ More Sharpness-aware minimization (SAM) is to improve model generalization by searching for flat minima in the loss landscape. The SAM update consists of one step for computing the perturbation and the other for computing the update gradient. Within the two steps, the choice of the perturbation radius is crucial to the performance of SAM, but finding an appropriate perturbation radius is challenging. In this paper, we propose a bilevel optimization framework called LEarning the perTurbation radiuS (LETS) to learn the perturbation radius for sharpness-aware minimization algorithms. Specifically, in the proposed LETS method, the upper-level problem aims at seeking a good perturbation radius by minimizing the squared generalization gap between the training and validation losses, while the lower-level problem is the SAM optimization problem. Moreover, the LETS method can be combined with any variant of SAM. Experimental results on various architectures and benchmark datasets in computer vision and natural language processing demonstrate the effectiveness of the proposed LETS method in improving the performance of SAM. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: Accepted by ECML PKDD 2024

Modeling Domain and Feedback Transitions for Cross-Domain Sequential Recommendation

Authors: Changshuo Zhang, Teng Shi, Xiao Zhang, Qi Liu, Ruobing Xie, Jun Xu, Ji-Rong Wen

Abstract: Nowadays, many recommender systems encompass various domains to cater to users' diverse needs, leading to user behaviors transitioning across different domains. In fact, user behaviors across different domains reveal changes in preference toward recommended items. For instance, a shift from negative feedback to positive feedback indicates improved user satisfaction. However, existing cross-domain… ▽ More Nowadays, many recommender systems encompass various domains to cater to users' diverse needs, leading to user behaviors transitioning across different domains. In fact, user behaviors across different domains reveal changes in preference toward recommended items. For instance, a shift from negative feedback to positive feedback indicates improved user satisfaction. However, existing cross-domain sequential recommendation methods typically model user interests by focusing solely on information about domain transitions, often overlooking the valuable insights provided by users' feedback transitions. In this paper, we propose $\text{Transition}^2$, a novel method to model transitions across both domains and types of user feedback. Specifically, $\text{Transition}^2$ introduces a transition-aware graph encoder based on user history, assigning different weights to edges according to the feedback type. This enables the graph encoder to extract historical embeddings that capture the transition information between different domains and feedback types. Subsequently, we encode the user history using a cross-transition multi-head self-attention, incorporating various masks to distinguish different types of transitions. Finally, we integrate these modules to make predictions across different domains. Experimental results on two public datasets demonstrate the effectiveness of $\text{Transition}^2$. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Revealing inadvertent periodic modulation of qubit frequency

Authors: Filip Wudarski, Yaxing Zhang, Juan Atalaya, M. I. Dykman

Abstract: The paper describes the means to reveal and characterize slow periodic modulation of qubit frequency. Such modulation can come from different sources and can impact qubit stability. We show that the modulation leads to very sharp peaks in the power spectrum of outcomes of periodically repeated Ramsey measurements. The positions and shapes of the peaks allow finding both the frequency and the ampli… ▽ More The paper describes the means to reveal and characterize slow periodic modulation of qubit frequency. Such modulation can come from different sources and can impact qubit stability. We show that the modulation leads to very sharp peaks in the power spectrum of outcomes of periodically repeated Ramsey measurements. The positions and shapes of the peaks allow finding both the frequency and the amplitude of the modulation. We also explore how additional slow fluctuations of the qubit frequency and fluctuations of the modulation frequency affect the spectrum. The analytical results are in excellent agreement with extensive simulations. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Doublons Bloch oscillations in the mass-imbalanced extended Fermi-Hubbard model

Authors: Kun-Liang Zhang

Abstract: Interactions between particles normally induce the decay of the particles Bloch oscillations (BOs) in a periodic lattice. In the large on-site interactions region, spin-$1/2$ fermions may form into doublon bound state and undergoes doublon BOs in the present of tilted potential. Here we investigate the impact of nearest-neighbor interaction $V$ on the multi-doublon BOs in a mass-imbalanced extende… ▽ More Interactions between particles normally induce the decay of the particles Bloch oscillations (BOs) in a periodic lattice. In the large on-site interactions region, spin-$1/2$ fermions may form into doublon bound state and undergoes doublon BOs in the present of tilted potential. Here we investigate the impact of nearest-neighbor interaction $V$ on the multi-doublon BOs in a mass-imbalanced extended Fermi-Hubbard model. We derive a doublons effective Hamiltonian, and show that a minor change of $V$ can alter the dynamic behaviors of doublons qualitatively. Notably, at a resonance point, the doublons act like free hard-core bosons. Under a tilted potential, the system may exhibit different types of multi-doublon BOs at or deviation from the resonance point with different initial states. Numerical results are presented to demonstrate our conclusions in the one- and two-dimensional systems. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 10 pages, 7 figures

"I Try to Represent Myself as I Am": Self-Presentation Preferences of People with Invisible Disabilities through Embodied Social VR Avatars

Authors: Ria J. Gualano, Lucy Jiang, Kexin Zhang, Tanisha Shende, Andrea Stevenson Won, Shiri Azenkot

Abstract: With the increasing adoption of social virtual reality (VR), it is critical to design inclusive avatars. While researchers have investigated how and why blind and d/Deaf people wish to disclose their disabilities in VR, little is known about the preferences of many others with invisible disabilities (e.g., ADHD, dyslexia, chronic conditions). We filled this gap by interviewing 15 participants, eac… ▽ More With the increasing adoption of social virtual reality (VR), it is critical to design inclusive avatars. While researchers have investigated how and why blind and d/Deaf people wish to disclose their disabilities in VR, little is known about the preferences of many others with invisible disabilities (e.g., ADHD, dyslexia, chronic conditions). We filled this gap by interviewing 15 participants, each with one to three invisible disabilities, who represented 22 different invisible disabilities in total. We found that invisibly disabled people approached avatar-based disclosure through contextualized considerations informed by their prior experiences. For example, some wished to use VR's embodied affordances, such as facial expressions and body language, to dynamically represent their energy level or willingness to engage with others, while others preferred not to disclose their disability identity in any context. We define a binary framework for embodied invisible disability expression (public and private) and discuss three disclosure patterns (Activists, Non-Disclosers, and Situational Disclosers) to inform the design of future inclusive VR experiences. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: To appear at ASSETS 2024

Stochastic Semi-Gradient Descent for Learning Mean Field Games with Population-Aware Function Approximation

Authors: Chenyu Zhang, Xu Chen, Xuan Di

Abstract: Mean field games (MFGs) model the interactions within a large-population multi-agent system using the population distribution. Traditional learning methods for MFGs are based on fixed-point iteration (FPI), which calculates best responses and induced population distribution separately and sequentially. However, FPI-type methods suffer from inefficiency and instability, due to oscillations caused b… ▽ More Mean field games (MFGs) model the interactions within a large-population multi-agent system using the population distribution. Traditional learning methods for MFGs are based on fixed-point iteration (FPI), which calculates best responses and induced population distribution separately and sequentially. However, FPI-type methods suffer from inefficiency and instability, due to oscillations caused by the forward-backward procedure. This paper considers an online learning method for MFGs, where an agent updates its policy and population estimates simultaneously and fully asynchronously, resulting in a simple stochastic gradient descent (SGD) type method called SemiSGD. Not only does SemiSGD exhibit numerical stability and efficiency, but it also provides a novel perspective by treating the value function and population distribution as a unified parameter. We theoretically show that SemiSGD directs this unified parameter along a descent direction to the mean field equilibrium. Motivated by this perspective, we develop a linear function approximation (LFA) for both the value function and the population distribution, resulting in the first population-aware LFA for MFGs on continuous state-action space. Finite-time convergence and approximation error analysis are provided for SemiSGD equipped with population-aware LFA. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Perturbation theory for resonant states near a bound state in the continuum

Authors: Nan Zhang, Ya Yan Lu

Abstract: In this work, we develop a perturbation theory to analyze resonant states near a bound state in the continuum (BIC) in photonic crystal slabs. The theory allows us to rigorously determine the asymptotic behavior of $Q$-factor and the far-field polarization. We show that the resonant states near a BIC can be nearly circularly polarized if the scattering matrix is subject to a certain condition. Mor… ▽ More In this work, we develop a perturbation theory to analyze resonant states near a bound state in the continuum (BIC) in photonic crystal slabs. The theory allows us to rigorously determine the asymptotic behavior of $Q$-factor and the far-field polarization. We show that the resonant states near a BIC can be nearly circularly polarized if the scattering matrix is subject to a certain condition. Moreover, our theory offers a novel perspective on super-BICs and provides a clear and precise condition to efficiently identify them in both symmetric and asymmetric structures without requiring a merging process. For practical applications, we find a super-BIC in a square lattice of cylinders on a dielectric substrate. Our theory addresses the non-Hermitian nature of the system, can be generalized to treat other structures that support BICs, and has potential applications in resonance and chiral optics. △ Less

Submitted 15 August, 2024; originally announced August 2024.

DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search

Authors: Huajian Xin, Z. Z. Ren, Junxiao Song, Zhihong Shao, Wanjia Zhao, Haocheng Wang, Bo Liu, Liyue Zhang, Xuan Lu, Qiushi Du, Wenjun Gao, Qihao Zhu, Dejian Yang, Zhibin Gou, Z. F. Wu, Fuli Luo, Chong Ruan

Abstract: We introduce DeepSeek-Prover-V1.5, an open-source language model designed for theorem proving in Lean 4, which enhances DeepSeek-Prover-V1 by optimizing both training and inference processes. Pre-trained on DeepSeekMath-Base with specialization in formal mathematical languages, the model undergoes supervised fine-tuning using an enhanced formal theorem proving dataset derived from DeepSeek-Prover-… ▽ More We introduce DeepSeek-Prover-V1.5, an open-source language model designed for theorem proving in Lean 4, which enhances DeepSeek-Prover-V1 by optimizing both training and inference processes. Pre-trained on DeepSeekMath-Base with specialization in formal mathematical languages, the model undergoes supervised fine-tuning using an enhanced formal theorem proving dataset derived from DeepSeek-Prover-V1. Further refinement is achieved through reinforcement learning from proof assistant feedback (RLPAF). Beyond the single-pass whole-proof generation approach of DeepSeek-Prover-V1, we propose RMaxTS, a variant of Monte-Carlo tree search that employs an intrinsic-reward-driven exploration strategy to generate diverse proof paths. DeepSeek-Prover-V1.5 demonstrates significant improvements over DeepSeek-Prover-V1, achieving new state-of-the-art results on the test set of the high school level miniF2F benchmark ($63.5\%$) and the undergraduate level ProofNet benchmark ($25.3\%$). △ Less

Submitted 15 August, 2024; originally announced August 2024.

P/D-Serve: Serving Disaggregated Large Language Model at Scale

Authors: Yibo Jin, Tao Wang, Huimin Lin, Mingyang Song, Peiyang Li, Yipeng Ma, Yicheng Shan, Zhengfan Yuan, Cailong Li, Yajing Sun, Tiandeng Wu, Xing Chu, Ruizhi Huan, Li Ma, Xiao You, Wenting Zhou, Yunpeng Ye, Wen Liu, Xiangkun Xu, Yongsheng Zhang, Tiantian Dong, Jiawei Zhu, Zhe Wang, Xijian Ju, Jianxun Song , et al. (5 additional authors not shown)

Abstract: Serving disaggregated large language models (LLMs) over tens of thousands of xPU devices (GPUs or NPUs) with reliable performance faces multiple challenges. 1) Ignoring the diversity (various prefixes and tidal requests), treating all the prompts in a mixed pool is inadequate. To facilitate the similarity per scenario and minimize the inner mismatch on P/D (prefill and decoding) processing, fine-g… ▽ More Serving disaggregated large language models (LLMs) over tens of thousands of xPU devices (GPUs or NPUs) with reliable performance faces multiple challenges. 1) Ignoring the diversity (various prefixes and tidal requests), treating all the prompts in a mixed pool is inadequate. To facilitate the similarity per scenario and minimize the inner mismatch on P/D (prefill and decoding) processing, fine-grained organization is required, dynamically adjusting P/D ratios for better performance. 2) Due to inaccurate estimation on workload (queue status or maintained connections), the global scheduler easily incurs unnecessary timeouts in prefill. 3) Block-fixed device-to-device (D2D) KVCache transfer over cluster-level RDMA (remote direct memory access) fails to achieve desired D2D utilization as expected. To overcome previous problems, this paper proposes an end-to-end system P/D-Serve, complying with the paradigm of MLOps (machine learning operations), which models end-to-end (E2E) P/D performance and enables: 1) fine-grained P/D organization, mapping the service with RoCE (RDMA over converged ethernet) as needed, to facilitate similar processing and dynamic adjustments on P/D ratios; 2) on-demand forwarding upon rejections for idle prefill, decoupling the scheduler from regular inaccurate reports and local queues, to avoid timeouts in prefill; and 3) efficient KVCache transfer via optimized D2D access. P/D-Serve is implemented upon Ascend and MindSpore, has been deployed over tens of thousands of NPUs for more than eight months in commercial use, and further achieves 60\%, 42\% and 46\% improvements on E2E throughput, time-to-first-token (TTFT) SLO (service level objective) and D2D transfer time. As the E2E system with optimizations, P/D-Serve achieves 6.7x increase on throughput, compared with aggregated LLMs. △ Less

Submitted 15 August, 2024; originally announced August 2024.

KOALA: Enhancing Speculative Decoding for LLM via Multi-Layer Draft Heads with Adversarial Learning

Authors: Kaiqi Zhang, Jing Zhao, Rui Chen

Abstract: Large Language Models (LLMs) exhibit high inference latency due to their autoregressive decoding nature. While the draft head in speculative decoding mitigates this issue, its full potential remains unexplored. In this paper, we introduce KOALA (K-layer Optimized Adversarial Learning Architecture), an orthogonal approach to the draft head. By transforming the conventional single-layer draft head i… ▽ More Large Language Models (LLMs) exhibit high inference latency due to their autoregressive decoding nature. While the draft head in speculative decoding mitigates this issue, its full potential remains unexplored. In this paper, we introduce KOALA (K-layer Optimized Adversarial Learning Architecture), an orthogonal approach to the draft head. By transforming the conventional single-layer draft head into a multi-layer architecture and incorporating adversarial learning into the traditional supervised training, KOALA significantly improves the accuracy of the draft head in predicting subsequent tokens, thus more closely mirroring the functionality of LLMs. Although this improvement comes at the cost of slightly increased drafting overhead, KOALA substantially unlocks the draft head's potential, greatly enhancing speculative decoding. We conducted comprehensive evaluations of KOALA, including both autoregressive and non-autoregressive draft heads across various tasks, demonstrating a latency speedup ratio improvement of 0.24x-0.41x, which is 10.57%-14.09% faster than the original draft heads. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Study of non-diffusive thermal behaviors in nanoscale transistors under different heating strategies

Authors: Chuang Zhang, Ziyang Xin, Qin Lou, Hong Liang

Abstract: Understanding the phonon transport mechanisms and efficiently capturing the spatiotemporal distributions of temperature is of great significance for alleviating hotspot issues in the electronic devices. Most previous simulations mainly focused on the steady-state problem with continuous heating, and the effective Fourier's law (EFL) is widely used for practical multiscale thermal engineering due t… ▽ More Understanding the phonon transport mechanisms and efficiently capturing the spatiotemporal distributions of temperature is of great significance for alleviating hotspot issues in the electronic devices. Most previous simulations mainly focused on the steady-state problem with continuous heating, and the effective Fourier's law (EFL) is widely used for practical multiscale thermal engineering due to its simplicity and efficiency although it still follows the diffusive rule. However, non-continuous heating is more common in the electronic devices, and few comparative study is conducted to estimate how much deviation the EFL would produce. To answer above questions, the heat conduction in nanoscale bulk or silicon-on-insulator (SOI) transistors is investigated by the phonon Boltzmann transport equation (BTE) under three heating strategies, namely, `Continuous', `Intermittent' and `Alternating' heating. Numerical results in the quasi-2D or 3D hotspot systems show that it is not easy to accurately capture the micro/nano scale heat conduction by the EFL, especially near the hotspot regions. Different heating strategies have great influence on the temperature rise and transient thermal dissipation process. Compared to `Intermittent' heating, the temperature variance of `Alternating' heating is smaller. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 25 pages, 52 figures

MSC Class: 82D37; 80A05 80A19

Two-dimensional superconductivity in a thick exfoliated kagome film

Authors: Fei Sun, Andrea Capa Salinas, Stephen D. Wilson, Haijing Zhang

Abstract: We report the observation of two-dimensional superconductivity (2D SC) in exfoliated kagome metal CsV$_3$Sb$_5$ with a thickness far thicker than the atomic limit. By examining the critical current and upper critical magnetic fields ($H_{c2}$) of 40-60 nm thick films in the superconducting state, we identify a pronounced Berezinskii-Kosterlitz-Thouless (BKT) transition behavior, i.e. a drastic dec… ▽ More We report the observation of two-dimensional superconductivity (2D SC) in exfoliated kagome metal CsV$_3$Sb$_5$ with a thickness far thicker than the atomic limit. By examining the critical current and upper critical magnetic fields ($H_{c2}$) of 40-60 nm thick films in the superconducting state, we identify a pronounced Berezinskii-Kosterlitz-Thouless (BKT) transition behavior, i.e. a drastic decrease of the superfluid stiffness near the transition, and a cusp-like feature of the angular dependent $H_{c2}$, both of which serve as direct evidence of 2D SC. In addition, an exceeding of the Pauli paramagnetic limit of the in-plane $H_{c2}$ is consistent with the 2D SC nature. The observed 2D SC occurs in thick films with the highest superconducting transition temperature $T_c$ and the lowest charge density wave transition temperature $T_{\rm {CDW}}$, which suggests that the charge density wave states are interrelated with the superconducting states. Our findings impose constraints in understanding the enhancement of SC in kagome superconductors, and illuminate pathways for achieving novel 2D superconducting states in more stable and much thicker systems. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 6 pages and 4 figures for the main text; 10 pages and 9 figures for the Supplementary Materials

Unsupervised Part Discovery via Dual Representation Alignment

Authors: Jiahao Xia, Wenjian Huang, Min Xu, Jianguo Zhang, Haimin Zhang, Ziyu Sheng, Dong Xu

Abstract: Object parts serve as crucial intermediate representations in various downstream tasks, but part-level representation learning still has not received as much attention as other vision tasks. Previous research has established that Vision Transformer can learn instance-level attention without labels, extracting high-quality instance-level representations for boosting downstream tasks. In this paper,… ▽ More Object parts serve as crucial intermediate representations in various downstream tasks, but part-level representation learning still has not received as much attention as other vision tasks. Previous research has established that Vision Transformer can learn instance-level attention without labels, extracting high-quality instance-level representations for boosting downstream tasks. In this paper, we achieve unsupervised part-specific attention learning using a novel paradigm and further employ the part representations to improve part discovery performance. Specifically, paired images are generated from the same image with different geometric transformations, and multiple part representations are extracted from these paired images using a novel module, named PartFormer. These part representations from the paired images are then exchanged to improve geometric transformation invariance. Subsequently, the part representations are aligned with the feature map extracted by a feature map encoder, achieving high similarity with the pixel representations of the corresponding part regions and low similarity in irrelevant regions. Finally, the geometric and semantic constraints are applied to the part representations through the intermediate results in alignment for part-specific attention learning, encouraging the PartFormer to focus locally and the part representations to explicitly include the information of the corresponding parts. Moreover, the aligned part representations can further serve as a series of reliable detectors in the testing phase, predicting pixel masks for part discovery. Extensive experiments are carried out on four widely used datasets, and our results demonstrate that the proposed method achieves competitive performance and robustness due to its part-specific attention. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: Accepted by TPAMI-2024

Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Infer Causal Links Between Siamese Images

Authors: Zhiyuan Li, Heng Wang, Dongnan Liu, Chaoyi Zhang, Ao Ma, Jieting Long, Weidong Cai

Abstract: Large Language Models (LLMs) have showcased exceptional ability in causal reasoning from textual information. However, will these causalities remain straightforward for Vision Large Language Models (VLLMs) when only visual hints are provided? Motivated by this, we propose a novel Multimodal Causal Reasoning benchmark, namely MuCR, to challenge VLLMs to infer semantic cause-and-effect relationship… ▽ More Large Language Models (LLMs) have showcased exceptional ability in causal reasoning from textual information. However, will these causalities remain straightforward for Vision Large Language Models (VLLMs) when only visual hints are provided? Motivated by this, we propose a novel Multimodal Causal Reasoning benchmark, namely MuCR, to challenge VLLMs to infer semantic cause-and-effect relationship when solely relying on visual cues such as action, appearance, clothing, and environment. Specifically, we introduce a prompt-driven image synthesis approach to create siamese images with embedded semantic causality and visual cues, which can effectively evaluate VLLMs' causal reasoning capabilities. Additionally, we develop tailored metrics from multiple perspectives, including image-level match, phrase-level understanding, and sentence-level explanation, to comprehensively assess VLLMs' comprehension abilities. Our extensive experiments reveal that the current state-of-the-art VLLMs are not as skilled at multimodal causal reasoning as we might have hoped. Furthermore, we perform a comprehensive analysis to understand these models' shortcomings from different views and suggest directions for future research. We hope MuCR can serve as a valuable resource and foundational benchmark in multimodal causal reasoning research. The project is available at: https://github.com/Zhiyuan-Li-John/MuCR △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 20 pages

Stochastic Real-Time Economic Dispatch for Integrated Electric and Gas Systems Considering Uncertainty Propagation and Pipeline Leakage

Authors: eiyao Zhao, Zhengshuo Li, Jiahui Zhang, Xiang Bai, Jia Su

Abstract: Gas-fired units (GFUs) with rapid regulation capabilities are considered an effective tool to mitigate fluctuations in the generation of renewable energy sources and have coupled electricity power systems (EPSs) and natural gas systems (NGSs) more tightly. However, this tight coupling leads to uncertainty propagation, a challenge for the real-time dispatch of such integrated electric and gas syste… ▽ More Gas-fired units (GFUs) with rapid regulation capabilities are considered an effective tool to mitigate fluctuations in the generation of renewable energy sources and have coupled electricity power systems (EPSs) and natural gas systems (NGSs) more tightly. However, this tight coupling leads to uncertainty propagation, a challenge for the real-time dispatch of such integrated electric and gas systems (IEGSs). Moreover, pipeline leakage failures in the NGS may threaten the electricity supply reliability of the EPS through GFUs. To address these problems, this paper first establishes an operational model considering gas pipeline dynamic characteristics under uncertain leakage failures for the NGS and then presents a stochastic IEGS real-time economic dispatch (RTED) model considering both uncertainty propagation and pipeline leakage uncertainty. To quickly solve this complicated large-scale stochastic optimization problem, a novel notion of the coupling boundary dynamic adjustment region considering pipeline leakage failure (LCBDAR) is proposed to characterize the dynamic characteristics of the NGS boundary connecting GFUs. Based on the LCBDAR, a noniterative decentralized solution is proposed to decompose the original stochastic RTED model into two subproblems that are solved separately by the EPS and NGS operators, thus preserving their data privacy. In particular, only one-time data interaction from the NGS to the EPS is required. Case studies on several IEGSs at different scales demonstrate the effectiveness of the proposed method. △ Less

Submitted 15 August, 2024; originally announced August 2024.

When Video Coding Meets Multimodal Large Language Models: A Unified Paradigm for Video Coding

Authors: Pingping Zhang, Jinlong Li, Meng Wang, Nicu Sebe, Sam Kwong, Shiqi Wang

Abstract: Existing codecs are designed to eliminate intrinsic redundancies to create a compact representation for compression. However, strong external priors from Multimodal Large Language Models (MLLMs) have not been explicitly explored in video compression. Herein, we introduce a unified paradigm for Cross-Modality Video Coding (CMVC), which is a pioneering approach to explore multimodality representatio… ▽ More Existing codecs are designed to eliminate intrinsic redundancies to create a compact representation for compression. However, strong external priors from Multimodal Large Language Models (MLLMs) have not been explicitly explored in video compression. Herein, we introduce a unified paradigm for Cross-Modality Video Coding (CMVC), which is a pioneering approach to explore multimodality representation and video generative models in video coding. Specifically, on the encoder side, we disentangle a video into spatial content and motion components, which are subsequently transformed into distinct modalities to achieve very compact representation by leveraging MLLMs. During decoding, previously encoded components and video generation models are leveraged to create multiple encoding-decoding modes that optimize video reconstruction quality for specific decoding requirements, including Text-Text-to-Video (TT2V) mode to ensure high-quality semantic information and Image-Text-to-Video (IT2V) mode to achieve superb perceptual consistency. In addition, we propose an efficient frame interpolation model for IT2V mode via Low-Rank Adaption (LoRA) tuning to guarantee perceptual quality, which allows the generated motion cues to behave smoothly. Experiments on benchmarks indicate that TT2V achieves effective semantic reconstruction, while IT2V exhibits competitive perceptual consistency. These results highlight potential directions for future research in video coding. △ Less

Submitted 15 August, 2024; originally announced August 2024.

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm

Authors: Yiming Liang, Ge Zhang, Xingwei Qu, Tianyu Zheng, Jiawei Guo, Xinrun Du, Zhenzhu Yang, Jiaheng Liu, Chenghua Lin, Lei Ma, Wenhao Huang, Jiajun Zhang

Abstract: Large Language Models (LLMs) have achieved significant advancements, however, the common learning paradigm treats LLMs as passive information repositories, neglecting their potential for active learning and alignment. Some approaches train LLMs using their own generated synthetic data, exploring the possibility of active alignment. However, there is still a huge gap between these one-time alignmen… ▽ More Large Language Models (LLMs) have achieved significant advancements, however, the common learning paradigm treats LLMs as passive information repositories, neglecting their potential for active learning and alignment. Some approaches train LLMs using their own generated synthetic data, exploring the possibility of active alignment. However, there is still a huge gap between these one-time alignment methods and the continuous automatic alignment of humans. In this paper, we introduce \textbf{I-SHEEP}, an \textbf{I}terative \textbf{S}elf-En\textbf{H}anc\textbf{E}m\textbf{E}nt \textbf{P}aradigm.This human-like paradigm enables LLMs to \textbf{continuously self-align from scratch with nothing}. Compared to the one-time alignment method Dromedary \cite{sun2023principledriven}, which refers to the first iteration in this paper, I-SHEEP can significantly enhance capacities on both Qwen and Llama models. I-SHEEP achieves a maximum relative improvement of 78.2\% in the Alpaca Eval, 24.0\% in the MT Bench, and an absolute increase of 8.88\% in the IFEval accuracy over subsequent iterations in Qwen-1.5 72B model. Additionally, I-SHEEP surpasses the base model in various standard benchmark generation tasks, achieving an average improvement of 24.77\% in code generation tasks, 12.04\% in TrivialQA, and 20.29\% in SQuAD. We also provide new insights based on the experiment results. Our codes, datasets, and models are available at \textbf{https://anonymous.4open.science/r/I-SHEEP}. △ Less

Submitted 15 August, 2024; originally announced August 2024.

RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation

Authors: Dongyu Ru, Lin Qiu, Xiangkun Hu, Tianhang Zhang, Peng Shi, Shuaichen Chang, Jiayang Cheng, Cunxiang Wang, Shichao Sun, Huanyu Li, Zizhao Zhang, Binjie Wang, Jiarong Jiang, Tong He, Zhiguo Wang, Pengfei Liu, Yue Zhang, Zheng Zhang

Abstract: Despite Retrieval-Augmented Generation (RAG) has shown promising capability in leveraging external knowledge, a comprehensive evaluation of RAG systems is still challenging due to the modular nature of RAG, evaluation of long-form responses and reliability of measurements. In this paper, we propose a fine-grained evaluation framework, RAGChecker, that incorporates a suite of diagnostic metrics for… ▽ More Despite Retrieval-Augmented Generation (RAG) has shown promising capability in leveraging external knowledge, a comprehensive evaluation of RAG systems is still challenging due to the modular nature of RAG, evaluation of long-form responses and reliability of measurements. In this paper, we propose a fine-grained evaluation framework, RAGChecker, that incorporates a suite of diagnostic metrics for both the retrieval and generation modules. Meta evaluation verifies that RAGChecker has significantly better correlations with human judgments than other evaluation metrics. Using RAGChecker, we evaluate 8 RAG systems and conduct an in-depth analysis of their performance, revealing insightful patterns and trade-offs in the design choices of RAG architectures. The metrics of RAGChecker can guide researchers and practitioners in developing more effective RAG systems. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: Under Review

Mamba Retriever: Utilizing Mamba for Effective and Efficient Dense Retrieval

Authors: Hanqi Zhang, Chong Chen, Lang Mei, Qi Liu, Jiaxin Mao

Abstract: In the information retrieval (IR) area, dense retrieval (DR) models use deep learning techniques to encode queries and passages into embedding space to compute their semantic relations. It is important for DR models to balance both efficiency and effectiveness. Pre-trained language models (PLMs), especially Transformer-based PLMs, have been proven to be effective encoders of DR models. However, th… ▽ More In the information retrieval (IR) area, dense retrieval (DR) models use deep learning techniques to encode queries and passages into embedding space to compute their semantic relations. It is important for DR models to balance both efficiency and effectiveness. Pre-trained language models (PLMs), especially Transformer-based PLMs, have been proven to be effective encoders of DR models. However, the self-attention component in Transformer-based PLM results in a computational complexity that grows quadratically with sequence length, and thus exhibits a slow inference speed for long-text retrieval. Some recently proposed non-Transformer PLMs, especially the Mamba architecture PLMs, have demonstrated not only comparable effectiveness to Transformer-based PLMs on generative language tasks but also better efficiency due to linear time scaling in sequence length. This paper implements the Mamba Retriever to explore whether Mamba can serve as an effective and efficient encoder of DR model for IR tasks. We fine-tune the Mamba Retriever on the classic short-text MS MARCO passage ranking dataset and the long-text LoCoV0 dataset. Experimental results show that (1) on the MS MARCO passage ranking dataset and BEIR, the Mamba Retriever achieves comparable or better effectiveness compared to Transformer-based retrieval models, and the effectiveness grows with the size of the Mamba model; (2) on the long-text LoCoV0 dataset, the Mamba Retriever can extend to longer text length than its pre-trained length after fine-tuning on retrieval task, and it has comparable or better effectiveness compared to other long-text retrieval models; (3) the Mamba Retriever has superior inference speed for long-text retrieval. In conclusion, Mamba Retriever is both effective and efficient, making it a practical model, especially for long-text retrieval. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Constraining Ultralight ALP Dark Matter in Light of Cosmic Birefringence

Authors: Dongdong Zhang, Elisa G. M. Ferreira, Ippei Obata, Toshiya Namikawa

Abstract: Cosmic birefringence, the observed rotation of the polarization plane of the cosmic microwave background (CMB), serves as a compelling probe for parity-violating physics beyond the Standard Model. This study explores the potential of ultralight axion-like particle (ALP) dark matter to explain the observed cosmic birefringence in the CMB. We focus on the previously understudied mass range of… ▽ More Cosmic birefringence, the observed rotation of the polarization plane of the cosmic microwave background (CMB), serves as a compelling probe for parity-violating physics beyond the Standard Model. This study explores the potential of ultralight axion-like particle (ALP) dark matter to explain the observed cosmic birefringence in the CMB. We focus on the previously understudied mass range of $10^{-25}$ eV to $10^{-23}$ eV, where ALPs start to undergo nonlinear clustering in the late universe. Our analysis incorporates recent cosmological constraints and considers the washout effect on CMB polarization. We find that for models with ALP masses $10^{-25}$ eV $\lesssim m_φ\lesssim 10^{-23}$ eV and birefringence arising from late ALP clustering, the upper limit on the ALP-photon coupling constant, imposed by the washout effect, is stringently lower than the coupling required to account for the observed static cosmic birefringence signal. This discrepancy persists regardless of the ALP fraction in dark matter. Furthermore, considering ALPs with masses $m_φ\gtrsim$ $10^{-23}$ eV cannot explain static birefringence due to their rapid field oscillations, our results indicate that, all ALP dark matter candidates capable of nonlinear clustering in the late universe and thus contributing mainly to the rotation angle of polarized photons, are incompatible with explaining the static cosmic birefringence signal observed in Planck and WMAP data. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Optimal Joint Fronthaul Compression and Beamforming Design for Networked ISAC Systems

Authors: Kexin Zhang, Yanqing Xu, Ruisi He, Chao Shen, Tsung-hui Chang

Abstract: This study investigates a networked integrated sensing and communication (ISAC) system, where multiple base stations (BSs), connected to a central processor (CP) via capacity-limited fronthaul links, cooperatively serve communication users while simultaneously sensing a target. The primary objective is to minimize the total transmit power while meeting the signal-to-interference-plus-noise ratio (… ▽ More This study investigates a networked integrated sensing and communication (ISAC) system, where multiple base stations (BSs), connected to a central processor (CP) via capacity-limited fronthaul links, cooperatively serve communication users while simultaneously sensing a target. The primary objective is to minimize the total transmit power while meeting the signal-to-interference-plus-noise ratio (SINR) requirements for communication and sensing under fronthaul capacity constraints, resulting in a joint fronthaul compression and beamforming design (J-FCBD) problem. We demonstrate that the optimal fronthaul compression variables can be determined in closed form alongside the beamformers, a novel finding in this field. Leveraging this insight, we show that the remaining beamforming design problem can be solved globally using the semidefinite relaxation (SDR) technique, albeit with considerable complexity. Furthermore, the tightness of its SDR reveals zero duality gap between the considered problem and its Lagrangian dual. Building on this duality result, we exploit the novel UL-DL duality within the ISAC framework to develop an efficient primal-dual (PD)-based algorithm. The algorithm alternates between solving beamforming with a fixed dual variable via fixed-point iteration and updating dual variable via bisection, ensuring global optimality and achieving high efficiency due to the computationally inexpensive iterations. Numerical results confirm the global optimality, effectiveness, and efficiency of the proposed PD-based algorithm. △ Less

Submitted 15 August, 2024; originally announced August 2024.

CamoTeacher: Dual-Rotation Consistency Learning for Semi-Supervised Camouflaged Object Detection

Authors: Xunfa Lai, Zhiyu Yang, Jie Hu, Shengchuan Zhang, Liujuan Cao, Guannan Jiang, Zhiyu Wang, Songan Zhang, Rongrong Ji

Abstract: Existing camouflaged object detection~(COD) methods depend heavily on large-scale pixel-level annotations.However, acquiring such annotations is laborious due to the inherent camouflage characteristics of the objects.Semi-supervised learning offers a promising solution to this challenge.Yet, its application in COD is hindered by significant pseudo-label noise, both pixel-level and instance-level.W… ▽ More Existing camouflaged object detection~(COD) methods depend heavily on large-scale pixel-level annotations.However, acquiring such annotations is laborious due to the inherent camouflage characteristics of the objects.Semi-supervised learning offers a promising solution to this challenge.Yet, its application in COD is hindered by significant pseudo-label noise, both pixel-level and instance-level.We introduce CamoTeacher, a novel semi-supervised COD framework, utilizing Dual-Rotation Consistency Learning~(DRCL) to effectively address these noise issues.Specifically, DRCL minimizes pseudo-label noise by leveraging rotation views' consistency in pixel-level and instance-level.First, it employs Pixel-wise Consistency Learning~(PCL) to deal with pixel-level noise by reweighting the different parts within the pseudo-label.Second, Instance-wise Consistency Learning~(ICL) is used to adjust weights for pseudo-labels, which handles instance-level noise.Extensive experiments on four COD benchmark datasets demonstrate that the proposed CamoTeacher not only achieves state-of-the-art compared with semi-supervised learning methods, but also rivals established fully-supervised learning methods.Our code will be available soon. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: Accepted to ECCV 2024

Maximum entropy models for patterns of gene expression

Authors: Camilla Sarra, Leopoldo Sarra, Luca Di Carlo, Trevor GrandPre, Yaojun Zhang, Curtis G. Callan Jr., William Bialek

Abstract: New experimental methods make it possible to measure the expression levels of many genes, simultaneously, in snapshots from thousands or even millions of individual cells. Current approaches to analyze these experiments involve clustering or low-dimensional projections. Here we use the principle of maximum entropy to obtain a probabilistic description that captures the observed presence or absence… ▽ More New experimental methods make it possible to measure the expression levels of many genes, simultaneously, in snapshots from thousands or even millions of individual cells. Current approaches to analyze these experiments involve clustering or low-dimensional projections. Here we use the principle of maximum entropy to obtain a probabilistic description that captures the observed presence or absence of mRNAs from hundreds of genes in cells from the mammalian brain. We construct the Ising model compatible with experimental means and pairwise correlations, and validate it by showing that it gives good predictions for higher-order statistics. We notice that the probability distribution of cell states has many local maxima. By labeling cell states according to the associated maximum, we obtain a cell classification that agrees well with previous results that use traditional clustering techniques. Our results provide quantitative descriptions of gene expression statistics and interpretable criteria for defining cell classes, supporting the hypothesis that cell classes emerge from the collective interaction of gene expression levels. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 14 pages, 21 figures

Centralized Network Utility Maximization with Accelerated Gradient Method

Authors: Ying Tian, Zhiliang Wang, Xia Yin, Xingang Shi, Jiahai Yang, Han Zhang

Abstract: Network utility maximization (NUM) is a well-studied problem for network traffic management and resource allocation. Because of the inherent decentralization and complexity of networks, most researches develop decentralized NUM algorithms.In recent years, the Software Defined Networking (SDN) architecture has been widely used, especially in cloud networks and inter-datacenter networks managed by l… ▽ More Network utility maximization (NUM) is a well-studied problem for network traffic management and resource allocation. Because of the inherent decentralization and complexity of networks, most researches develop decentralized NUM algorithms.In recent years, the Software Defined Networking (SDN) architecture has been widely used, especially in cloud networks and inter-datacenter networks managed by large enterprises, promoting the design of centralized NUM algorithms. To cope with the large and increasing number of flows in such SDN networks, existing researches about centralized NUM focus on the scalability of the algorithm with respect to the number of flows, however the efficiency is ignored. In this paper, we focus on the SDN scenario, and derive a centralized, efficient and scalable algorithm for the NUM problem. By the designing of a smooth utility function and a smooth penalty function, we formulate the NUM problem with a smooth objective function, which enables the use of Nesterov's accelerated gradient method. We prove that the proposed method has $O(d/t^2)$ convergence rate, which is the fastest with respect to the number of iterations $t$, and our method is scalable with respect to the number of flows $d$ in the network. Experiments show that our method obtains accurate solutions with less iterations, and achieves close-to-optimal network utility. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Journal ref: 2022 IEEE 30th International Conference on Network Protocols (ICNP), pp. 1-11

Adaptive Learning of Consistency and Inconsistency Information for Fake News Detection

Authors: Aohan Li, Jiaxin Chen, Xin Liao, Dengyong Zhang

Abstract: The rapid advancement of social media platforms has significantly reduced the cost of information dissemination, yet it has also led to a proliferation of fake news, posing a threat to societal trust and credibility. Most of fake news detection research focused on integrating text and image information to represent the consistency of multiple modes in news content, while paying less attention to i… ▽ More The rapid advancement of social media platforms has significantly reduced the cost of information dissemination, yet it has also led to a proliferation of fake news, posing a threat to societal trust and credibility. Most of fake news detection research focused on integrating text and image information to represent the consistency of multiple modes in news content, while paying less attention to inconsistent information. Besides, existing methods that leveraged inconsistent information often caused one mode overshadowing another, leading to ineffective use of inconsistent clue. To address these issues, we propose an adaptive multi-modal feature fusion network (MFF-Net). Inspired by human judgment processes for determining truth and falsity in news, MFF-Net focuses on inconsistent parts when news content is generally consistent and consistent parts when it is generally inconsistent. Specifically, MFF-Net extracts semantic and global features from images and texts respectively, and learns consistency information between modes through a multiple feature fusion module. To deal with the problem of modal information being easily masked, we design a single modal feature filtering strategy to capture inconsistent information from corresponding modes separately. Finally, similarity scores are calculated based on global features with adaptive adjustments made to achieve weighted fusion of consistent and inconsistent features. Extensive experimental results demonstrate that MFF-Net outperforms state-of-the-art methods across three public news datasets derived from real social medias. △ Less

Submitted 15 August, 2024; originally announced August 2024.

The mean-variance portfolio selection based on the average and current profitability of the risky asset

Authors: Yu Li, Yuhan Wu, Shuhua Zhang

Abstract: We study the continuous-time pre-commitment mean-variance portfolio selection in a time-varying financial market. By introducing two indexes which respectively express the average profitability of the risky asset (AP) and the current profitability of the risky asset (CP), the optimal portfolio selection is represented by AP and CP. Furthermore, instead of the traditional maximum likelihood estimat… ▽ More We study the continuous-time pre-commitment mean-variance portfolio selection in a time-varying financial market. By introducing two indexes which respectively express the average profitability of the risky asset (AP) and the current profitability of the risky asset (CP), the optimal portfolio selection is represented by AP and CP. Furthermore, instead of the traditional maximum likelihood estimation (MLE) of return rate and volatility of the risky asset, we estimate AP and CP with the second-order variation of an auxiliary wealth process. We prove that the estimations of AP and CP in this paper are more accurate than that in MLE. And, the portfolio selection is implemented in various simulated and real financial markets. Numerical studies confirm the superior performance of our portfolio selection with the estimation of AP and CP under various evaluation criteria. △ Less

Submitted 15 August, 2024; originally announced August 2024.

FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Rendering

Authors: Guofeng Feng, Siyan Chen, Rong Fu, Zimu Liao, Yi Wang, Tao Liu, Zhilin Pei, Hengjie Li, Xingcheng Zhang, Bo Dai

Abstract: This work introduces FlashGS, an open-source CUDA Python library, designed to facilitate the efficient differentiable rasterization of 3D Gaussian Splatting through algorithmic and kernel-level optimizations. FlashGS is developed based on the observations from a comprehensive analysis of the rendering process to enhance computational efficiency and bring the technique to wide adoption. The paper i… ▽ More This work introduces FlashGS, an open-source CUDA Python library, designed to facilitate the efficient differentiable rasterization of 3D Gaussian Splatting through algorithmic and kernel-level optimizations. FlashGS is developed based on the observations from a comprehensive analysis of the rendering process to enhance computational efficiency and bring the technique to wide adoption. The paper includes a suite of optimization strategies, encompassing redundancy elimination, efficient pipelining, refined control and scheduling mechanisms, and memory access optimizations, all of which are meticulously integrated to amplify the performance of the rasterization process. An extensive evaluation of FlashGS' performance has been conducted across a diverse spectrum of synthetic and real-world large-scale scenes, encompassing a variety of image resolutions. The empirical findings demonstrate that FlashGS consistently achieves an average 4x acceleration over mobile consumer GPUs, coupled with reduced memory consumption. These results underscore the superior performance and resource optimization capabilities of FlashGS, positioning it as a formidable tool in the domain of 3D rendering. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Characterization of Intensity Correlation via Single-photon Detection in Quantum Key Distribution

Authors: Tianyi Xing, Junxuan Liu, Likang Zhang, Min-Yan Wang, Yu-Huai Li, Ruiyin Liu, Qingquan Peng, Dongyang Wang, Yaxuan Wang, Hongwei Liu, Wei Li, Yuan Cao, Anqi Huang

Abstract: One of the most significant vulnerabilities in the source unit of quantum key distribution (QKD) is the correlation between quantum states after modulation, which shall be characterized and evaluated for its practical security performance. In this work, we propose a methodology to characterize the intensity correlation according to the single-photon detection results in the measurement unit withou… ▽ More One of the most significant vulnerabilities in the source unit of quantum key distribution (QKD) is the correlation between quantum states after modulation, which shall be characterized and evaluated for its practical security performance. In this work, we propose a methodology to characterize the intensity correlation according to the single-photon detection results in the measurement unit without modifying the configuration of the QKD system. In contrast to the previous research that employs extra classical optical detector to measure the correlation, our method can directly analyse the detection data generated during the raw key exchange, enabling to characterize the feature of correlation in real-time system operation. The basic method is applied to a BB84 QKD system and the characterized correlation decreases the secure key rate shown by the security proof. Furthermore, the method is extended and applied to characterize the correlation from the result of Bell-state measurement, which demonstrates its applicability to a running full-scheme MDI QKD system. This study provides an approach for standard certification of a QKD system. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Joint Optimization of Buffer Delay and HARQ for Video Communications

Authors: Baoping Cheng, Peng Lei, Xiaoyan Xie, Tao Fu, Yukun Zhang, Xiaoming Tao

Abstract: To improve the quality of experience (QoE) in video communication over lossy networks, this paper presents a transmission method that jointly optimizes buffer delay and Hybrid Automatic Repeat request (HARQ), referred to as BD-HARQ. This method operates on packet group and employs dynamic buffer delay combined with HARQ strategy for transmission. By defining the QoE based on metrics such as buffer… ▽ More To improve the quality of experience (QoE) in video communication over lossy networks, this paper presents a transmission method that jointly optimizes buffer delay and Hybrid Automatic Repeat request (HARQ), referred to as BD-HARQ. This method operates on packet group and employs dynamic buffer delay combined with HARQ strategy for transmission. By defining the QoE based on metrics such as buffer delay, Forward Error Correction (FEC) redundancy, and data recovery rate, the proposed method derives its closed-form expression through rigorous mathematical modeling and analysis. The optimal transmission parameters, i.e., the buffer delay and the FEC redundancy, are then determined and implemented, guaranteeing the real-time performance, transmission efficiency, and data recovery rate of video communication. Experimental results demonstrate that the proposed method aligns well with its theoretical expectations, and that it can provide up to 13.7% higher QoE compared to existing methods and increase the tolerance for packet loss rate from 15%-22% to up to 31% while maintaining a high QoE. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 6 pages, 5figures

A quantum-classical hybrid algorithm with Ising model for the learning with errors problem

Authors: Muxi Zheng, Jinfeng Zeng, Wentao Yang, Pei-Jie Chang, Bao Yan, Haoran Zhang, Min Wang, Shijie Wei, Gui-Lu Long

Abstract: The Learning-With-Errors (LWE) problem is a crucial computational challenge with significant implications for post-quantum cryptography and computational learning theory. Here we propose a quantum-classical hybrid algorithm with Ising model (HAWI) to address the LWE problem. Our approach involves transforming the LWE problem into the Shortest Vector Problem (SVP), using variable qubits to encode l… ▽ More The Learning-With-Errors (LWE) problem is a crucial computational challenge with significant implications for post-quantum cryptography and computational learning theory. Here we propose a quantum-classical hybrid algorithm with Ising model (HAWI) to address the LWE problem. Our approach involves transforming the LWE problem into the Shortest Vector Problem (SVP), using variable qubits to encode lattice vectors into an Ising Hamiltonian. We then identify the low-energy levels of the Hamiltonian to extract the solution, making it suitable for implementation on current noisy intermediate-scale quantum (NISQ) devices. We prove that the number of qubits required is less than $m(3m-1)/2$, where $m$ is the number of samples in the algorithm. Our algorithm is heuristic, and its time complexity depends on the specific quantum algorithm employed to find the Hamiltonian's low-energy levels. If the Quantum Approximate Optimization Algorithm (QAOA) is used to solve the Ising Hamiltonian problem, and the number of iterations satisfies $y < O\left(m\log m\cdot 2^{0.2972k}/pk^2\right)$, our algorithm will outperform the classical Block Korkine-Zolotarev (BKZ) algorithm, where $k$ is the block size related to problem parameters, and $p$ is the number of layers in QAOA. We demonstrate the algorithm by solving a $2$-dimensional LWE problem on a real quantum device with $5$ qubits, showing its potential for solving meaningful instances of the LWE problem in the NISQ era. △ Less

Submitted 15 August, 2024; originally announced August 2024.

A new blowup criterion for the 3D barotropic compressible Navier-Stokes equations with vacuum

Authors: Saiguo Xu, Yinghui Zhang

Abstract: We investigate the blowup criterion of the barotropic compressible viscous fluids for the Cauchy problem, Dirichlet problem and Navier-slip boundary condition. The main novelty of this paper is two-fold: First, for the Cauchy problem and Dirichlet problem, we prove that a strong or smooth solution exists globally, provided that the vorticity of velocity satisfies Serrin's condition and the maximum… ▽ More We investigate the blowup criterion of the barotropic compressible viscous fluids for the Cauchy problem, Dirichlet problem and Navier-slip boundary condition. The main novelty of this paper is two-fold: First, for the Cauchy problem and Dirichlet problem, we prove that a strong or smooth solution exists globally, provided that the vorticity of velocity satisfies Serrin's condition and the maximum norm of the divergence of the velocity is bounded. Second, for the Navier-slip boundary condition, we show that if both the maximum norm of the vorticity of velocity and the maximum norm of the divergence of velocity are bounded, then the solution exists globally. In particular, this criterion extends the well-known Beale-Kato-Majda's blowup criterion for the 3D incompressible Euler equations (Comm. Math. Phys. 94(1984):61-66) to the 3D barotropic compressible Navier-Stokes equations, and can be regarded as a complement for the work by Huang-Li-Xin (Comm. Math. Phys. 301(2011):23-35). The vacuum is allowed to exist here. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 19 pages

Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruning

Authors: Haofeng Liu, Erli Zhang, Junde Wu, Mingxuan Hong, Yueming Jin

Abstract: Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image and video segmentation. However, SAM2 struggles with efficiency due to the high computational demands of processing high-resolution images and complex and long-r… ▽ More Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image and video segmentation. However, SAM2 struggles with efficiency due to the high computational demands of processing high-resolution images and complex and long-range temporal dynamics in surgical videos. To address these challenges, we introduce Surgical SAM 2 (SurgSAM-2), an advanced model to utilize SAM2 with an Efficient Frame Pruning (EFP) mechanism, to facilitate real-time surgical video segmentation. The EFP mechanism dynamically manages the memory bank by selectively retaining only the most informative frames, reducing memory usage and computational cost while maintaining high segmentation accuracy. Our extensive experiments demonstrate that SurgSAM-2 significantly improves both efficiency and segmentation accuracy compared to the vanilla SAM2. Remarkably, SurgSAM-2 achieves a 3$\times$ FPS compared with SAM2, while also delivering state-of-the-art performance after fine-tuning with lower-resolution data. These advancements establish SurgSAM-2 as a leading model for surgical video analysis, making real-time surgical video segmentation in resource-constrained environments a feasible reality. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Comments: 16 pages, 2 figures

AIE: Auction Information Enhanced Framework for CTR Prediction in Online Advertising

Authors: Yang Yang, Bo Chen, Chenxu Zhu, Menghui Zhu, Xinyi Dai, Huifeng Guo, Muyu Zhang, Zhenhua Dong, Ruiming Tang

Abstract: Click-Through Rate (CTR) prediction is a fundamental technique for online advertising recommendation and the complex online competitive auction process also brings many difficulties to CTR optimization. Recent studies have shown that introducing posterior auction information contributes to the performance of CTR prediction. However, existing work doesn't fully capitalize on the benefits of auction… ▽ More Click-Through Rate (CTR) prediction is a fundamental technique for online advertising recommendation and the complex online competitive auction process also brings many difficulties to CTR optimization. Recent studies have shown that introducing posterior auction information contributes to the performance of CTR prediction. However, existing work doesn't fully capitalize on the benefits of auction information and overlooks the data bias brought by the auction, leading to biased and suboptimal results. To address these limitations, we propose Auction Information Enhanced Framework (AIE) for CTR prediction in online advertising, which delves into the problem of insufficient utilization of auction signals and first reveals the auction bias. Specifically, AIE introduces two pluggable modules, namely Adaptive Market-price Auxiliary Module (AM2) and Bid Calibration Module (BCM), which work collaboratively to excavate the posterior auction signals better and enhance the performance of CTR prediction. Furthermore, the two proposed modules are lightweight, model-agnostic, and friendly to inference latency. Extensive experiments are conducted on a public dataset and an industrial dataset to demonstrate the effectiveness and compatibility of AIE. Besides, a one-month online A/B test in a large-scale advertising platform shows that AIE improves the base model by 5.76% and 2.44% in terms of eCPM and CTR, respectively. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Quantum-inspired Interpretable Deep Learning Architecture for Text Sentiment Analysis

Authors: Bingyu Li, Da Zhang, Zhiyuan Zhao, Junyu Gao, Yuan Yuan

Abstract: Text has become the predominant form of communication on social media, embedding a wealth of emotional nuances. Consequently, the extraction of emotional information from text is of paramount importance. Despite previous research making some progress, existing text sentiment analysis models still face challenges in integrating diverse semantic information and lack interpretability. To address thes… ▽ More Text has become the predominant form of communication on social media, embedding a wealth of emotional nuances. Consequently, the extraction of emotional information from text is of paramount importance. Despite previous research making some progress, existing text sentiment analysis models still face challenges in integrating diverse semantic information and lack interpretability. To address these issues, we propose a quantum-inspired deep learning architecture that combines fundamental principles of quantum mechanics (QM principles) with deep learning models for text sentiment analysis. Specifically, we analyze the commonalities between text representation and QM principles to design a quantum-inspired text representation method and further develop a quantum-inspired text embedding layer. Additionally, we design a feature extraction layer based on long short-term memory (LSTM) networks and self-attention mechanisms (SAMs). Finally, we calculate the text density matrix using the quantum complex numbers principle and apply 2D-convolution neural networks (CNNs) for feature condensation and dimensionality reduction. Through a series of visualization, comparative, and ablation experiments, we demonstrate that our model not only shows significant advantages in accuracy and efficiency compared to previous related models but also achieves a certain level of interpretability by integrating QM principles. Our code is available at QISA. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Topological Charge Quadrupole Protected by Spin-Orbit U(1) Quasi-Symmetry in Antiferromagnet NdBiPt

Authors: Ao Zhang, Xiaobing Chen, Jiayu Li, Pengfei Liu, Yuntian Liu, Qihang Liu

Abstract: The interplay of symmetry and topology in crystal solids has given rise to various elementary excitations as quasiparticles. Among these, those with significant Berry-phase-related transport responses are of particular interest. Here, we predict a new type of quasiparticle called topological charge quadruple (TCQ), which is analogous to a charge quadrupole but consists of two closely-packed pairs… ▽ More The interplay of symmetry and topology in crystal solids has given rise to various elementary excitations as quasiparticles. Among these, those with significant Berry-phase-related transport responses are of particular interest. Here, we predict a new type of quasiparticle called topological charge quadruple (TCQ), which is analogous to a charge quadrupole but consists of two closely-packed pairs of Weyl points in momentum space, specifically in a half-Heusler antiferromagnet NdBiPt. Interestingly, the TCQ is protected by the spin-orbit $U(1)$ quasi-symmetry, rather than any exact crystallographic symmetries. This quasi-symmetry restricts the energy splitting induced by symmetry-lowering perturbations to a second-order effect. Furthermore, the closely located Berry curvature sources and sinks in the TCQ lead to a large Berry curvature dipole, resulting in a significant nonlinear Hall effect. Our work opens an avenue for designing novel quasiparticles using quasi-symmetries and developing materials with enhanced nonlinear responses. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 6 pages, 4 figures

Anomalous thermodiffusion, absolute negative mobility and reverse heat transport in a single quantum dot

Authors: Yanchao Zhang, Xiaolong Lü

Abstract: We investigate the steady-state transport characteristics of a quantum dot system consisting of a single energy level embedded between two reservoirs under the influence of both the temperature gradient and bias voltage. Within tailored parameter regimes, the system can exhibit three counterintuitive transport phenomena of anomalous thermodiffusion, absolute negative mobility and reverse heat tran… ▽ More We investigate the steady-state transport characteristics of a quantum dot system consisting of a single energy level embedded between two reservoirs under the influence of both the temperature gradient and bias voltage. Within tailored parameter regimes, the system can exhibit three counterintuitive transport phenomena of anomalous thermodiffusion, absolute negative mobility and reverse heat transport respectively. These counterintuitive phenomena do not violate the second law of thermodynamics. Moreover, absolute negative mobility and reverse heat transport can be identified by a reversible energy level. These anomalous transports are different from thermoelectric transports and provide different perspectives for a more comprehensive understanding of the transport characteristics of quantum systems. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 16 pages, 9 figures

A Systematic Evaluation of Generated Time Series and Their Effects in Self-Supervised Pretraining

Authors: Audrey Der, Chin-Chia Michael Yeh, Xin Dai, Huiyuan Chen, Yan Zheng, Yujie Fan, Zhongfang Zhuang, Vivian Lai, Junpeng Wang, Liang Wang, Wei Zhang, Eamonn Keogh

Abstract: Self-supervised Pretrained Models (PTMs) have demonstrated remarkable performance in computer vision and natural language processing tasks. These successes have prompted researchers to design PTMs for time series data. In our experiments, most self-supervised time series PTMs were surpassed by simple supervised models. We hypothesize this undesired phenomenon may be caused by data scarcity. In res… ▽ More Self-supervised Pretrained Models (PTMs) have demonstrated remarkable performance in computer vision and natural language processing tasks. These successes have prompted researchers to design PTMs for time series data. In our experiments, most self-supervised time series PTMs were surpassed by simple supervised models. We hypothesize this undesired phenomenon may be caused by data scarcity. In response, we test six time series generation methods, use the generated data in pretraining in lieu of the real data, and examine the effects on classification performance. Our results indicate that replacing a real-data pretraining set with a greater volume of only generated samples produces noticeable improvement. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: To appear in CIKM 2024 as a short paper; the version here is the self-contained version that includes the non-mandatory supplementary material available on the paper's companion website

Hybrid Semantic/Bit Communication Based Networking Problem Optimization

Authors: Le Xia, Yao Sun, Dusit Niyato, Lan Zhang, Lei Zhang, Muhammad Ali Imran

Abstract: Semantic communication (SemCom) has recently shown great potential in significant resource savings and efficient information exchanges, thus naturally introducing a novel and practical next-generation cellular network paradigm where two modes of SemCom and conventional bit communication (BitCom) coexist, namely hybrid semantic/bit communication network (HSB-Net). Nevertheless, the pertinent wirele… ▽ More Semantic communication (SemCom) has recently shown great potential in significant resource savings and efficient information exchanges, thus naturally introducing a novel and practical next-generation cellular network paradigm where two modes of SemCom and conventional bit communication (BitCom) coexist, namely hybrid semantic/bit communication network (HSB-Net). Nevertheless, the pertinent wireless resource management issue becomes rather complicated and challenging, especially considering the unique background knowledge matching and time-consuming semantic coding requirements in SemCom. To this end, this paper jointly investigates user association (UA), mode selection (MS), and bandwidth allocation (BA) problems in the uplink of HSB-Net. Concretely, we first identify a unified performance metric of message throughput for both SemCom and BitCom links. Next, we comprehensively develop a knowledge matching-aware two-stage tandem packet queuing model and theoretically derive the average packet loss ratio and queuing latency. Combined with several practical constraints, we then formulate a joint optimization problem for UA, MS, and BA to maximize the overall message throughput of HSB-Net. Afterward, we propose an optimal resource management strategy by employing a Lagrange primal-dual method and devising a preference list-based heuristic algorithm. Finally, numerical results validate the performance superiority of our proposed strategy compared with different benchmarks. △ Less

Submitted 30 July, 2024; originally announced August 2024.

Comments: This paper has been accepted for publication in 2024 IEEE Global Communications Conference (GlobeCom 2024). Copyright may be transferred without notice, after which this version may no longer be accessible. arXiv admin note: substantial text overlap with arXiv:2404.04162

Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference

Authors: Rohan Baskar Prabhakar, Hengrui Zhang, David Wentlzaff

Abstract: Large Transformer networks are increasingly used in settings where low inference latency can improve the end-user experience and enable new applications. However, autoregressive inference is resource intensive and requires parallelism for efficiency. Parallelism introduces collective communication that is both expensive and represents a phase when hardware resources are underutilized. Towards miti… ▽ More Large Transformer networks are increasingly used in settings where low inference latency can improve the end-user experience and enable new applications. However, autoregressive inference is resource intensive and requires parallelism for efficiency. Parallelism introduces collective communication that is both expensive and represents a phase when hardware resources are underutilized. Towards mitigating this, Kraken is an evolution of the standard Transformer architecture that is designed to complement existing tensor parallelism schemes for efficient inference on multi-device systems. By introducing a fixed degree of intra-layer model parallelism, the architecture allows collective operations to be overlapped with compute, decreasing latency and increasing hardware utilization. When trained on OpenWebText, Kraken models reach a similar perplexity as standard Transformers while also preserving their language modeling capabilities when evaluated on the SuperGLUE benchmark. Importantly, when tested on multi-GPU systems using TensorRT-LLM engines, Kraken speeds up Time To First Token by a mean of 35.6% across a range of model sizes, context lengths, and degrees of tensor parallelism. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Hybrid entanglement and error correction in a scalable quantum network node

Authors: Xiu-Ying Chang, Pan-Yu Hou, Wen-Gang Zhang, Xiang-Qian Meng, Ye-Fei Yu, Ya-Nan Lu, Yan-Qing Liu, Bin-Xiang Qi, Dong-Ling Deng, Lu-Ming Duan

Abstract: Recent breakthroughs have ushered the quantum network into a new era, where quantum information can be stored, transferred, and processed across multiple nodes on a metropolitan scale. A key challenge in this new era is enhancing the capabilities of individual nodes, providing precise and robust control over multiple qubits and advanced functionality for scalable quantum networks. Here, we report… ▽ More Recent breakthroughs have ushered the quantum network into a new era, where quantum information can be stored, transferred, and processed across multiple nodes on a metropolitan scale. A key challenge in this new era is enhancing the capabilities of individual nodes, providing precise and robust control over multiple qubits and advanced functionality for scalable quantum networks. Here, we report on precise and complex control in a hybrid quantum node based on a diamond color center. We demonstrate hybrid coherent control by entangling three types of qubits: an electron spin as an interface qubit, a nuclear spin with long memory time, and a flying photonic qubit, with their qubit frequencies spanning three distinct regimes from the optical domain to the rf domain. By incorporating two additional memory qubits, we encode three memory qubits into a logical state using the three-qubit repetition code and entangle this logical qubit with a photonic qubit. Leveraging hybrid qubits and precise control, we repeatedly read out the error syndromes of memory qubits through the electron spin, serving as an auxiliary qubit, then apply a real-time feedback operation to correct bit-flip errors. We execute and verify active error correction for up to twelve rounds and demonstrate the improvement over the uncorrected counterpart. Our results demonstrate the feasibility of several key functionalities for next-generation quantum repeaters, paving the way towards full-fledged metropolitan-scale quantum networks for a wide range of practical applications. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 8 pages, 3 figures