Showing 1–50 of 126 results for author: Wen, D

Anisotropic pressure effect on central EOS of PSR J0740+6620 in the light of dimensionless TOV equation

Authors: Zhihao Yang, Dehua Wen

Abstract: It is generally agreed upon that the pressure inside a neutron star is isotropic. However, a strong magnetic field or superfluidity suggests that the pressure anisotropy may be a more realistic model. We derived the dimensionless TOV equation for anisotropic neutron stars based on two popular models, namely the BL model and the H model, to investigate the effect of anisotropy. Similar to the isotr… ▽ More It is generally agreed upon that the pressure inside a neutron star is isotropic. However, a strong magnetic field or superfluidity suggests that the pressure anisotropy may be a more realistic model. We derived the dimensionless TOV equation for anisotropic neutron stars based on two popular models, namely the BL model and the H model, to investigate the effect of anisotropy. Similar to the isotropic case, the maximum mass $M_{max}$ and its corresponding radius $R_{Mmax}$ can also be expressed linearly by a combination of radial central pressure $p_{rc}$ and central energy density $\varepsilon_{c}$, which is insensitive to the equation of state (EOS). We also found that the obtained central EOS would change with different values of $λ_{BL}$ ($λ_{H}$), which controls the magnitude of the difference between the transverse pressure and the radial pressure. Combining with observational data of PSR J0740+6620 and comparing to the extracted EOS based on isotropic neutron star, it is shown that in the BL model, for $λ_{BL}$ = 0.4, the extracted central energy density $\varepsilon_{c}$ changed from 546 -- 1056 MeV/fm$^{3}$ to 510 -- 1005 MeV/fm$^{3}$, and the extracted radial central pressure $p_{rc}$ changed from 87 -- 310 MeV/fm$^{3}$ to 76 -- 271 MeV/fm$^{3}$. For $λ_{BL}$ = 2, the extracted $\varepsilon_{c}$ and $p_{rc}$ changed to 412 -- 822 MeV/fm$^{3}$ and 50 -- 165 MeV/fm$^{3}$, respectively. In the H model, for $λ_{H}$ = 0.4, the extracted $\varepsilon_{c}$ changed to 626 -- 1164 MeV/fm$^{3}$, and the extracted $p_{rc}$ changed to 104 -- 409 MeV/fm$^{3}$. For $λ_{H}$ = 2, the extracted $\varepsilon_{c}$ decreased to 894 -- 995 MeV/fm$^{3}$, and the extracted $p_{rc}$ changed to 220 -- 301 MeV/fm$^{3}$. △ Less

Submitted 3 September, 2024; originally announced September 2024.

Comments: 19 pages, 8 figures

Journal ref: Chinese Physics C Vol. 48, No. 10 (2024) 104106

A Survey on Integrated Sensing, Communication, and Computation

Authors: Dingzhu Wen, Yong Zhou, Xiaoyang Li, Yuanming Shi, Kaibin Huang, Khaled B. Letaief

Abstract: The forthcoming generation of wireless technology, 6G, promises a revolutionary leap beyond traditional data-centric services. It aims to usher in an era of ubiquitous intelligent services, where everything is interconnected and intelligent. This vision requires the seamless integration of three fundamental modules: Sensing for information acquisition, communication for information sharing, and co… ▽ More The forthcoming generation of wireless technology, 6G, promises a revolutionary leap beyond traditional data-centric services. It aims to usher in an era of ubiquitous intelligent services, where everything is interconnected and intelligent. This vision requires the seamless integration of three fundamental modules: Sensing for information acquisition, communication for information sharing, and computation for information processing and decision-making. These modules are intricately linked, especially in complex tasks such as edge learning and inference. However, the performance of these modules is interdependent, creating a resource competition for time, energy, and bandwidth. Existing techniques like integrated communication and computation (ICC), integrated sensing and computation (ISC), and integrated sensing and communication (ISAC) have made partial strides in addressing this challenge, but they fall short of meeting the extreme performance requirements. To overcome these limitations, it is essential to develop new techniques that comprehensively integrate sensing, communication, and computation. This integrated approach, known as Integrated Sensing, Communication, and Computation (ISCC), offers a systematic perspective for enhancing task performance. This paper begins with a comprehensive survey of historic and related techniques such as ICC, ISC, and ISAC, highlighting their strengths and limitations. It then explores the state-of-the-art signal designs for ISCC, along with network resource management strategies specifically tailored for ISCC. Furthermore, this paper discusses the exciting research opportunities that lie ahead for implementing ISCC in future advanced networks. By embracing ISCC, we can unlock the full potential of intelligent connectivity, paving the way for groundbreaking applications and services. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Efficient Maximal Frequent Group Enumeration in Temporal Bipartite Graphs

Authors: Yanping Wu, Renjie Sun, Xiaoyang Wang, Dong Wen, Ying Zhang, Lu Qin, Xuemin Lin

Abstract: Cohesive subgraph mining is a fundamental problem in bipartite graph analysis. In reality, relationships between two types of entities often occur at some specific timestamps, which can be modeled as a temporal bipartite graph. However, the temporal information is widely neglected by previous studies. Moreover, directly extending the existing models may fail to find some critical groups in tempora… ▽ More Cohesive subgraph mining is a fundamental problem in bipartite graph analysis. In reality, relationships between two types of entities often occur at some specific timestamps, which can be modeled as a temporal bipartite graph. However, the temporal information is widely neglected by previous studies. Moreover, directly extending the existing models may fail to find some critical groups in temporal bipartite graphs, which appear in a unilateral (i.e., one-layer) form. To fill the gap, in this paper, we propose a novel model, called maximal λ-frequency group (MFG). Given a temporal bipartite graph G=(U,V,E), a vertex set V_S \subseteq V is an MFG if i) there are no less than λtimestamps, at each of which V_S can form a (t_U,t_V)-biclique with some vertices in U at the corresponding snapshot, and ii) it is maximal. To solve the problem, a filter-and-verification (FilterV) method is proposed based on the Bron-Kerbosch framework, incorporating novel filtering techniques to reduce the search space and array-based strategy to accelerate the frequency and maximality verification. Nevertheless, the cost of frequency verification in each valid candidate set computation and maximality check could limit the scalability of FilterV to larger graphs. Therefore, we further develop a novel verification-free (VFree) approach by leveraging the advanced dynamic counting structure proposed. Theoretically, we prove that VFree can reduce the cost of each valid candidate set computation in FilterV by a factor of O(|V|). Furthermore, VFree can avoid the explicit maximality verification because of the developed search paradigm. Finally, comprehensive experiments on 15 real-world graphs are conducted to demonstrate the efficiency and effectiveness of the proposed techniques and model. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Referring Atomic Video Action Recognition

Authors: Kunyu Peng, Jia Fu, Kailun Yang, Di Wen, Yufan Chen, Ruiping Liu, Junwei Zheng, Jiaming Zhang, M. Saquib Sarfraz, Rainer Stiefelhagen, Alina Roitberg

Abstract: We introduce a new task called Referring Atomic Video Action Recognition (RAVAR), aimed at identifying atomic actions of a particular person based on a textual description and the video data of this person. This task differs from traditional action recognition and localization, where predictions are delivered for all present individuals. In contrast, we focus on recognizing the correct atomic acti… ▽ More We introduce a new task called Referring Atomic Video Action Recognition (RAVAR), aimed at identifying atomic actions of a particular person based on a textual description and the video data of this person. This task differs from traditional action recognition and localization, where predictions are delivered for all present individuals. In contrast, we focus on recognizing the correct atomic action of a specific individual, guided by text. To explore this task, we present the RefAVA dataset, containing 36,630 instances with manually annotated textual descriptions of the individuals. To establish a strong initial benchmark, we implement and validate baselines from various domains, e.g., atomic action localization, video question answering, and text-video retrieval. Since these existing methods underperform on RAVAR, we introduce RefAtomNet -- a novel cross-stream attention-driven method specialized for the unique challenges of RAVAR: the need to interpret a textual referring expression for the targeted individual, utilize this reference to guide the spatial localization and harvest the prediction of the atomic actions for the referring person. The key ingredients are: (1) a multi-stream architecture that connects video, text, and a new location-semantic stream, and (2) cross-stream agent attention fusion and agent token fusion which amplify the most relevant information across these streams and consistently surpasses standard attention-based fusion on RAVAR. Extensive experiments demonstrate the effectiveness of RefAtomNet and its building blocks for recognizing the action of the described individual. The dataset and code will be made publicly available at https://github.com/KPeng9510/RAVAR. △ Less

Submitted 10 July, 2024; v1 submitted 1 July, 2024; originally announced July 2024.

Comments: Accepted to ECCV 2024. The dataset and code will be made publicly available at https://github.com/KPeng9510/RAVAR

Task-oriented Over-the-air Computation for Edge-device Co-inference with Balanced Classification Accuracy

Authors: Xiang Jiao, Dingzhu Wen, Guangxu Zhu, Wei Jiang, Wu Luo, Yuanming Shi

Abstract: Edge-device co-inference, which concerns the cooperation between edge devices and an edge server for completing inference tasks over wireless networks, has been a promising technique for enabling various kinds of intelligent services at the network edge, e.g., auto-driving. In this paradigm, the concerned design objective of the network shifts from the traditional communication throughput to the e… ▽ More Edge-device co-inference, which concerns the cooperation between edge devices and an edge server for completing inference tasks over wireless networks, has been a promising technique for enabling various kinds of intelligent services at the network edge, e.g., auto-driving. In this paradigm, the concerned design objective of the network shifts from the traditional communication throughput to the effective and efficient execution of the inference task underpinned by the network, measured by, e.g., the inference accuracy and latency. In this paper, a task-oriented over-the-air computation scheme is proposed for a multidevice artificial intelligence system. Particularly, a novel tractable inference accuracy metric is proposed for classification tasks, which is called minimum pair-wise discriminant gain. Unlike prior work measuring the average of all class pairs in feature space, it measures the minimum distance of all class pairs. By maximizing the minimum pair-wise discriminant gain instead of its average counterpart, any pair of classes can be better separated in the feature space, and thus leading to a balanced and improved inference accuracy for all classes. Besides, this paper jointly optimizes the minimum discriminant gain of all feature elements instead of separately maximizing that of each element in the existing designs. As a result, the transmit power can be adaptively allocated to the feature elements according to their different contributions to the inference accuracy, opening an extra degree of freedom to improve inference performance. Extensive experiments are conducted using a concrete use case of human motion recognition to verify the superiority of the proposed design over the benchmarking scheme. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Comments: This paper was accepted by IEEE Transactions on Vehicular Technology on June 30, 2024

Unveiling Glitches: A Deep Dive into Image Encoding Bugs within CLIP

Authors: Ayush Ranjan, Daniel Wen, Karthik Bhat

Abstract: Understanding the limitations and weaknesses of state-of-the-art models in artificial intelligence is crucial for their improvement and responsible application. In this research, we focus on CLIP, a model renowned for its integration of vision and language processing. Our objective is to uncover recurring problems and blind spots in CLIP's image comprehension. By delving into both the commonalitie… ▽ More Understanding the limitations and weaknesses of state-of-the-art models in artificial intelligence is crucial for their improvement and responsible application. In this research, we focus on CLIP, a model renowned for its integration of vision and language processing. Our objective is to uncover recurring problems and blind spots in CLIP's image comprehension. By delving into both the commonalities and disparities between CLIP and human image understanding, we augment our comprehension of these models' capabilities. Through our analysis, we reveal significant discrepancies in CLIP's interpretation of images compared to human perception, shedding light on areas requiring improvement. Our methodologies, the Discrepancy Analysis Framework (DAF) and the Transformative Caption Analysis for CLIP (TCAC), enable a comprehensive evaluation of CLIP's performance. We identify 14 systemic faults, including Action vs. Stillness confusion, Failure to identify the direction of movement or positioning of objects in the image, Hallucination of Water-like Features, Misattribution of Geographic Context, among others. By addressing these limitations, we lay the groundwork for the development of more accurate and nuanced image embedding models, contributing to advancements in artificial intelligence. △ Less

Submitted 30 June, 2024; originally announced July 2024.

ACM Class: F.2.2; I.2.7

Improving Generative Adversarial Networks for Video Super-Resolution

Authors: Daniel Wen

Abstract: In this research, we explore different ways to improve generative adversarial networks for video super-resolution tasks from a base single image super-resolution GAN model. Our primary objective is to identify potential techniques that enhance these models and to analyze which of these techniques yield the most significant improvements. We evaluate our results using Peak Signal-to-Noise Ratio (PSN… ▽ More In this research, we explore different ways to improve generative adversarial networks for video super-resolution tasks from a base single image super-resolution GAN model. Our primary objective is to identify potential techniques that enhance these models and to analyze which of these techniques yield the most significant improvements. We evaluate our results using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM). Our findings indicate that the most effective techniques include temporal smoothing, long short-term memory (LSTM) layers, and a temporal loss function. The integration of these methods results in an 11.97% improvement in PSNR and an 8% improvement in SSIM compared to the baseline video super-resolution generative adversarial network (GAN) model. This substantial improvement suggests potential further applications to enhance current state-of-the-art models. △ Less

Submitted 24 June, 2024; originally announced June 2024.

ACM Class: F.2.2; I.2.7

Directed Domain Fine-Tuning: Tailoring Separate Modalities for Specific Training Tasks

Authors: Daniel Wen, Nafisa Hussain

Abstract: Large language models (LLMs) and large visual language models (LVLMs) have been at the forefront of the artificial intelligence field, particularly for tasks like text generation, video captioning, and question-answering. Typically, it is more applicable to train these models on broader knowledge bases or datasets to increase generalizability, learn relationships between topics, and recognize patt… ▽ More Large language models (LLMs) and large visual language models (LVLMs) have been at the forefront of the artificial intelligence field, particularly for tasks like text generation, video captioning, and question-answering. Typically, it is more applicable to train these models on broader knowledge bases or datasets to increase generalizability, learn relationships between topics, and recognize patterns. Instead, we propose to provide instructional datasets specific to the task of each modality within a distinct domain and then fine-tune the parameters of the model using LORA. With our approach, we can eliminate all noise irrelevant to the given task while also ensuring that the model generates with enhanced precision. For this work, we use Video-LLaVA to generate recipes given cooking videos without transcripts. Video-LLaVA's multimodal architecture allows us to provide cooking images to its image encoder, cooking videos to its video encoder, and general cooking questions to its text encoder. Thus, we aim to remove all noise unrelated to cooking while improving our model's capabilities to generate specific ingredient lists and detailed instructions. As a result, our approach to fine-tuning Video-LLaVA leads to gains over the baseline Video-LLaVA by 2% on the YouCook2 dataset. While this may seem like a marginal increase, our model trains on an image instruction dataset 2.5% the size of Video-LLaVA's and a video instruction dataset 23.76% of Video-LLaVA's. △ Less

Submitted 24 June, 2024; originally announced June 2024.

ACM Class: F.2.2; I.2.7

Efficient Antagonistic k-plex Enumeration in Signed Graphs

Authors: Lantian Xu, Rong-Hua Li, Dong Wen, Qiangqiang Dai, Guoren Wang, Lu Qin

Abstract: A signed graph is a graph where each edge receives a sign, positive or negative. The signed graph model has been used in many real applications, such as protein complex discovery and social network analysis. Finding cohesive subgraphs in signed graphs is a fundamental problem. A k-plex is a common model for cohesive subgraphs in which every vertex is adjacent to all but at most k vertices within t… ▽ More A signed graph is a graph where each edge receives a sign, positive or negative. The signed graph model has been used in many real applications, such as protein complex discovery and social network analysis. Finding cohesive subgraphs in signed graphs is a fundamental problem. A k-plex is a common model for cohesive subgraphs in which every vertex is adjacent to all but at most k vertices within the subgraph. In this paper, we propose the model of size-constrained antagonistic k-plex in a signed graph. The proposed model guarantees that the resulting subgraph is a k-plex and can be divided into two sub-k-plexes, both of which have positive inner edges and negative outer edges. This paper aims to identify all maximal antagonistic k-plexes in a signed graph. Through rigorous analysis, we show that the problem is NP-Hardness. We propose a novel framework for maximal antagonistic k-plexes utilizing set enumeration. Efficiency is improved through pivot pruning and early termination based on the color bound. Preprocessing techniques based on degree and dichromatic graphs effectively narrow the search space before enumeration. Extensive experiments on real-world datasets demonstrate our algorithm's efficiency, effectiveness, and scalability. △ Less

Submitted 23 June, 2024; originally announced June 2024.

Smart Pixels: In-pixel AI for on-sensor data filtering

Authors: Benjamin Parpillon, Chinar Syal, Jieun Yoo, Jennet Dickinson, Morris Swartz, Giuseppe Di Guglielmo, Alice Bean, Douglas Berry, Manuel Blanco Valentin, Karri DiPetrillo, Anthony Badea, Lindsey Gray, Petar Maksimovic, Corrinne Mills, Mark S. Neubauer, Gauri Pradhan, Nhan Tran, Dahai Wen, Farah Fahim

Abstract: We present a smart pixel prototype readout integrated circuit (ROIC) designed in CMOS 28 nm bulk process, with in-pixel implementation of an artificial intelligence (AI) / machine learning (ML) based data filtering algorithm designed as proof-of-principle for a Phase III upgrade at the Large Hadron Collider (LHC) pixel detector. The first version of the ROIC consists of two matrices of 256 smart p… ▽ More We present a smart pixel prototype readout integrated circuit (ROIC) designed in CMOS 28 nm bulk process, with in-pixel implementation of an artificial intelligence (AI) / machine learning (ML) based data filtering algorithm designed as proof-of-principle for a Phase III upgrade at the Large Hadron Collider (LHC) pixel detector. The first version of the ROIC consists of two matrices of 256 smart pixels, each 25$\times$25 $μ$m$^2$ in size. Each pixel consists of a charge-sensitive preamplifier with leakage current compensation and three auto-zero comparators for a 2-bit flash-type ADC. The frontend is capable of synchronously digitizing the sensor charge within 25 ns. Measurement results show an equivalent noise charge (ENC) of $\sim$30e$^-$ and a total dispersion of $\sim$100e$^-$ The second version of the ROIC uses a fully connected two-layer neural network (NN) to process information from a cluster of 256 pixels to determine if the pattern corresponds to highly desirable high-momentum particle tracks for selection and readout. The digital NN is embedded in-between analog signal processing regions of the 256 pixels without increasing the pixel size and is implemented as fully combinatorial digital logic to minimize power consumption and eliminate clock distribution, and is active only in the presence of an input signal. The total power consumption of the neural network is $\sim$ 300 $μ$W. The NN performs momentum classification based on the generated cluster patterns and even with a modest momentum threshold, it is capable of 54.4\% - 75.4\% total data rejection, opening the possibility of using the pixel information at 40MHz for the trigger. The total power consumption of analog and digital functions per pixel is $\sim$ 6 $μ$W per pixel, which corresponds to $\sim$ 1 W/cm$^2$ staying within the experimental constraints. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Comments: IEEE NSS MIC RSTD 2024

Report number: FERMILAB-CONF-24-0233-ETD

Optimal Matrix Sketching over Sliding Windows

Authors: Hanyan Yin, Dongxie Wen, Jiajun Li, Zhewei Wei, Xiao Zhang, Zengfeng Huang, Feifei Li

Abstract: Matrix sketching, aimed at approximating a matrix $\boldsymbol{A} \in \mathbb{R}^{N\times d}$ consisting of vector streams of length $N$ with a smaller sketching matrix $\boldsymbol{B} \in \mathbb{R}^{\ell\times d}, \ell \ll N$, has garnered increasing attention in fields such as large-scale data analytics and machine learning. A well-known deterministic matrix sketching method is the Frequent Dir… ▽ More Matrix sketching, aimed at approximating a matrix $\boldsymbol{A} \in \mathbb{R}^{N\times d}$ consisting of vector streams of length $N$ with a smaller sketching matrix $\boldsymbol{B} \in \mathbb{R}^{\ell\times d}, \ell \ll N$, has garnered increasing attention in fields such as large-scale data analytics and machine learning. A well-known deterministic matrix sketching method is the Frequent Directions algorithm, which achieves the optimal $O\left(\frac{d}{\varepsilon}\right)$ space bound and provides a covariance error guarantee of $\varepsilon = \lVert \boldsymbol{A}^\top \boldsymbol{A} - \boldsymbol{B}^\top \boldsymbol{B} \rVert_2/\lVert \boldsymbol{A} \rVert_F^2$. The matrix sketching problem becomes particularly interesting in the context of sliding windows, where the goal is to approximate the matrix $\boldsymbol{A}_W$, formed by input vectors over the most recent $N$ time units. However, despite recent efforts, whether achieving the optimal $O\left(\frac{d}{\varepsilon}\right)$ space bound on sliding windows is possible has remained an open question. In this paper, we introduce the DS-FD algorithm, which achieves the optimal $O\left(\frac{d}{\varepsilon}\right)$ space bound for matrix sketching over row-normalized, sequence-based sliding windows. We also present matching upper and lower space bounds for time-based and unnormalized sliding windows, demonstrating the generality and optimality of \dsfd across various sliding window models. This conclusively answers the open question regarding the optimal space bound for matrix sketching over sliding windows. Furthermore, we conduct extensive experiments with both synthetic and real-world datasets, validating our theoretical claims and thus confirming the correctness and effectiveness of our algorithm, both theoretically and empirically. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Collaborative Edge AI Inference over Cloud-RAN

Authors: Pengfei Zhang, Dingzhu Wen, Guangxu Zhu, Qimei Chen, Kaifeng Han, Yuanming Shi

Abstract: In this paper, a cloud radio access network (Cloud-RAN) based collaborative edge AI inference architecture is proposed. Specifically, geographically distributed devices capture real-time noise-corrupted sensory data samples and extract the noisy local feature vectors, which are then aggregated at each remote radio head (RRH) to suppress sensing noise. To realize efficient uplink feature aggregatio… ▽ More In this paper, a cloud radio access network (Cloud-RAN) based collaborative edge AI inference architecture is proposed. Specifically, geographically distributed devices capture real-time noise-corrupted sensory data samples and extract the noisy local feature vectors, which are then aggregated at each remote radio head (RRH) to suppress sensing noise. To realize efficient uplink feature aggregation, we allow each RRH receives local feature vectors from all devices over the same resource blocks simultaneously by leveraging an over-the-air computation (AirComp) technique. Thereafter, these aggregated feature vectors are quantized and transmitted to a central processor (CP) for further aggregation and downstream inference tasks. Our aim in this work is to maximize the inference accuracy via a surrogate accuracy metric called discriminant gain, which measures the discernibility of different classes in the feature space. The key challenges lie on simultaneously suppressing the coupled sensing noise, AirComp distortion caused by hostile wireless channels, and the quantization error resulting from the limited capacity of fronthaul links. To address these challenges, this work proposes a joint transmit precoding, receive beamforming, and quantization error control scheme to enhance the inference accuracy. Extensive numerical experiments demonstrate the effectiveness and superiority of our proposed optimization algorithm compared to various baselines. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Comments: This paper is accepted by IEEE Transactions on Communications on 08-Apr-2024

Skeleton-Based Human Action Recognition with Noisy Labels

Authors: Yi Xu, Kunyu Peng, Di Wen, Ruiping Liu, Junwei Zheng, Yufan Chen, Jiaming Zhang, Alina Roitberg, Kailun Yang, Rainer Stiefelhagen

Abstract: Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and annotation of activity sequences is time-consuming and the resulting labels are often noisy. If not effectively addressed, label noise negatively affects the model's training, resul… ▽ More Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and annotation of activity sequences is time-consuming and the resulting labels are often noisy. If not effectively addressed, label noise negatively affects the model's training, resulting in lower recognition quality. Despite its importance, addressing label noise for skeleton-based action recognition has been overlooked so far. In this study, we bridge this gap by implementing a framework that augments well-established skeleton-based human action recognition methods with label-denoising strategies from various research areas to serve as the initial benchmark. Observations reveal that these baselines yield only marginal performance when dealing with sparse skeleton data. Consequently, we introduce a novel methodology, NoiseEraSAR, which integrates global sample selection, co-teaching, and Cross-Modal Mixture-of-Experts (CM-MOE) strategies, aimed at mitigating the adverse impacts of label noise. Our proposed approach demonstrates better performance on the established benchmark, setting new state-of-the-art standards. The source code for this study is accessible at https://github.com/xuyizdby/NoiseEraSAR. △ Less

Submitted 5 August, 2024; v1 submitted 14 March, 2024; originally announced March 2024.

Comments: Accepted to IROS 2024. The source code for this study is accessible at https://github.com/xuyizdby/NoiseEraSAR

MCFEND: A Multi-source Benchmark Dataset for Chinese Fake News Detection

Authors: Yupeng Li, Haorui He, Jin Bai, Dacheng Wen

Abstract: The prevalence of fake news across various online sources has had a significant influence on the public. Existing Chinese fake news detection datasets are limited to news sourced solely from Weibo. However, fake news originating from multiple sources exhibits diversity in various aspects, including its content and social context. Methods trained on purely one single news source can hardly be appli… ▽ More The prevalence of fake news across various online sources has had a significant influence on the public. Existing Chinese fake news detection datasets are limited to news sourced solely from Weibo. However, fake news originating from multiple sources exhibits diversity in various aspects, including its content and social context. Methods trained on purely one single news source can hardly be applicable to real-world scenarios. Our pilot experiment demonstrates that the F1 score of the state-of-the-art method that learns from a large Chinese fake news detection dataset, Weibo-21, drops significantly from 0.943 to 0.470 when the test data is changed to multi-source news data, failing to identify more than one-third of the multi-source fake news. To address this limitation, we constructed the first multi-source benchmark dataset for Chinese fake news detection, termed MCFEND, which is composed of news we collected from diverse sources such as social platforms, messaging apps, and traditional online news outlets. Notably, such news has been fact-checked by 14 authoritative fact-checking agencies worldwide. In addition, various existing Chinese fake news detection methods are thoroughly evaluated on our proposed dataset in cross-source, multi-source, and unseen source ways. MCFEND, as a benchmark dataset, aims to advance Chinese fake news detection approaches in real-world scenarios. △ Less

Submitted 24 July, 2024; v1 submitted 14 March, 2024; originally announced March 2024.

Comments: Accepted by the ACM Web Conference 2024 (WWW 2024) oral, dataset available: https://github.com/TrustworthyComp

Confidence-Aware RGB-D Face Recognition via Virtual Depth Synthesis

Authors: Zijian Chen, Mei Wang, Weihong Deng, Hongzhi Shi, Dongchao Wen, Yingjie Zhang, Xingchen Cui, Jian Zhao

Abstract: 2D face recognition encounters challenges in unconstrained environments due to varying illumination, occlusion, and pose. Recent studies focus on RGB-D face recognition to improve robustness by incorporating depth information. However, collecting sufficient paired RGB-D training data is expensive and time-consuming, hindering wide deployment. In this work, we first construct a diverse depth datase… ▽ More 2D face recognition encounters challenges in unconstrained environments due to varying illumination, occlusion, and pose. Recent studies focus on RGB-D face recognition to improve robustness by incorporating depth information. However, collecting sufficient paired RGB-D training data is expensive and time-consuming, hindering wide deployment. In this work, we first construct a diverse depth dataset generated by 3D Morphable Models for depth model pre-training. Then, we propose a domain-independent pre-training framework that utilizes readily available pre-trained RGB and depth models to separately perform face recognition without needing additional paired data for retraining. To seamlessly integrate the two distinct networks and harness the complementary benefits of RGB and depth information for improved accuracy, we propose an innovative Adaptive Confidence Weighting (ACW). This mechanism is designed to learn confidence estimates for each modality to achieve modality fusion at the score level. Our method is simple and lightweight, only requiring ACW training beyond the backbone models. Experiments on multiple public RGB-D face recognition benchmarks demonstrate state-of-the-art performance surpassing previous methods based on depth estimation and feature fusion, validating the efficacy of our approach. △ Less

Submitted 16 March, 2024; v1 submitted 11 March, 2024; originally announced March 2024.

Comments: 9 pages, 5 figures

Complex angular structure of three elliptical galaxies from high-resolution ALMA observations of strong gravitational lenses

Authors: H. R. Stacey, D. M. Powell, S. Vegetti, J. P. McKean, C. D. Fassnacht, D. Wen, C. M. O'Riordan

Abstract: The large-scale mass distributions of galaxy-scale strong lenses have long been assumed to be well-described by a singular ellipsoidal power-law density profile with external shear. However, the inflexibility of this model could lead to systematic errors in astrophysical parameters inferred with gravitational lensing observables. Here, we present observations with the Atacama Large (sub-)Millimetr… ▽ More The large-scale mass distributions of galaxy-scale strong lenses have long been assumed to be well-described by a singular ellipsoidal power-law density profile with external shear. However, the inflexibility of this model could lead to systematic errors in astrophysical parameters inferred with gravitational lensing observables. Here, we present observations with the Atacama Large (sub-)Millimetre Array (ALMA) of three strongly lensed dusty star-forming galaxies at $\simeq30$ mas angular resolution and investigate the sensitivity of these data to angular structure in the lensing galaxies. We jointly infer the lensing mass distribution and the full surface brightness of the lensed sources with multipole expansions of the power-law density profile up to fourth order using a technique developed for interferometric data. All three data sets strongly favour third and fourth-order multipole amplitudes of $\approx1$ percent of the convergence. While the infrared stellar isophotes and isodensity shapes agree for one lens system, for the other two the isophotes disagree to varying extents, suggesting contributions to the angular structure from dark matter intrinsic or extrinsic to the lensing galaxy. △ Less

Submitted 27 May, 2024; v1 submitted 7 March, 2024; originally announced March 2024.

Comments: In print with A&A

Journal ref: A&A 688, A110 (2024)

Wukong: Towards a Scaling Law for Large-Scale Recommendation

Authors: Buyun Zhang, Liang Luo, Yuxin Chen, Jade Nie, Xi Liu, Daifeng Guo, Yanli Zhao, Shen Li, Yuchen Hao, Yantao Yao, Guna Lakshminarayanan, Ellie Dingqiao Wen, Jongsoo Park, Maxim Naumov, Wenlin Chen

Abstract: Scaling laws play an instrumental role in the sustainable improvement in model quality. Unfortunately, recommendation models to date do not exhibit such laws similar to those observed in the domain of large language models, due to the inefficiencies of their upscaling mechanisms. This limitation poses significant challenges in adapting these models to increasingly more complex real-world datasets.… ▽ More Scaling laws play an instrumental role in the sustainable improvement in model quality. Unfortunately, recommendation models to date do not exhibit such laws similar to those observed in the domain of large language models, due to the inefficiencies of their upscaling mechanisms. This limitation poses significant challenges in adapting these models to increasingly more complex real-world datasets. In this paper, we propose an effective network architecture based purely on stacked factorization machines, and a synergistic upscaling strategy, collectively dubbed Wukong, to establish a scaling law in the domain of recommendation. Wukong's unique design makes it possible to capture diverse, any-order of interactions simply through taller and wider layers. We conducted extensive evaluations on six public datasets, and our results demonstrate that Wukong consistently outperforms state-of-the-art models quality-wise. Further, we assessed Wukong's scalability on an internal, large-scale dataset. The results show that Wukong retains its superiority in quality over state-of-the-art models, while holding the scaling law across two orders of magnitude in model complexity, extending beyond 100 GFLOP/example, where prior arts fall short. △ Less

Submitted 4 June, 2024; v1 submitted 4 March, 2024; originally announced March 2024.

Comments: 12 pages

Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation

Authors: Liang Luo, Buyun Zhang, Michael Tsang, Yinbin Ma, Ching-Hsiang Chu, Yuxin Chen, Shen Li, Yuchen Hao, Yanli Zhao, Guna Lakshminarayanan, Ellie Dingqiao Wen, Jongsoo Park, Dheevatsa Mudigere, Maxim Naumov

Abstract: We study a mismatch between the deep learning recommendation models' flat architecture, common distributed training paradigm and hierarchical data center topology. To address the associated inefficiencies, we propose Disaggregated Multi-Tower (DMT), a modeling technique that consists of (1) Semantic-preserving Tower Transform (SPTT), a novel training paradigm that decomposes the monolithic global… ▽ More We study a mismatch between the deep learning recommendation models' flat architecture, common distributed training paradigm and hierarchical data center topology. To address the associated inefficiencies, we propose Disaggregated Multi-Tower (DMT), a modeling technique that consists of (1) Semantic-preserving Tower Transform (SPTT), a novel training paradigm that decomposes the monolithic global embedding lookup process into disjoint towers to exploit data center locality; (2) Tower Module (TM), a synergistic dense component attached to each tower to reduce model complexity and communication volume through hierarchical feature interaction; and (3) Tower Partitioner (TP), a feature partitioner to systematically create towers with meaningful feature interactions and load balanced assignments to preserve model quality and training throughput via learned embeddings. We show that DMT can achieve up to 1.9x speedup compared to the state-of-the-art baselines without losing accuracy across multiple generations of hardware at large data center scales. △ Less

Submitted 2 May, 2024; v1 submitted 1 March, 2024; originally announced March 2024.

Topological classes of thermodynamics of the rotating charged AdS black holes in gauged supergravities

Authors: Xiao-Dan Zhu, Di Wu, Dan Wen

Abstract: In this paper, we investigate the topological numbers of rotating charged AdS black holes in both four- and five-dimensional gauged supergravity theories. Our analysis is conducted within the framework of the thermodynamical topological approach to black holes, utilizing the generalized off-shell Helmholtz free energy. We demonstrate that the number of rotation parameters plays a significant role… ▽ More In this paper, we investigate the topological numbers of rotating charged AdS black holes in both four- and five-dimensional gauged supergravity theories. Our analysis is conducted within the framework of the thermodynamical topological approach to black holes, utilizing the generalized off-shell Helmholtz free energy. We demonstrate that the number of rotation parameters plays a significant role in determining the topological numbers of five-dimensional rotating AdS black holes. Moreover, our findings indicate that the topological numbers of both four- and five-dimensional rotating AdS black holes are not influenced by the number of electric charge parameters. This highlights a distinct difference in how rotation and electric charge parameters impact the thermodynamic topological properties of these black holes. △ Less

Submitted 26 July, 2024; v1 submitted 21 February, 2024; originally announced February 2024.

Comments: 11 pages, 10 figures, 1 table, revtex4-1.cls, to appear in PLB

Journal ref: Phys. Lett. B 856 (2024) 138919

High-quality Extragalactic Legacy-field Monitoring (HELM) with DECam

Authors: Ming-Yang Zhuang, Qian Yang, Yue Shen, Monika Adamow, Douglas N. Friedel, R. A. Gruendl, Xin Liu, Paul Martini, Timothy M. C. Abbott, Scott F. Anderson, Roberto J. Assef, Franz E. Bauer, Rich Bielby, W. N. Brandt, Colin J. Burke, Jorge Casares, Yu-Ching Chen, Gisella De Rosa, Alex Drlica-Wagner, Tom Dwelly, Alice Eltvedt, Gloria Fonseca Alvarez, Jianyang Fu, Cesar Fuentes, Melissa L. Graham , et al. (23 additional authors not shown)

Abstract: High-quality Extragalactic Legacy-field Monitoring (HELM) is a long-term observing program that photometrically monitors several well-studied extragalactic legacy fields with the Dark Energy Camera (DECam) imager on the CTIO 4m Blanco telescope. Since Feb 2019, HELM has been monitoring regions within COSMOS, XMM-LSS, CDF-S, S-CVZ, ELAIS-S1, and SDSS Stripe 82 with few-day cadences in the… ▽ More High-quality Extragalactic Legacy-field Monitoring (HELM) is a long-term observing program that photometrically monitors several well-studied extragalactic legacy fields with the Dark Energy Camera (DECam) imager on the CTIO 4m Blanco telescope. Since Feb 2019, HELM has been monitoring regions within COSMOS, XMM-LSS, CDF-S, S-CVZ, ELAIS-S1, and SDSS Stripe 82 with few-day cadences in the $(u)gri(z)$ bands, over a collective sky area of $\sim 38$ deg${\rm ^2}$. The main science goal of HELM is to provide high-quality optical light curves for a large sample of active galactic nuclei (AGNs), and to build decades-long time baselines when combining past and future optical light curves in these legacy fields. These optical images and light curves will facilitate the measurements of AGN reverberation mapping lags, as well as studies of AGN variability and its dependences on accretion properties. In addition, the time-resolved and coadded DECam photometry will enable a broad range of science applications from galaxy evolution to time-domain science. We describe the design and implementation of the program and present the first data release that includes source catalogs and the first $\sim 3.5$ years of light curves during 2019A--2022A. △ Less

Submitted 8 February, 2024; originally announced February 2024.

Comments: 11 pages, 8 figures, 4 tables, submitted to ApJS. Median source catalogs and light curves of individual objects are publicly available at https://ariel.astro.illinois.edu/helm/

Low-Rank Gradient Compression with Error Feedback for MIMO Wireless Federated Learning

Authors: Mingzhao Guo, Dongzhu Liu, Osvaldo Simeone, Dingzhu Wen

Abstract: This paper presents a novel approach to enhance the communication efficiency of federated learning (FL) in multiple input and multiple output (MIMO) wireless systems. The proposed method centers on a low-rank matrix factorization strategy for local gradient compression based on alternating least squares, along with over-the-air computation and error feedback. The proposed protocol, termed over-the… ▽ More This paper presents a novel approach to enhance the communication efficiency of federated learning (FL) in multiple input and multiple output (MIMO) wireless systems. The proposed method centers on a low-rank matrix factorization strategy for local gradient compression based on alternating least squares, along with over-the-air computation and error feedback. The proposed protocol, termed over-the-air low-rank compression (Ota-LC), is demonstrated to have lower computation cost and lower communication overhead as compared to existing benchmarks while guaranteeing the same inference performance. As an example, when targeting a test accuracy of 80% on the Cifar-10 dataset, Ota-LC achieves a reduction in total communication costs of at least 30% when contrasted with benchmark schemes, while also reducing the computational complexity order by a factor equal to the sum of the dimension of the gradients. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: 5 pages, 3 figures, 27 references, submitted

Enhancing Generalization of Invisible Facial Privacy Cloak via Gradient Accumulation

Authors: Xuannan Liu, Yaoyao Zhong, Weihong Deng, Hongzhi Shi, Xingchen Cui, Yunfeng Yin, Dongchao Wen

Abstract: The blooming of social media and face recognition (FR) systems has increased people's concern about privacy and security. A new type of adversarial privacy cloak (class-universal) can be applied to all the images of regular users, to prevent malicious FR systems from acquiring their identity information. In this work, we discover the optimization dilemma in the existing methods -- the local optima… ▽ More The blooming of social media and face recognition (FR) systems has increased people's concern about privacy and security. A new type of adversarial privacy cloak (class-universal) can be applied to all the images of regular users, to prevent malicious FR systems from acquiring their identity information. In this work, we discover the optimization dilemma in the existing methods -- the local optima problem in large-batch optimization and the gradient information elimination problem in small-batch optimization. To solve these problems, we propose Gradient Accumulation (GA) to aggregate multiple small-batch gradients into a one-step iterative gradient to enhance the gradient stability and reduce the usage of quantization operations. Experiments show that our proposed method achieves high performance on the Privacy-Commons dataset against black-box face recognition models. △ Less

Submitted 3 January, 2024; originally announced January 2024.

A new criterion for the existence of dark matter in neutron stars

Authors: Hongyi Sun, Dehua Wen

Abstract: The tidal deformability and the radius of neutron stars are observables, which have been used to constrain the neutron star equation of state and explore the composition in neutron stars. We investigated the radius and tidal deformability of dark matter admixed neutron stars (DANSs) by utilizing the two-fluid TOV equations. Assuming that the dark matter modeled as ideal fermi gas or self-interacti… ▽ More The tidal deformability and the radius of neutron stars are observables, which have been used to constrain the neutron star equation of state and explore the composition in neutron stars. We investigated the radius and tidal deformability of dark matter admixed neutron stars (DANSs) by utilizing the two-fluid TOV equations. Assuming that the dark matter modeled as ideal fermi gas or self-interacting bosons, for a series of DANSs at a fixed mass, it is shown that there exists the DANSs with smaller normal matter radii but larger tidal deformabilities. This negative correlation does not exist in the normal neutron stars.In other words, if the observation finds that the neutron stars with a fixed mass exists such a situation, that is, having a smaller observed radius but a larger tidal deformability, it will indicate the existence of dark matter in neutron stars.In addition, the relevant neutron star observations can also be used to constrain the dark matter parameters. △ Less

Submitted 28 December, 2023; originally announced December 2023.

Comments: 13 pages, 5 figures

Journal ref: Physical Review D 109, 123037 (2024)

Strong lensing as a probe of braneworld

Authors: Yi Zhang, Hong Liu, Dan Wen, Hongsheng Zhang

Abstract: For the first time, we use the Event Horizon Telescope (EHT) data to constrain the parameters of braneworld black holes which constrain $ε=0.0285^{+0.0888+0.1456}_{-0.0895-0.1475}$ for the anisotropic black hole and $q=-0.0305^{+0.1034+0.1953}_{-0.0895-0.1470}$ for the tidal Reissner-Nordstr$\ddot{o}$m (RN) black hole. Based on the fitted data and physical requirement, we calculate the photon defl… ▽ More For the first time, we use the Event Horizon Telescope (EHT) data to constrain the parameters of braneworld black holes which constrain $ε=0.0285^{+0.0888+0.1456}_{-0.0895-0.1475}$ for the anisotropic black hole and $q=-0.0305^{+0.1034+0.1953}_{-0.0895-0.1470}$ for the tidal Reissner-Nordstr$\ddot{o}$m (RN) black hole. Based on the fitted data and physical requirement, we calculate the photon deflection, the angular separation and time delay between different relativistic images of the anisotropic black hole and the tidal RN black hole in the ranges $-0.1190<ε<0$ and $-0.1775 <q<0$. And furthermore, we study the quasinormal modes (QNMs) for the braneworld black holes. The results shed light on existence of extra dimension. △ Less

Submitted 25 July, 2024; v1 submitted 25 December, 2023; originally announced December 2023.

Comments: 15 pages, 5 figures. arXiv admin note: text overlap with arXiv:hep-th/0406252 by other authors

From masses and radii of neutron stars to EOS of nuclear matter through neural network

Authors: Zehan Wu, Dehua Wen

Abstract: The equation of state (EOS) of dense nuclear matter is a key factor to determine the internal structure and properties of neutron stars. However, the EOS of high-density nuclear matter has great uncertainty mainly because the terrestrial nuclear experiments cannot reproduce matter as dense as that in the inner core of a neutron star. Fortunately, continuous improvements in astronomical observation… ▽ More The equation of state (EOS) of dense nuclear matter is a key factor to determine the internal structure and properties of neutron stars. However, the EOS of high-density nuclear matter has great uncertainty mainly because the terrestrial nuclear experiments cannot reproduce matter as dense as that in the inner core of a neutron star. Fortunately, continuous improvements in astronomical observations of neutron stars provide the opportunity to inversely constrain the EOS of high-density nuclear matter. A number of methods have been proposed to implement this inverse constraint, such as the Bayesian analysis algorithm, the Lindblom's approach, and so on. Neural network algorithm is an effective new method developed in recent years. By employing a set of isospin-dependent parametric EOSs as the training sample of neural network algorithm, we set up an effective way to reconstruct the EOS with relative accuracy through a few mass-radius data. Based on the obtained neural network algorithms and according to the NICER observations on masses and radii of neutron stars with assumed precision, we get the inversely constrained EOS and further calculate the corresponding macroscopic properties of the neutron star. The results are basically consistent with the constraint on EOS from the Huth $et~ al.$ based on Bayesian analysis. Moreover, the results show that even though the neural network algorithm was obtained by using the finite parameterized EOS as the training set, it is valid for any rational parameter combination of the parameterized EOS model. △ Less

Submitted 25 December, 2023; originally announced December 2023.

Comments: 13 pages, 6 figures

Journal ref: Chinese Physics C Vol. 48, No. 2 (2024) 024101

Smartpixels: Towards on-sensor inference of charged particle track parameters and uncertainties

Authors: Jennet Dickinson, Rachel Kovach-Fuentes, Lindsey Gray, Morris Swartz, Giuseppe Di Guglielmo, Alice Bean, Doug Berry, Manuel Blanco Valentin, Karri DiPetrillo, Farah Fahim, James Hirschauer, Shruti R. Kulkarni, Ron Lipton, Petar Maksimovic, Corrinne Mills, Mark S. Neubauer, Benjamin Parpillon, Gauri Pradhan, Chinar Syal, Nhan Tran, Dahai Wen, Jieun Yoo, Aaron Young

Abstract: The combinatorics of track seeding has long been a computational bottleneck for triggering and offline computing in High Energy Physics (HEP), and remains so for the HL-LHC. Next-generation pixel sensors will be sufficiently fine-grained to determine angular information of the charged particle passing through from pixel-cluster properties. This detector technology immediately improves the situatio… ▽ More The combinatorics of track seeding has long been a computational bottleneck for triggering and offline computing in High Energy Physics (HEP), and remains so for the HL-LHC. Next-generation pixel sensors will be sufficiently fine-grained to determine angular information of the charged particle passing through from pixel-cluster properties. This detector technology immediately improves the situation for offline tracking, but any major improvements in physics reach are unrealized since they are dominated by lowest-level hardware trigger acceptance. We will demonstrate track angle and hit position prediction, including errors, using a mixture density network within a single layer of silicon as well as the progress towards and status of implementing the neural network in hardware on both FPGAs and ASICs. △ Less

Submitted 18 December, 2023; originally announced December 2023.

Comments: 6 pages, 3 figures, submitted to Neural Information Processing Systems 2023 (NeurIPS)

Report number: FERMILAB-PUB-23-513-CMS-ETD-PPD

End-to-End Delay Minimization based on Joint Optimization of DNN Partitioning and Resource Allocation for Cooperative Edge Inference

Authors: Xinrui Ye, Yanzan Sun, Dingzhu Wen, Guanjin Pan, Shunqing Zhang

Abstract: Cooperative inference in Mobile Edge Computing (MEC), achieved by deploying partitioned Deep Neural Network (DNN) models between resource-constrained user equipments (UEs) and edge servers (ESs), has emerged as a promising paradigm. Firstly, we consider scenarios of continuous Artificial Intelligence (AI) task arrivals, like the object detection for video streams, and utilize a serial queuing mode… ▽ More Cooperative inference in Mobile Edge Computing (MEC), achieved by deploying partitioned Deep Neural Network (DNN) models between resource-constrained user equipments (UEs) and edge servers (ESs), has emerged as a promising paradigm. Firstly, we consider scenarios of continuous Artificial Intelligence (AI) task arrivals, like the object detection for video streams, and utilize a serial queuing model for the accurate evaluation of End-to-End (E2E) delay in cooperative edge inference. Secondly, to enhance the long-term performance of inference systems, we formulate a multi-slot stochastic E2E delay optimization problem that jointly considers model partitioning and multi-dimensional resource allocation. Finally, to solve this problem, we introduce a Lyapunov-guided Multi-Dimensional Optimization algorithm (LyMDO) that decouples the original problem into per-slot deterministic problems, where Deep Reinforcement Learning (DRL) and convex optimization are used for joint optimization of partitioning decisions and complementary resource allocation. Simulation results show that our approach effectively improves E2E delay while balancing long-term resource constraints. △ Less

Submitted 19 October, 2023; originally announced October 2023.

Comments: 7 pages, 9 figures, 1 table, 1 algorithm, to be published in IEEE 98th Vehicular Technology Conference (VTC2023-Fall)

Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning

Authors: Jieun Yoo, Jennet Dickinson, Morris Swartz, Giuseppe Di Guglielmo, Alice Bean, Douglas Berry, Manuel Blanco Valentin, Karri DiPetrillo, Farah Fahim, Lindsey Gray, James Hirschauer, Shruti R. Kulkarni, Ron Lipton, Petar Maksimovic, Corrinne Mills, Mark S. Neubauer, Benjamin Parpillon, Gauri Pradhan, Chinar Syal, Nhan Tran, Dahai Wen, Aaron Young

Abstract: Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the… ▽ More Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 54.4-75.4%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 $μW$ with an area of less than 0.2 mm$^2$. The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area. △ Less

Submitted 3 October, 2023; originally announced October 2023.

Suppression of the multiplicity fluctuations in particle correlations

Authors: Chong Ye, Hong-Hao Ma, Dan Wen, Philipe Mota, Wei-Liang Qian, Rui-Hong Yue

Abstract: Multiplicity fluctuations play a crucial role in relativistic heavy-ion collisions. In this work, we explore how the multiplicity fluctuations can be effectively suppressed in the measurement of particle correlations. In particular, through proper normalization, particle correlations can be evaluated in a manner irrelevant to multiplicity. When the multiplicity fluctuations are adequately extracte… ▽ More Multiplicity fluctuations play a crucial role in relativistic heavy-ion collisions. In this work, we explore how the multiplicity fluctuations can be effectively suppressed in the measurement of particle correlations. In particular, through proper normalization, particle correlations can be evaluated in a manner irrelevant to multiplicity. When the multiplicity fluctuations are adequately extracted, Monte Carlo simulations show that the remaining correlations possess distinct features buried in the otherwise overwhelming fluctuations. Moreover, we argue that such a normalization scheme naturally agrees with the multi-particle correlator, which can be evaluated using the Q-vectors. The implications of the present study in the data analysis are also addressed. △ Less

Submitted 8 September, 2023; originally announced September 2023.

Comments: 15 pages, 3 figures

Octopus: A Heterogeneous In-network Computing Accelerator Enabling Deep Learning for network

Authors: Dong Wen, Tao Li, Chenglong Li, Pengye Xia, Hui Yang, Zhigang Sun

Abstract: Deep learning (DL) for network models have achieved excellent performance in the field and are becoming a promising component in future intelligent network system. Programmable in-network computing device has great potential to deploy DL for network models, however, existing device cannot afford to run a DL model. The main challenges of data-plane supporting DL-based network models lie in computin… ▽ More Deep learning (DL) for network models have achieved excellent performance in the field and are becoming a promising component in future intelligent network system. Programmable in-network computing device has great potential to deploy DL for network models, however, existing device cannot afford to run a DL model. The main challenges of data-plane supporting DL-based network models lie in computing power, task granularity, model generality and feature extracting. To address above problems, we propose Octopus: a heterogeneous in-network computing accelerator enabling DL for network models. A feature extractor is designed for fast and efficient feature extracting. Vector accelerator and systolic array work in a heterogeneous collaborative way, offering low-latency-highthroughput general computing ability for packet-and-flow-based tasks. Octopus also contains on-chip memory fabric for storage and connecting, and Risc-V core for global controlling. The proposed Octopus accelerator design is implemented on FPGA. Functionality and performance of Octopus are validated in several use-cases, achieving performance of 31Mpkt/s feature extracting, 207ns packet-based computing latency, and 90kflow/s flow-based computing throughput. △ Less

Submitted 22 August, 2023; originally announced August 2023.

Implications of supermassive neutron stars for the form of the equation of state of hybrid stars

Authors: Hongyi Sun, Dehua Wen

Abstract: The observations of PSR J0952-0607 and the second object in GW190814 event indicate the possible existence of supermassive neutron stars. In this work, by using the Constant-Sound-Speed (CSS) parametrization to describe the equation of state (EOS) of quark matter, the constraints on the EOS parameters from supermassive hybrid stars are investigated through the Maxwell and Gibbs constructions. It i… ▽ More The observations of PSR J0952-0607 and the second object in GW190814 event indicate the possible existence of supermassive neutron stars. In this work, by using the Constant-Sound-Speed (CSS) parametrization to describe the equation of state (EOS) of quark matter, the constraints on the EOS parameters from supermassive hybrid stars are investigated through the Maxwell and Gibbs constructions. It is shown that to support a supermassive hybrid star, a lower transition energy density, a smaller energy density discontinuity and a higher sound speed of quark matter are favored. For the constructed hybrid star EOS model, the maximum mass of the corresponding hybrid stars will not meet the lower mass limit of the second object in GW190814 if the energy density discontinuity takes a value higher than $180~{\rm MeV~fm^{-3}}$. Moreover, it is confirmed that the supermassive neutron star observation can also rule out the existence of twin stars as a supermassive hybrid star requires a relatively small energy density discontinuity. Finally, we give a rough estimate of the lower limit of the dimensionless tidal deformability of neutron stars which ranges from 2 to 3. △ Less

Submitted 14 August, 2023; originally announced August 2023.

Comments: 12 pages, 5 figures

Journal ref: Physical Review C 108, 025801 (2023)

Integrated Sensing-Communication-Computation for Over-the-Air Edge AI Inference

Authors: Zeming Zhuang, Dingzhu Wen, Yuanming Shi, Guangxu Zhu, Sheng Wu, Dusit Niyato

Abstract: Edge-device co-inference refers to deploying well-trained artificial intelligent (AI) models at the network edge under the cooperation of devices and edge servers for providing ambient intelligent services. For enhancing the utilization of limited network resources in edge-device co-inference tasks from a systematic view, we propose a task-oriented scheme of integrated sensing, computation and com… ▽ More Edge-device co-inference refers to deploying well-trained artificial intelligent (AI) models at the network edge under the cooperation of devices and edge servers for providing ambient intelligent services. For enhancing the utilization of limited network resources in edge-device co-inference tasks from a systematic view, we propose a task-oriented scheme of integrated sensing, computation and communication (ISCC) in this work. In this system, all devices sense a target from the same wide view to obtain homogeneous noise-corrupted sensory data, from which the local feature vectors are extracted. All local feature vectors are aggregated at the server using over-the-air computation (AirComp) in a broadband channel with the orthogonal-frequency-division-multiplexing technique for suppressing the sensing and channel noise. The aggregated denoised global feature vector is further input to a server-side AI model for completing the downstream inference task. A novel task-oriented design criterion, called maximum minimum pair-wise discriminant gain, is adopted for classification tasks. It extends the distance of the closest class pair in the feature space, leading to a balanced and enhanced inference accuracy. Under this criterion, a problem of joint sensing power assignment, transmit precoding and receive beamforming is formulated. The challenge lies in three aspects: the coupling between sensing and AirComp, the joint optimization of all feature dimensions' AirComp aggregation over a broadband channel, and the complicated form of the maximum minimum pair-wise discriminant gain. To solve this problem, a task-oriented ISCC scheme with AirComp is proposed. Experiments based on a human motion recognition task are conducted to verify the advantages of the proposed scheme over the existing scheme and a baseline. △ Less

Submitted 12 August, 2023; originally announced August 2023.

Comments: This work was accepted by IEEE Transactions on Wireless Communications on Aug. 12, 2023

Interpretable inverse-designed cavity for on-chip nonlinear and quantum optics

Authors: Zhetao Jia, Wayesh Qarony, Jagang Park, Sean Hooten, Difan Wen, Yertay Zhiyenbayev, Matteo Seclì, Walid Redjem, Scott Dhuey, Adam Schwartzberg, Eli Yablonovitch, Boubacar Kanté

Abstract: Inverse design is a powerful tool in wave-physics and in particular in photonics for compact, high-performance devices. To date, applications have mostly been limited to linear systems and it has rarely been investigated or demonstrated in the nonlinear regime. In addition, the "black box" nature of inverse design techniques has hindered the understanding of optimized inverse-designed structures.… ▽ More Inverse design is a powerful tool in wave-physics and in particular in photonics for compact, high-performance devices. To date, applications have mostly been limited to linear systems and it has rarely been investigated or demonstrated in the nonlinear regime. In addition, the "black box" nature of inverse design techniques has hindered the understanding of optimized inverse-designed structures. We propose an inverse design method with interpretable results to enhance the efficiency of on-chip photon generation rate through nonlinear processes by controlling the effective phase-matching conditions. We fabricate and characterize a compact, inverse-designed device using a silicon-on-insulator platform that allows a spontaneous four-wave mixing process to generate photon pairs at 1.1MHz with a coincidence to accidental ratio of 162. Our design method accounts for fabrication constraints and can be used for scalable quantum light sources in large-scale communication and computing applications. △ Less

Submitted 6 August, 2023; originally announced August 2023.

Integrated Sensing-Communication-Computation for Edge Artificial Intelligence

Authors: Dingzhu Wen, Xiaoyang Li, Yong Zhou, Yuanming Shi, Sheng Wu, Chunxiao Jiang

Abstract: Edge artificial intelligence (AI) has been a promising solution towards 6G to empower a series of advanced techniques such as digital twins, holographic projection, semantic communications, and auto-driving, for achieving intelligence of everything. The performance of edge AI tasks, including edge learning and edge AI inference, depends on the quality of three highly coupled processes, i.e., sensi… ▽ More Edge artificial intelligence (AI) has been a promising solution towards 6G to empower a series of advanced techniques such as digital twins, holographic projection, semantic communications, and auto-driving, for achieving intelligence of everything. The performance of edge AI tasks, including edge learning and edge AI inference, depends on the quality of three highly coupled processes, i.e., sensing for data acquisition, computation for information extraction, and communication for information transmission. However, these three modules need to compete for network resources for enhancing their own quality-of-services. To this end, integrated sensing-communication-computation (ISCC) is of paramount significance for improving resource utilization as well as achieving the customized goals of edge AI tasks. By investigating the interplay among the three modules, this article presents various kinds of ISCC schemes for federated edge learning tasks and edge AI inference tasks in both application and physical layers. △ Less

Submitted 18 April, 2024; v1 submitted 1 June, 2023; originally announced June 2023.

Comments: This paper was accepted by IEEE Internet of Things Magazine on April-18-2024

Exploring Few-Shot Adaptation for Activity Recognition on Diverse Domains

Authors: Kunyu Peng, Di Wen, David Schneider, Jiaming Zhang, Kailun Yang, M. Saquib Sarfraz, Rainer Stiefelhagen, Alina Roitberg

Abstract: Domain adaptation is essential for activity recognition to ensure accurate and robust performance across diverse environments, sensor types, and data sources. Unsupervised domain adaptation methods have been extensively studied, yet, they require large-scale unlabeled data from the target domain. In this work, we focus on Few-Shot Domain Adaptation for Activity Recognition (FSDA-AR), which leverag… ▽ More Domain adaptation is essential for activity recognition to ensure accurate and robust performance across diverse environments, sensor types, and data sources. Unsupervised domain adaptation methods have been extensively studied, yet, they require large-scale unlabeled data from the target domain. In this work, we focus on Few-Shot Domain Adaptation for Activity Recognition (FSDA-AR), which leverages a very small amount of labeled target videos to achieve effective adaptation. This approach is appealing for applications because it only needs a few or even one labeled example per class in the target domain, ideal for recognizing rare but critical activities. However, the existing FSDA-AR works mostly focus on the domain adaptation on sports videos, where the domain diversity is limited. We propose a new FSDA-AR benchmark using five established datasets considering the adaptation on more diverse and challenging domains. Our results demonstrate that FSDA-AR performs comparably to unsupervised domain adaptation with significantly fewer labeled target domain samples. We further propose a novel approach, RelaMiX, to better leverage the few labeled target domain samples as knowledge guidance. RelaMiX encompasses a temporal relational attention network with relation dropout, alongside a cross-domain information alignment mechanism. Furthermore, it integrates a mechanism for mixing features within a latent space by using the few-shot target domain samples. The proposed RelaMiX solution achieves state-of-the-art performance on all datasets within the FSDA-AR benchmark. To encourage future research of few-shot domain adaptation for activity recognition, our code will be publicly available at https://github.com/KPeng9510/RelaMiX. △ Less

Submitted 27 April, 2024; v1 submitted 15 May, 2023; originally announced May 2023.

Comments: The benchmark and source code will be publicly available at https://github.com/KPeng9510/RelaMiX

AeonG: An Efficient Built-in Temporal Support in Graph Databases

Authors: Jiamin Hou, Zhanhao Zhao, Zhouyu Wang, Wei Lu, Guodong Jin, Dong Wen, Xiaoyong Du

Abstract: Real world graphs are often dynamic and evolve over time. It is crucial for storing and querying graph evolution in graph databases. However, existing works either suffer from high storage overhead or lack efficient temporal query support, or both. In this paper, we propose AeonG, a new graph database with built-in temporal support. AeonG is based on a novel temporal graph model. To fit this model… ▽ More Real world graphs are often dynamic and evolve over time. It is crucial for storing and querying graph evolution in graph databases. However, existing works either suffer from high storage overhead or lack efficient temporal query support, or both. In this paper, we propose AeonG, a new graph database with built-in temporal support. AeonG is based on a novel temporal graph model. To fit this model, we design a storage engine and a query engine. Our storage engine is hybrid, with one current storage to manage the most recent versions of graph objects, and another historical storage to manage the previous versions of graph objects. This separation makes the performance degradation of querying the most recent graph object versions as slight as possible. To reduce the historical storage overhead, we propose a novel anchor+delta strategy, in which we periodically create a complete version (namely anchor) of a graph object, and maintain every change (namely delta) between two adjacent anchors of the same object. To boost temporal query processing, we propose an anchor-based version retrieval technique in the query engine to skip unnecessary historical version traversals. Extensive experiments are conducted on both real and synthetic datasets. The results show that AeonG achieves up to 5.73X lower storage consumption and 2.57X lower temporal query latency against state-of-the-art approaches, while introducing only 9.74% performance degradation for supporting temporal features △ Less

Submitted 1 April, 2024; v1 submitted 24 April, 2023; originally announced April 2023.

Comments: VLDB 2024

Gradient Attention Balance Network: Mitigating Face Recognition Racial Bias via Gradient Attention

Authors: Linzhi Huang, Mei Wang, Jiahao Liang, Weihong Deng, Hongzhi Shi, Dongchao Wen, Yingjie Zhang, Jian Zhao

Abstract: Although face recognition has made impressive progress in recent years, we ignore the racial bias of the recognition system when we pursue a high level of accuracy. Previous work found that for different races, face recognition networks focus on different facial regions, and the sensitive regions of darker-skinned people are much smaller. Based on this discovery, we propose a new de-bias method ba… ▽ More Although face recognition has made impressive progress in recent years, we ignore the racial bias of the recognition system when we pursue a high level of accuracy. Previous work found that for different races, face recognition networks focus on different facial regions, and the sensitive regions of darker-skinned people are much smaller. Based on this discovery, we propose a new de-bias method based on gradient attention, called Gradient Attention Balance Network (GABN). Specifically, we use the gradient attention map (GAM) of the face recognition network to track the sensitive facial regions and make the GAMs of different races tend to be consistent through adversarial learning. This method mitigates the bias by making the network focus on similar facial regions. In addition, we also use masks to erase the Top-N sensitive facial regions, forcing the network to allocate its attention to a larger facial region. This method expands the sensitive region of darker-skinned people and further reduces the gap between GAM of darker-skinned people and GAM of Caucasians. Extensive experiments show that GABN successfully mitigates racial bias in face recognition and learns more balanced performance for people of different races. △ Less

Submitted 5 April, 2023; originally announced April 2023.

Comments: Accepted by CVPR 2023 workshop

A Survey of Machine Learning-Based Ride-Hailing Planning

Authors: Dacheng Wen, Yupeng Li, Francis C. M. Lau

Abstract: Ride-hailing is a sustainable transportation paradigm where riders access door-to-door traveling services through a mobile phone application, which has attracted a colossal amount of usage. There are two major planning tasks in a ride-hailing system: (1) matching, i.e., assigning available vehicles to pick up the riders, and (2) repositioning, i.e., proactively relocating vehicles to certain locat… ▽ More Ride-hailing is a sustainable transportation paradigm where riders access door-to-door traveling services through a mobile phone application, which has attracted a colossal amount of usage. There are two major planning tasks in a ride-hailing system: (1) matching, i.e., assigning available vehicles to pick up the riders, and (2) repositioning, i.e., proactively relocating vehicles to certain locations to balance the supply and demand of ride-hailing services. Recently, many studies of ride-hailing planning that leverage machine learning techniques have emerged. In this article, we present a comprehensive overview on latest developments of machine learning-based ride-hailing planning. To offer a clear and structured review, we introduce a taxonomy into which we carefully fit the different categories of related works according to the types of their planning tasks and solution schemes, which include collective matching, distributed matching, collective repositioning, distributed repositioning, and joint matching and repositioning. We further shed light on many real-world datasets and simulators that are indispensable for empirical studies on machine learning-based ride-hailing planning strategies. At last, we propose several promising research directions for this rapidly growing research and practical field. △ Less

Submitted 26 March, 2023; originally announced March 2023.

Task-Oriented Communications for 6G: Vision, Principles, and Technologies

Authors: Yuanming Shi, Yong Zhou, Dingzhu Wen, Youlong Wu, Chunxiao Jiang, Khaled B. Letaief

Abstract: Driven by the interplay among artificial intelligence, digital twin, and wireless networks, 6G is envisaged to go beyond data-centric services to provide intelligent and immersive experiences. To efficiently support intelligent tasks with customized service requirements, it becomes critical to develop novel information compression and transmission technologies, which typically involve coupled sens… ▽ More Driven by the interplay among artificial intelligence, digital twin, and wireless networks, 6G is envisaged to go beyond data-centric services to provide intelligent and immersive experiences. To efficiently support intelligent tasks with customized service requirements, it becomes critical to develop novel information compression and transmission technologies, which typically involve coupled sensing, communication, and computation processes. To this end, task-oriented communication stands out as a disruptive technology for 6G system design by exploiting the task-specific information structures and folding the communication goals into the design of task-level transmission strategies. In this article, by developing task-oriented information extraction and network resource orchestration strategies, we demonstrate the effectiveness of task-oriented communication principles for typical intelligent tasks, including federated learning, edge inference, and semantic communication. △ Less

Submitted 22 March, 2023; v1 submitted 20 March, 2023; originally announced March 2023.

Comments: This paper has been accepted by IEEE Wireless Communications, 2023

Dive into the Resolution Augmentations and Metrics in Low Resolution Face Recognition: A Plain yet Effective New Baseline

Authors: Xu Ling, Yichen Lu, Wenqi Xu, Weihong Deng, Yingjie Zhang, Xingchen Cui, Hongzhi Shi, Dongchao Wen

Abstract: Although deep learning has significantly improved Face Recognition (FR), dramatic performance deterioration may occur when processing Low Resolution (LR) faces. To alleviate this, approaches based on unified feature space are proposed with the sacrifice under High Resolution (HR) circumstances. To deal with the huge domain gap between HR and LR domains and achieve the best on both domains, we firs… ▽ More Although deep learning has significantly improved Face Recognition (FR), dramatic performance deterioration may occur when processing Low Resolution (LR) faces. To alleviate this, approaches based on unified feature space are proposed with the sacrifice under High Resolution (HR) circumstances. To deal with the huge domain gap between HR and LR domains and achieve the best on both domains, we first took a closer look at the impacts of several resolution augmentations and then analyzed the difficulty of LR samples from the perspective of the model gradient produced by different resolution samples. Besides, we also find that the introduction of some resolutions could help the learning of lower resolutions. Based on these, we divide the LR samples into three difficulties according to the resolution and propose a more effective Multi-Resolution Augmentation. Then, due to the rapidly increasing domain gap as the resolution decreases, we carefully design a novel and effective metric loss based on a LogExp distance function that provides decent gradients to prevent oscillation near the convergence point or tolerance to small distance errors; it could also dynamically adjust the penalty for errors in different dimensions, allowing for more optimization of dimensions with large errors. Combining these two insights, our model could learn more general knowledge in a wide resolution range of images and balanced results can be achieved by our extremely simple framework. Moreover, the augmentations and metrics are the cornerstones of LRFR, so our method could be considered a new baseline for the LRFR task. Experiments on the LRFR datasets: SCface, XQLFW, and large-scale LRFR dataset: TinyFace demonstrate the effectiveness of our methods, while the degradation on HRFR datasets is significantly reduced. △ Less

Submitted 11 February, 2023; originally announced February 2023.

Comments: AAAI 2023 R2HCAI Workshop

Regulated Polarization Degree of Upconversion Luminescence and Multiple Anti-Counterfeit Applications

Authors: Dongping Wen, Yi Liang, Xiaoming Mo, Caofeng Pan, Ping Chen

Abstract: Polarized upconversion luminescence (PUCL) of lanthanide (Ln3+) ions has been widely used in single particle tracking, microfluidics detection, three-dimensional displays, and so on. However, no effective strategy has been developed for modulating PUCL. Here, we report a strategy to regulate PUCL in Ho3+-doped NaYF4 single nanorods based on the number of upconversion photons. By constructing a mul… ▽ More Polarized upconversion luminescence (PUCL) of lanthanide (Ln3+) ions has been widely used in single particle tracking, microfluidics detection, three-dimensional displays, and so on. However, no effective strategy has been developed for modulating PUCL. Here, we report a strategy to regulate PUCL in Ho3+-doped NaYF4 single nanorods based on the number of upconversion photons. By constructing a multiphoton upconversion system for Ho3+, we regulate the degree of polarization (DOP) of PUCL from 0.6 for two-photon luminescence to 0.929 for three-photon upconversion luminescence (UCL). Furthermore, our strategy is verified by cross-relaxation between Ho3+ and Yb3+, excitation wavelength, excitation power density, and local site symmetry. And this regulation strategy of PUCL has also been achieved in Tm3+, where DOP is ranged from 0.233 for two-photon luminescence to 0.925 for four-photon UCL. Besides, multi-dimensional anti-counterfeiting display has been explored with PUCL. This work provides an effective strategy for the regulation of PUCL and also provides more opportunities for the development of polarization display, optical encoding, anti-counterfeiting, and integrated optical devices. △ Less

Submitted 10 June, 2023; v1 submitted 8 February, 2023; originally announced February 2023.

Model and Data Agreement for Learning with Noisy Labels

Authors: Yuhang Zhang, Weihong Deng, Xingchen Cui, Yunfeng Yin, Hongzhi Shi, Dongchao Wen

Abstract: Learning with noisy labels is a vital topic for practical deep learning as models should be robust to noisy open-world datasets in the wild. The state-of-the-art noisy label learning approach JoCoR fails when faced with a large ratio of noisy labels. Moreover, selecting small-loss samples can also cause error accumulation as once the noisy samples are mistakenly selected as small-loss samples, the… ▽ More Learning with noisy labels is a vital topic for practical deep learning as models should be robust to noisy open-world datasets in the wild. The state-of-the-art noisy label learning approach JoCoR fails when faced with a large ratio of noisy labels. Moreover, selecting small-loss samples can also cause error accumulation as once the noisy samples are mistakenly selected as small-loss samples, they are more likely to be selected again. In this paper, we try to deal with error accumulation in noisy label learning from both model and data perspectives. We introduce mean point ensemble to utilize a more robust loss function and more information from unselected samples to reduce error accumulation from the model perspective. Furthermore, as the flip images have the same semantic meaning as the original images, we select small-loss samples according to the loss values of flip images instead of the original ones to reduce error accumulation from the data perspective. Extensive experiments on CIFAR-10, CIFAR-100, and large-scale Clothing1M show that our method outperforms state-of-the-art noisy label learning methods with different levels of label noise. Our method can also be seamlessly combined with other noisy label learning methods to further improve their performance and generalize well to other tasks. The code is available in https://github.com/zyh-uaiaaaa/MDA-noisy-label-learning. △ Less

Submitted 24 December, 2022; v1 submitted 2 December, 2022; originally announced December 2022.

Comments: Accepted by AAAI2023 Workshop

Dimensional homogeneity constrained gene expression programming for discovering governing equations

Authors: Wenjun Ma, Jun Zhang, Kaikai Feng, Haoyun Xing, Dongsheng Wen

Abstract: Data-driven discovery of governing equations is of great significance for helping us understand intrinsic mechanisms and build physical models. Recently, numerous highly innovative algorithms have emerged, aimed at inversely discovering the underlying governing equations from data, such as sparse regression-based methods and symbolic regression-based methods. Along this direction, a novel dimensio… ▽ More Data-driven discovery of governing equations is of great significance for helping us understand intrinsic mechanisms and build physical models. Recently, numerous highly innovative algorithms have emerged, aimed at inversely discovering the underlying governing equations from data, such as sparse regression-based methods and symbolic regression-based methods. Along this direction, a novel dimensional homogeneity constrained gene expression programming (DHC-GEP) method is proposed in this work. DHC-GEP simultaneously discovers the forms and coefficients of functions using basic mathematical operators and physical variables, without requiring pre-assumed candidate functions. The constraint of dimensional homogeneity is capable of filtering out the overfitting equations effectively. The key advantages of DHC-GEP compared to Original-GEP, including being more robust to hyperparameters, the noise level and the size of datasets, are demonstrated on two benchmark studies. Furthermore, DHC-GEP is employed to discover the unknown constitutive relations of two representative non-equilibrium flows. Galilean invariance and the second law of thermodynamics are imposed as constraints to enhance the reliability of the discovered constitutive relations. Comparisons, both quantitative and qualitative, indicate that the derived constitutive relations are more accurate than the conventional Burnett equations in a wide range of Knudsen number and Mach number, and are also applicable to the cases beyond the parameter space of the training data. △ Less

Submitted 28 March, 2024; v1 submitted 15 November, 2022; originally announced November 2022.

Task-Oriented Over-the-Air Computation for Multi-Device Edge AI

Authors: Dingzhu Wen, Xiang Jiao, Peixi Liu, Guangxu Zhu, Yuanming Shi, Kaibin Huang

Abstract: Departing from the classic paradigm of data-centric designs, the 6G networks for supporting edge AI features task-oriented techniques that focus on effective and efficient execution of AI task. Targeting end-to-end system performance, such techniques are sophisticated as they aim to seamlessly integrate sensing (data acquisition), communication (data transmission), and computation (data processing… ▽ More Departing from the classic paradigm of data-centric designs, the 6G networks for supporting edge AI features task-oriented techniques that focus on effective and efficient execution of AI task. Targeting end-to-end system performance, such techniques are sophisticated as they aim to seamlessly integrate sensing (data acquisition), communication (data transmission), and computation (data processing). Aligned with the paradigm shift, a task-oriented over-the-air computation (AirComp) scheme is proposed in this paper for multi-device split-inference system. In the considered system, local feature vectors, which are extracted from the real-time noisy sensory data on devices, are aggregated over-the-air by exploiting the waveform superposition in a multiuser channel. Then the aggregated features as received at a server are fed into an inference model with the result used for decision making or control of actuators. To design inference-oriented AirComp, the transmit precoders at edge devices and receive beamforming at edge server are jointly optimized to rein in the aggregation error and maximize the inference accuracy. The problem is made tractable by measuring the inference accuracy using a surrogate metric called discriminant gain, which measures the discernibility of two object classes in the application of object/event classification. It is discovered that the conventional AirComp beamforming design for minimizing the mean square error in generic AirComp with respect to the noiseless case may not lead to the optimal classification accuracy. The reason is due to the overlooking of the fact that feature dimensions have different sensitivity towards aggregation errors and are thus of different importance levels for classification. This issue is addressed in this work via a new task-oriented AirComp scheme designed by directly maximizing the derived discriminant gain. △ Less

Submitted 2 November, 2022; originally announced November 2022.

Testing Primordial Black Hole Dark Matter with ALMA Observations of the Gravitational Lens B1422+231

Authors: Di Wen, Athol J. Kemball

Abstract: We examine the flux density ratio anomaly in the quadruply-imaged strong gravitational lens, B1422+231, and consider the contribution of $10-10^3M_{\odot}$ primordial black holes (PBHs) as a potential dark matter constituent. We describe the first flux density ratio measurement of B1422+231 in the millimeter-wave band using the Atacama Large Millimeter Array (ALMA). This fills an important multi-w… ▽ More We examine the flux density ratio anomaly in the quadruply-imaged strong gravitational lens, B1422+231, and consider the contribution of $10-10^3M_{\odot}$ primordial black holes (PBHs) as a potential dark matter constituent. We describe the first flux density ratio measurement of B1422+231 in the millimeter-wave band using the Atacama Large Millimeter Array (ALMA). This fills an important multi-wavelength gap in our knowledge of this key lensed system. The flux density of the quasar at 233 GHz is dominated by synchrotron emission and the source size is estimated to be 66.9 pc. The observed flux density ratios at 233 GHz are similar to those measured in radio, mid-infrared and optical bands, which cannot be explained by a simple smooth mass model of the lens galaxy. We examine the probability of the flux density ratio anomaly arising from PBH microlensing using ray tracing simulations. The simulations consider the cases where 10% and 50% of dark matter are $10-10^3M_{\odot}$ PBHs with a power law mass function. Our analysis shows that the anomalous flux density ratio for B1422+231 can be explained by a lens model with a significant fraction of dark matter being PBHs. This study demonstrates the potential for new constraints on PBH dark matter using ALMA observations of multiply imaged strong gravitational lenses. △ Less

Submitted 28 October, 2022; originally announced October 2022.

Comments: 14 pages, 6 figures, 4 tables, submitted to ApJ

Task-Oriented Sensing, Computation, and Communication Integration for Multi-Device Edge AI

Authors: Dingzhu Wen, Peixi Liu, Guangxu Zhu, Yuanming Shi, Jie Xu, Yonina C. Eldar, Shuguang Cui

Abstract: This paper studies a new multi-device edge artificial-intelligent (AI) system, which jointly exploits the AI model split inference and integrated sensing and communication (ISAC) to enable low-latency intelligent services at the network edge. In this system, multiple ISAC devices perform radar sensing to obtain multi-view data, and then offload the quantized version of extracted features to a cent… ▽ More This paper studies a new multi-device edge artificial-intelligent (AI) system, which jointly exploits the AI model split inference and integrated sensing and communication (ISAC) to enable low-latency intelligent services at the network edge. In this system, multiple ISAC devices perform radar sensing to obtain multi-view data, and then offload the quantized version of extracted features to a centralized edge server, which conducts model inference based on the cascaded feature vectors. Under this setup and by considering classification tasks, we measure the inference accuracy by adopting an approximate but tractable metric, namely discriminant gain, which is defined as the distance of two classes in the Euclidean feature space under normalized covariance. To maximize the discriminant gain, we first quantify the influence of the sensing, computation, and communication processes on it with a derived closed-form expression. Then, an end-to-end task-oriented resource management approach is developed by integrating the three processes into a joint design. This integrated sensing, computation, and communication (ISCC) design approach, however, leads to a challenging non-convex optimization problem, due to the complicated form of discriminant gain and the device heterogeneity in terms of channel gain, quantization level, and generated feature subsets. Remarkably, the considered non-convex problem can be optimally solved based on the sum-of-ratios method. This gives the optimal ISCC scheme, that jointly determines the transmit power and time allocation at multiple devices for sensing and communication, as well as their quantization bits allocation for computation distortion control. By using human motions recognition as a concrete AI inference task, extensive experiments are conducted to verify the performance of our derived optimal ISCC scheme. △ Less

Submitted 3 July, 2022; originally announced July 2022.

Efficient Passivation of Surface Defects by Lewis Base in Lead-free Tin-based Perovskite Solar Cells

Authors: Hejin Yan, Bowen Wang, Xuefei Yan, Qiye Guan, Hongfei Chen, Zheng Shu, Dawei Wen, Yongqing Cai

Abstract: Lead-free tin-based perovskites are highly appealing for the next generation of solar cells due to their intriguing optoelectronic properties. However, the tendency of Sn2+ oxidation to Sn4+ in the tin-based perovskites induces serious film degradation and performance deterioration. Herein, we demonstrate, through the density functional theory based first-principle calculations in a surface slab m… ▽ More Lead-free tin-based perovskites are highly appealing for the next generation of solar cells due to their intriguing optoelectronic properties. However, the tendency of Sn2+ oxidation to Sn4+ in the tin-based perovskites induces serious film degradation and performance deterioration. Herein, we demonstrate, through the density functional theory based first-principle calculations in a surface slab model, that the surface defects of the Sn-based perovskite FASnI3 (FA = NH2CHNH2+) could be effectively passivated by the Lewis base molecules. The passivation performance of Lewis base molecules in tin-based perovskite is tightly correlated with their molecular hardness. We reveal that the degree of hardness of Lewis adsorbate governs the stabilization via dual effects: first, changing the stubborn spatial distribution of tin vacancy (VSn) by triggering charge redistribution; second, saturating the dangling states while simultaneously reducing the amounts of deep band gap states. Specifically, the hard Lewis base molecules like edamine (N-donor group) and Isatin-Cl (Cl-donor group) would show a better healing effect than other candidates on the defects-contained tin-based perovskite surface with a somehow hard Lewis acid nature. Our research provides a general strategy for additive engineering and fabricating stable and high-efficiency lead-free Sn-based perovskite solar cells. △ Less

Submitted 10 June, 2022; originally announced June 2022.

Journal ref: Materials Today Energy (2022)

SFace: Sigmoid-Constrained Hypersphere Loss for Robust Face Recognition

Authors: Yaoyao Zhong, Weihong Deng, Jiani Hu, Dongyue Zhao, Xian Li, Dongchao Wen

Abstract: Deep face recognition has achieved great success due to large-scale training databases and rapidly developing loss functions. The existing algorithms devote to realizing an ideal idea: minimizing the intra-class distance and maximizing the inter-class distance. However, they may neglect that there are also low quality training images which should not be optimized in this strict way. Considering th… ▽ More Deep face recognition has achieved great success due to large-scale training databases and rapidly developing loss functions. The existing algorithms devote to realizing an ideal idea: minimizing the intra-class distance and maximizing the inter-class distance. However, they may neglect that there are also low quality training images which should not be optimized in this strict way. Considering the imperfection of training databases, we propose that intra-class and inter-class objectives can be optimized in a moderate way to mitigate overfitting problem, and further propose a novel loss function, named sigmoid-constrained hypersphere loss (SFace). Specifically, SFace imposes intra-class and inter-class constraints on a hypersphere manifold, which are controlled by two sigmoid gradient re-scale functions respectively. The sigmoid curves precisely re-scale the intra-class and inter-class gradients so that training samples can be optimized to some degree. Therefore, SFace can make a better balance between decreasing the intra-class distances for clean examples and preventing overfitting to the label noise, and contributes more robust deep face recognition models. Extensive experiments of models trained on CASIA-WebFace, VGGFace2, and MS-Celeb-1M databases, and evaluated on several face recognition benchmarks, such as LFW, MegaFace and IJB-C databases, have demonstrated the superiority of SFace. △ Less

Submitted 24 May, 2022; originally announced May 2022.

Comments: 12 pages, 9 figures

Journal ref: IEEE Transactions on Image Processing, 2021

What is Semantic Communication? A View on Conveying Meaning in the Era of Machine Intelligence

Authors: Qiao Lan, Dingzhu Wen, Zezhong Zhang, Qunsong Zeng, Xu Chen, Petar Popovski, Kaibin Huang

Abstract: In 1940s, Claude Shannon developed the information theory focusing on quantifying the maximum data rate that can be supported by a communication channel. Guided by this, the main theme of wireless system design up until 5G was the data rate maximization. In his theory, the semantic aspect and meaning of messages were treated as largely irrelevant to communication. The classic theory started to rev… ▽ More In 1940s, Claude Shannon developed the information theory focusing on quantifying the maximum data rate that can be supported by a communication channel. Guided by this, the main theme of wireless system design up until 5G was the data rate maximization. In his theory, the semantic aspect and meaning of messages were treated as largely irrelevant to communication. The classic theory started to reveal its limitations in the modern era of machine intelligence, consisting of the synergy between IoT and AI. By broadening the scope of the classic framework, in this article we present a view of semantic communication (SemCom) and conveying meaning through the communication systems. We address three communication modalities, human-to-human (H2H), human-to-machine (H2M), and machine-to-machine (M2M) communications. The latter two, the main theme of the article, represent the paradigm shift in communication and computing. H2M SemCom refers to semantic techniques for conveying meanings understandable by both humans and machines so that they can interact. M2M SemCom refers to effectiveness techniques for efficiently connecting machines such that they can effectively execute a specific computation task in a wireless network. The first part of the article introduces SemCom principles including encoding, system architecture, and layer-coupling and end-to-end design approaches. The second part focuses on specific techniques for application areas of H2M (human and AI symbiosis, recommendation, etc.) and M2M SemCom (distributed learning, split inference, etc.) Finally, we discuss the knowledge graphs approach for designing SemCom systems. We believe that this comprehensive introduction will provide a useful guide into the emerging area of SemCom that is expected to play an important role in 6G featuring connected intelligence and integrated sensing, computing, communication, and control. △ Less

Submitted 30 September, 2021; originally announced October 2021.

Comments: This is an invited paper for Journal of Communications and Information Networks

Federated Dropout -- A Simple Approach for Enabling Federated Learning on Resource Constrained Devices

Authors: Dingzhu Wen, Ki-Jun Jeon, Kaibin Huang

Abstract: Federated learning (FL) is a popular framework for training an AI model using distributed mobile data in a wireless network. It features data parallelism by distributing the learning task to multiple edge devices while attempting to preserve their local-data privacy. One main challenge confronting practical FL is that resource constrained devices struggle with the computation intensive task of upd… ▽ More Federated learning (FL) is a popular framework for training an AI model using distributed mobile data in a wireless network. It features data parallelism by distributing the learning task to multiple edge devices while attempting to preserve their local-data privacy. One main challenge confronting practical FL is that resource constrained devices struggle with the computation intensive task of updating of a deep-neural network model. To tackle the challenge, in this paper, a federated dropout (FedDrop) scheme is proposed building on the classic dropout scheme for random model pruning. Specifically, in each iteration of the FL algorithm, several subnets are independently generated from the global model at the server using dropout but with heterogeneous dropout rates (i.e., parameter-pruning probabilities),each of which is adapted to the state of an assigned channel. The subnets are downloaded to associated devices for updating. Thereby, FedDrop reduces both the communication overhead and devices' computation loads compared with the conventional FL while outperforming the latter in the case of overfitting and also the FL scheme with uniform dropout (i.e., identical subnets). △ Less

Submitted 5 February, 2022; v1 submitted 30 September, 2021; originally announced September 2021.

Comments: This paper was accepted by IEEE Wireless Communications Letters