-
Deep-sub-cycle attosecond optical pulses
Authors:
Hongliang Dang,
Jiaxin Gao,
Hao Wu,
Xin Guo,
Y. R. Shen,
Limin Tong
Abstract:
Sub-cycle optical pulse is of great importance for ultrafast science and technology. While a narrower pulse can offer a higher temporal resolution, so far the pulse width has not exceeded the limit of half an optical cycle. Here we propose to break the half-cycle limit via inverse Compton scattering in a nano-slit optical mode, in which a deep-subwavelength-confined optical field can be converted…
▽ More
Sub-cycle optical pulse is of great importance for ultrafast science and technology. While a narrower pulse can offer a higher temporal resolution, so far the pulse width has not exceeded the limit of half an optical cycle. Here we propose to break the half-cycle limit via inverse Compton scattering in a nano-slit optical mode, in which a deep-subwavelength-confined optical field can be converted into a deep-sub-cycle attosecond pulse by high-energy free electrons flying through. Our calculations show that, with experimentally reachable conditions, a measurable deep-sub-cycle attosecond pulse with a width narrower than half an optical cycle can be generated. Quantitatively, using a deep-subwavelength-confined 4.4-$μ$m-wavelength 100-fs pulsed optical driving field and a 2-MeV 50-as 5-pC electron bunch, we can obtain an attosecond pulse with a peak frequency of 2.55 PHz, a pulse width of 99 as ($\sim$0.25 optical cycle), and a single-pulse photon number larger than 200 around the material damage threshold. Such pulses may open opportunities for studying light-matter interaction on the deep-sub-cycle level, and pave a way to unprecedented optical technology ranging from temporal super-resolution optical microscopy and spectroscopy to unconventional atom/molecule polarization and manipulation.
△ Less
Submitted 17 August, 2024; v1 submitted 14 August, 2024;
originally announced August 2024.
-
Haze-Aware Attention Network for Single-Image Dehazing
Authors:
Lihan Tong,
Yun Liu,
Weijia Li,
Liyuan Chen,
Erkang Chen
Abstract:
Single-image dehazing is a pivotal challenge in computer vision that seeks to remove haze from images and restore clean background details. Recognizing the limitations of traditional physical model-based methods and the inefficiencies of current attention-based solutions, we propose a new dehazing network combining an innovative Haze-Aware Attention Module (HAAM) with a Multiscale Frequency Enhanc…
▽ More
Single-image dehazing is a pivotal challenge in computer vision that seeks to remove haze from images and restore clean background details. Recognizing the limitations of traditional physical model-based methods and the inefficiencies of current attention-based solutions, we propose a new dehazing network combining an innovative Haze-Aware Attention Module (HAAM) with a Multiscale Frequency Enhancement Module (MFEM). The HAAM is inspired by the atmospheric scattering model, thus skillfully integrating physical principles into high-dimensional features for targeted dehazing. It picks up on latent features during the image restoration process, which gives a significant boost to the metrics, while the MFEM efficiently enhances high-frequency details, thus sidestepping wavelet or Fourier transform complexities. It employs multiscale fields to extract and emphasize key frequency components with minimal parameter overhead. Integrated into a simple U-Net framework, our Haze-Aware Attention Network (HAA-Net) for single-image dehazing significantly outperforms existing attention-based and transformer models in efficiency and effectiveness. Tested across various public datasets, the HAA-Net sets new performance benchmarks. Our work not only advances the field of image dehazing but also offers insights into the design of attention mechanisms for broader applications in computer vision.
△ Less
Submitted 16 July, 2024;
originally announced July 2024.
-
Vision Transformer with Key-select Routing Attention for Single Image Dehazing
Authors:
Lihan Tong,
Weijia Li,
Qingxia Yang,
Liyuan Chen,
Peng Chen
Abstract:
We present Ksformer, utilizing Multi-scale Key-select Routing Attention (MKRA) for intelligent selection of key areas through multi-channel, multi-scale windows with a top-k operator, and Lightweight Frequency Processing Module (LFPM) to enhance high-frequency features, outperforming other dehazing methods in tests.
We present Ksformer, utilizing Multi-scale Key-select Routing Attention (MKRA) for intelligent selection of key areas through multi-channel, multi-scale windows with a top-k operator, and Lightweight Frequency Processing Module (LFPM) to enhance high-frequency features, outperforming other dehazing methods in tests.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
MLPs Learn In-Context
Authors:
William L. Tong,
Cengiz Pehlevan
Abstract:
In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, has commonly been assumed to be a unique hallmark of Transformer models. In this study, we demonstrate that multi-layer perceptrons (MLPs) can also learn in-context. Moreover, we find that MLPs, and the closely related MLP-Mixer models, learn in-context competitively with Transformers given the same comput…
▽ More
In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, has commonly been assumed to be a unique hallmark of Transformer models. In this study, we demonstrate that multi-layer perceptrons (MLPs) can also learn in-context. Moreover, we find that MLPs, and the closely related MLP-Mixer models, learn in-context competitively with Transformers given the same compute budget. We further show that MLPs outperform Transformers on a subset of ICL tasks designed to test relational reasoning. These results suggest that in-context learning is not exclusive to Transformers and highlight the potential of exploring this phenomenon beyond attention-based architectures. In addition, MLPs' surprising success on relational tasks challenges prior assumptions about simple connectionist models. Altogether, our results endorse the broad trend that ``less inductive bias is better" and contribute to the growing interest in all-MLP alternatives to task-specific architectures.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Parallel Cross Strip Attention Network for Single Image Dehazing
Authors:
Lihan Tong,
Yun Liu,
Tian Ye,
Weijia Li,
Liyuan Chen,
Erkang Chen
Abstract:
The objective of single image dehazing is to restore hazy images and produce clear, high-quality visuals. Traditional convolutional models struggle with long-range dependencies due to their limited receptive field size. While Transformers excel at capturing such dependencies, their quadratic computational complexity in relation to feature map resolution makes them less suitable for pixel-to-pixel…
▽ More
The objective of single image dehazing is to restore hazy images and produce clear, high-quality visuals. Traditional convolutional models struggle with long-range dependencies due to their limited receptive field size. While Transformers excel at capturing such dependencies, their quadratic computational complexity in relation to feature map resolution makes them less suitable for pixel-to-pixel dense prediction tasks. Moreover, fixed kernels or tokens in most models do not adapt well to varying blur sizes, resulting in suboptimal dehazing performance. In this study, we introduce a novel dehazing network based on Parallel Stripe Cross Attention (PCSA) with a multi-scale strategy. PCSA efficiently integrates long-range dependencies by simultaneously capturing horizontal and vertical relationships, allowing each pixel to capture contextual cues from an expanded spatial domain. To handle different sizes and shapes of blurs flexibly, We employs a channel-wise design with varying convolutional kernel sizes and strip lengths in each PCSA to capture context information at different scales.Additionally, we incorporate a softmax-based adaptive weighting mechanism within PCSA to prioritize and leverage more critical features.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
RELICS: a REactor neutrino LIquid xenon Coherent elastic Scattering experiment
Authors:
Chang Cai,
Guocai Chen,
Jiangyu Chen,
Rundong Fang,
Fei Gao,
Xiaoran Guo,
Jiheng Guo,
Tingyi He,
Chengjie Jia,
Gaojun Jin,
Yipin Jing,
Gaojun Ju,
Yang Lei,
Jiayi Li,
Kaihang Li,
Meng Li,
Minhua Li,
Shengchao Li,
Siyin Li,
Tao Li,
Qing Lin,
Jiajun Liu,
Minghao Liu,
Sheng Lv,
Guang Luo
, et al. (24 additional authors not shown)
Abstract:
Coherent elastic neutrino-nucleus scattering (CEvNS) provides a unique probe for neutrino properties Beyond the Standard Model (BSM) physics. REactor neutrino LIquid xenon Coherent Scattering experiment (RELICS), a proposed reactor neutrino program using liquid xenon time projection chamber (LXeTPC) technology, aims to investigate the CEvNS process of antineutrinos off xenon atomic nuclei. In this…
▽ More
Coherent elastic neutrino-nucleus scattering (CEvNS) provides a unique probe for neutrino properties Beyond the Standard Model (BSM) physics. REactor neutrino LIquid xenon Coherent Scattering experiment (RELICS), a proposed reactor neutrino program using liquid xenon time projection chamber (LXeTPC) technology, aims to investigate the CEvNS process of antineutrinos off xenon atomic nuclei. In this work, the design of the experiment is studied and optimized based on Monte Carlo (MC) simulations. To achieve a sufficiently low energy threshold for CEvNS detection, an ionization-only analysis channel is adopted for RELICS. A high emission rate of delayed electrons after a big ionization signal is the major background, leading to an analysis threshold of 120 photo-electrons in the CEvNS search. The second largest background, nuclear recoils induced by cosmic-ray neutrons, is suppressed via a passive water shield. The physics potential of RELICS is explored with a 32 kg-yr exposure at a baseline of 25 m from a reactor core with a 3 GW thermal power. In an energy range of 120 to 240 PE, we expect 4902.4 CEvNS and 1318.4 background events. The sensitivity of RELICS to the weak mixing angle is investigated at a low momentum transfer. Our study shows that RELICS can further improve the constraints on the non-standard neutrino interaction (NSI) compared to the current best results.
△ Less
Submitted 12 June, 2024; v1 submitted 9 May, 2024;
originally announced May 2024.
-
Enhancing Autonomous Vehicle Design and Testing: A Comprehensive Review of AR and VR Integration
Authors:
Emanuella Ejichukwu,
Lauren Tong,
Gadir Hazime,
Bochen Jia
Abstract:
This comprehensive literature review explores the potential of Augmented Reality and Virtual Reality technologies to enhance the design and testing of autonomous vehicles. By analyzing existing research, the review aims to identify how AR and VR can be leveraged to improve various aspects of autonomous vehicle development, including: creating more realistic and comprehensive testing environments,…
▽ More
This comprehensive literature review explores the potential of Augmented Reality and Virtual Reality technologies to enhance the design and testing of autonomous vehicles. By analyzing existing research, the review aims to identify how AR and VR can be leveraged to improve various aspects of autonomous vehicle development, including: creating more realistic and comprehensive testing environments, facilitating the design of user centered interfaces, and safely evaluating driver behavior in complex scenarios. Ultimately, the review highlights AR and VR utilization as a key driver in the development of adaptable testing environments, fostering more dependable autonomous vehicle technology, and ultimately propelling significant advancements within the field.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Planning of Truck Platooning for Road-Network Capacitated Vehicle Routing Problem
Authors:
Yilang Hao,
Zhibin Chen,
Xiaotong Sun,
Lu Tong
Abstract:
Truck platooning, a linking technology of trucks on the highway, has gained enormous attention in recent years due to its benefits in energy and operation cost savings. However, most existing studies on truck platooning limit their focus on scenarios in which each truck can serve only one customer demand and is thus with a specified origin-destination pair, so only routing and time schedules are c…
▽ More
Truck platooning, a linking technology of trucks on the highway, has gained enormous attention in recent years due to its benefits in energy and operation cost savings. However, most existing studies on truck platooning limit their focus on scenarios in which each truck can serve only one customer demand and is thus with a specified origin-destination pair, so only routing and time schedules are considered. Nevertheless, in real-world logistics, each truck may need to serve multiple customers located at different places, and the operator has to determine not only the routing and time schedules of each truck but also the set of customers allocated to each truck and their sequence to visit. This is well known as a capacitated vehicle routing problem with time windows (CVRPTW), and considering the application of truck platooning in such a problem entails new modeling frameworks and tailored solution algorithms. In light of this, this study makes the first attempt to optimize the truck platooning plan for a road-network CVRPTW to minimize the total operation cost, including vehicles' fixed dispatch cost and energy cost, while fulfilling all delivery demands within their time window constraints. Specifically, the operation plan will dictate the number of trucks to be dispatched, the set of customers, and the routing and time schedules for each truck. In addition, the modeling framework is constructed based on a road network instead of a traditional customer node graph to better resemble and facilitate the platooning operation. A 3-stage algorithm embedded with a "route-then-schedule" scheme, dynamic programming, and modified insertion heuristic, is developed to solve the proposed model in a timely manner. Numerical experiments are conducted to validate the modeling framework, demonstrate the performance of the proposed solution algorithm, and quantify the benefit of truck platooning.
△ Less
Submitted 20 April, 2024;
originally announced April 2024.
-
Network-Aware and Welfare-Maximizing Dynamic Pricing for Energy Sharing
Authors:
Ahmed S. Alahmed,
Guido Cavraro,
Andrey Bernstein,
Lang Tong
Abstract:
The proliferation of behind-the-meter (BTM) distributed energy resources (DER) within the electrical distribution network presents significant supply and demand flexibilities, but also introduces operational challenges such as voltage spikes and reverse power flows. In response, this paper proposes a network-aware dynamic pricing framework tailored for energy-sharing coalitions that aggregate smal…
▽ More
The proliferation of behind-the-meter (BTM) distributed energy resources (DER) within the electrical distribution network presents significant supply and demand flexibilities, but also introduces operational challenges such as voltage spikes and reverse power flows. In response, this paper proposes a network-aware dynamic pricing framework tailored for energy-sharing coalitions that aggregate small, but ubiquitous, BTM DER downstream of a distribution system operator's (DSO) revenue meter that adopts a generic net energy metering (NEM) tariff. By formulating a Stackelberg game between the energy-sharing market leader and its prosumers, we show that the dynamic pricing policy induces the prosumers toward a network-safe operation and decentrally maximizes the energy-sharing social welfare. The dynamic pricing mechanism involves a combination of a locational {\em ex-ante} dynamic price and an {\em ex-post} allocation, both of which are functions of the energy sharing's BTM DER. The {\em ex-post} allocation is proportionate to the price differential between the DSO NEM price and the energy sharing locational price. Simulation results using real DER data and the IEEE 13-bus test systems illustrate the dynamic nature of network-aware pricing at each bus, and its impact on voltage.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Grid Monitoring and Protection with Continuous Point-on-Wave Measurements and Generative AI
Authors:
Lang Tong,
Xinyi Wang,
Qing Zhao
Abstract:
Purpose This article presents a case for a next-generation grid monitoring and control system, leveraging recent advances in generative artificial intelligence (AI), machine learning, and statistical inference. Advancing beyond earlier generations of wide-area monitoring systems built upon supervisory control and data acquisition (SCADA) and synchrophasor technologies, we argue for a monitoring an…
▽ More
Purpose This article presents a case for a next-generation grid monitoring and control system, leveraging recent advances in generative artificial intelligence (AI), machine learning, and statistical inference. Advancing beyond earlier generations of wide-area monitoring systems built upon supervisory control and data acquisition (SCADA) and synchrophasor technologies, we argue for a monitoring and control framework based on the streaming of continuous point-on-wave (CPOW) measurements with AI-powered data compression and fault detection.
Methods and Results: The architecture of the proposed design originates from the Wiener-Kallianpur innovation representation of a random process that transforms causally a stationary random process into an innovation sequence with independent and identically distributed random variables. This work presents a generative AI approach that (i) learns an innovation autoencoder that extracts innovation sequence from CPOW time series, (ii) compresses the CPOW streaming data with innovation autoencoder and subband coding, and (iii) detects unknown faults and novel trends via nonparametric sequential hypothesis testing.
Conclusion: This work argues that conventional monitoring using SCADA and phasor measurement unit (PMU) technologies is ill-suited for a future grid with deep penetration of inverter-based renewable generations and distributed energy resources. A monitoring system based on CPOW data streaming and AI data analytics should be the basic building blocks for situational awareness of a highly dynamic future grid.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Forecasting Electricity Market Signals via Generative AI
Authors:
Xinyi Wang,
Qing Zhao,
Lang Tong
Abstract:
This paper presents a generative artificial intelligence approach to probabilistic forecasting of electricity market signals, such as real-time locational marginal prices and area control error signals. Inspired by the Wiener-Kallianpur innovation representation of nonparametric time series, we propose a weak innovation autoencoder architecture and a novel deep learning algorithm that extracts the…
▽ More
This paper presents a generative artificial intelligence approach to probabilistic forecasting of electricity market signals, such as real-time locational marginal prices and area control error signals. Inspired by the Wiener-Kallianpur innovation representation of nonparametric time series, we propose a weak innovation autoencoder architecture and a novel deep learning algorithm that extracts the canonical independent and identically distributed innovation sequence of the time series, from which samples of future time series are generated. The validity of the proposed approach is established by proving that, under ideal training conditions, the generated samples have the same conditional probability distribution as that of the ground truth. Three applications involving highly dynamic and volatile time series in real-time market operations are considered: (i) locational marginal price forecasting for self-scheduled resources such as battery storage participants, (ii) interregional price spread forecasting for virtual bidders in interchange markets, and (iii) area control error forecasting for frequency regulations. Numerical studies based on market data from multiple independent system operators demonstrate the superior performance of the proposed generative forecaster over leading classical and modern machine learning techniques under both probabilistic and point forecasting metrics.
△ Less
Submitted 27 June, 2024; v1 submitted 8 March, 2024;
originally announced March 2024.
-
A Decentralized Market Mechanism for Energy Communities under Operating Envelopes
Authors:
Ahmed S. Alahmed,
Guido Cavraro,
Andrey Bernstein,
Lang Tong
Abstract:
We propose an operating envelopes (OEs) aware energy community market mechanism that dynamically charges/rewards its members based on two-part pricing. The OEs are imposed exogenously by a regulated distribution system operator (DSO) on the energy community's revenue meter and is subject to a generalized net energy metering (NEM) tariff design. By formulating the interaction of the community opera…
▽ More
We propose an operating envelopes (OEs) aware energy community market mechanism that dynamically charges/rewards its members based on two-part pricing. The OEs are imposed exogenously by a regulated distribution system operator (DSO) on the energy community's revenue meter and is subject to a generalized net energy metering (NEM) tariff design. By formulating the interaction of the community operator and its members as a Stackelberg game, we show that the proposed two-part pricing achieves a Nash equilibrium and maximizes the community's social welfare in a decentralized fashion while ensuring that the community's operation abides by the OEs. The market mechanism conforms with the cost-causation principle and guarantees community members a surplus level no less than their maximum surplus when they autonomously face the DSO. The dynamic and uniform community price is a monotonically decreasing function of the community's aggregate renewable generation. We also analyze the impact of exogenous parameters such as NEM rates and OEs on the value of joining the community. Lastly, through numerical studies, we showcase the community's welfare, and pricing, and compare its members' surplus to customers under the DSO's regime.
△ Less
Submitted 10 July, 2024; v1 submitted 26 February, 2024;
originally announced February 2024.
-
Generative Probabilistic Time Series Forecasting and Applications in Grid Operations
Authors:
Xinyi Wang,
Lang Tong,
Qing Zhao
Abstract:
Generative probabilistic forecasting produces future time series samples according to the conditional probability distribution given past time series observations. Such techniques are essential in risk-based decision-making and planning under uncertainty with broad applications in grid operations, including electricity price forecasting, risk-based economic dispatch, and stochastic optimizations.…
▽ More
Generative probabilistic forecasting produces future time series samples according to the conditional probability distribution given past time series observations. Such techniques are essential in risk-based decision-making and planning under uncertainty with broad applications in grid operations, including electricity price forecasting, risk-based economic dispatch, and stochastic optimizations. Inspired by Wiener and Kallianpur's innovation representation, we propose a weak innovation autoencoder architecture and a learning algorithm to extract independent and identically distributed innovation sequences from nonparametric stationary time series. We show that the weak innovation sequence is Bayesian sufficient, which makes the proposed weak innovation autoencoder a canonical architecture for generative probabilistic forecasting. The proposed technique is applied to forecasting highly volatile real-time electricity prices, demonstrating superior performance across multiple forecasting measures over leading probabilistic and point forecasting techniques.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
Multi-Interval Energy-Reserve Co-Optimization with SoC-Dependent Bids from Battery Storage
Authors:
Cong Chen,
Siying Li,
Lang Tong
Abstract:
We consider the problem of co-optimized energy-reserve market clearing with state-of-charge (SoC) dependent bids from battery storage participants. While SoC-dependent bids capture storage's degradation and opportunity costs, such bids result in a non-convex optimization in the market clearing process. More challenging is the regulation reserve capacity clearing, where the SoC-dependent cost is un…
▽ More
We consider the problem of co-optimized energy-reserve market clearing with state-of-charge (SoC) dependent bids from battery storage participants. While SoC-dependent bids capture storage's degradation and opportunity costs, such bids result in a non-convex optimization in the market clearing process. More challenging is the regulation reserve capacity clearing, where the SoC-dependent cost is uncertain as it depends on the unknown regulation trajectories ex-post of the market clearing. Addressing the nonconvexity and uncertainty in a multi-interval co-optimized real-time energy-reserve market, we introduce a simple restriction on the SoC-dependent bids along with a robust optimization formulation, transforming the non-convex market clearing under uncertainty into a standard convex piece-wise linear program and making it possible for large-scale storage integration. Under reasonable assumptions, we show that SoC-dependent bids yield higher profit for storage participants than that from SoC-independent bids. Numerical simulations demonstrate a 28%-150% profit increase of the proposed SoC-dependent bids compared with the SoC-independent counterpart.
△ Less
Submitted 24 August, 2024; v1 submitted 27 January, 2024;
originally announced January 2024.
-
Multinomial Link Models
Authors:
Tianmeng Wang,
Liping Tong,
Jie Yang
Abstract:
We propose a unified multinomial link model for analyzing categorical responses. It not only covers the existing multinomial logistic models and their extensions as special cases, but also includes new models that can incorporate the observations with NA or Unknown responses in the data analysis. We provide explicit formulae and detailed algorithms for finding the maximum likelihood estimates of t…
▽ More
We propose a unified multinomial link model for analyzing categorical responses. It not only covers the existing multinomial logistic models and their extensions as special cases, but also includes new models that can incorporate the observations with NA or Unknown responses in the data analysis. We provide explicit formulae and detailed algorithms for finding the maximum likelihood estimates of the model parameters and computing the Fisher information matrix. Our algorithms solve the infeasibility issue of existing statistical software on estimating parameters of cumulative link models. The applications to real datasets show that the new models can fit the data significantly better, and the corresponding data analysis may correct the misleading conclusions due to missing responses.
△ Less
Submitted 18 June, 2024; v1 submitted 26 December, 2023;
originally announced December 2023.
-
Layer-dependent evolution of electronic structures and correlations in rhombohedral multilayer graphene
Authors:
Yue-Ying Zhou,
Yang Zhang,
Shihao Zhang,
Hao Cai,
Ling-Hui Tong,
Yuan Tian,
Tongtong Chen,
Qiwei Tian,
Chen Zhang,
Yiliu Wang,
Xuming Zou,
Xingqiang Liu,
Yuanyuan Hu,
Li Zhang,
Lijie Zhang,
Wen-Xiao Wang,
Lei Liao,
Zhihui Qin,
Long-Jing Yin
Abstract:
The recent discovery of superconductivity and magnetism in trilayer rhombohedral graphene (RG) establishes an ideal, untwisted platform to study strong correlation electronic phenomena. However, the correlated effects in multilayer RG have received limited attention, and, particularly, the evolution of the correlations with increasing layer number remains an unresolved question. Here, we show the…
▽ More
The recent discovery of superconductivity and magnetism in trilayer rhombohedral graphene (RG) establishes an ideal, untwisted platform to study strong correlation electronic phenomena. However, the correlated effects in multilayer RG have received limited attention, and, particularly, the evolution of the correlations with increasing layer number remains an unresolved question. Here, we show the observation of layer-dependent electronic structures and correlations in RG multilayers from 3 to 9 layers by using scanning tunneling microscopy and spectroscopy. We explicitly determine layer-enhanced low-energy flat bands and interlayer coupling strength. The former directly demonstrates the further flattening of low-energy bands in thicker RG, and the later indicates the presence of varying interlayer interactions in RG multilayers. Moreover, we find significant splitting of the flat bands, ranging from ~50-80 meV, under liquid nitrogen temperature when they are partially filled, indicating the emergence of interaction-induced strongly correlated states. Particularly, the strength of the correlated states is notably enhanced in thicker RG and reaches its maximum in the six-layer, validating directly theoretical predictions and establishing abundant new candidates for strongly correlated systems. Our results provide valuable insights into the layer dependence of the electronic properties in RG, paving the way for investigating robust and highly accessible correlated phases in simpler systems.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Resource Sharing in Energy Communities: A Cooperative Game Approach
Authors:
Ahmed S. Alahmed,
Lang Tong
Abstract:
We analyze the overall benefits of an energy community cooperative game under which distributed energy resources (DER) are shared behind a regulated distribution utility meter under a general net energy metering (NEM) tariff. Two community DER scheduling algorithms are examined. The first is a community with centrally controlled DER, whereas the second is decentralized letting its members schedule…
▽ More
We analyze the overall benefits of an energy community cooperative game under which distributed energy resources (DER) are shared behind a regulated distribution utility meter under a general net energy metering (NEM) tariff. Two community DER scheduling algorithms are examined. The first is a community with centrally controlled DER, whereas the second is decentralized letting its members schedule their own DER locally. For both communities, we prove that the cooperative game's value function is superadditive, hence the grand coalition achieves the highest welfare. We also prove the balancedness of the cooperative game under the two DER scheduling algorithms, which means that there is a welfare re-distribution scheme that de-incentivizes players from leaving the grand coalition to form smaller ones. Lastly, we present five ex-post and an ex-ante welfare re-distribution mechanisms and evaluate them in simulation, in addition to investigating the performance of various community sizes under the two DER scheduling algorithms.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Enhancing Microgrid Resilience with Green Hydrogen Storage
Authors:
Shreshtha Dhankar,
Cong Chen,
Lang Tong
Abstract:
We consider the problem of hydrogen storage integration in microgrids to improve the electricity supply resilience. Nonlinear effects from electrochemical models of electrolyzers and fuel cells for hydrogen storage are considered, making scheduling under the nonlinear model intractable and the conventional linear approximation infeasible. A piecewise linear model approximation with feasibility pro…
▽ More
We consider the problem of hydrogen storage integration in microgrids to improve the electricity supply resilience. Nonlinear effects from electrochemical models of electrolyzers and fuel cells for hydrogen storage are considered, making scheduling under the nonlinear model intractable and the conventional linear approximation infeasible. A piecewise linear model approximation with feasibility projection is proposed, resulting in a computationally efficient model predictive control for hydrogen storage operation. Several resilience performance measures, such as loss-of-load, duration-of-outage, and system cost, are used in performance evaluation. Simulations for the proposed optimization demonstrated a 13%-48% reduction in duration-of-outage, a 6.4%-21.7% reduction in system cost, and a 95% reduction in loss-of-load for critical loads compared to the scheduling algorithm involving linear model approximation. The performance gap of the proposed optimization to the benchmark involving the accurate nonlinear electrochemical model is less than 1% in most metrics.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Convexifying Regulation Market Clearing of State-of-Charge Dependent Bid
Authors:
Siying Li,
Cong Chen,
Lang Tong
Abstract:
We consider the problem of merchant storage participating in the regulation market with state-of-charge (SoC) dependent bids. Because storage can simultaneously provide regulation up and regulation down capacities, the market-clearing engine faces the computation challenge of evaluating storage costs under different regulation scenarios. One approach is to employ a bilevel optimization that minimi…
▽ More
We consider the problem of merchant storage participating in the regulation market with state-of-charge (SoC) dependent bids. Because storage can simultaneously provide regulation up and regulation down capacities, the market-clearing engine faces the computation challenge of evaluating storage costs under different regulation scenarios. One approach is to employ a bilevel optimization that minimizes the worst-case storage cost among all potential regulation events. However, subproblems of such a bilevel optimization are nonconvex, resulting in prohibitive computation challenges for the real-time clearing of the regulation market. We show that the complex nonconvex market clearing problem can be convexified by a simple restriction on the SoC-dependent bid, rendering the intractable market clearing computation to standard linear programs. Numerical simulations demonstrate that SoC-dependent bids satisfying the convexification conditions increase the profits of merchant storage owners by 12.32-77.38% compared with SoC-independent bids.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Large-area, freestanding single-crystal gold of single nanometer thickness
Authors:
Chenxinyu Pan,
Yuanbiao Tong,
Haoliang Qian,
Alexey V. Krasavin,
Jialin Li,
Jiajie Zhu,
Yiyun Zhang,
Bowen Cui,
Zhiyong Li,
Chenming Wu,
Zhenxin Wang,
Lufang Liu,
Linjun Li,
Xin Guo,
Anatoly V. Zayats,
Limin Tong,
Pan Wang
Abstract:
Two-dimensional single-crystal metals are highly sought after for next-generation technologies. Here, we report large-area (>10^4 μm2), single-crystal two-dimensional gold with thicknesses down to a single-nanometer level, employing an atomic-level-precision chemical etching approach. The ultrathin thickness and single-crystal quality endow two-dimensional gold with unique properties including sig…
▽ More
Two-dimensional single-crystal metals are highly sought after for next-generation technologies. Here, we report large-area (>10^4 μm2), single-crystal two-dimensional gold with thicknesses down to a single-nanometer level, employing an atomic-level-precision chemical etching approach. The ultrathin thickness and single-crystal quality endow two-dimensional gold with unique properties including significantly quantum-confinement-augmented optical nonlinearity, low sheet resistance, high transparency and excellent mechanical flexibility. By patterning the two-dimensional gold into nanoribbon arrays, extremely-confined near-infrared plasmonic resonances are further demonstrated with quality factors up to 5. The freestanding nature of two-dimensional gold allows its straightforward manipulation and transfer-printing for integration with other structures. The developed two-dimensional gold provides an emerging platform for fundamental studies in various disciplines and opens up new opportunities for applications in high-performance ultrathin optoelectronic, photonic and quantum devices.
△ Less
Submitted 13 November, 2023;
originally announced November 2023.
-
Operating-Envelopes-Aware Decentralized Welfare Maximization for Energy Communities
Authors:
Ahmed S. Alahmed,
Guido Cavraro,
Andrey Bernstein,
Lang Tong
Abstract:
We propose an operating-envelope-aware, prosumer-centric, and efficient energy community that aggregates individual and shared community distributed energy resources and transacts with a regulated distribution system operator (DSO) under a generalized net energy metering tariff design. To ensure safe network operation, the DSO imposes dynamic export and import limits, known as dynamic operating en…
▽ More
We propose an operating-envelope-aware, prosumer-centric, and efficient energy community that aggregates individual and shared community distributed energy resources and transacts with a regulated distribution system operator (DSO) under a generalized net energy metering tariff design. To ensure safe network operation, the DSO imposes dynamic export and import limits, known as dynamic operating envelopes, on end-users' revenue meters. Given the operating envelopes, we propose an incentive-aligned community pricing mechanism under which the decentralized optimization of community members' benefit implies the optimization of overall community welfare. The proposed pricing mechanism satisfies the cost-causation principle and ensures the stability of the energy community in a coalition game setting. Numerical examples provide insights into the characteristics of the proposed pricing mechanism and quantitative measures of its performance.
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
A hybrid quantum-classical conditional generative adversarial network algorithm for human-centered paradigm in cloud
Authors:
Wenjie Liu,
Ying Zhang,
Zhiliang Deng,
Jiaojiao Zhao,
Lian Tong
Abstract:
As an emerging field that aims to bridge the gap between human activities and computing systems, human-centered computing (HCC) in cloud, edge, fog has had a huge impact on the artificial intelligence algorithms. The quantum generative adversarial network (QGAN) is considered to be one of the quantum machine learning algorithms with great application prospects, which also should be improved to con…
▽ More
As an emerging field that aims to bridge the gap between human activities and computing systems, human-centered computing (HCC) in cloud, edge, fog has had a huge impact on the artificial intelligence algorithms. The quantum generative adversarial network (QGAN) is considered to be one of the quantum machine learning algorithms with great application prospects, which also should be improved to conform to the human-centered paradigm. The generation process of QGAN is relatively random and the generated model does not conform to the human-centered concept, so it is not quite suitable for real scenarios. In order to solve these problems, a hybrid quantum-classical conditional generative adversarial network (QCGAN) algorithm is proposed, which is a knowledge-driven human-computer interaction computing mode that can be implemented in cloud. The purposes of stabilizing the generation process and realizing the interaction between human and computing process are achieved by inputting artificial conditional information in the generator and discriminator. The generator uses the parameterized quantum circuit with an all-to-all connected topology, which facilitates the tuning of network parameters during the training process. The discriminator uses the classical neural network, which effectively avoids the "input bottleneck" of quantum machine learning. Finally, the BAS training set is selected to conduct experiment on the quantum cloud computing platform. The result shows that the QCGAN algorithm can effectively converge to the Nash equilibrium point after training and perform human-centered classification generation tasks.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
An optimized quantum minimum searching algorithm with sure-success probability and its experiment simulation with Cirq
Authors:
Wenjie Liu,
Qingshan Wu,
Jiahao Shen,
Jiaojiao Zhao,
Mohammed Zidan,
Lian Tong
Abstract:
Finding a minimum is an essential part of mathematical models, and it plays an important role in some optimization problems. Durr and Hoyer proposed a quantum searching algorithm (DHA), with a certain probability of success, to achieve quadratic speed than classical ones. In this paper, we propose an optimized quantum minimum searching algorithm with sure-success probability, which utilizes Grover…
▽ More
Finding a minimum is an essential part of mathematical models, and it plays an important role in some optimization problems. Durr and Hoyer proposed a quantum searching algorithm (DHA), with a certain probability of success, to achieve quadratic speed than classical ones. In this paper, we propose an optimized quantum minimum searching algorithm with sure-success probability, which utilizes Grover-Long searching to implement the optimal exact searching, and the dynamic strategy to reduce the iterations of our algorithm. Besides, we optimize the oracle circuit to reduce the number of gates by the simplified rules. The performance evaluation including the theoretical success rate and computational complexity shows that our algorithm has higher accuracy and efficiency than DHA algorithm. Finally, a simulation experiment based on Cirq is performed to verify its feasibility.
△ Less
Submitted 25 September, 2023;
originally announced September 2023.
-
Class Binarization to NeuroEvolution for Multiclass Classification
Authors:
Gongjin Lan,
Zhenyu Gao,
Lingyao Tong,
Ting Liu
Abstract:
Multiclass classification is a fundamental and challenging task in machine learning. The existing techniques of multiclass classification can be categorized as (i) decomposition into binary (ii) extension from binary and (iii) hierarchical classification. Decomposing multiclass classification into a set of binary classifications that can be efficiently solved by using binary classifiers, called cl…
▽ More
Multiclass classification is a fundamental and challenging task in machine learning. The existing techniques of multiclass classification can be categorized as (i) decomposition into binary (ii) extension from binary and (iii) hierarchical classification. Decomposing multiclass classification into a set of binary classifications that can be efficiently solved by using binary classifiers, called class binarization, which is a popular technique for multiclass classification. Neuroevolution, a general and powerful technique for evolving the structure and weights of neural networks, has been successfully applied to binary classification. In this paper, we apply class binarization techniques to a neuroevolution algorithm, NeuroEvolution of Augmenting Topologies (NEAT), that is used to generate neural networks for multiclass classification. We propose a new method that applies Error-Correcting Output Codes (ECOC) to design the class binarization strategies on the neuroevolution for multiclass classification. The ECOC strategies are compared with the class binarization strategies of One-vs-One and One-vs-All on three well-known datasets Digit, Satellite, and Ecoli. We analyse their performance from four aspects of multiclass classification degradation, accuracy, evolutionary efficiency, and robustness. The results show that the NEAT with ECOC performs high accuracy with low variance. Specifically, it shows significant benefits in a flexible number of binary classifiers and strong robustness.
△ Less
Submitted 26 August, 2023;
originally announced August 2023.
-
High performance artificial visual system with plasmon-enhanced 2D material neural network
Authors:
Tian Zhang,
Xin Guo,
Pan Wang,
Linjun Li,
Limin Tong
Abstract:
Artificial visual systems (AVS) have gained tremendous momentum because of its huge potential in areas such as autonomous vehicles and robotics as part of artificial intelligence (AI) in recent years. However, current machine visual systems composed of complex circuits based on complementary metal oxide semiconductor (CMOS) platform usually contains photosensor array, format conversion, memory and…
▽ More
Artificial visual systems (AVS) have gained tremendous momentum because of its huge potential in areas such as autonomous vehicles and robotics as part of artificial intelligence (AI) in recent years. However, current machine visual systems composed of complex circuits based on complementary metal oxide semiconductor (CMOS) platform usually contains photosensor array, format conversion, memory and processing module. The large amount of redundant data shuttling between each unit, resulting in large latency and high power consumption, which greatly limits the performance of the AVS. Here, we demonstrate an AVS based on a new design concept, which consists of hardware devices connected in an artificial neural network (ANN) that can simultaneously sense, pre-process and recognize optical images without latency. The Ag nanograting and the two-dimensional (2D) heterostructure integrated plasmonic phototransistor array (PPTA) constitute the hardware ANN, and its synaptic weight is determined by the adjustable regularized photoresponsivity matrix. The eye-inspired pre-processing function of the device under photoelectric synergy ensures the considerable improvement of the efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and ultralow energy consumption per spike (2.4e(-17) J).
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Wholesale Market Participation of DERA: Competitive DER Aggregation
Authors:
Cong Chen,
Ahmed S. Alahmed,
Timothy D. Mount,
Lang Tong
Abstract:
We consider the aggregation of distributed energy resources (DERs) by a profit-seeking DER aggregator (DERA), participating directly in the wholesale electricity market and constrained by the distribution network access. We propose a competitive DER aggregation that maximizes the DERA's profit subject to that each customer of the DERA gains no less surplus and pays no higher energy cost than that…
▽ More
We consider the aggregation of distributed energy resources (DERs) by a profit-seeking DER aggregator (DERA), participating directly in the wholesale electricity market and constrained by the distribution network access. We propose a competitive DER aggregation that maximizes the DERA's profit subject to that each customer of the DERA gains no less surplus and pays no higher energy cost than that under the regulated retail tariff. The DERA participates in the wholesale electricity market as virtual storage with optimized generation offers and consumption bids derived from the DERA's competitive aggregation. Also derived are DERA's bid curves for the distribution network access and DERA's profitability when competing with the regulated retail tariff. We show that, with the same distribution network access, the proposed DERA's wholesale market participation achieves the same welfare-maximizing outcome as when its customers participate directly in the wholesale market. We empirically evaluate how many DERAs can survive in the long-run equilibrium. Numerical studies also compare the proposed DERA with existing benchmarks on surpluses of DERA's customers and DERA profits as functions of the DER adoption level and the distribution network access.
△ Less
Submitted 23 June, 2024; v1 submitted 4 July, 2023;
originally announced July 2023.
-
Wholesale Market Participation of DERA: DSO-DERA-ISO Coordination
Authors:
Cong Chen,
Subhonmesh Bose,
Timothy D. Mount,
Lang Tong
Abstract:
Distributed energy resource aggregators (DERAs) must share the distribution network together with the distribution utility in order to participate in the wholesale electricity markets that are operated by independent system operators (ISOs). We propose a forward auction that a distribution system operator (DSO) can utilize to allocate distribution network access limits to DERAs. As long as the DER…
▽ More
Distributed energy resource aggregators (DERAs) must share the distribution network together with the distribution utility in order to participate in the wholesale electricity markets that are operated by independent system operators (ISOs). We propose a forward auction that a distribution system operator (DSO) can utilize to allocate distribution network access limits to DERAs. As long as the DERAs operate within their acquired limits, these limits define operating envelopes that guarantee distribution network security, thus defining a mechanism that requires no real-time intervention from the DSOs for DERAs to participate in the wholesale markets. Our auctions take the form of robust and risk-sensitive markets with bids/offers from DERAs and utility's operational costs. Properties of the proposed auction, e.g., resulting surpluses of DSO and the DERAs, and the auction prices, along with empirical performance studies, are presented.
△ Less
Submitted 7 January, 2024; v1 submitted 4 July, 2023;
originally announced July 2023.
-
CLANet: A Comprehensive Framework for Cross-Batch Cell Line Identification Using Brightfield Images
Authors:
Lei Tong,
Adam Corrigan,
Navin Rathna Kumar,
Kerry Hallbrook,
Jonathan Orme,
Yinhai Wang,
Huiyu Zhou
Abstract:
Cell line authentication plays a crucial role in the biomedical field, ensuring researchers work with accurately identified cells. Supervised deep learning has made remarkable strides in cell line identification by studying cell morphological features through cell imaging. However, batch effects, a significant issue stemming from the different times at which data is generated, lead to substantial…
▽ More
Cell line authentication plays a crucial role in the biomedical field, ensuring researchers work with accurately identified cells. Supervised deep learning has made remarkable strides in cell line identification by studying cell morphological features through cell imaging. However, batch effects, a significant issue stemming from the different times at which data is generated, lead to substantial shifts in the underlying data distribution, thus complicating reliable differentiation between cell lines from distinct batch cultures. To address this challenge, we introduce CLANet, a pioneering framework for cross-batch cell line identification using brightfield images, specifically designed to tackle three distinct batch effects. We propose a cell cluster-level selection method to efficiently capture cell density variations, and a self-supervised learning strategy to manage image quality variations, thus producing reliable patch representations. Additionally, we adopt multiple instance learning(MIL) for effective aggregation of instance-level features for cell line identification. Our innovative time-series segment sampling module further enhances MIL's feature-learning capabilities, mitigating biases from varying incubation times across batches. We validate CLANet using data from 32 cell lines across 93 experimental batches from the AstraZeneca Global Cell Bank. Our results show that CLANet outperforms related approaches (e.g. domain adaptation, MIL), demonstrating its effectiveness in addressing batch effects in cell line identification.
△ Less
Submitted 28 June, 2023;
originally announced June 2023.
-
Dynamic Net Metering for Energy Communities
Authors:
Ahmed S. Alahmed,
Lang Tong
Abstract:
We propose a social welfare maximizing market mechanism for an energy community that aggregates individual and community-shared energy resources under a general net energy metering (NEM) policy. Referred to as Dynamic NEM (D-NEM), the proposed mechanism dynamically sets the community NEM prices based on aggregated community resources, including flexible consumption, storage, and renewable generati…
▽ More
We propose a social welfare maximizing market mechanism for an energy community that aggregates individual and community-shared energy resources under a general net energy metering (NEM) policy. Referred to as Dynamic NEM (D-NEM), the proposed mechanism dynamically sets the community NEM prices based on aggregated community resources, including flexible consumption, storage, and renewable generation. D-NEM guarantees a higher benefit to each community member than possible outside the community, and no sub-communities would be better off departing from its parent community. D-NEM aligns each member's incentive with that of the community such that each member maximizing individual surplus under D-NEM results in maximum community social welfare. Empirical studies compare the proposed mechanism with existing benchmarks, demonstrating its welfare benefits, operational characteristics, and responsiveness to NEM rates.
△ Less
Submitted 15 January, 2024; v1 submitted 21 June, 2023;
originally announced June 2023.
-
Non-parametric Probabilistic Time Series Forecasting via Innovations Representation
Authors:
Xinyi Wang,
Meijen Lee,
Qing Zhao,
Lang Tong
Abstract:
Probabilistic time series forecasting predicts the conditional probability distributions of the time series at a future time given past realizations. Such techniques are critical in risk-based decision-making and planning under uncertainties. Existing approaches are primarily based on parametric or semi-parametric time-series models that are restrictive, difficult to validate, and challenging to a…
▽ More
Probabilistic time series forecasting predicts the conditional probability distributions of the time series at a future time given past realizations. Such techniques are critical in risk-based decision-making and planning under uncertainties. Existing approaches are primarily based on parametric or semi-parametric time-series models that are restrictive, difficult to validate, and challenging to adapt to varying conditions. This paper proposes a nonparametric method based on the classic notion of {\em innovations} pioneered by Norbert Wiener and Gopinath Kallianpur that causally transforms a nonparametric random process to an independent and identical uniformly distributed {\em innovations process}. We present a machine-learning architecture and a learning algorithm that circumvent two limitations of the original Wiener-Kallianpur innovations representation: (i) the need for known probability distributions of the time series and (ii) the existence of a causal decoder that reproduces the original time series from the innovations representation. We develop a deep-learning approach and a Monte Carlo sampling technique to obtain a generative model for the predicted conditional probability distribution of the time series based on a weak notion of Wiener-Kallianpur innovations representation. The efficacy of the proposed probabilistic forecasting technique is demonstrated on a variety of electricity price datasets, showing marked improvement over leading benchmarks of probabilistic forecasting techniques.
△ Less
Submitted 4 June, 2023;
originally announced June 2023.
-
A Quantitative Review on Language Model Efficiency Research
Authors:
Meng Jiang,
Hy Dang,
Lingbo Tong
Abstract:
Language models (LMs) are being scaled and becoming powerful. Improving their efficiency is one of the core research topics in neural information processing systems. Tay et al. (2022) provided a comprehensive overview of efficient Transformers that have become an indispensable staple in the field of NLP. However, in the section of "On Evaluation", they left an open question "which fundamental effi…
▽ More
Language models (LMs) are being scaled and becoming powerful. Improving their efficiency is one of the core research topics in neural information processing systems. Tay et al. (2022) provided a comprehensive overview of efficient Transformers that have become an indispensable staple in the field of NLP. However, in the section of "On Evaluation", they left an open question "which fundamental efficient Transformer one should consider," answered by "still a mystery" because "many research papers select their own benchmarks." Unfortunately, there was not quantitative analysis about the performances of Transformers on any benchmarks. Moreover, state space models (SSMs) have demonstrated their abilities of modeling long-range sequences with non-attention mechanisms, which were not discussed in the prior review. This article makes a meta analysis on the results from a set of papers on efficient Transformers as well as those on SSMs. It provides a quantitative review on LM efficiency research and gives suggestions for future research.
△ Less
Submitted 28 May, 2023;
originally announced June 2023.
-
On the Optimality of Procrastination Policy for EV charging under Net Energy Metering
Authors:
Minjae Jeon,
Lang Tong,
Qing Zhao
Abstract:
We consider the problem of behind-the-meter EV charging by a prosumer, co-optimized with rooftop solar, electric battery, and flexible consumptions such as water heaters and HVAC. Under the time-of-use net energy metering tariff with the stochastic solar production and random EV charging demand, a finite-horizon surplus-maximization problem is formulated. We show that a procrastination threshold p…
▽ More
We consider the problem of behind-the-meter EV charging by a prosumer, co-optimized with rooftop solar, electric battery, and flexible consumptions such as water heaters and HVAC. Under the time-of-use net energy metering tariff with the stochastic solar production and random EV charging demand, a finite-horizon surplus-maximization problem is formulated. We show that a procrastination threshold policy that delays EV charging to the last possible moment is optimal when EV charging is co-optimized with flexible demand, and the policy thresholds can be computed easily offline. When battery storage is part of the co-optimization, it is shown that the net consumption of the prosumer is a two-threshold piecewise linear function of the behind-the-meter renewable generation under the optimal policy, and the procrastination threshold policy remains optimal, although the thresholds cannot be computed easily. We propose a simple myopic solution and demonstrate in simulations that the performance gap between the myopic policy and an oracle upper bound appears to be 0.5-7.5%.
△ Less
Submitted 29 April, 2024; v1 submitted 8 April, 2023;
originally announced April 2023.
-
Hierarchical Graph Neural Networks for Causal Discovery and Root Cause Localization
Authors:
Dongjie Wang,
Zhengzhang Chen,
Jingchao Ni,
Liang Tong,
Zheng Wang,
Yanjie Fu,
Haifeng Chen
Abstract:
In this paper, we propose REASON, a novel framework that enables the automatic discovery of both intra-level (i.e., within-network) and inter-level (i.e., across-network) causal relationships for root cause localization. REASON consists of Topological Causal Discovery and Individual Causal Discovery. The Topological Causal Discovery component aims to model the fault propagation in order to trace b…
▽ More
In this paper, we propose REASON, a novel framework that enables the automatic discovery of both intra-level (i.e., within-network) and inter-level (i.e., across-network) causal relationships for root cause localization. REASON consists of Topological Causal Discovery and Individual Causal Discovery. The Topological Causal Discovery component aims to model the fault propagation in order to trace back to the root causes. To achieve this, we propose novel hierarchical graph neural networks to construct interdependent causal networks by modeling both intra-level and inter-level non-linear causal relations. Based on the learned interdependent causal networks, we then leverage random walks with restarts to model the network propagation of a system fault. The Individual Causal Discovery component focuses on capturing abrupt change patterns of a single system entity. This component examines the temporal patterns of each entity's metric data (i.e., time series), and estimates its likelihood of being a root cause based on the Extreme Value theory. Combining the topological and individual causal scores, the top K system entities are identified as root causes. Extensive experiments on three real-world datasets with case studies demonstrate the effectiveness and superiority of the proposed framework.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
MultiNet with Transformers: A Model for Cancer Diagnosis Using Images
Authors:
Hosein Barzekar,
Yash Patel,
Ling Tong,
Zeyun Yu
Abstract:
Cancer is a leading cause of death in many countries. An early diagnosis of cancer based on biomedical imaging ensures effective treatment and a better prognosis. However, biomedical imaging presents challenges to both clinical institutions and researchers. Physiological anomalies are often characterized by slight abnormalities in individual cells or tissues, making them difficult to detect visual…
▽ More
Cancer is a leading cause of death in many countries. An early diagnosis of cancer based on biomedical imaging ensures effective treatment and a better prognosis. However, biomedical imaging presents challenges to both clinical institutions and researchers. Physiological anomalies are often characterized by slight abnormalities in individual cells or tissues, making them difficult to detect visually. Traditionally, anomalies are diagnosed by radiologists and pathologists with extensive training. This procedure, however, demands the participation of professionals and incurs a substantial cost. The cost makes large-scale biological image classification impractical. In this study, we provide unique deep neural network designs for multiclass classification of medical images, in particular cancer images. We incorporated transformers into a multiclass framework to take advantage of data-gathering capability and perform more accurate classifications. We evaluated models on publicly accessible datasets using various measures to ensure the reliability of the models. Extensive assessment metrics suggest this method can be used for a multitude of classification tasks.
△ Less
Submitted 21 January, 2023;
originally announced January 2023.
-
Co-optimizing Behind-The-Meter Resources under Net Metering
Authors:
Ahmed S. Alahmed,
Lang Tong
Abstract:
We consider the problem of co-optimizing behind-the-meter (BTM) storage and flexible demands with BTM stochastic renewable generation. Under a generalized net energy metering (NEM) policy-NEM X, we show that the optimal co-optimization policy schedules the flexible demands based on a load priority list that defers less prioritized loads to times when the BTM generation is abundant. This gives rise…
▽ More
We consider the problem of co-optimizing behind-the-meter (BTM) storage and flexible demands with BTM stochastic renewable generation. Under a generalized net energy metering (NEM) policy-NEM X, we show that the optimal co-optimization policy schedules the flexible demands based on a load priority list that defers less prioritized loads to times when the BTM generation is abundant. This gives rise to the notion of a net-zero zone, which we quantify under different distributed energy resources (DER) compositions. We highlight the special case of inflexible demands that results in a storage policy that minimizes the imports and exports from and to the grid. Comparative statics are provided on the optimal co-optimization policy. Simulations using real residential data show the surplus gains of various customers under different DER compositions.
△ Less
Submitted 6 December, 2022;
originally announced December 2022.
-
DSO-DERA Coordination for the Wholesale Market Participation of Distributed Energy Resources
Authors:
Cong Chen,
Subhonmesh Bose,
Lang Tong
Abstract:
We design a coordination mechanism between a distribution system operator (DSO) and distributed energy resource aggregators (DERAs) participating directly in the wholesale electricity market. Aimed at ensuring system reliability while providing open access to DERAs, the coordination mechanism includes a forward auction that allocates access limits to aggregators based on aggregators' bids that rep…
▽ More
We design a coordination mechanism between a distribution system operator (DSO) and distributed energy resource aggregators (DERAs) participating directly in the wholesale electricity market. Aimed at ensuring system reliability while providing open access to DERAs, the coordination mechanism includes a forward auction that allocates access limits to aggregators based on aggregators' bids that represent their benefits of aggregation. The proposed coordination mechanism results in decoupled DSO and DERAs operations that satisfy the network constraints, independent of the stochasticity of the renewables, wholesale real-time locational marginal prices, and individual DERA's aggregation policy. Optimal bidding strategies by competitive aggregators are also derived. The efficiency of the coordination mechanism and the locational price distribution at buses of a radial distribution grid are demonstrated for a 141-bus radial network.
△ Less
Submitted 29 November, 2022;
originally announced November 2022.
-
Co-optimizing Consumption and EV Charging under Net Energy Metering
Authors:
Minjae Jeon,
Lang Tong,
Qing Zhao
Abstract:
We consider the co-optimization of flexible household consumption, electric vehicle charging, and behind-the-meter distributed energy resources under the net energy metering tariff. Using a stochastic dynamic programming formulation, we show that the solution to the dynamic programming co-optimization is a procrastination threshold policy that delays and minimizes electricity purchasing for EV cha…
▽ More
We consider the co-optimization of flexible household consumption, electric vehicle charging, and behind-the-meter distributed energy resources under the net energy metering tariff. Using a stochastic dynamic programming formulation, we show that the solution to the dynamic programming co-optimization is a procrastination threshold policy that delays and minimizes electricity purchasing for EV charging in each time interval. The policy thresholds can be computed off-line, simplifying the continuous action space dynamic optimization to decoupled closed-form charging and consumption decisions. Empirical studies using renewable, consumption, and EV data demonstrate the benefits of co-optimization.
△ Less
Submitted 4 July, 2023; v1 submitted 20 November, 2022;
originally announced November 2022.
-
Achieving Social Optimality for Energy Communities via Dynamic NEM Pricing
Authors:
Ahmed S. Alahmed,
Lang Tong
Abstract:
We propose a social welfare maximizing mechanism for an energy community that aggregates individual and shared community resources under a general net energy metering (NEM) policy. Referred to as Dynamic NEM, the proposed mechanism adopts the standard NEM tariff model and sets NEM prices dynamically based on the total shared renewables within the community. We show that Dynamic NEM guarantees a hi…
▽ More
We propose a social welfare maximizing mechanism for an energy community that aggregates individual and shared community resources under a general net energy metering (NEM) policy. Referred to as Dynamic NEM, the proposed mechanism adopts the standard NEM tariff model and sets NEM prices dynamically based on the total shared renewables within the community. We show that Dynamic NEM guarantees a higher benefit to each community member than possible outside the community. We further show that Dynamic NEM aligns the individual member's incentive with that of the overall community; each member optimizing individual surplus under Dynamic NEM results in maximum community's social welfare. Dynamic NEM is also shown to satisfy the cost-causation principle. Empirical studies using real data on a hypothetical energy community demonstrate the benefits to community members and grid operators.
△ Less
Submitted 17 November, 2022;
originally announced November 2022.
-
Personalized Federated Learning via Heterogeneous Modular Networks
Authors:
Tianchun Wang,
Wei Cheng,
Dongsheng Luo,
Wenchao Yu,
Jingchao Ni,
Liang Tong,
Haifeng Chen,
Xiang Zhang
Abstract:
Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL approaches result in sub-optimal solutions when the joint distribution among local clients diverges. To address this issue, we present Federated Modular Network (Fe…
▽ More
Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL approaches result in sub-optimal solutions when the joint distribution among local clients diverges. To address this issue, we present Federated Modular Network (FedMN), a novel PFL approach that adaptively selects sub-modules from a module pool to assemble heterogeneous neural architectures for different clients. FedMN adopts a light-weighted routing hypernetwork to model the joint distribution on each client and produce the personalized selection of the module blocks for each client. To reduce the communication burden in existing FL, we develop an efficient way to interact between the clients and the server. We conduct extensive experiments on the real-world test beds and the results show both the effectiveness and efficiency of the proposed FedMN over the baselines.
△ Less
Submitted 2 December, 2022; v1 submitted 26 October, 2022;
originally announced October 2022.
-
FocusedCleaner: Sanitizing Poisoned Graphs for Robust GNN-based Node Classification
Authors:
Yulin Zhu,
Liang Tong,
Gaolei Li,
Xiapu Luo,
Kai Zhou
Abstract:
Graph Neural Networks (GNNs) are vulnerable to data poisoning attacks, which will generate a poisoned graph as the input to the GNN models. We present FocusedCleaner as a poisoned graph sanitizer to effectively identify the poison injected by attackers. Specifically, FocusedCleaner provides a sanitation framework consisting of two modules: bi-level structural learning and victim node detection. In…
▽ More
Graph Neural Networks (GNNs) are vulnerable to data poisoning attacks, which will generate a poisoned graph as the input to the GNN models. We present FocusedCleaner as a poisoned graph sanitizer to effectively identify the poison injected by attackers. Specifically, FocusedCleaner provides a sanitation framework consisting of two modules: bi-level structural learning and victim node detection. In particular, the structural learning module will reverse the attack process to steadily sanitize the graph while the detection module provides ``the focus" -- a narrowed and more accurate search region -- to structural learning. These two modules will operate in iterations and reinforce each other to sanitize a poisoned graph step by step. As an important application, we show that the adversarial robustness of GNNs trained over the sanitized graph for the node classification task is significantly improved. Extensive experiments demonstrate that FocusedCleaner outperforms the state-of-the-art baselines both on poisoned graph sanitation and improving robustness.
△ Less
Submitted 17 July, 2023; v1 submitted 25 October, 2022;
originally announced October 2022.
-
Novelty Detection in Time Series via Weak Innovations Representation: A Deep Learning Approach
Authors:
Xinyi Wang,
Mei-jen Lee,
Qing Zhao,
Lang Tong
Abstract:
We consider novelty detection in time series with unknown and nonparametric probability structures. A deep learning approach is proposed to causally extract an innovations sequence consisting of novelty samples statistically independent of all past samples of the time series. A novelty detection algorithm is developed for the online detection of novel changes in the probability structure in the in…
▽ More
We consider novelty detection in time series with unknown and nonparametric probability structures. A deep learning approach is proposed to causally extract an innovations sequence consisting of novelty samples statistically independent of all past samples of the time series. A novelty detection algorithm is developed for the online detection of novel changes in the probability structure in the innovations sequence. A minimax optimality under a Bayes risk measure is established for the proposed novelty detection method, and its robustness and efficacy are demonstrated in experiments using real and synthetic datasets.
△ Less
Submitted 24 October, 2022;
originally announced October 2022.
-
Wholesale Market Participation of Storage with State-of-Charge Dependent Bids
Authors:
Cong Chen,
Lang Tong
Abstract:
Wholesale market participation of storage with state-of-charge (SoC) dependent bids results in a non-convex cost in a multi-interval economic dispatch, which requires a mixed-integer linear program in the market clearing. We show that the economic dispatch can be convexified to the standard linear program when the SoC-dependent bid satisfies the equal decremental-cost ratio (EDCR) condition. Such…
▽ More
Wholesale market participation of storage with state-of-charge (SoC) dependent bids results in a non-convex cost in a multi-interval economic dispatch, which requires a mixed-integer linear program in the market clearing. We show that the economic dispatch can be convexified to the standard linear program when the SoC-dependent bid satisfies the equal decremental-cost ratio (EDCR) condition. Such EDCR bids are shown to support individual rationalities of all market participants in both the day-ahead multi-interval economic dispatch under locational marginal pricing and the rolling-window look-ahead dispatch under temporal-locational marginal pricing in the real-time market. A numerical example is presented to demonstrate a higher profit margin with an SoC-dependent bid over that from an SoC-independent bid.
△ Less
Submitted 7 October, 2022;
originally announced October 2022.
-
Convexifying Market Clearing of SoC-Dependent Bids from Merchant Storage Participants
Authors:
Cong Chen,
Lang Tong
Abstract:
State-of-charge (SoC) dependent bidding allows merchant storage participants to incorporate SoC-dependent operation and opportunity costs in a bid-based market clearing process. However, such a bid results in a non-convex cost function in the multi-interval economic dispatch and market clearing, limiting its implementation in practice. We show that a simple restriction on the bidding format remove…
▽ More
State-of-charge (SoC) dependent bidding allows merchant storage participants to incorporate SoC-dependent operation and opportunity costs in a bid-based market clearing process. However, such a bid results in a non-convex cost function in the multi-interval economic dispatch and market clearing, limiting its implementation in practice. We show that a simple restriction on the bidding format removes the non-convexity, making the multi-interval dispatch of SoC-dependent bids a standard convex piece-wise linear program.
△ Less
Submitted 31 January, 2023; v1 submitted 5 September, 2022;
originally announced September 2022.
-
Differential evolution variants for Searching D- and A-optimal designs
Authors:
Lyuyang Tong
Abstract:
Optimal experimental design is an essential subfield of statistics that maximizes the chances of experimental success. The D- and A-optimal design is a very challenging problem in the field of optimal design, namely minimizing the determinant and trace of the inverse Fisher information matrix. Due to the flexibility and ease of implementation, traditional evolutionary algorithms (EAs) are applied…
▽ More
Optimal experimental design is an essential subfield of statistics that maximizes the chances of experimental success. The D- and A-optimal design is a very challenging problem in the field of optimal design, namely minimizing the determinant and trace of the inverse Fisher information matrix. Due to the flexibility and ease of implementation, traditional evolutionary algorithms (EAs) are applied to deal with a small part of experimental optimization design problems without mathematical derivation and assumption. However, the current EAs remain the issues of determining the support point number, handling the infeasible weight solution, and the insufficient experiment. To address the above issues, this paper investigates differential evolution (DE) variants for finding D- and A-optimal designs on several different statistical models. The repair operation is proposed to automatically determine the support point by combining similar support points with their corresponding weights based on Euclidean distance and deleting the support point with less weight. Furthermore, the repair operation fixes the infeasible weight solution into the feasible weight solution. To enrich our optimal design experiments, we utilize the proposed DE variants to test the D- and A-optimal design problems on 12 statistical models. Compared with other competitor algorithms, simulation experiments show that LSHADE can achieve better performance on the D- and A-optimal design problems.
△ Less
Submitted 23 August, 2022;
originally announced August 2022.
-
Co-Optimizing Distributed Energy Resources in Linear Complexity under Net Energy Metering
Authors:
Ahmed S. Alahmed,
Lang Tong,
Qing Zhao
Abstract:
The co-optimization of behind-the-meter distributed energy resources is considered for prosumers under the net energy metering tariff. The distributed energy resources considered include renewable generations, flexible demands, and battery energy storage systems. An energy management system co-optimizes the consumptions and battery storage based on locally available stochastic renewables by solvin…
▽ More
The co-optimization of behind-the-meter distributed energy resources is considered for prosumers under the net energy metering tariff. The distributed energy resources considered include renewable generations, flexible demands, and battery energy storage systems. An energy management system co-optimizes the consumptions and battery storage based on locally available stochastic renewables by solving a stochastic dynamic program that maximizes the expected operation surplus. To circumvent the exponential complexity of the dynamic program solution, we propose a closed-form and linear computation complexity co-optimization algorithm based on a relaxation-projection approach to a constrained stochastic dynamic program. Sufficient conditions for optimality for the proposed solution are obtained. Numerical studies demonstrate orders of magnitude reduction of computation costs and significantly reduced optimality gap.
△ Less
Submitted 8 May, 2024; v1 submitted 20 August, 2022;
originally announced August 2022.
-
giMLPs: Gate with Inhibition Mechanism in MLPs
Authors:
Cheng Kang,
Jindich Prokop,
Lei Tong,
Huiyu Zhou,
Yong Hu,
Daneil Novak
Abstract:
This paper presents a new model architecture, gate with inhibition MLP (giMLP).The gate with inhibition on CycleMLP (gi-CycleMLP) can produce equal performance on the ImageNet classification task, and it also improves the BERT, Roberta, and DeBERTaV3 models depending on two novel techniques. The first is the gating MLP, where matrix multiplications between the MLP and the trunk Attention input in…
▽ More
This paper presents a new model architecture, gate with inhibition MLP (giMLP).The gate with inhibition on CycleMLP (gi-CycleMLP) can produce equal performance on the ImageNet classification task, and it also improves the BERT, Roberta, and DeBERTaV3 models depending on two novel techniques. The first is the gating MLP, where matrix multiplications between the MLP and the trunk Attention input in further adjust models' adaptation. The second is inhibition which inhibits or enhances the branch adjustment, and with the inhibition levels increasing, it offers models more muscular features restriction. We show that the giCycleMLP with a lower inhibition level can be competitive with the original CycleMLP in terms of ImageNet classification accuracy. In addition, we also show through a comprehensive empirical study that these techniques significantly improve the performance of fine-tuning NLU downstream tasks. As for the gate with inhibition MLPs on DeBERTa (giDeBERTa) fine-tuning, we find it can achieve appealing results on most parts of NLU tasks without any extra pretraining again. We also find that with the use of Gate With Inhibition, the activation function should have a short and smooth negative tail, with which the unimportant features or the features that hurt models can be moderately inhibited. The experiments on ImageNet and twelve language downstream tasks demonstrate the effectiveness of Gate With Inhibition, both for image classification and for enhancing the capacity of nature language fine-tuning without any extra pretraining.
△ Less
Submitted 2 August, 2022; v1 submitted 1 August, 2022;
originally announced August 2022.
-
Gain-gain and gain-lossless PT-symmetry broken from PT-phase diagram
Authors:
Qi Zhang,
Yun Ma,
Qi Liu,
Xinchen Zhang,
Yali Jia,
Limin Tong,
Qihuang Gong,
Ying Gu
Abstract:
Parity-time (PT) symmetry and broken in micro/nano photonic structures have been investigated extensively as they bring new opportunities to control the flow of light based on non-Hermitian optics. Previous studies have focused on the situations of PT-symmetry broken in loss-loss or gain-loss coupling systems. Here, we theoretically predict the gain-gain and gain-lossless PT-broken from phase diag…
▽ More
Parity-time (PT) symmetry and broken in micro/nano photonic structures have been investigated extensively as they bring new opportunities to control the flow of light based on non-Hermitian optics. Previous studies have focused on the situations of PT-symmetry broken in loss-loss or gain-loss coupling systems. Here, we theoretically predict the gain-gain and gain-lossless PT-broken from phase diagram, where the boundaries between PT-symmetry and PT-broken can be clearly defined in the full-parameter space including gain, lossless and loss. For specific micro/nano photonic structures, such as coupled waveguides, we give the transmission matrices of each phase space, which can be used for beam splitting. Taking coupled waveguides as an example, we obtain periodic energy exchange in PT-symmetry phase and exponential gain or loss in PT-broken phase, which are consistent with the phase diagram. The scenario giving a full view of PT-symmetry or broken, will not only deepen the understanding of fundamental physics, but also will promote the breakthrough of photonic applications like optical routers and beam splitters.
△ Less
Submitted 18 July, 2022;
originally announced July 2022.
-
Constrained D-optimal Design for Paid Research Study
Authors:
Yifei Huang,
Liping Tong,
Jie Yang
Abstract:
We consider constrained sampling problems in paid research studies or clinical trials. When qualified volunteers are more than the budget allowed, we recommend a D-optimal sampling strategy based on the optimal design theory and develop a constrained lift-one algorithm to find the optimal allocation. Unlike the literature which mainly deals with linear models, our solution solves the constrained s…
▽ More
We consider constrained sampling problems in paid research studies or clinical trials. When qualified volunteers are more than the budget allowed, we recommend a D-optimal sampling strategy based on the optimal design theory and develop a constrained lift-one algorithm to find the optimal allocation. Unlike the literature which mainly deals with linear models, our solution solves the constrained sampling problem under fairly general statistical models, including generalized linear models and multinomial logistic models, and with more general constraints. We justify theoretically the optimality of our sampling strategy and show by simulation studies and real-world examples the advantages over simple random sampling and proportionally stratified sampling strategies.
△ Less
Submitted 24 May, 2024; v1 submitted 11 July, 2022;
originally announced July 2022.
-
Competitive DER Aggregation for Participation in Wholesale Markets
Authors:
Cong Chen,
Ahmed S. Alahmed,
Timothy D. Mount,
Lang Tong
Abstract:
The problem of the large-scale aggregation of the behind-the-meter demand and generation resources by a distributed-energy-resource aggregator (DERA) is considered. As a profit-seeking wholesale market participant, a DERA maximizes its profit while providing competitive services to its customers with higher consumer/prosumer surpluses than those offered by the distribution utilities or community c…
▽ More
The problem of the large-scale aggregation of the behind-the-meter demand and generation resources by a distributed-energy-resource aggregator (DERA) is considered. As a profit-seeking wholesale market participant, a DERA maximizes its profit while providing competitive services to its customers with higher consumer/prosumer surpluses than those offered by the distribution utilities or community choice aggregators. A constrained profit maximization program for aggregating behind-the-meter generation and consumption resources is formulated, from which payment functions for the behind-the-meter consumptions and generations are derived. Also obtained are DERA's bid and offer curves for its participation in the wholesale energy market and the optimal schedule of behind-the-meter resources. It is shown that the proposed DERA's aggregation model can achieve market efficiency equivalent to that when its customers participate individually directly in the wholesale market.
△ Less
Submitted 1 July, 2022;
originally announced July 2022.
-
Direct observation of moiré flat-band breakdown at the edge of magic-angle twisted bilayer graphene
Authors:
Long-Jing Yin,
Ling-Hui Tong,
Yue-Ying Zhou,
Yang Zhang,
Yuan Tian,
Li Zhang,
Lijie Zhang,
Zhihui Qin
Abstract:
Low-energy moiré flat bands in magic-angle twisted bilayer graphene (tBG) have demonstrated incredible potentials to exhibit rich exotic quantum phenomena. Theoretically, the moiré flat bands of tBG are based on the extended structures, i.e., the moiré patterns with periodic boundary conditions. However, a fundamental question of whether the flat bands can exist in the graphene moiré patterns with…
▽ More
Low-energy moiré flat bands in magic-angle twisted bilayer graphene (tBG) have demonstrated incredible potentials to exhibit rich exotic quantum phenomena. Theoretically, the moiré flat bands of tBG are based on the extended structures, i.e., the moiré patterns with periodic boundary conditions. However, a fundamental question of whether the flat bands can exist in the graphene moiré patterns with a reduced structure symmetry, such as sample edges, remains unanswered. Here, via scanning tunneling microscopy and spectroscopy, we study the local electronic properties of a magic-angle tBG near the sample terminated edge and report a direct observation of breakdown of the moiré flat bands. We show that the moiré electronic structures, including the low-energy flat bands, can sufficiently exist in a complete moiré spot, i.e., a moiré supercell, right at the edge even the translational symmetry of the moiré patterns is broken in one direction. However, the flat-band characteristic is obviously absent in the incomplete moiré spots that are partly terminated by the edge. Our results indicate that a whole moiré spot is sufficient and indispensable for the generation of the effective moiré flat bands in tBG.
△ Less
Submitted 20 May, 2022;
originally announced May 2022.