Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
Behaviors Speak More: Achieving User Authentication Leveraging Facial Activities via mmWave Sensing
SenSys '24: Proceedings of the 22nd ACM Conference on Embedded Networked Sensor SystemsPages 169–183https://doi.org/10.1145/3666025.3699330Human faces have been widely adopted in many applications and systems requiring a high-security standard. Although face authentication is deemed to be mature nowadays, many existing works have demonstrated not only the privacy leakage of facial ...
- research-articleNovember 2024
Unveiling the impact of heterogeneous driving behaviors on traffic flow: A mesoscale multi-agent modeling approach
Computers and Electrical Engineering (CENG), Volume 119, Issue PAhttps://doi.org/10.1016/j.compeleceng.2024.109500AbstractThere are fewer simulation studies that comprehensively consider the impact of collision events due to heterogeneous driving behaviour on multi-lane traffic flow. This comprehensive study utilized multi-agent modeling to simulate the driver-...
- research-articleJanuary 2025
Advancing dynamic sparse training by exploring optimization opportunities
ICML'24: Proceedings of the 41st International Conference on Machine LearningArticle No.: 867, Pages 21606–21619Dynamic Sparse Training (DST) has been effectively addressing the substantial training resource requirements of increasingly large Deep Neural Networks (DNNs). Characterized by its dynamic "train-prune-grow" schedule during training, DST implicitly ...
- research-articleMay 2024
MalleTrain: Deep Neural Networks Training on Unfillable Supercomputer Nodes
ICPE '24: Proceedings of the 15th ACM/SPEC International Conference on Performance EngineeringPages 190–200https://doi.org/10.1145/3629526.3645035First-come first-serve scheduling can result in substantial (up to 10%) of transiently idle nodes on supercomputers. Recognizing that such unfilled nodes are well-suited for deep neural network (DNN) training, due to the flexible nature of DNN training ...
-
- research-articleMay 2024
Dynamic sparsity is channel-level sparsity learner
- Lu Yin,
- Gen Li,
- Meng Fang,
- Li Shen,
- Tianjin Huang,
- Zhangyang Wang,
- Vlado Menkovski,
- Xiaolong Ma,
- Mykola Pechenizkiy,
- Shiwei Liu
NIPS '23: Proceedings of the 37th International Conference on Neural Information Processing SystemsArticle No.: 2975, Pages 67993–68012Sparse training has received an upsurging interest in machine learning due to its tantalizing saving potential for the entire training process as well as inference. Dynamic sparse training (DST), as a leading sparse training approach, can train deep ...
- research-articleAugust 2023
Data level lottery ticket hypothesis for vision transformers
IJCAI '23: Proceedings of the Thirty-Second International Joint Conference on Artificial IntelligenceArticle No.: 153, Pages 1378–1386https://doi.org/10.24963/ijcai.2023/153The conventional lottery ticket hypothesis (LTH) claims that there exists a sparse subnetwork within a dense neural network and a proper random initialization method called the winning ticket, such that it can be trained from scratch to almost as good as ...
- ArticleOctober 2023
Dexterous Hand-Object Interaction Control Based on Adaptive Impedance Algorithm
AbstractAiming at the problem of contact force control of objects with different dynamic characteristics in the process of hand-object interaction of dexterous hands, this paper proposes a contact force control algorithm of dexterous hands based on ...
- ArticleOctober 2023
Soft Fingertip with Sensor Integrated for Continuous In-hand Manipulation
AbstractThe human hand’s fingers are capable of precise manipulation due to the abundance of neural receptors in them. These receptors provide interactive feedback to the brain in real-time. However, complex sensors are difficult to integrate into the ...
- research-articleJuly 2023
Smart Road Stud-Empowered Vehicle Magnetic Field Distribution and Vehicle Detection
IEEE Transactions on Intelligent Transportation Systems (ITS-TRANSACTIONS), Volume 24, Issue 7Pages 7357–7362https://doi.org/10.1109/TITS.2023.3257837A self-designed AMR detector named Smart Road Stud (SRS) is proposed. SRS, installed along lane markings, is not only a detector but also a lane markings enhancement device. Because a single SRS needs to detect vehicles on two lanes, the vehicle detection ...
InfiniStore: Elastic Serverless Cloud Storage
- Jingyuan Zhang,
- Ao Wang,
- Xiaolong Ma,
- Benjamin Carver,
- Nicholas John Newman,
- Ali Anwar,
- Lukas Rupprecht,
- Vasily Tarasov,
- Dimitrios Skourtis,
- Feng Yan,
- Yue Cheng
Proceedings of the VLDB Endowment (PVLDB), Volume 16, Issue 7Pages 1629–1642https://doi.org/10.14778/3587136.3587139Cloud object storage such as AWS S3 is cost-effective and highly elastic but relatively slow, while high-performance cloud storage such as AWS ElastiCache is expensive and provides limited elasticity. We present a new cloud storage service called ...
- research-articleFebruary 2023
Peeling the onion: hierarchical reduction of data redundancy for efficient vision transformer training
- Zhenglun Kong,
- Haoyu Ma,
- Geng Yuan,
- Mengshu Sun,
- Yanyue Xie,
- Peiyan Dong,
- Xin Meng,
- Xuan Shen,
- Hao Tang,
- Minghai Qin,
- Tianlong Chen,
- Xiaolong Ma,
- Xiaohui Xie,
- Zhangyang Wang,
- Yanzhi Wang
AAAI'23/IAAI'23/EAAI'23: Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial IntelligenceArticle No.: 939, Pages 8360–8368https://doi.org/10.1609/aaai.v37i7.26008Vision transformers (ViTs) have recently obtained success in many applications, but their intensive computation and heavy memory usage at both training and inference time limit their generalization. Previous compression algorithms usually start from the ...
- ArticleOctober 2022
SPViT: Enabling Faster Vision Transformers via Latency-Aware Soft Token Pruning
- Zhenglun Kong,
- Peiyan Dong,
- Xiaolong Ma,
- Xin Meng,
- Wei Niu,
- Mengshu Sun,
- Xuan Shen,
- Geng Yuan,
- Bin Ren,
- Hao Tang,
- Minghai Qin,
- Yanzhi Wang
AbstractRecently, Vision Transformer (ViT) has continuously established new milestones in the computer vision field, while the high computation and memory cost makes its propagation in industrial production difficult. Considering the computation ...
- ArticleOctober 2022
You Already Have It: A Generator-Free Low-Precision DNN Training Framework Using Stochastic Rounding
- Geng Yuan,
- Sung-En Chang,
- Qing Jin,
- Alec Lu,
- Yanyu Li,
- Yushu Wu,
- Zhenglun Kong,
- Yanyue Xie,
- Peiyan Dong,
- Minghai Qin,
- Xiaolong Ma,
- Xulong Tang,
- Zhenman Fang,
- Yanzhi Wang
AbstractStochastic rounding is a critical technique used in low-precision deep neural networks (DNNs) training to ensure good model accuracy. However, it requires a large number of random numbers generated on the fly. This is not a trivial task on the ...
- articleOctober 2022
Recognition of Air Passengers' Willingness to Pay for Seat Selection for Imbalanced Data Based on Improved XGBoost
International Journal of Cognitive Informatics and Natural Intelligence (IJCINI-IGI), Volume 16, Issue 1Pages 1–20https://doi.org/10.4018/IJCINI.312249Passenger-paid seat selection is one of the important sources of ancillary revenue for airlines, and machine learning-based willingness-to-pay identification is of great practicality for airlines to accurately tap potential willing passengers. However,...
- research-articleOctober 2022
GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices Based on Fine-Grained Structured Weight Sparsity
IEEE Transactions on Pattern Analysis and Machine Intelligence (ITPM), Volume 44, Issue 10_Part_1Pages 6224–6239https://doi.org/10.1109/TPAMI.2021.3089687It is appealing but challenging to achieve real-time deep neural network (DNN) inference on mobile devices, because even the powerful modern mobile devices are considered as “resource-constrained” when executing large-scale DNNs. It ...
- ArticleAugust 2022
Simulation of Model Reference Adaptive Compliance Control Based on Environmental Stiffness Parameter Identification
AbstractThis paper describes an impedance control strategy based on model reference adaptation in unstructured environment, aimed at the uncertainty of the environmental stiffness and the unknown of the dynamic change of the environmental position during ...
- research-articleAugust 2022
Hardware-efficient stochastic rounding unit design for DNN training: late breaking results
- Sung-En Chang,
- Geng Yuan,
- Alec Lu,
- Mengshu Sun,
- Yanyu Li,
- Xiaolong Ma,
- Zhengang Li,
- Yanyue Xie,
- Minghai Qin,
- Xue Lin,
- Zhenman Fang,
- Yanzhi Wang
DAC '22: Proceedings of the 59th ACM/IEEE Design Automation ConferencePages 1396–1397https://doi.org/10.1145/3489517.3530619Stochastic rounding is crucial in the training of low-bit deep neural networks (DNNs) to achieve high accuracy. Unfortunately, prior studies require a large number of high-precision stochastic rounding units (SRUs) to guarantee the low-bit DNN accuracy, ...
- research-articleAugust 2022
Optimizing Data Layout for Training Deep Neural Networks
WWW '22: Companion Proceedings of the Web Conference 2022Pages 548–554https://doi.org/10.1145/3487553.3524856The widespread popularity of deep neural networks (DNNs) has made it an important workload in modern datacenters. Training DNNs is both computation-intensive and memory-intensive. While prior works focus on training parallelization (e.g., data ...
- research-articleMay 2022
Fault-tolerant deep neural networks for processing-in-memory based autonomous edge systems
DATE '22: Proceedings of the 2022 Conference & Exhibition on Design, Automation & Test in EuropePages 424–429In-memory deep neural network (DNN) accelerators will be the key for energy-efficient autonomous edge systems. The resistive random access memory (ReRAM) is a potential solution for the non-CMOS-based in-memory computing platform for energy-efficient ...