Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleJuly 2024
Lessons from Benchmarking the AI Tennessee Initiative Resources
PEARC '24: Practice and Experience in Advanced Research Computing 2024: Human Powered ComputingJuly 2024, Article No.: 15, Pages 1–8https://doi.org/10.1145/3626203.3670524Artificial intelligence computational capabilities are emerging as an important capability for research across many disciplines and having access to these capabilities is also a key component in research training for developing the future, skilled AI ...
- research-articleJuly 2024JUST ACCEPTED
Optimization Applications as Quantum Performance Benchmarks
- Thomas Lubinski,
- Carleton Coffrin,
- Catherine McGeoch,
- Pratik Sathe,
- Joshua Apanavicius,
- David Bernal Neira,
Combinatorial optimization is anticipated to be one of the primary use cases for quantum computation in the coming years. The Quantum Approximate Optimization Algorithm (QAOA) and Quantum Annealing (QA) can potentially demonstrate significant run-time ...
- research-articleJuly 2024
Static Application Security Testing (SAST) Tools for Smart Contracts: How Far Are We?
Proceedings of the ACM on Software Engineering (PACMSE), Volume 1, Issue FSEArticle No.: 65, Pages 1447–1470https://doi.org/10.1145/3660772In recent years, the importance of smart contract security has been heightened by the increasing number of attacks against them. To address this issue, a multitude of static application security testing (SAST) tools have been proposed for detecting ...
- research-articleJuly 2024
Online human motion analysis in industrial context: A review
Engineering Applications of Artificial Intelligence (EAAI), Volume 131, Issue CMay 2024https://doi.org/10.1016/j.engappai.2024.107850AbstractHuman motion analysis plays a crucial role in industry 4.0 and, more recently, in industry 5.0 where human-centered applications are becoming increasingly important, demonstrating its potential for enhancing safety, ergonomics and productivity. ...
- research-articleMarch 2024
Design, implementation, and validation of a benchmark generator for combinatorial interaction testing tools
Journal of Systems and Software (JSSO), Volume 209, Issue CMar 2024https://doi.org/10.1016/j.jss.2023.111920AbstractCombinatorial testing is a widely adopted technique for efficiently detecting faults in software. The quality of combinatorial test generators plays a crucial role in achieving effective test coverage. Evaluating combinatorial test generators ...
Highlights- Combinatorial test generators are hard to assess without benchmarks.
- We present BenCIGen, which generates benchmarks for testing and evaluating CIT tools.
- BenCIGen embeds a Model Analyzer extracting its configuration from a ...
-
- research-articleJanuary 2024
A Memetic Approach to Multi-Disciplinary Design and Numerical Optimization Problems using Intensify Slime Mould Optimizer
Applied Intelligence (KLU-APIN), Volume 54, Issue 2Jan 2024, Pages 2031–2083https://doi.org/10.1007/s10489-023-05073-7AbstractA new memetic metaheuristic optimizer, hybridizing the classical Slime Mould Optimization Algorithm (SMA) with Harris hawk’s Optimizer (HHO), is developed. The proposed hSMA-HHO is based on SMA- a swarm-inspired population metaheuristics algorithm ...
- research-articleJanuary 2024
Are neural architecture search benchmarks well designed? A deeper look into operation importance
Information Sciences: an International Journal (ISCI), Volume 650, Issue CDec 2023https://doi.org/10.1016/j.ins.2023.119695AbstractNeural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information of trained neural ...
- ArticleDecember 2023
Benchmark: Neural Network Malware Classification
Bridging the Gap Between AI and RealityOct 2023, Pages 291–298https://doi.org/10.1007/978-3-031-46002-9_17AbstractAs malware threats continue to increase in both complexity and sophistication, the adoption of advanced detection methods, such as deep neural networks (DNNs) for malware classification, has become increasingly vital to safeguard digital ...
Benchmarking Robustness of AI-Enabled Multi-sensor Fusion Systems: Challenges and Opportunities
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software EngineeringNovember 2023, Pages 871–882https://doi.org/10.1145/3611643.3616278Multi-Sensor Fusion (MSF) based perception systems have been the foundation in supporting many industrial applications and domains, such as self-driving cars, robotic arms, and unmanned aerial vehicles. Over the past few years, the fast progress in ...
- research-articleNovember 2023
Comparison and Evaluation on Static Application Security Testing (SAST) Tools for Java
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software EngineeringNovember 2023, Pages 921–933https://doi.org/10.1145/3611643.3616262Static application security testing (SAST) takes a significant role in the software development life cycle (SDLC). However, it is challenging to comprehensively evaluate the effectiveness of SAST tools to determine which is the better one for detecting ...
- ArticleSeptember 2023
The Metric is the Message: Benchmarking Challenges for Neural Symbolic Regression
Machine Learning and Knowledge Discovery in Databases: Research TrackSep 2023, Pages 161–177https://doi.org/10.1007/978-3-031-43421-1_10AbstractThe neural symbolic regression (NSR) literature has thus far been hindered by an over-reliance on individual, ad hoc evaluation metrics, producing seemingly favorable performance for the method using it but making comparison between methods ...
- research-articleSeptember 2023
DPU-Bench: A Micro-Benchmark Suite to Measure Offload Efficiency Of SmartNICs
PEARC '23: Practice and Experience in Advanced Research Computing 2023: Computing for the Common GoodJuly 2023, Pages 94–101https://doi.org/10.1145/3569951.3593595Smart Network Interface Cards (SmartNIC) have experienced massive growth in popularity over the last few years such as the NVIDIA BlueField-2 Data Processing Unit (DPU). Being equipped with their own set of cores and memory allows them to perform ...
- research-articleSeptember 2023
ChampKit: A framework for rapid evaluation of deep neural networks for patch-based histopathology classification
Computer Methods and Programs in Biomedicine (CBIO), Volume 239, Issue CSep 2023https://doi.org/10.1016/j.cmpb.2023.107631Highlights- We present ChampKit, a Python-based software package that enables rapid exploration and evaluation of deep learning models for patch-level classification of ...
Histopathology is the gold standard for diagnosis of many cancers. Recent advances in computer vision, specifically deep learning, have facilitated the analysis of histopathology images for many ...
- research-articleAugust 2023
On Efficiency and Usability of Group Signatures on Smartphone and Single-board Platforms
ARES '23: Proceedings of the 18th International Conference on Availability, Reliability and SecurityAugust 2023, Article No.: 127, Pages 1–9https://doi.org/10.1145/3600160.3605015With increasing digitalization and omnipresent data sensing, security and users’ privacy become essential requirements in new digital services. Group Signatures (GS) or also known as Anonymous Digital Signatures (ADS) are often used as a core Privacy-...
- research-articleJuly 2023
NPDP benchmark suite for the evaluation of the effectiveness of automatic optimizing compilers
AbstractThe paper presents a benchmark suite of ten non-serial polyadic dynamic programming (NPDP) kernels, which are designed to test the efficiency of tiled code generated by polyhedral optimization compilers. These kernels are mainly ...
Highlights- NPDP Benchmark Suite for the Evaluation of Automatic Optimizing Compilers.
- NPDP ...
- research-articleJune 2023
WebAssembly as an Enabler for Next Generation Serverless Computing
Journal of Grid Computing (SPJGC), Volume 21, Issue 3Sep 2023https://doi.org/10.1007/s10723-023-09669-8AbstractWebAssembly is a new binary instruction format and runtime environment capable of executing both client side and server side workloads. With its numerous advantages, including drastically reduced cold start times, efficiency, easy portability, and ...
- research-articleMay 2023
Formulations and an adaptive large neighborhood search for just-in-time scheduling of unrelated parallel machines with a common due window
Computers and Operations Research (CORS), Volume 153, Issue CMay 2023https://doi.org/10.1016/j.cor.2023.106159AbstractIn this paper, we address an unrelated parallel machine scheduling problem inspired by aspects of semiconductor manufacturing and other production systems. The objective is to minimize the total sum of weighted earliness and tardiness ...
Highlights- New optimization problem involving just-in-time scheduling in unrelated parallel machines (UPMSP).
- posterApril 2023
Measuring Potential Performance Gains of Python Web Applications with pyUpgradeSim
WWW '23 Companion: Companion Proceedings of the ACM Web Conference 2023April 2023, Pages 164–167https://doi.org/10.1145/3543873.3587338Python is a popular programming language for web development. However, optimizing the performance of Python web applications is a challenging task for developers. This paper presents a new approach to measuring the potential performance gains of upgraded ...
- research-articleApril 2023
Continual Object Detection: A review of definitions, strategies, and challenges
Neural Networks (NENE), Volume 161, Issue CApr 2023, Pages 476–493https://doi.org/10.1016/j.neunet.2023.01.041AbstractThe field of Continual Learning investigates the ability to learn consecutive tasks without losing performance on those previously learned. The efforts of researchers have been mainly focused on incremental classification tasks. Yet, we believe ...
Highlights- Overview of the class-incremental object detection field, its trends, and directions.
- A short systematic review of current strategies, benchmarks and metrics for the field.
- A new metric to quantify the predictive performance of ...
- ArticleMarch 2023
Benchmarking Considerations for Trustworthy and Responsible AI (Panel)
Performance Evaluation and BenchmarkingSep 2022, Pages 110–119https://doi.org/10.1007/978-3-031-29576-8_8AbstractContinuing growth of Artificial Intelligence (AI) adoption across enterprises and governments around the world has fueled the demand for trustworthy AI systems and applications. The need ranges from the so-called Explainable or Interpretable AI to ...