Showing 1–35 of 35 results for author: Armin, A

Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video Dataset

Authors: Rahm Ranjan, David Ahmedt-Aristizabal, Mohammad Ali Armin, Juno Kim

Abstract: Clinical gait analysis (CGA) using computer vision is an emerging field in artificial intelligence that faces barriers of accessible, real-world data, and clear task objectives. This paper lays the foundation for current developments in CGA as well as vision-based methods and datasets suitable for gait analysis. We introduce The Gait Abnormality in Video Dataset (GAVD) in response to our review of… ▽ More Clinical gait analysis (CGA) using computer vision is an emerging field in artificial intelligence that faces barriers of accessible, real-world data, and clear task objectives. This paper lays the foundation for current developments in CGA as well as vision-based methods and datasets suitable for gait analysis. We introduce The Gait Abnormality in Video Dataset (GAVD) in response to our review of over 150 current gait-related computer vision datasets, which highlighted the need for a large and accessible gait dataset clinically annotated for CGA. GAVD stands out as the largest video gait dataset, comprising 1874 sequences of normal, abnormal and pathological gaits. Additionally, GAVD includes clinically annotated RGB data sourced from publicly available content on online platforms. It also encompasses over 400 subjects who have undergone clinical grade visual screening to represent a diverse range of abnormal gait patterns, captured in various settings, including hospital clinics and urban uncontrolled outdoor environments. We demonstrate the validity of the dataset and utility of action recognition models for CGA using pretrained models Temporal Segment Networks(TSN) and SlowFast network to achieve video abnormality detection of 94% and 92% respectively when tested on GAVD dataset. A GitHub repository https://github.com/Rahmyyy/GAVD consisting of convenient URL links, and clinically relevant annotation for CGA is provided for over 450 online videos, featuring diverse subjects performing a range of normal, pathological, and abnormal gait patterns. △ Less

Submitted 4 July, 2024; originally announced July 2024.

ACM Class: I.2.10

Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation

Authors: Sam Cantrill, David Ahmedt-Aristizabal, Lars Petersson, Hanna Suominen, Mohammad Ali Armin

Abstract: Camera-based remote photoplethysmography (rPPG) enables contactless measurement of important physiological signals such as pulse rate (PR). However, dynamic and unconstrained subject motion introduces significant variability into the facial appearance in video, confounding the ability of video-based methods to accurately extract the rPPG signal. In this study, we leverage the 3D facial surface to… ▽ More Camera-based remote photoplethysmography (rPPG) enables contactless measurement of important physiological signals such as pulse rate (PR). However, dynamic and unconstrained subject motion introduces significant variability into the facial appearance in video, confounding the ability of video-based methods to accurately extract the rPPG signal. In this study, we leverage the 3D facial surface to construct a novel orientation-conditioned facial texture video representation which improves the motion robustness of existing video-based facial rPPG estimation methods. Our proposed method achieves a significant 18.2% performance improvement in cross-dataset testing on MMPD over our baseline using the PhysNet model trained on PURE, highlighting the efficacy and generalization benefits of our designed video representation. We demonstrate significant performance improvements of up to 29.6% in all tested motion scenarios in cross-dataset testing on MMPD, even in the presence of dynamic and unconstrained subject motion, emphasizing the benefits of disentangling motion through modeling the 3D facial surface for motion robust facial rPPG estimation. We validate the efficacy of our design decisions and the impact of different video processing steps through an ablation study. Our findings illustrate the potential strengths of exploiting the 3D facial surface as a general strategy for addressing dynamic and unconstrained subject motion in videos. The code is available at https://samcantrill.github.io/orientation-uv-rppg/. △ Less

Submitted 1 May, 2024; v1 submitted 14 April, 2024; originally announced April 2024.

Comments: 12 pages, 8 figures, 6 tables; minor corrections

ACM Class: I.4.9

Deep Learning Approaches for Seizure Video Analysis: A Review

Authors: David Ahmedt-Aristizabal, Mohammad Ali Armin, Zeeshan Hayder, Norberto Garcia-Cairasco, Lars Petersson, Clinton Fookes, Simon Denman, Aileen McGonigal

Abstract: Seizure events can manifest as transient disruptions in the control of movements which may be organized in distinct behavioral sequences, accompanied or not by other observable features such as altered facial expressions. The analysis of these clinical signs, referred to as semiology, is subject to observer variations when specialists evaluate video-recorded events in the clinical setting. To enha… ▽ More Seizure events can manifest as transient disruptions in the control of movements which may be organized in distinct behavioral sequences, accompanied or not by other observable features such as altered facial expressions. The analysis of these clinical signs, referred to as semiology, is subject to observer variations when specialists evaluate video-recorded events in the clinical setting. To enhance the accuracy and consistency of evaluations, computer-aided video analysis of seizures has emerged as a natural avenue. In the field of medical applications, deep learning and computer vision approaches have driven substantial advancements. Historically, these approaches have been used for disease detection, classification, and prediction using diagnostic data; however, there has been limited exploration of their application in evaluating video-based motion detection in the clinical epileptology setting. While vision-based technologies do not aim to replace clinical expertise, they can significantly contribute to medical decision-making and patient care by providing quantitative evidence and decision support. Behavior monitoring tools offer several advantages such as providing objective information, detecting challenging-to-observe events, reducing documentation efforts, and extending assessment capabilities to areas with limited expertise. The main applications of these could be (1) improved seizure detection methods; (2) refined semiology analysis for predicting seizure type and cerebral localization. In this paper, we detail the foundation technologies used in vision-based systems in the analysis of seizure videos, highlighting their success in semiology detection and analysis, focusing on work published in the last 7 years. Additionally, we illustrate how existing technologies can be interconnected through an integrated system for video-based semiology analysis. △ Less

Submitted 4 March, 2024; v1 submitted 17 December, 2023; originally announced December 2023.

Comments: Accepted in Epilepsy & Behavior

Syn3DWound: A Synthetic Dataset for 3D Wound Bed Analysis

Authors: Léo Lebrat, Rodrigo Santa Cruz, Remi Chierchia, Yulia Arzhaeva, Mohammad Ali Armin, Joshua Goldsmith, Jeremy Oorloff, Prithvi Reddy, Chuong Nguyen, Lars Petersson, Michelle Barakat-Johnson, Georgina Luscombe, Clinton Fookes, Olivier Salvado, David Ahmedt-Aristizabal

Abstract: Wound management poses a significant challenge, particularly for bedridden patients and the elderly. Accurate diagnostic and healing monitoring can significantly benefit from modern image analysis, providing accurate and precise measurements of wounds. Despite several existing techniques, the shortage of expansive and diverse training datasets remains a significant obstacle to constructing machine… ▽ More Wound management poses a significant challenge, particularly for bedridden patients and the elderly. Accurate diagnostic and healing monitoring can significantly benefit from modern image analysis, providing accurate and precise measurements of wounds. Despite several existing techniques, the shortage of expansive and diverse training datasets remains a significant obstacle to constructing machine learning-based frameworks. This paper introduces Syn3DWound, an open-source dataset of high-fidelity simulated wounds with 2D and 3D annotations. We propose baseline methods and a benchmarking framework for automated 3D morphometry analysis and 2D/3D wound segmentation. △ Less

Submitted 3 March, 2024; v1 submitted 27 November, 2023; originally announced November 2023.

Comments: In the IEEE International Symposium on Biomedical Imaging (ISBI) 2024

Roadmap on Photovoltaic Absorber Materials for Sustainable Energy Conversion

Authors: James C. Blakesley, Ruy S. Bonilla, Marina Freitag, Alex M. Ganose, Nicola Gasparini, Pascal Kaienburg, George Koutsourakis, Jonathan D. Major, Jenny Nelson, Nakita K. Noel, Bart Roose, Jae Sung Yun, Simon Aliwell, Pietro P. Altermatt, Tayebeh Ameri, Virgil Andrei, Ardalan Armin, Diego Bagnis, Jenny Baker, Hamish Beath, Mathieu Bellanger, Philippe Berrouard, Jochen Blumberger, Stuart A. Boden, Hugo Bronstein , et al. (61 additional authors not shown)

Abstract: Photovoltaics (PVs) are a critical technology for curbing growing levels of anthropogenic greenhouse gas emissions, and meeting increases in future demand for low-carbon electricity. In order to fulfil ambitions for net-zero carbon dioxide equivalent (CO₂eq) emissions worldwide, the global cumulative capacity of solar PVs must increase by an order of magnitude from 0.9 TWp in 2021 to 8.… ▽ More Photovoltaics (PVs) are a critical technology for curbing growing levels of anthropogenic greenhouse gas emissions, and meeting increases in future demand for low-carbon electricity. In order to fulfil ambitions for net-zero carbon dioxide equivalent (CO₂eq) emissions worldwide, the global cumulative capacity of solar PVs must increase by an order of magnitude from 0.9 TWp in 2021 to 8.5 TWp by 2050 according to the International Renewable Energy Agency, which is considered to be a highly conservative estimate. In 2020, the Henry Royce Institute brought together the UK PV community to discuss the critical technological and infrastructure challenges that need to be overcome to address the vast challenges in accelerating PV deployment. Herein, we examine the key developments in the global community, especially the progress made in the field since this earlier roadmap, bringing together experts primarily from the UK across the breadth of the photovoltaics community. The focus is both on the challenges in improving the efficiency, stability and levelized cost of electricity of current technologies for utility-scale PVs, as well as the fundamental questions in novel technologies that can have a significant impact on emerging markets, such as indoor PVs, space PVs, and agrivoltaics. We discuss challenges in advanced metrology and computational tools, as well as the growing synergies between PVs and solar fuels, and offer a perspective on the environmental sustainability of the PV industry. Through this roadmap, we emphasize promising pathways forward in both the short- and long-term, and for communities working on technologies across a range of maturity levels to learn from each other. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Comments: 160 pages, 21 figures

A Unified Diode Equation for Organic Photovoltaic Devices

Authors: Oskar J Sandberg, Ardalan Armin

Abstract: Organic photovoltaics (OPVs) are promising candidates for future sustainable technologies, including applications within the renewable energy sector, such as solar cells and indoor light recycling, and photodetection. However, the performance of OPVs is still inferior compared to established technologies, partially due to the intrinsically low charge carrier mobilities and large recombination loss… ▽ More Organic photovoltaics (OPVs) are promising candidates for future sustainable technologies, including applications within the renewable energy sector, such as solar cells and indoor light recycling, and photodetection. However, the performance of OPVs is still inferior compared to established technologies, partially due to the intrinsically low charge carrier mobilities and large recombination losses in the low-permittivity, molecular organic semiconductors. To better understand these losses, accurate analytical diode models capable of capturing the underlying device physics are imperative. However, previously proposed analytical models have neglected the effects of injected charge carriers, which is the predominant source for bimolecular recombination in thin-film systems with ohmic contacts. In this work, we derive a unified diode equation for current in OPVs, which accounts for the interplay between charge carrier extraction, injection, and bimolecular recombination. To this end, we use a regional approximation approach to solve the coupled charge transport equations in sandwich-type thin film devices. The diode model is further validated by numerical simulations and experimental data. The derived theoretical framework not only provides vital insights into the underlying device physics of OPVs but is generally applicable to sandwich-type thin-film photovoltaic device based on semiconductors with low charge carrier mobilities. △ Less

Submitted 18 July, 2023; originally announced July 2023.

The Thermodynamic Limit of Indoor Photovoltaics Based on Energetically-Disordered Molecular Semiconductors

Authors: Austin M. Kay, Maura E. Fitzsimons, Gregory Burwell, Paul Meredith, Ardalan Armin, Oskar J. Sandberg

Abstract: Due to their tailorable optical properties, organic semiconductors show considerable promise for use in indoor photovoltaics (IPVs), which present a sustainable route for powering ubiquitous "Internet-of-Things" devices in the coming decades. However, owing to their excitonic and energetically disordered nature, organic semiconductors generally display considerable sub-gap absorption and relativel… ▽ More Due to their tailorable optical properties, organic semiconductors show considerable promise for use in indoor photovoltaics (IPVs), which present a sustainable route for powering ubiquitous "Internet-of-Things" devices in the coming decades. However, owing to their excitonic and energetically disordered nature, organic semiconductors generally display considerable sub-gap absorption and relatively large nonradiative losses in solar cells. To optimize organic semiconductor-based photovoltaics, it is therefore vital to understand how energetic disorder and non-radiative recombination limit the performance of these devices under indoor light sources. In this work, we explore how energetic disorder, sub-optical gap absorption, and non-radiative open-circuit voltage losses detrimentally affect the upper performance limits of organic semiconductor-based IPVs. Based on these considerations, we provide realistic upper estimates for the power conversion efficiency. The energetic disorder, inherently present in molecular semiconductors, is generally found to shift the optimal optical gap from 1.83 eV to ~1.9 eV for devices operating under LED spectra. Finally, we also describe a methodology (accompanied by a computational tool with a graphical user interface) for predicting IPV performance under arbitrary illumination conditions. Using this methodology, we estimate the indoor PCEs of several photovoltaic materials, including the state-of-the-art systems PM6:Y6 and PM6:BTP-eC9. △ Less

Submitted 14 June, 2023; v1 submitted 3 March, 2023; originally announced March 2023.

Comments: 26 main text pages, 6 main text figures, 48 supporting pages, 19 supporting figures, and 6 supporting tables

A Hyperspectral and RGB Dataset for Building Facade Segmentation

Authors: Nariman Habili, Ernest Kwan, Weihao Li, Christfried Webers, Jeremy Oorloff, Mohammad Ali Armin, Lars Petersson

Abstract: Hyperspectral Imaging (HSI) provides detailed spectral information and has been utilised in many real-world applications. This work introduces an HSI dataset of building facades in a light industry environment with the aim of classifying different building materials in a scene. The dataset is called the Light Industrial Building HSI (LIB-HSI) dataset. This dataset consists of nine categories and 4… ▽ More Hyperspectral Imaging (HSI) provides detailed spectral information and has been utilised in many real-world applications. This work introduces an HSI dataset of building facades in a light industry environment with the aim of classifying different building materials in a scene. The dataset is called the Light Industrial Building HSI (LIB-HSI) dataset. This dataset consists of nine categories and 44 classes. In this study, we investigated deep learning based semantic segmentation algorithms on RGB and hyperspectral images to classify various building materials, such as timber, brick and concrete. △ Less

Submitted 5 December, 2022; originally announced December 2022.

Automated Coronary Arteries Labeling Via Geometric Deep Learning

Authors: Yadan Li, Mohammad Ali Armin, Simon Denman, David Ahmedt-Aristizabal

Abstract: Automatic labelling of anatomical structures, such as coronary arteries, is critical for diagnosis, yet existing (non-deep learning) methods are limited by a reliance on prior topological knowledge of the expected tree-like structures. As the structure such vascular systems is often difficult to conceptualize, graph-based representations have become popular due to their ability to capture the geom… ▽ More Automatic labelling of anatomical structures, such as coronary arteries, is critical for diagnosis, yet existing (non-deep learning) methods are limited by a reliance on prior topological knowledge of the expected tree-like structures. As the structure such vascular systems is often difficult to conceptualize, graph-based representations have become popular due to their ability to capture the geometric and topological properties of the morphology in an orientation-independent and abstract manner. However, graph-based learning for automated labeling of tree-like anatomical structures has received limited attention in the literature. The majority of prior studies have limitations in the entity graph construction, are dependent on topological structures, and have limited accuracy due to the anatomical variability between subjects. In this paper, we propose an intuitive graph representation method, well suited to use with 3D coordinate data obtained from angiography scans. We subsequently seek to analyze subject-specific graphs using geometric deep learning. The proposed models leverage expert annotated labels from 141 patients to learn representations of each coronary segment, while capturing the effects of anatomical variability within the training data. We investigate different variants of so-called message passing neural networks. Through extensive evaluations, our pipeline achieves a promising weighted F1-score of 0.805 for labeling coronary artery (13 classes) for a five-fold cross-validation. Considering the ability of graph models in dealing with irregular data, and their scalability for data segmentation, this work highlights the potential of such methods to provide quantitative evidence to support the decisions of medical experts. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Journal ref: 2023 IEEE International Symposium on Biomedical Imaging (ISBI)

Vision-Based Activity Recognition in Children with Autism-Related Behaviors

Authors: Pengbo Wei, David Ahmedt-Aristizabal, Harshala Gammulle, Simon Denman, Mohammad Ali Armin

Abstract: Advances in machine learning and contactless sensors have enabled the understanding complex human behaviors in a healthcare setting. In particular, several deep learning systems have been introduced to enable comprehensive analysis of neuro-developmental conditions such as Autism Spectrum Disorder (ASD). This condition affects children from their early developmental stages onwards, and diagnosis r… ▽ More Advances in machine learning and contactless sensors have enabled the understanding complex human behaviors in a healthcare setting. In particular, several deep learning systems have been introduced to enable comprehensive analysis of neuro-developmental conditions such as Autism Spectrum Disorder (ASD). This condition affects children from their early developmental stages onwards, and diagnosis relies entirely on observing the child's behavior and detecting behavioral cues. However, the diagnosis process is time-consuming as it requires long-term behavior observation, and the scarce availability of specialists. We demonstrate the effect of a region-based computer vision system to help clinicians and parents analyze a child's behavior. For this purpose, we adopt and enhance a dataset for analyzing autism-related actions using videos of children captured in uncontrolled environments (e.g. videos collected with consumer-grade cameras, in varied environments). The data is pre-processed by detecting the target child in the video to reduce the impact of background noise. Motivated by the effectiveness of temporal convolutional models, we propose both light-weight and conventional models capable of extracting action features from video frames and classifying autism-related behaviors by analyzing the relationships between frames in a video. Through extensive evaluations on the feature extraction and learning strategies, we demonstrate that the best performance is achieved with an Inflated 3D Convnet and Multi-Stage Temporal Convolutional Networks, achieving a 0.83 Weighted F1-score for classification of the three autism-related actions, outperforming existing methods. We also propose a light-weight solution by employing the ESNet backbone within the same system, achieving competitive results of 0.71 Weighted F1-score, and enabling potential deployment on embedded systems. △ Less

Submitted 8 August, 2022; originally announced August 2022.

Journal ref: Heliyon, Volume 9, Issue 6, June 2023, e16763

You Only Cut Once: Boosting Data Augmentation with a Single Cut

Authors: Junlin Han, Pengfei Fang, Weihao Li, Jie Hong, Mohammad Ali Armin, Ian Reid, Lars Petersson, Hongdong Li

Abstract: We present You Only Cut Once (YOCO) for performing data augmentations. YOCO cuts one image into two pieces and performs data augmentations individually within each piece. Applying YOCO improves the diversity of the augmentation per sample and encourages neural networks to recognize objects from partial information. YOCO enjoys the properties of parameter-free, easy usage, and boosting almost all a… ▽ More We present You Only Cut Once (YOCO) for performing data augmentations. YOCO cuts one image into two pieces and performs data augmentations individually within each piece. Applying YOCO improves the diversity of the augmentation per sample and encourages neural networks to recognize objects from partial information. YOCO enjoys the properties of parameter-free, easy usage, and boosting almost all augmentations for free. Thorough experiments are conducted to evaluate its effectiveness. We first demonstrate that YOCO can be seamlessly applied to varying data augmentations, neural network architectures, and brings performance gains on CIFAR and ImageNet classification tasks, sometimes surpassing conventional image-level augmentation by large margins. Moreover, we show YOCO benefits contrastive pre-training toward a more powerful representation that can be better transferred to multiple downstream tasks. Finally, we study a number of variants of YOCO and empirically analyze the performance for respective settings. Code is available at GitHub. △ Less

Submitted 15 June, 2022; v1 submitted 28 January, 2022; originally announced January 2022.

Comments: ICML 2022, Code: https://github.com/JunlinHan/YOCO

Quantifying the Excitonic Static Disorder in Organic Semiconductors

Authors: Austin M. Kay, Oskar J. Sandberg, Nasim Zarrabi, Wei Li, Stefan Zeiske, Christina Kaiser, Paul Meredith, Ardalan Armin

Abstract: Organic semiconductors are disordered molecular solids and as a result, their internal charge dynamics and ultimately, the performance of the optoelectronic devices they constitute, are governed by energetic disorder. To ascertain how energetic disorder impacts charge generation, exciton transport, charge transport, and the performance of organic semiconductor devices, an accurate approach is firs… ▽ More Organic semiconductors are disordered molecular solids and as a result, their internal charge dynamics and ultimately, the performance of the optoelectronic devices they constitute, are governed by energetic disorder. To ascertain how energetic disorder impacts charge generation, exciton transport, charge transport, and the performance of organic semiconductor devices, an accurate approach is first required to measure this critical parameter. In this work, we show that the static disorder has no relation with the so-called Urbach energy in organic semiconductors. Instead, it can be obtained from photovoltaic external quantum efficiency spectra at wavelengths near the absorption onset. We then present a detailed methodology, alongside a computational framework, for quantifying the static energetic disorder associated with singlet excitons. Moreover, the role of optical interference in this analysis is considered to achieve a high-accuracy quantification. Finally, the excitonic static disorder was quantified in several technologically-relevant donor-acceptor blends, including high-efficiency PM6:Y6. △ Less

Submitted 14 December, 2021; originally announced December 2021.

Comments: 21 pages, 6 figures. 9 supplementary pages, 3 supplementary figures, and 4 supplementary tables. Submitted to Advanced Functional Materials

In-Bed Human Pose Estimation from Unseen and Privacy-Preserving Image Domains

Authors: Ting Cao, Mohammad Ali Armin, Simon Denman, Lars Petersson, David Ahmedt-Aristizabal

Abstract: Medical applications have benefited greatly from the rapid advancement in computer vision. Considering patient monitoring in particular, in-bed human posture estimation offers important health-related metrics with potential value in medical condition assessments. Despite great progress in this domain, it remains challenging due to substantial ambiguity during occlusions, and the lack of large corp… ▽ More Medical applications have benefited greatly from the rapid advancement in computer vision. Considering patient monitoring in particular, in-bed human posture estimation offers important health-related metrics with potential value in medical condition assessments. Despite great progress in this domain, it remains challenging due to substantial ambiguity during occlusions, and the lack of large corpora of manually labeled data for model training, particularly with domains such as thermal infrared imaging which are privacy-preserving, and thus of great interest. Motivated by the effectiveness of self-supervised methods in learning features directly from data, we propose a multi-modal conditional variational autoencoder (MC-VAE) capable of reconstructing features from missing modalities seen during training. This approach is used with HRNet to enable single modality inference for in-bed pose estimation. Through extensive evaluations, we demonstrate that body positions can be effectively recognized from the available modality, achieving on par results with baseline models that are highly dependent on having access to multiple modes at inference time. The proposed framework supports future research towards self-supervised learning that generates a robust model from a single source, and expects it to generalize over many unknown distributions in clinical environments. △ Less

Submitted 24 January, 2022; v1 submitted 29 November, 2021; originally announced November 2021.

Comments: In the IEEE International Symposium on Biomedical Imaging (ISBI)

Journal ref: ISBI 2022

The CSIRO Crown-of-Thorn Starfish Detection Dataset

Authors: Jiajun Liu, Brano Kusy, Ross Marchant, Brendan Do, Torsten Merz, Joey Crosswell, Andy Steven, Nic Heaney, Karl von Richter, Lachlan Tychsen-Smith, David Ahmedt-Aristizabal, Mohammad Ali Armin, Geoffrey Carlin, Russ Babcock, Peyman Moghadam, Daniel Smith, Tim Davis, Kemal El Moujahid, Martin Wicke, Megha Malpani

Abstract: Crown-of-Thorn Starfish (COTS) outbreaks are a major cause of coral loss on the Great Barrier Reef (GBR) and substantial surveillance and control programs are underway in an attempt to manage COTS populations to ecologically sustainable levels. We release a large-scale, annotated underwater image dataset from a COTS outbreak area on the GBR, to encourage research on Machine Learning and AI-driven… ▽ More Crown-of-Thorn Starfish (COTS) outbreaks are a major cause of coral loss on the Great Barrier Reef (GBR) and substantial surveillance and control programs are underway in an attempt to manage COTS populations to ecologically sustainable levels. We release a large-scale, annotated underwater image dataset from a COTS outbreak area on the GBR, to encourage research on Machine Learning and AI-driven technologies to improve the detection, monitoring, and management of COTS populations at reef scale. The dataset is released and hosted in a Kaggle competition that challenges the international Machine Learning community with the task of COTS detection from these underwater images. △ Less

Submitted 28 November, 2021; originally announced November 2021.

Learning To Segment Dominant Object Motion From Watching Videos

Authors: Sahir Shrestha, Mohammad Ali Armin, Hongdong Li, Nick Barnes

Abstract: Existing deep learning based unsupervised video object segmentation methods still rely on ground-truth segmentation masks to train. Unsupervised in this context only means that no annotated frames are used during inference. As obtaining ground-truth segmentation masks for real image scenes is a laborious task, we envision a simple framework for dominant moving object segmentation that neither requ… ▽ More Existing deep learning based unsupervised video object segmentation methods still rely on ground-truth segmentation masks to train. Unsupervised in this context only means that no annotated frames are used during inference. As obtaining ground-truth segmentation masks for real image scenes is a laborious task, we envision a simple framework for dominant moving object segmentation that neither requires annotated data to train nor relies on saliency priors or pre-trained optical flow maps. Inspired by a layered image representation, we introduce a technique to group pixel regions according to their affine parametric motion. This enables our network to learn segmentation of the dominant foreground object using only RGB image pairs as input for both training and inference. We establish a baseline for this novel task using a new MovingCars dataset and show competitive performance against recent methods that require annotated masks to train. △ Less

Submitted 28 November, 2021; originally announced November 2021.

Comments: DICTA 2021

Quantum trajectories, interference, and state localisation in dephasing assisted quantum transport

Authors: Kiran E. Khosla, Ardalan Armin, M. S. Kim

Abstract: Dephased quantum transport of excitations occurs when energetic fluctuations in a system are sufficient to suppress the built-up of coherent amplitudes. While this has been extensively studied in many different systems, a unified and comprehensive understanding of quantum assisted transport via on-site and coupling-induced dephasing processes is lacking. The aim of the present work is to present a… ▽ More Dephased quantum transport of excitations occurs when energetic fluctuations in a system are sufficient to suppress the built-up of coherent amplitudes. While this has been extensively studied in many different systems, a unified and comprehensive understanding of quantum assisted transport via on-site and coupling-induced dephasing processes is lacking. The aim of the present work is to present a simple and unified understanding of the role of these two key dephasing processes in dephasing assisted transport. Our work explicitly links continuous dephasing to classical and quantum transitions. We present a natural quantum trajectories explanation of how different coupling and dephasing terms alter the diffusion rate of excitations and how this is impacted by the onset of Anderson localized eigenstates. Our results provide insight in understanding quantum transport in molecular semiconductors, artificial lattices and quantum features of excitonic solids. △ Less

Submitted 4 November, 2021; originally announced November 2021.

Comments: 10 pages 6 Figures

A quasi steady-state measurement of exciton diffusion lengths in organic semiconductors

Authors: Drew B. Riley, Oskar J. Sandberg, Wei Li, Paul Meredith, Ardalan Armin

Abstract: Understanding the role that exciton diffusion plays in organic solar cells is a crucial to understanding the recent rise in power conversion effciencies brought about by non-fullerene acceptors (NFA). Established methods for measuring exciton diffusion lengths in organic solar cells require specialized equipment designed for measuring high-resolution time-resolved photoluminescence (TRPL). Here we… ▽ More Understanding the role that exciton diffusion plays in organic solar cells is a crucial to understanding the recent rise in power conversion effciencies brought about by non-fullerene acceptors (NFA). Established methods for measuring exciton diffusion lengths in organic solar cells require specialized equipment designed for measuring high-resolution time-resolved photoluminescence (TRPL). Here we introduce a technique, coined pulsed-PLQY, to measure the diffusion length of organic solar cells without any temporal measurements. Using a Monte-Carlo model we simulate the dynamics within a thin film semiconductor and analyse the results using both pulsed-PLQY and TRPL methods. We find that pulsed-PLQY has a larger operational region and depends less on the excitation fuence than the TRPL approach. We validate these simulated results by preforming both measurements on organic thin films and reproduce the predicted trends. Pulsed-PLQY is then used to evaluate the diffusion length in a variety of technologically relevant organic semiconductors. It is found that the diffusion lengths in NFA's are much larger than in the benchmark fullerene and that this increase is driven by an increase in diffusivity. △ Less

Submitted 26 January, 2022; v1 submitted 2 September, 2021; originally announced September 2021.

Blind Image Decomposition

Authors: Junlin Han, Weihao Li, Pengfei Fang, Chunyi Sun, Jie Hong, Mohammad Ali Armin, Lars Petersson, Hongdong Li

Abstract: We propose and study a novel task named Blind Image Decomposition (BID), which requires separating a superimposed image into constituent underlying images in a blind setting, that is, both the source components involved in mixing as well as the mixing mechanism are unknown. For example, rain may consist of multiple components, such as rain streaks, raindrops, snow, and haze. Rainy images can be tr… ▽ More We propose and study a novel task named Blind Image Decomposition (BID), which requires separating a superimposed image into constituent underlying images in a blind setting, that is, both the source components involved in mixing as well as the mixing mechanism are unknown. For example, rain may consist of multiple components, such as rain streaks, raindrops, snow, and haze. Rainy images can be treated as an arbitrary combination of these components, some of them or all of them. How to decompose superimposed images, like rainy images, into distinct source components is a crucial step toward real-world vision systems. To facilitate research on this new task, we construct multiple benchmark datasets, including mixed image decomposition across multiple domains, real-scenario deraining, and joint shadow/reflection/watermark removal. Moreover, we propose a simple yet general Blind Image Decomposition Network (BIDeN) to serve as a strong baseline for future work. Experimental results demonstrate the tenability of our benchmarks and the effectiveness of BIDeN. △ Less

Submitted 18 July, 2022; v1 submitted 25 August, 2021; originally announced August 2021.

Comments: ECCV 2022. Project page: https://junlinhan.github.io/projects/BID.html. Code: https://github.com/JunlinHan/BID

A Survey on Graph-Based Deep Learning for Computational Histopathology

Authors: David Ahmedt-Aristizabal, Mohammad Ali Armin, Simon Denman, Clinton Fookes, Lars Petersson

Abstract: With the remarkable success of representation learning for prediction problems, we have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. However, learning over patch-wise features using convolutional neural networks limits the ability of the model to capture global contextual information and comprehensively… ▽ More With the remarkable success of representation learning for prediction problems, we have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. However, learning over patch-wise features using convolutional neural networks limits the ability of the model to capture global contextual information and comprehensively model tissue composition. The phenotypical and topological distribution of constituent histological entities play a critical role in tissue diagnosis. As such, graph data representations and deep learning have attracted significant attention for encoding tissue representations, and capturing intra- and inter- entity level interactions. In this review, we provide a conceptual grounding for graph analytics in digital pathology, including entity-graph construction and graph architectures, and present their current success for tumor localization and classification, tumor invasion and staging, image retrieval, and survival prediction. We provide an overview of these methods in a systematic manner organized by the graph representation of the input image, scale, and organ on which they operate. We also outline the limitations of existing techniques, and suggest potential future research directions in this domain. △ Less

Submitted 27 September, 2021; v1 submitted 1 July, 2021; originally announced July 2021.

Comments: Preprint submitted to Computerized Medical Imaging and Graphics

Journal ref: Volume 95, January 2022, 102027

Underwater Image Restoration via Contrastive Learning and a Real-world Dataset

Authors: Junlin Han, Mehrdad Shoeiby, Tim Malthus, Elizabeth Botha, Janet Anstee, Saeed Anwar, Ran Wei, Mohammad Ali Armin, Hongdong Li, Lars Petersson

Abstract: Underwater image restoration is of significant importance in unveiling the underwater world. Numerous techniques and algorithms have been developed in the past decades. However, due to fundamental difficulties associated with imaging/sensing, lighting, and refractive geometric distortions, in capturing clear underwater images, no comprehensive evaluations have been conducted of underwater image re… ▽ More Underwater image restoration is of significant importance in unveiling the underwater world. Numerous techniques and algorithms have been developed in the past decades. However, due to fundamental difficulties associated with imaging/sensing, lighting, and refractive geometric distortions, in capturing clear underwater images, no comprehensive evaluations have been conducted of underwater image restoration. To address this gap, we have constructed a large-scale real underwater image dataset, dubbed `HICRD' (Heron Island Coral Reef Dataset), for the purpose of benchmarking existing methods and supporting the development of new deep-learning based methods. We employ accurate water parameter (diffuse attenuation coefficient) in generating reference images. There are 2000 reference restored images and 6003 original underwater images in the unpaired training set. Further, we present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images. Extensive experiments with comparisons to recent approaches further demonstrate the superiority of our proposed method. Our code and dataset are publicly available at GitHub. △ Less

Submitted 20 June, 2021; originally announced June 2021.

Comments: In submission, code/dataset are at https://github.com/JunlinHan/CWR. arXiv admin note: text overlap with arXiv:2103.09697

Video-Based Inpatient Fall Risk Assessment: A Case Study

Authors: Ziqing Wang, Mohammad Ali Armin, Simon Denman, Lars Petersson, David Ahmedt-Aristizabal

Abstract: Inpatient falls are a serious safety issue in hospitals and healthcare facilities. Recent advances in video analytics for patient monitoring provide a non-intrusive avenue to reduce this risk through continuous activity monitoring. However, in-bed fall risk assessment systems have received less attention in the literature. The majority of prior studies have focused on fall event detection, and do… ▽ More Inpatient falls are a serious safety issue in hospitals and healthcare facilities. Recent advances in video analytics for patient monitoring provide a non-intrusive avenue to reduce this risk through continuous activity monitoring. However, in-bed fall risk assessment systems have received less attention in the literature. The majority of prior studies have focused on fall event detection, and do not consider the circumstances that may indicate an imminent inpatient fall. Here, we propose a video-based system that can monitor the risk of a patient falling, and alert staff of unsafe behaviour to help prevent falls before they occur. We propose an approach that leverages recent advances in human localisation and skeleton pose estimation to extract spatial features from video frames recorded in a simulated environment. We demonstrate that body positions can be effectively recognised and provide useful evidence for fall risk assessment. This work highlights the benefits of video-based models for analysing behaviours of interest, and demonstrates how such a system could enable sufficient lead time for healthcare professionals to respond and address patient needs, which is necessary for the development of fall intervention programs. △ Less

Submitted 27 May, 2021; originally announced June 2021.

Journal ref: IEEE Engineering in Medicine & Biology Society (EMBC) 2021

Towards Interpretable Attention Networks for Cervical Cancer Analysis

Authors: Ruiqi Wang, Mohammad Ali Armin, Simon Denman, Lars Petersson, David Ahmedt-Aristizabal

Abstract: Recent advances in deep learning have enabled the development of automated frameworks for analysing medical images and signals, including analysis of cervical cancer. Many previous works focus on the analysis of isolated cervical cells, or do not offer sufficient methods to explain and understand how the proposed models reach their classification decisions on multi-cell images. Here, we evaluate v… ▽ More Recent advances in deep learning have enabled the development of automated frameworks for analysing medical images and signals, including analysis of cervical cancer. Many previous works focus on the analysis of isolated cervical cells, or do not offer sufficient methods to explain and understand how the proposed models reach their classification decisions on multi-cell images. Here, we evaluate various state-of-the-art deep learning models and attention-based frameworks for the classification of images of multiple cervical cells. As we aim to provide interpretable deep learning models to address this task, we also compare their explainability through the visualization of their gradients. We demonstrate the importance of using images that contain multiple cells over using isolated single-cell images. We show the effectiveness of the residual channel attention model for extracting important features from a group of cells, and demonstrate this model's efficiency for this classification task. This work highlights the benefits of channel attention mechanisms in analyzing multiple-cell images for potential relations and distributions within a group of cells. It also provides interpretable models to address the classification of cervical cells. △ Less

Submitted 27 May, 2021; originally announced June 2021.

Journal ref: IEEE Engineering in Medicine & Biology Society (EMBC) 2021

Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future

Authors: David Ahmedt-Aristizabal, Mohammad Ali Armin, Simon Denman, Clinton Fookes, Lars Petersson

Abstract: With the advances of data-driven machine learning research, a wide variety of prediction problems have been tackled. It has become critical to explore how machine learning and specifically deep learning methods can be exploited to analyse healthcare data. A major limitation of existing methods has been the focus on grid-like data; however, the structure of physiological recordings are often irregu… ▽ More With the advances of data-driven machine learning research, a wide variety of prediction problems have been tackled. It has become critical to explore how machine learning and specifically deep learning methods can be exploited to analyse healthcare data. A major limitation of existing methods has been the focus on grid-like data; however, the structure of physiological recordings are often irregular and unordered which makes it difficult to conceptualise them as a matrix. As such, graph neural networks have attracted significant attention by exploiting implicit information that resides in a biological system, with interactive nodes connected by edges whose weights can be either temporal associations or anatomical junctions. In this survey, we thoroughly review the different types of graph architectures and their applications in healthcare. We provide an overview of these methods in a systematic manner, organized by their domain of application including functional connectivity, anatomical structure and electrical-based analysis. We also outline the limitations of existing techniques and discuss potential directions for future research. △ Less

Submitted 27 May, 2021; originally announced May 2021.

Journal ref: Sensors 2021, 21, 4758

Energetics and Kinetics Requirements for Organic Solar Cells to 2 Break the 20% Power Conversion Efficiency Barrier

Authors: Oskar J Sandberg, Ardalan Armin

Abstract: The thermodynamic limit for the efficiency of solar cells is predominantly defined by the energy bandgap of the used semiconductor. In case of organic solar cells both energetics and kinetics of three different species play role: excitons, charge transfer states and charge separated states. In this work, we clarify the effect of the relative energetics and kinetics of these species on the recombin… ▽ More The thermodynamic limit for the efficiency of solar cells is predominantly defined by the energy bandgap of the used semiconductor. In case of organic solar cells both energetics and kinetics of three different species play role: excitons, charge transfer states and charge separated states. In this work, we clarify the effect of the relative energetics and kinetics of these species on the recombination and generation dynamics. Making use of detailed balance, we develop an analytical framework describing how the intricate interplay between the different species influence the photocurrent generation, the recombination, and the open-circuit voltage in organic solar cells. Furthermore, we clarify the essential requirements for equilibrium between excitons, CT states and charge carriers to occur. Finally, we find that the photovoltaic parameters are not only determined by the relative energy level between the different states but also by the kinetic rate constants. These findings provide vital insights into the operation of state-of-art non-fullerene organic solar cells with low offsets. △ Less

Submitted 1 July, 2021; v1 submitted 22 April, 2021; originally announced April 2021.

Journal ref: J. Phys. Chem. C 2021

Dual Contrastive Learning for Unsupervised Image-to-Image Translation

Authors: Junlin Han, Mehrdad Shoeiby, Lars Petersson, Mohammad Ali Armin

Abstract: Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields state-of-the-art results in modeling unsupervised image-to-image translation by maximizing mutual information between input and output patches using only one encoder for both domain… ▽ More Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields state-of-the-art results in modeling unsupervised image-to-image translation by maximizing mutual information between input and output patches using only one encoder for both domains. In this paper, we propose a novel method based on contrastive learning and a dual learning setting (exploiting two encoders) to infer an efficient mapping between unpaired data. Additionally, while CUT suffers from mode collapse, a variant of our method efficiently addresses this issue. We further demonstrate the advantage of our approach through extensive ablation studies demonstrating superior performance comparing to recent approaches in multiple challenging image translation tasks. Lastly, we demonstrate that the gap between unsupervised methods and supervised methods can be efficiently closed. △ Less

Submitted 15 April, 2021; originally announced April 2021.

Comments: Accepted to NTIRE, CVPRW 2021. Code is available at https://github.com/JunlinHan/DCLGAN

Single Underwater Image Restoration by Contrastive Learning

Authors: Junlin Han, Mehrdad Shoeiby, Tim Malthus, Elizabeth Botha, Janet Anstee, Saeed Anwar, Ran Wei, Lars Petersson, Mohammad Ali Armin

Abstract: Underwater image restoration attracts significant attention due to its importance in unveiling the underwater world. This paper elaborates on a novel method that achieves state-of-the-art results for underwater image restoration based on the unsupervised image-to-image translation framework. We design our method by leveraging from contrastive learning and generative adversarial networks to maximiz… ▽ More Underwater image restoration attracts significant attention due to its importance in unveiling the underwater world. This paper elaborates on a novel method that achieves state-of-the-art results for underwater image restoration based on the unsupervised image-to-image translation framework. We design our method by leveraging from contrastive learning and generative adversarial networks to maximize mutual information between raw and restored images. Additionally, we release a large-scale real underwater image dataset to support both paired and unpaired training modules. Extensive experiments with comparisons to recent approaches further demonstrate the superiority of our proposed method. △ Less

Submitted 15 April, 2021; v1 submitted 17 March, 2021; originally announced March 2021.

Comments: Accepted to IGARSS 2021 as oral presentation. Code is available at https://github.com/JunlinHan/CWR

Direct quantification of quasi-Fermi level splitting in organic semiconductor devices

Authors: Drew B. Riley, Oskar J. Sandberg, Nora M. Wilson, Wei Li, Stefan Zeiske, Nasim Zarrabi, Paul Meredith, Ronald Osterbacka, Ardalan Armin

Abstract: Non-radiative losses to the open-circuit voltage are a primary factor in limiting the power conversion efficiency of organic photovoltaic devices. The dominant non-radiative loss is intrinsic to the active layer and can be determined from the quasi-Fermi level splitting (QFLS) and the radiative thermodynamic limit of the photovoltage. Quantification of the QFLS in thin film devices with low mobili… ▽ More Non-radiative losses to the open-circuit voltage are a primary factor in limiting the power conversion efficiency of organic photovoltaic devices. The dominant non-radiative loss is intrinsic to the active layer and can be determined from the quasi-Fermi level splitting (QFLS) and the radiative thermodynamic limit of the photovoltage. Quantification of the QFLS in thin film devices with low mobility is challenging due to the excitonic nature of photoexcitation and additional sources of nonradiative loss associated with the device structure. This work outlines an experimental approach based on electro-modulated photoluminescence, which can be used to directly measure the intrinsic non-radiative loss to the open-circuit voltage; thereby, quantifying the QFLS. Drift-diffusion simulations are carried out to show that this method accurately predicts the QFLS in the bulk of the device regardless of device-related non-radiative losses. State-of-the-art PM6:Y6-based organic solar cells are used as a model to test the experimental approach, and the QFLS is quantified and shown to be independent of device architecture. This work provides a method to quantify the QFLS of organic solar cells under operational conditions, fully characterizing the different contributions to the non-radiative losses of the open-circuit voltage. The reported method will be useful in not only characterizing and understanding losses in organic solar cells, but also other device platforms such as light-emitting diodes and photodetectors. △ Less

Submitted 1 March, 2021; originally announced March 2021.

Journal ref: Phys. Rev. Applied 15, 064035 (2021)

A Universal Urbach Rule for Disordered Organic Semiconductors

Authors: Christina Kaiser, Oskar J. Sandberg, Nasim Zarrabi, Wei Li, Paul Meredith, Ardalan Armin

Abstract: In crystalline semiconductors, absorption onset sharpness is characterized by temperature dependent Urbach energies. These energies quantify the static, structural disorder causing localized exponential-tail states, and dynamic disorder from electron-phonon scattering. Applicability of this exponential-tail model to disordered solids has been long debated. Nonetheless, exponential fittings are rou… ▽ More In crystalline semiconductors, absorption onset sharpness is characterized by temperature dependent Urbach energies. These energies quantify the static, structural disorder causing localized exponential-tail states, and dynamic disorder from electron-phonon scattering. Applicability of this exponential-tail model to disordered solids has been long debated. Nonetheless, exponential fittings are routinely applied to sub-gap absorption analysis of organic semiconductors. Herein, we elucidate the sub-gap spectral line-shapes of organic semiconductors and their blends by temperature-dependent quantum efficiency measurements. We find that sub-gap absorption due to singlet excitons is universally dominated by thermal broadening at low photon energies and the associated Urbach energy equals the thermal energy, regardless of static disorder. This is consistent with absorptions obtained from a convolution of Gaussian density of excitonic states weighted by Boltzmann-like thermally activated optical transitions. A simple model is presented that explains absorption line-shapes of disordered systems, and we also provide a strategy to determine the excitonic disorder energy. Our findings elaborate the meaning of the Urbach energy in molecular solids and relate the photo-physics to static disorder, crucial for optimizing organic solar cells for which we present a new radiative open-circuit voltage limit. △ Less

Submitted 19 May, 2021; v1 submitted 25 February, 2021; originally announced February 2021.

Mosaic Super-resolution via Sequential Feature Pyramid Networks

Authors: Mehrdad Shoeiby, Mohammad Ali Armin, Sadegh Aliakbarian, Saeed Anwar, Lars Petersson

Abstract: Advances in the design of multi-spectral cameras have led to great interests in a wide range of applications, from astronomy to autonomous driving. However, such cameras inherently suffer from a trade-off between the spatial and spectral resolution. In this paper, we propose to address this limitation by introducing a novel method to carry out super-resolution on raw mosaic images, multi-spectral… ▽ More Advances in the design of multi-spectral cameras have led to great interests in a wide range of applications, from astronomy to autonomous driving. However, such cameras inherently suffer from a trade-off between the spatial and spectral resolution. In this paper, we propose to address this limitation by introducing a novel method to carry out super-resolution on raw mosaic images, multi-spectral or RGB Bayer, captured by modern real-time single-shot mosaic sensors. To this end, we design a deep super-resolution architecture that benefits from a sequential feature pyramid along the depth of the network. This, in fact, is achieved by utilizing a convolutional LSTM (ConvLSTM) to learn the inter-dependencies between features at different receptive fields. Additionally, by investigating the effect of different attention mechanisms in our framework, we show that a ConvLSTM inspired module is able to provide superior attention in our context. Our extensive experiments and analyses evidence that our approach yields significant super-resolution quality, outperforming current state-of-the-art mosaic super-resolution methods on both Bayer and multi-spectral images. Additionally, to the best of our knowledge, our method is the first specialized method to super-resolve mosaic images, whether it be multi-spectral or Bayer. △ Less

Submitted 14 April, 2020; originally announced April 2020.

Comments: Accepted by IEEE CVPR Workshop

Determining Ultra-low Absorption Coefficients of Organic Semiconductors from the Sub-bandgap Photovoltaic External Quantum Efficiency

Authors: Christina Kaiser, Stefan Zeiske, Paul Meredith, Ardalan Armin

Abstract: Energy states below the bandgap of a semiconductor, such as trap states or charge transfer states in organic donor acceptor blends, can contribute to light absorption. Due to their low number density or ultrasmall absorption cross-section, the absorption coefficient of these states is challenging to measure using conventional transmission reflection spectrophotometry. As an alternative, the extern… ▽ More Energy states below the bandgap of a semiconductor, such as trap states or charge transfer states in organic donor acceptor blends, can contribute to light absorption. Due to their low number density or ultrasmall absorption cross-section, the absorption coefficient of these states is challenging to measure using conventional transmission reflection spectrophotometry. As an alternative, the external quantum efficiency (EQE) of photovoltaic devices is often used as a representative of the absorption coefficient, where the spectral line shape of the EQE is considered to follow the absorption coefficient of the active layer material. In this work, it is shown that the subbandgap EQE is subject to thickness dependent low finesse cavity interference effects within the device, making this assumption questionable. A better estimate for the absorption coefficient is obtained when EQE spectra corresponding to different active layer thicknesses are fitted simultaneously for one attenuation coefficient using an iterative transfer matrix method. The principle is demonstrated for two model acceptor-donor systems (PCE12ITIC and PBTTTPC71BM) and accurate subgap absorption coefficients are determined. This approach has particular relevance for both understanding sub-gap states and their utilization in organic optoelectronic devices. △ Less

Submitted 26 November, 2019; originally announced November 2019.

Journal ref: Adv. Optical Mater. 2019, 1901542

Super-resolved Chromatic Mapping of Snapshot Mosaic Image Sensors via a Texture Sensitive Residual Network

Authors: Mehrdad Shoeiby, Lars Petersson, Mohammad Ali Armin, Sadegh Aliakbarian, Antonio Robles-Kelly

Abstract: This paper introduces a novel method to simultaneously super-resolve and colour-predict images acquired by snapshot mosaic sensors. These sensors allow for spectral images to be acquired using low-power, small form factor, solid-state CMOS sensors that can operate at video frame rates without the need for complex optical setups. Despite their desirable traits, their main drawback stems from the fa… ▽ More This paper introduces a novel method to simultaneously super-resolve and colour-predict images acquired by snapshot mosaic sensors. These sensors allow for spectral images to be acquired using low-power, small form factor, solid-state CMOS sensors that can operate at video frame rates without the need for complex optical setups. Despite their desirable traits, their main drawback stems from the fact that the spatial resolution of the imagery acquired by these sensors is low. Moreover, chromatic mapping in snapshot mosaic sensors is not straightforward since the bands delivered by the sensor tend to be narrow and unevenly distributed across the range in which they operate. We tackle this drawback as applied to chromatic mapping by using a residual channel attention network equipped with a texture sensitive block. Our method significantly outperforms the traditional approach of interpolating the image and, afterwards, applying a colour matching function. This work establishes state-of-the-art in this domain while also making available to the research community a dataset containing 296 registered stereo multi-spectral/RGB images pairs. △ Less

Submitted 5 September, 2019; originally announced September 2019.

A Theoretical Perspective on Transient Photovoltage and Charge Extraction Techniques

Authors: Oskar J. Sandberg, Kristofer Tvingstedt, Paul Meredith, Ardalan Armin

Abstract: Transient photovoltage (TPV) is a technique frequently used to determine charge carrier lifetimes in thin-film solar cells such as organic, dye sensitized and perovskite solar cells. As this lifetime is often incident light intensity dependent, its relevance to understanding the intrinsic properties of a photoactive material system as a material or device figure of merit has been questioned. To ex… ▽ More Transient photovoltage (TPV) is a technique frequently used to determine charge carrier lifetimes in thin-film solar cells such as organic, dye sensitized and perovskite solar cells. As this lifetime is often incident light intensity dependent, its relevance to understanding the intrinsic properties of a photoactive material system as a material or device figure of merit has been questioned. To extract complete information on recombination dynamics, the TPV measurements are often performed in conjunction with charge extraction (CE) measurements, employed to determine the photo-generated charge carrier density and thereby the recombination rate constant and its order. In this communication, the underlying theory of TPV and CE is reviewed and expanded. Our theoretical findings are further solidified by numerical simulations and experiments on organic solar cells. We identify regimes of the open-circuit voltage within which accurate lifetimes and carrier densities can be determined with TPV and CE experiments. A wide range of steady-state light intensities is required in performing these experiments in order to identify their 'working dynamic range' from which the recombination kinetics in thin-film solar cells can be determined. △ Less

Submitted 17 May, 2019; originally announced May 2019.

Journal ref: J. Phys. Chem. C 2019, 123, 23, 14261-14271

On the effect of surface recombination in thin film solar cells, light emitting diodes and photodetectors

Authors: Oskar J. Sandberg, Ardalan Armin

Abstract: Radiative and non-radiative charge carrier recombination in thin-film diodes plays a key role in determining the efficiency of electronic devices made of next generation semiconductors such as organic, perovskite and nanocrystals. In this work, we show that lowering the bulk recombination does not necessarily result in enhanced performance metrics of electronic devices. From the perspective of cha… ▽ More Radiative and non-radiative charge carrier recombination in thin-film diodes plays a key role in determining the efficiency of electronic devices made of next generation semiconductors such as organic, perovskite and nanocrystals. In this work, we show that lowering the bulk recombination does not necessarily result in enhanced performance metrics of electronic devices. From the perspective of charge carrier extraction and injection, the radiative limit of the open-circuit voltage of solar cells, noise current of photodetectors and lasing threshold of injection lasers cannot be improved if the contacts are not perfectly selective. A numerical drift-diffusion model is used to investigate the interplay between bulk recombination and surface recombination of minority carriers at the contacts in bipolar thin diode devices based on low-mobility semiconductors. The surface recombination becomes prominent in case of reduced bulk recombination strengths when non-selective contacts, i. e. contacts that are either metallic or have imperfect charge-selective interlayer, are employed. Finally, we derive analytical approximations for the case when diffusion-limited surface recombination of minority carriers at Ohmic contacts dominates the dark current. These results indicate that having perfectly selective contacts becomes crucial in systems with suppressed bulk recombination - a challenging requirement for future state-of-the-art thin-film solar cells, light-emitting devices and photodetectors made of next generation semiconductors. △ Less

Submitted 17 May, 2019; originally announced May 2019.

Journal ref: Synthetic Metals Volume 254, August 2019, Pages 114-121

Precision ultrasound sensing on a chip

Authors: Sahar Basiri-Esfahani, Ardalan Armin, Stefan Forstner, Warwick P. Bowen

Abstract: Ultrasound sensors have wide applications across science and technology. However, improved sensitivity is required for both miniaturisation and increased spatial resolution. Here, we introduce cavity optomechanical ultrasound sensing, where dual optical and mechanical resonances enhance the ultrasound signal. We achieve noise equivalent pressures of 8--300 $μ$Pa/$\sqrt{\rm Hz}$ at kilohertz to meg… ▽ More Ultrasound sensors have wide applications across science and technology. However, improved sensitivity is required for both miniaturisation and increased spatial resolution. Here, we introduce cavity optomechanical ultrasound sensing, where dual optical and mechanical resonances enhance the ultrasound signal. We achieve noise equivalent pressures of 8--300 $μ$Pa/$\sqrt{\rm Hz}$ at kilohertz to megahertz frequencies in a microscale silicon-chip-based sensor with $>$120 dB dynamic range. The sensitivity far exceeds similar sensors that use optical resonance alone and, normalised to sensing area, surpasses previous air-coupled ultrasound sensors by several orders of magnitude. The noise floor is, for the first time, dominated by collisions from molecules in the gas within which the acoustic wave propagates. This new approach to acoustic sensing could find applications ranging from biomedical diagnostics, to autonomous navigation, trace gas sensing, and scientific exploration of the life-induced-vibrations of single cells. △ Less

Submitted 8 October, 2018; v1 submitted 3 May, 2018; originally announced May 2018.

Comments: 50 pages, 15 figures

An integrated quantum photonic sensor based on Hong-Ou-Mandel interference

Authors: Sahar Basiri-Esfahani, Casey R. Myers, Ardalan Armin, Joshua Combes, Gerard J. Milburn

Abstract: Photonic-crystal-based integrated optical systems have been used for a broad range of sensing applications with great success. This has been motivated by several advantages such as high sensitivity, miniaturization, remote sensing, selectivity and stability. Many photonic crystal sensors have been proposed with various fabrication designs that result in improved optical properties. In parallel, in… ▽ More Photonic-crystal-based integrated optical systems have been used for a broad range of sensing applications with great success. This has been motivated by several advantages such as high sensitivity, miniaturization, remote sensing, selectivity and stability. Many photonic crystal sensors have been proposed with various fabrication designs that result in improved optical properties. In parallel, integrated optical systems are being pursued as a platform for photonic quantum information processing using linear optics and Fock states. Here we propose a novel integrated Fock state optical sensor architecture that can be used for force, refractive index and possibly local temperature detection. In this scheme, two coupled cavities behave as an "effective beam splitter". The sensor works based on fourth order interference (the Hong-Ou-Mandel effect) and requires a sequence of single photon pulses and consequently has low pulse power. Changes in the parameter to be measured induce variations in the effective beam splitter reflectivity and result in changes to the visibility of interference. We demonstrate this generic scheme in coupled L3 photonic crystal cavities as an example and find that this system, which only relies on photon coincidence detection and does not need any spectral resolution, can estimate forces as small as $10^{-7}$ Newtons and can measure one part per million change in refractive index using a very low input power of $10^{-10}$W. Thus linear optical quantum photonic architectures can achieve comparable sensor performance to semiclassical devices. △ Less

Submitted 10 June, 2015; v1 submitted 12 February, 2015; originally announced February 2015.

Comments: 24 pages, 7 figures

Journal ref: Opt. Express 23(12), 16008-16023 (2015)