-
Pseudo-Labeling Enhanced by Privileged Information and Its Application to In Situ Sequencing Images
Authors:
Marzieh Haghighi,
Mario C. Cruz,
Erin Weisbart,
Beth A. Cimini,
Avtar Singh,
Julia Bauman,
Maria E. Lozada,
Sanam L. Kavari,
James T. Neal,
Paul C. Blainey,
Anne E. Carpenter,
Shantanu Singh
Abstract:
Various strategies for label-scarce object detection have been explored by the computer vision research community. These strategies mainly rely on assumptions that are specific to natural images and not directly applicable to the biological and biomedical vision domains. For example, most semi-supervised learning strategies rely on a small set of labeled data as a confident source of ground truth.…
▽ More
Various strategies for label-scarce object detection have been explored by the computer vision research community. These strategies mainly rely on assumptions that are specific to natural images and not directly applicable to the biological and biomedical vision domains. For example, most semi-supervised learning strategies rely on a small set of labeled data as a confident source of ground truth. In many biological vision applications, however, the ground truth is unknown and indirect information might be available in the form of noisy estimations or orthogonal evidence. In this work, we frame a crucial problem in spatial transcriptomics - decoding barcodes from In-Situ-Sequencing (ISS) images - as a semi-supervised object detection (SSOD) problem. Our proposed framework incorporates additional available sources of information into a semi-supervised learning framework in the form of privileged information. The privileged information is incorporated into the teacher's pseudo-labeling in a teacher-student self-training iteration. Although the available privileged information could be data domain specific, we have introduced a general strategy of pseudo-labeling enhanced by privileged information (PLePI) and exemplified the concept using ISS images, as well on the COCO benchmark using extra evidence provided by CLIP.
△ Less
Submitted 27 June, 2023;
originally announced June 2023.
-
Subject Identification Across Large Expression Variations Using 3D Facial Landmarks
Authors:
Sk Rahatul Jannat,
Diego Fabiano,
Shaun Canavan,
Tempestt Neal
Abstract:
Landmark localization is an important first step towards geometric based vision research including subject identification. Considering this, we propose to use 3D facial landmarks for the task of subject identification, over a range of expressed emotion. Landmarks are detected, using a Temporal Deformable Shape Model and used to train a Support Vector Machine (SVM), Random Forest (RF), and Long Sho…
▽ More
Landmark localization is an important first step towards geometric based vision research including subject identification. Considering this, we propose to use 3D facial landmarks for the task of subject identification, over a range of expressed emotion. Landmarks are detected, using a Temporal Deformable Shape Model and used to train a Support Vector Machine (SVM), Random Forest (RF), and Long Short-term Memory (LSTM) neural network for subject identification. As we are interested in subject identification with large variations in expression, we conducted experiments on 3 emotion-based databases, namely the BU-4DFE, BP4D, and BP4D+ 3D/4D face databases. We show that our proposed method outperforms current state of the art methods for subject identification on BU-4DFE and BP4D. To the best of our knowledge, this is the first work to investigate subject identification on the BP4D+, resulting in a baseline for the community.
△ Less
Submitted 17 May, 2020;
originally announced May 2020.
-
A Closer Look at Mobile App Usage as a Persistent Biometric: A Small Case Study
Authors:
Md A. Noor,
G. Kaptan,
V. Cherukupally,
P. Gera,
T. Neal
Abstract:
In this paper, we explore mobile app use as a behavioral biometric identifier. While several efforts have also taken on this challenge, many have alluded to the inconsistency in human behavior, resulting in updating the biometric template frequently and periodically. Here, we represent app usage as simple images wherein each pixel value provides some information about the user's app usage. Then, w…
▽ More
In this paper, we explore mobile app use as a behavioral biometric identifier. While several efforts have also taken on this challenge, many have alluded to the inconsistency in human behavior, resulting in updating the biometric template frequently and periodically. Here, we represent app usage as simple images wherein each pixel value provides some information about the user's app usage. Then, we feed use these images to train a deep learning network (convolutional neural net) to classify the user's identity. Our contribution lies in the random order in which the images are fed to the classifier, thereby presenting novel evidence that there are some aspects of app usage that are indeed persistent. Our results yield a 96.8% $F$-score without any updates to the template data.
△ Less
Submitted 25 December, 2019;
originally announced December 2019.
-
Towards the Avoidance of Counterfeit Memory: Identifying the DRAM Origin
Authors:
B. M. S. Bahar Talukder,
Vineetha Menon,
Biswajit Ray,
Tempestt Neal,
Md Tauhidur Rahman
Abstract:
Due to the globalization in the semiconductor supply chain, counterfeit dynamic random-access memory (DRAM) chips/modules have been spreading worldwide at an alarming rate. Deploying counterfeit DRAM modules into an electronic system can have severe consequences on security and reliability domains because of their sub-standard quality, poor performance, and shorter life span. Besides, studies sugg…
▽ More
Due to the globalization in the semiconductor supply chain, counterfeit dynamic random-access memory (DRAM) chips/modules have been spreading worldwide at an alarming rate. Deploying counterfeit DRAM modules into an electronic system can have severe consequences on security and reliability domains because of their sub-standard quality, poor performance, and shorter life span. Besides, studies suggest that a counterfeit DRAM can be more vulnerable to sophisticated attacks. However, detecting counterfeit DRAMs is very challenging because of their nature and ability to pass the initial testing. In this paper, we propose a technique to identify the DRAM origin (i.e., the origin of the manufacturer and the specification of individual DRAM) to detect and prevent counterfeit DRAM modules. A silicon evaluation shows that the proposed method reliably identifies off-the-shelf DRAM modules from three major manufacturers.
△ Less
Submitted 8 November, 2019;
originally announced November 2019.
-
Studying the Impact of Mood on Identifying Smartphone Users
Authors:
Khadija Zanna,
Sayde King,
Tempestt Neal,
Shaun Canavan
Abstract:
This paper explores the identification of smartphone users when certain samples collected while the subject felt happy, upset or stressed were absent or present. We employ data from 19 subjects using the StudentLife dataset, a dataset collected by researchers at Dartmouth College that was originally collected to correlate behaviors characterized by smartphone usage patterns with changes in stress…
▽ More
This paper explores the identification of smartphone users when certain samples collected while the subject felt happy, upset or stressed were absent or present. We employ data from 19 subjects using the StudentLife dataset, a dataset collected by researchers at Dartmouth College that was originally collected to correlate behaviors characterized by smartphone usage patterns with changes in stress and academic performance. Although many previous works on behavioral biometrics have implied that mood is a source of intra-person variation which may impact biometric performance, our results contradict this assumption. Our findings show that performance worsens when removing samples that were generated when subjects may be happy, upset, or stressed. Thus, there is no indication that mood negatively impacts performance. However, we do find that changes existing in smartphone usage patterns may correlate with mood, including changes in locking, audio, location, calling, homescreen, and e-mail habits. Thus, we show that while mood is a source of intra-person variation, it may be an inaccurate assumption that biometric systems (particularly, mobile biometrics) are likely influenced by mood.
△ Less
Submitted 27 June, 2019;
originally announced June 2019.
-
Homegrown Governments: Visualizing Regional Governance in the United States
Authors:
Abdulelah Abuabat,
Steven Johnston,
Mohammed Aldosari,
Taylor Neal
Abstract:
Regional Intergovernmental Organizations (RIGOs) are constituted by the local governments within their respective regions and are supported by the active engagement of the regions community and citizens. Metropolitan Statistical Areas (MSAs), on the other hand, are classified by the federal government based on commuting and commerce patterns. They do not adhere to any local government. The Graduat…
▽ More
Regional Intergovernmental Organizations (RIGOs) are constituted by the local governments within their respective regions and are supported by the active engagement of the regions community and citizens. Metropolitan Statistical Areas (MSAs), on the other hand, are classified by the federal government based on commuting and commerce patterns. They do not adhere to any local government. The Graduate School of Policy and International Affairs Center for Metropolitan Studies (GSPIA) at the University of Pittsburgh have been researching the boundaries of RIGOs and the characteristics defining them. In this paper, we propose, design, and implement an approach to enhance the current visualization by visualizing two categorical data: RIGOs and MSAs and the overlapping between them. We attempted to use a combination of visual attributes that leverage human perception system and do not impose cognitive and mental effort. The overall result of the evaluation shows that our work proved to be more effective than the current visualization.
△ Less
Submitted 4 April, 2019;
originally announced May 2019.
