-
Invariant Anomaly Detection under Distribution Shifts: A Causal Perspective
Authors:
João B. S. Carvalho,
Mengtao Zhang,
Robin Geyer,
Carlos Cotrini,
Joachim M. Buhmann
Abstract:
Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that training samples and test samples are drawn from the same distribution breaks down. In this work, by leveraging tools from causal inference we attempt to increase…
▽ More
Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that training samples and test samples are drawn from the same distribution breaks down. In this work, by leveraging tools from causal inference we attempt to increase the resilience of anomaly detection models to different kinds of distribution shifts. We begin by elucidating a simple yet necessary statistical property that ensures invariant representations, which is critical for robust AD under both domain and covariate shifts. From this property, we derive a regularization term which, when minimized, leads to partial distribution invariance across environments. Through extensive experimental evaluation on both synthetic and real-world tasks, covering a range of six different AD methods, we demonstrated significant improvements in out-of-distribution performance. Under both covariate and domain shift, models regularized with our proposed term showed marked increased robustness. Code is available at: https://github.com/JoaoCarv/invariant-anomaly-detection.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Improving Explainability of Disentangled Representations using Multipath-Attribution Mappings
Authors:
Lukas Klein,
João B. S. Carvalho,
Mennatallah El-Assady,
Paolo Penna,
Joachim M. Buhmann,
Paul F. Jaeger
Abstract:
Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based clinical diagnostics, it is necessary to integrate explainable AI into these safety-critical systems. Current explanatory methods typically assign attribution scores…
▽ More
Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based clinical diagnostics, it is necessary to integrate explainable AI into these safety-critical systems. Current explanatory methods typically assign attribution scores to pixel regions in the input image, indicating their importance for a model's decision. However, they fall short when explaining why a visual feature is used. We propose a framework that utilizes interpretable disentangled representations for downstream-task prediction. Through visualizing the disentangled representations, we enable experts to investigate possible causation effects by leveraging their domain knowledge. Additionally, we deploy a multi-path attribution mapping for enriching and validating explanations. We demonstrate the effectiveness of our approach on a synthetic benchmark suite and two medical datasets. We show that the framework not only acts as a catalyst for causal relation extraction but also enhances model robustness by enabling shortcut detection without the need for testing under distribution shifts.
△ Less
Submitted 15 June, 2023;
originally announced June 2023.
-
Protocolo de Revisão Sistemática da Literatura para Wireless Mesh Networks com mecanismos de incentivo financeiro
Authors:
Rodolfo B. S. Carvalho
Abstract:
The objective of this systematic review is to assess the state of the art on routing protocols aimed at WMNs, when associated with mechanisms for financial incentives that aim to ensure the self-sustainability of the network, seeking to identify the improvements and associated risks as well as the efficiency of the mechanisms adopted within networks, thus ensuring increased reliability in the use…
▽ More
The objective of this systematic review is to assess the state of the art on routing protocols aimed at WMNs, when associated with mechanisms for financial incentives that aim to ensure the self-sustainability of the network, seeking to identify the improvements and associated risks as well as the efficiency of the mechanisms adopted within networks, thus ensuring increased reliability in the use of such protocols for routing encouraged WMNs.
△ Less
Submitted 10 November, 2021;
originally announced January 2022.
-
A field guide to cultivating computational biology
Authors:
Anne E Carpenter,
Casey S Greene,
Piero Carnici,
Benilton S Carvalho,
Michiel de Hoon,
Stacey Finley,
Kim-Anh Le Cao,
Jerry SH Lee,
Luigi Marchionni,
Suzanne Sindi,
Fabian J Theis,
Gregory P Way,
Jean YH Yang,
Elana J Fertig
Abstract:
Biomedical research centers can empower basic discovery and novel therapeutic strategies by leveraging their large-scale datasets from experiments and patients. This data, together with new technologies to create and analyze it, has ushered in an era of data-driven discovery which requires moving beyond the traditional individual, single-discipline investigator research model. This interdisciplina…
▽ More
Biomedical research centers can empower basic discovery and novel therapeutic strategies by leveraging their large-scale datasets from experiments and patients. This data, together with new technologies to create and analyze it, has ushered in an era of data-driven discovery which requires moving beyond the traditional individual, single-discipline investigator research model. This interdisciplinary niche is where computational biology thrives. It has matured over the past three decades and made major contributions to scientific knowledge and human health, yet researchers in the field often languish in career advancement, publication, and grant review. We propose solutions for individual scientists, institutions, journal publishers, funding agencies, and educators.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Spatially Dependent U-Nets: Highly Accurate Architectures for Medical Imaging Segmentation
Authors:
João B. S. Carvalho,
João A. Santinha,
Đorđe Miladinović,
Joachim M. Buhmann
Abstract:
In clinical practice, regions of interest in medical imaging often need to be identified through a process of precise image segmentation. The quality of this image segmentation step critically affects the subsequent clinical assessment of the patient status. To enable high accuracy, automatic image segmentation, we introduce a novel deep neural network architecture that exploits the inherent spati…
▽ More
In clinical practice, regions of interest in medical imaging often need to be identified through a process of precise image segmentation. The quality of this image segmentation step critically affects the subsequent clinical assessment of the patient status. To enable high accuracy, automatic image segmentation, we introduce a novel deep neural network architecture that exploits the inherent spatial coherence of anatomical structures and is well equipped to capture long-range spatial dependencies in the segmented pixel/voxel space. In contrast to the state-of-the-art solutions based on convolutional layers, our approach leverages on recently introduced spatial dependency layers that have an unbounded receptive field and explicitly model the inductive bias of spatial coherence. Our method performs favourably to commonly used U-Net and U-Net++ architectures as demonstrated by improved Dice and Jaccardscore in three different medical segmentation tasks: nuclei segmentation in microscopy images, polyp segmentation in colonoscopy videos, and liver segmentation in abdominal CT scans.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
-
Screening and merging algorithm for the detection of copy-number alterations
Authors:
Murilo S. Pinheiro,
Benilton S. Carvalho,
Aluísio S. Pinheiro
Abstract:
We call change-point problem (CPP) the identification of changes in the probabilistic behavior of a sequence of observations. Solving the CPP involves detecting the number and position of such changes. In genetics the study of how and what characteristics of a individual's genetic content might contribute to the occurrence and evolution of cancer has fundamental importance in the diagnosis and tre…
▽ More
We call change-point problem (CPP) the identification of changes in the probabilistic behavior of a sequence of observations. Solving the CPP involves detecting the number and position of such changes. In genetics the study of how and what characteristics of a individual's genetic content might contribute to the occurrence and evolution of cancer has fundamental importance in the diagnosis and treatment of such diseases and can be formulated in the framework of chage-point analysis. In this article we propose a modification to a existing method of segmentation with the objective of producing a algorithm that is robust to a variety of sampling distributions and that is adequate for more recent method of accessing DNA copy-number which might require a restriction on the minimum length of a altered segment.
△ Less
Submitted 16 January, 2017;
originally announced January 2017.