-
Ensuring accurate stain reproduction in deep generative networks for virtual immunohistochemistry
Authors:
Christopher D. Walsh,
Joanne Edwards,
Robert H. Insall
Abstract:
Immunohistochemistry is a valuable diagnostic tool for cancer pathology. However, it requires specialist labs and equipment, is time-intensive, and is difficult to reproduce. Consequently, a long term aim is to provide a digital method of recreating physical immunohistochemical stains. Generative Adversarial Networks have become exceedingly advanced at mapping one image type to another and have sh…
▽ More
Immunohistochemistry is a valuable diagnostic tool for cancer pathology. However, it requires specialist labs and equipment, is time-intensive, and is difficult to reproduce. Consequently, a long term aim is to provide a digital method of recreating physical immunohistochemical stains. Generative Adversarial Networks have become exceedingly advanced at mapping one image type to another and have shown promise at inferring immunostains from haematoxylin and eosin. However, they have a substantial weakness when used with pathology images as they can fabricate structures that are not present in the original data. CycleGANs can mitigate invented tissue structures in pathology image mapping but have a related disposition to generate areas of inaccurate staining. In this paper, we describe a modification to the loss function of a CycleGAN to improve its mapping ability for pathology images by enforcing realistic stain replication while retaining tissue structure. Our approach improves upon others by considering structure and staining during model training. We evaluated our network using the Fréchet Inception distance, coupled with a new technique that we propose to appraise the accuracy of virtual immunohistochemistry. This assesses the overlap between each stain component in the inferred and ground truth images through colour deconvolution, thresholding and the Sorensen-Dice coefficient. Our modified loss function resulted in a Dice coefficient for the virtual stain of 0.78 compared with the real AE1/AE3 slide. This was superior to the unaltered CycleGAN's score of 0.74. Additionally, our loss function improved the Fréchet Inception distance for the reconstruction to 74.54 from 76.47. We, therefore, describe an advance in virtual restaining that can extend to other immunostains and tumour types and deliver reproducible, fast and readily accessible immunohistochemistry worldwide.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
A Conservative Finite Element ALE Scheme for Mass-Conserving Reaction-Diffusion Equations on Evolving Two-Dimensional Domains
Authors:
John A. Mackenzie,
Christopher F. Rowlatt,
Robert H. Insall
Abstract:
Mass-conservative reaction-diffusion systems have recently been proposed as a general framework to describe intracellular pattern formation. These systems have been used to model the conformational switching of proteins as they cycle from an inactive state in the cell cytoplasm, to an active state at the cell membrane. The active state then acts as input to downstream effectors. The paradigm of ac…
▽ More
Mass-conservative reaction-diffusion systems have recently been proposed as a general framework to describe intracellular pattern formation. These systems have been used to model the conformational switching of proteins as they cycle from an inactive state in the cell cytoplasm, to an active state at the cell membrane. The active state then acts as input to downstream effectors. The paradigm of activation by recruitment to the membrane underpins a range of biological pathways - including G-protein signalling, growth control through Ras and PI 3-kinase, and cell polarity through Rac and Rho; all activate their targets by recruiting them from the cytoplasm to the membrane. Global mass conservation lies at the heart of these models reflecting the property that the total number of active and inactive forms, and targets, remains constant. Here we present a conservative arbitrary Lagrangian Eulerian (ALE) finite element method for the approximate solution of systems of bulk-surface reaction-diffusion equations on an evolving two-dimensional domain. Fundamental to the success of the method is the robust generation of bulk and surface meshes. For this purpose, we use a moving mesh partial differential equation (MMPDE) approach. Global conservation of the fully discrete finite element solution is established independently of the ALE velocity field and the time step size. The developed method is applied to model problems with known analytical solutions; these experiments indicate that the method is second-order accurate and globally conservative. The method is further applied to a model of a single cell migrating in the presence of an external chemotactic signal.
△ Less
Submitted 5 October, 2019;
originally announced October 2019.
-
Screening by changes in stereotypical behavior during cell motility
Authors:
Luke Tweedy,
Patrick Witzel,
Doris Heinrich,
Robert H. Insall,
Robert G. Endres
Abstract:
Stereotyped behaviors are series of postures that show very little variability between repeats. They have been used to classify the dynamics of individuals, groups and species without reference to the lower-level mechanisms that drive them. Stereotypes are easily identified in animals due to strong constraints on the number, shape, and relative positions of anatomical features, such as limbs, that…
▽ More
Stereotyped behaviors are series of postures that show very little variability between repeats. They have been used to classify the dynamics of individuals, groups and species without reference to the lower-level mechanisms that drive them. Stereotypes are easily identified in animals due to strong constraints on the number, shape, and relative positions of anatomical features, such as limbs, that may be used as landmarks for posture identification. In contrast, the identification of stereotypes in single cells poses a significant challenge as the cell lacks these landmark features, and finding constraints on cell shape is a non-trivial task. Here, we use the maximum caliber variational method to build a minimal model of cell behavior during migration. Without reference to biochemical details, we are able to make behavioral predictions over timescales of minutes using only changes in cell shape over timescales of seconds. We use drug treatment and genetics to demonstrate that maximum caliber descriptors can discriminate between healthy and aberrant migration, thereby showing potential applications for maximum caliber methods in automated disease screening, for example in the identification of behaviors associated with cancer metastasis.
△ Less
Submitted 11 June, 2019;
originally announced June 2019.
