-
Sparse $L^1$-Autoencoders for Scientific Data Compression
Authors:
Matthias Chung,
Rick Archibald,
Paul Atzberger,
Jack Michael Solomon
Abstract:
Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing and rate-distortion theory, we introduce effective data compression methods by developing autoencoders using high dimensional latent spaces that are $L^1$-regul…
▽ More
Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing and rate-distortion theory, we introduce effective data compression methods by developing autoencoders using high dimensional latent spaces that are $L^1$-regularized to obtain sparse low dimensional representations. We show how these information-rich latent spaces can be used to mitigate blurring and other artifacts to obtain highly effective data compression methods for scientific data. We demonstrate our methods for short angle scattering (SAS) datasets showing they can achieve compression ratios around two orders of magnitude and in some cases better. Our compression methods show promise for use in addressing current bottlenecks in transmission, storage, and analysis in high-performance distributed computing environments. This is central to processing the large volume of SAS data being generated at shared experimental facilities around the world to support scientific investigations. Our approaches provide general ways for obtaining specialized compression methods for targeted scientific datasets.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Image reconstructions using sparse dictionary representations and implicit, non-negative mappings
Authors:
Elizabeth Newman,
Jack Michael Solomon,
Matthias Chung
Abstract:
Many imaging science tasks can be modeled as a discrete linear inverse problem. Solving linear inverse problems is often challenging, with ill-conditioned operators and potentially non-unique solutions. Embedding prior knowledge, such as smoothness, into the solution can overcome these challenges. In this work, we encode prior knowledge using a non-negative patch dictionary, which effectively lear…
▽ More
Many imaging science tasks can be modeled as a discrete linear inverse problem. Solving linear inverse problems is often challenging, with ill-conditioned operators and potentially non-unique solutions. Embedding prior knowledge, such as smoothness, into the solution can overcome these challenges. In this work, we encode prior knowledge using a non-negative patch dictionary, which effectively learns a basis from a training set of natural images. In this dictionary basis, we desire solutions that are non-negative and sparse (i.e., contain many zero entries). With these constraints, standard methods for solving discrete linear inverse problems are not directly applicable. One such approach is the modified residual norm steepest descent (MRNSD), which produces non-negative solutions but does not induce sparsity. In this paper, we provide two methods based on MRNSD that promote sparsity. In our first method, we add an $\ell_1$-regularization term with a new, optimal step size. In our second method, we propose a new non-negative, sparsity-promoting mapping of the solution. We compare the performance of our proposed methods on a number of numerical experiments, including deblurring, image completion, computer tomography, and superresolution. Our results show that these methods effectively solve discrete linear inverse problems with non-negativity and sparsity constraints.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
-
Dielectric breakdown and sub-wavelength patterning of monolayer hexagonal boron nitride using femtosecond pulses
Authors:
Sabeeh Irfan Ahmad,
Emmanuel Sarpong,
Arpit Dave,
Hsin-Yu Yao,
Joel M. Solomon,
Jing-Kai Jiang,
Chih-Wei Luo,
Wen-Hao Chang,
Tsing-Hua Her
Abstract:
Hexagonal boron nitride (hBN) has emerged as a promising two-dimensional (2D) material for many applications in photonics. Although its linear and nonlinear optical properties have been extensively studied, its interaction with high-intensity laser pulses, which is important for high-harmonic generation, fabricating quantum emitters, and maskless patterning of hBN, has not been investigated. Here…
▽ More
Hexagonal boron nitride (hBN) has emerged as a promising two-dimensional (2D) material for many applications in photonics. Although its linear and nonlinear optical properties have been extensively studied, its interaction with high-intensity laser pulses, which is important for high-harmonic generation, fabricating quantum emitters, and maskless patterning of hBN, has not been investigated. Here we report the first study of dielectric breakdown in hBN monolayers induced by single femtosecond laser pulses. We show that hBN has the highest breakdown threshold among all existing 2D materials. This enables us to observe clearly for the first time a linear dependence of breakdown threshold on the bandgap energy for 2D materials, demonstrating such a linear dependency is a universal scaling law independent of the dimensionality. We also observe counter-intuitively that hBN, which has a larger bandgap and mechanical strength than quartz, has a lower breakdown threshold. This implies carrier generation in hBN is much more efficient. Furthermore, we demonstrate the clean removal of hBN without damage to the surrounding hBN film or the substrate, indicating that hBN is optically very robust. The ablated features are shown to possess very small edge roughness, which is attributed to its ultrahigh fracture toughness. Finally, we demonstrate femtosecond laser patterning of hBN with sub-wavelength resolution, including an isolated stripe width of 200 nm. Our work advances the knowledge of light-hBN interaction in the strong field regime and firmly establishes femtosecond lasers as novel and promising tools for one-step deterministic patterning of hBN monolayers.
△ Less
Submitted 7 June, 2023;
originally announced June 2023.
-
Ultrafast Multi-Shot Ablation and Defect Generation in Monolayer Transition Metal Dichalcogenides
Authors:
Joel M. Solomon,
Sabeeh Irfan Ahmad,
Arpit Dave,
Li-Syuan Lu,
Yu-Chen Wu,
Wen-Hao Chang,
Chih-Wei Luo,
Tsing-Hua Her
Abstract:
Transition metal dichalcogenides are known to possess large optical nonlinearities and driving these materials at high intensities is desirable for many applications. Understanding their optical responses under repetitive intense excitation is essential to improve the performance limit of these strong-field devices and to achieve efficient laser patterning. Here, we report the incubation study of…
▽ More
Transition metal dichalcogenides are known to possess large optical nonlinearities and driving these materials at high intensities is desirable for many applications. Understanding their optical responses under repetitive intense excitation is essential to improve the performance limit of these strong-field devices and to achieve efficient laser patterning. Here, we report the incubation study of monolayer MoS${}_{2}$ and WS${}_{2}$ induced by 160 fs, 800 nm pulses in air to examine how their ablation threshold scales with the number of admitted laser pulses. Both materials were shown to outperform graphene and most bulk materials; specifically, MoS${}_{2}$ is as resistant to radiation degradation as the best of the bulk thin films with a record fast saturation. Our modeling provides convincing evidence that the small reduction in threshold and fast saturation of MoS${}_{2}$ originates in its excellent bonding integrity against radiation-induced softening. Sub-ablation damages, in the forms of vacancies, lattice disorder, and nano-voids, were revealed by transmission electron microscopy, photoluminescence, Raman, and second harmonic generation studies, which were attributed to the observed incubation. For the first time, a sub-ablation damage threshold is identified for monolayer MoS${}_{2}$ to be 78% of single-shot ablation threshold, below which MoS${}_{2}$ remains intact for many laser pulses. Our results firmly establish MoS${}_{2}$ as a robust material for strong-field devices and for high-throughput laser patterning.
△ Less
Submitted 20 December, 2021;
originally announced December 2021.
-
Ultrafast Laser Ablation, Intrinsic Threshold, and Nanopatterning of Monolayer Molybdenum Disulfide
Authors:
Joel M. Solomon,
Sabeeh Irfan Ahmad,
Arpit Dave,
Li-Syuan Lu,
Fatemeh HadavandMirzaee,
Shih-Chu Lin,
Sih-Hua Chen,
Chih-Wei Luo,
Wen-Hao Chang,
Tsing-Hua Her
Abstract:
Laser direct writing is an attractive method for patterning 2D materials without contamination. Literature shows that the femtosecond ablation threshold of graphene across substrates varies by an order of magnitude. Some attribute it to the thermal coupling to the substrates, but it remains by and large an open question. For the first time the effect of substrates on femtosecond ablation of 2D mat…
▽ More
Laser direct writing is an attractive method for patterning 2D materials without contamination. Literature shows that the femtosecond ablation threshold of graphene across substrates varies by an order of magnitude. Some attribute it to the thermal coupling to the substrates, but it remains by and large an open question. For the first time the effect of substrates on femtosecond ablation of 2D materials is studied using MoS$_{2}$ as an example. We show unambiguously that femtosecond ablation of MoS$_{2}$ is an adiabatic process with negligible heat transfer to the substrates. The observed threshold variation is due to the etalon effect which was not identified before for the laser ablation of 2D materials. Subsequently, an intrinsic ablation threshold is proposed as a true threshold parameter for 2D materials. Additionally, we demonstrate for the first time femtosecond laser patterning of monolayer MoS$_{2}$ with sub-micron resolution and mm/s speed. Moreover, engineered substrates are shown to enhance the ablation efficiency, enabling patterning with low-power femtosecond oscillators. Finally, a zero-thickness approximation is introduced to predict the field enhancement with simple analytical expressions. Our work clarifies the role of substrates on ablation and firmly establishes femtosecond laser ablation as a viable route to pattern 2D materials.
△ Less
Submitted 1 November, 2021;
originally announced November 2021.
-
PRNet: Self-Supervised Learning for Partial-to-Partial Registration
Authors:
Yue Wang,
Justin M. Solomon
Abstract:
We present a simple, flexible, and general framework titled Partial Registration Network (PRNet), for partial-to-partial point cloud registration. Inspired by recently-proposed learning-based methods for registration, we use deep networks to tackle non-convexity of the alignment and partial correspondence problems. While previous learning-based methods assume the entire shape is visible, PRNet is…
▽ More
We present a simple, flexible, and general framework titled Partial Registration Network (PRNet), for partial-to-partial point cloud registration. Inspired by recently-proposed learning-based methods for registration, we use deep networks to tackle non-convexity of the alignment and partial correspondence problems. While previous learning-based methods assume the entire shape is visible, PRNet is suitable for partial-to-partial registration, outperforming PointNetLK, DCP, and non-learning methods on synthetic data. PRNet is self-supervised, jointly learning an appropriate geometric representation, a keypoint detector that finds points in common between partial views, and keypoint-to-keypoint correspondences. We show PRNet predicts keypoints and correspondences consistently across views and objects. Furthermore, the learned representation is transferable to classification.
△ Less
Submitted 29 October, 2019; v1 submitted 27 October, 2019;
originally announced October 2019.
-
Deep Closest Point: Learning Representations for Point Cloud Registration
Authors:
Yue Wang,
Justin M. Solomon
Abstract:
Point cloud registration is a key problem for computer vision applied to robotics, medical imaging, and other applications. This problem involves finding a rigid transformation from one point cloud into another so that they align. Iterative Closest Point (ICP) and its variants provide simple and easily-implemented iterative methods for this task, but these algorithms can converge to spurious local…
▽ More
Point cloud registration is a key problem for computer vision applied to robotics, medical imaging, and other applications. This problem involves finding a rigid transformation from one point cloud into another so that they align. Iterative Closest Point (ICP) and its variants provide simple and easily-implemented iterative methods for this task, but these algorithms can converge to spurious local optima. To address local optima and other difficulties in the ICP pipeline, we propose a learning-based method, titled Deep Closest Point (DCP), inspired by recent techniques in computer vision and natural language processing. Our model consists of three parts: a point cloud embedding network, an attention-based module combined with a pointer generation layer, to approximate combinatorial matching, and a differentiable singular value decomposition (SVD) layer to extract the final rigid transformation. We train our model end-to-end on the ModelNet40 dataset and show in several settings that it performs better than ICP, its variants (e.g., Go-ICP, FGR), and the recently-proposed learning-based method PointNetLK. Beyond providing a state-of-the-art registration technique, we evaluate the suitability of our learned features transferred to unseen objects. We also provide preliminary analysis of our learned model to help understand whether domain-specific and/or global features facilitate rigid registration.
△ Less
Submitted 8 May, 2019;
originally announced May 2019.
-
Dynamic Graph CNN for Learning on Point Clouds
Authors:
Yue Wang,
Yongbin Sun,
Ziwei Liu,
Sanjay E. Sarma,
Michael M. Bronstein,
Justin M. Solomon
Abstract:
Point clouds provide a flexible geometric representation suitable for countless applications in computer graphics; they also comprise the raw output of most 3D data acquisition devices. While hand-designed features on point clouds have long been proposed in graphics and vision, however, the recent overwhelming success of convolutional neural networks (CNNs) for image analysis suggests the value of…
▽ More
Point clouds provide a flexible geometric representation suitable for countless applications in computer graphics; they also comprise the raw output of most 3D data acquisition devices. While hand-designed features on point clouds have long been proposed in graphics and vision, however, the recent overwhelming success of convolutional neural networks (CNNs) for image analysis suggests the value of adapting insight from CNN to the point cloud world. Point clouds inherently lack topological information so designing a model to recover topology can enrich the representation power of point clouds. To this end, we propose a new neural network module dubbed EdgeConv suitable for CNN-based high-level tasks on point clouds including classification and segmentation. EdgeConv acts on graphs dynamically computed in each layer of the network. It is differentiable and can be plugged into existing architectures. Compared to existing modules operating in extrinsic space or treating each point independently, EdgeConv has several appealing properties: It incorporates local neighborhood information; it can be stacked applied to learn global shape properties; and in multi-layer systems affinity in feature space captures semantic characteristics over potentially long distances in the original embedding. We show the performance of our model on standard benchmarks including ModelNet40, ShapeNetPart, and S3DIS.
△ Less
Submitted 11 June, 2019; v1 submitted 23 January, 2018;
originally announced January 2018.
-
CIDI-Lung-Seg: A Single-Click Annotation Tool for Automatic Delineation of Lungs from CT Scans
Authors:
Awais Mansoor,
Ulas Bagci,
Brent Foster,
Ziyue Xu,
Deborah Douglas,
Jeffrey M. Solomon,
Jayaram K. Udupa,
Daniel J. Mollura
Abstract:
Accurate and fast extraction of lung volumes from computed tomography (CT) scans remains in a great demand in the clinical environment because the available methods fail to provide a generic solution due to wide anatomical variations of lungs and existence of pathologies. Manual annotation, current gold standard, is time consuming and often subject to human bias. On the other hand, current state-o…
▽ More
Accurate and fast extraction of lung volumes from computed tomography (CT) scans remains in a great demand in the clinical environment because the available methods fail to provide a generic solution due to wide anatomical variations of lungs and existence of pathologies. Manual annotation, current gold standard, is time consuming and often subject to human bias. On the other hand, current state-of-the-art fully automated lung segmentation methods fail to make their way into the clinical practice due to their inability to efficiently incorporate human input for handling misclassifications and praxis. This paper presents a lung annotation tool for CT images that is interactive, efficient, and robust. The proposed annotation tool produces an "as accurate as possible" initial annotation based on the fuzzy-connectedness image segmentation, followed by efficient manual fixation of the initial extraction if deemed necessary by the practitioner. To provide maximum flexibility to the users, our annotation tool is supported in three major operating systems (Windows, Linux, and the Mac OS X). The quantitative results comparing our free software with commercially available lung segmentation tools show higher degree of consistency and precision of our software with a considerable potential to enhance the performance of routine clinical tasks.
△ Less
Submitted 11 July, 2014;
originally announced July 2014.
