Showing 1–50 of 118 results for author: Maji, S

Multi-Objective Optimization for Common-Centroid Placement of Analog Transistors

Authors: Supriyo Maji, Hyungjoo Park, Gi moon Hong, Souradip Poddar, David Z. Pan

Abstract: In analog circuits, process variation can cause unpredictability in circuit performance. Common-centroid (CC) type layouts have been shown to mitigate process-induced variations and are widely used to match circuit elements. Nevertheless, selecting the most suitable CC topology necessitates careful consideration of important layout constraints. Manual handling of these constraints becomes challeng… ▽ More In analog circuits, process variation can cause unpredictability in circuit performance. Common-centroid (CC) type layouts have been shown to mitigate process-induced variations and are widely used to match circuit elements. Nevertheless, selecting the most suitable CC topology necessitates careful consideration of important layout constraints. Manual handling of these constraints becomes challenging, especially with large size problems. State-of-the-art CC placement methods lack an optimization framework to handle important layout constraints collectively. They also require manual efforts and consequently, the solutions can be suboptimal. To address this, we propose a unified framework based on multi-objective optimization for CC placement of analog transistors. Our method handles various constraints, including degree of dispersion, routing complexity, diffusion sharing, and layout dependent effects. The multi-objective optimization provides better handling of the objectives when compared to single-objective optimization. Moreover, compared to existing methods, our method explores more CC topologies. Post-layout simulation results show better performance compared to state-of-the-art techniques in generating CC layouts. △ Less

Submitted 30 June, 2024; originally announced July 2024.

Spectral representation in Klein space: simplifying celestial leaf amplitudes

Authors: Sarthak Duary, Sourav Maji

Abstract: In this paper, we explore the spectral representation in Klein space, which is the split $(2,2)$ signature flat spacetime. The Klein space can be foliated into Lorentzian $\mathrm{AdS}_3 /\mathbb{Z}$ slices, and its identity resolution has continuous and discrete parts. We calculate the identity resolution and the Plancherel measure in these slices. Using the foliation of Klein space into the slic… ▽ More In this paper, we explore the spectral representation in Klein space, which is the split $(2,2)$ signature flat spacetime. The Klein space can be foliated into Lorentzian $\mathrm{AdS}_3 /\mathbb{Z}$ slices, and its identity resolution has continuous and discrete parts. We calculate the identity resolution and the Plancherel measure in these slices. Using the foliation of Klein space into the slices, the identity resolution, and the Plancherel measure in each slice, we compute the spectral representation of the massive bulk-to-bulk propagator in Klein space. It can be expressed as the sum of the product of two massive (or tachyonic) conformal primary wavefunctions, with both continuous and discrete parts, and sharing a common boundary coordinate. An interesting point in Klein space is that, since the identity resolution has discrete and continuous parts, a new type of conformal primary wavefunction naturally arises for the massive (or tachyonic) case. For the conformal primary wavefunctions, both the discrete and continuous parts involve integrating over the common boundary coordinate and the real (or imaginary) mass. The conformal dimension is summed in the discrete part, whereas it is integrated in the continuous part. The spectral representation in Klein space is a computational tool to derive conformal block expansions for celestial amplitudes in Klein space and its building blocks, called celestial leaf amplitudes, by integrating the particle interaction vertex over a single slice of foliation. △ Less

Submitted 30 July, 2024; v1 submitted 4 June, 2024; originally announced June 2024.

Comments: 43 pages, 3 figures, typos and minor errors corrected, matches journal version to appear in JHEP

Description of turbulent dynamics in the interstellar medium: Multifractal microcanonical analysis: II. Sparse filtering of Herschel observation maps and visualization of filamentary structures at different length scales

Authors: A. Rashidi, H. Yahia, S. Bontemps, N. Schneider, L. Bonne, P. Hennebelle, J. Scholtys, G. Attuel, A. Turiel, R. Simon, A. Cailly, A. Zebadua, A. Cherif, C. Lacroix, M. Martin, A. El Aouni, C. Sakka, S. K. Maji

Abstract: We present significant improvements to our previous work on noise reduction in {\sl Herschel} observation maps by defining sparse filtering tools capable of handling, in a unified formalism, a significantly improved noise reduction as well as a deconvolution in order to reduce effects introduced by the limited instrumental response (beam). We implement greater flexibility by allowing a wider choic… ▽ More We present significant improvements to our previous work on noise reduction in {\sl Herschel} observation maps by defining sparse filtering tools capable of handling, in a unified formalism, a significantly improved noise reduction as well as a deconvolution in order to reduce effects introduced by the limited instrumental response (beam). We implement greater flexibility by allowing a wider choice of parsimonious priors in the noise-reduction process. More precisely, we introduce a sparse filtering and deconvolution approach approach of type $l^2$-$l^p$, with $p > 0$ variable and apply it to a larger set of molecular clouds using {\sl Herschel} 250 $μ$m data in order to demonstrate their wide range of application. In the {\sl Herschel} data, we are able to use this approach to highlight extremely fine filamentary structures and obtain singularity spectra that tend to show a significantly less $\log$-normal behavior and a filamentary nature in the less dense regions. We also use high-resolution adaptive magneto-hydrodynamic simulation data to assess the quality of deconvolution in such a simulated beaming framework. △ Less

Submitted 5 June, 2024; v1 submitted 2 June, 2024; originally announced June 2024.

Comments: 24 pages, 32 figures, official acceptance date on 16/05/2024 (Astronomy & Astrophysics)

MSC Class: 85-02

Journal ref: Astronomy & Astrophysics 2024

MobileConvRec: A Conversational Dataset for Mobile Apps Recommendations

Authors: Srijata Maji, Moghis Fereidouni, Vinaik Chhetri, Umar Farooq, A. B. Siddique

Abstract: Existing recommendation systems have focused on two paradigms: 1- historical user-item interaction-based recommendations and 2- conversational recommendations. Conversational recommendation systems facilitate natural language dialogues between users and the system, allowing the system to solicit users' explicit needs while enabling users to inquire about recommendations and provide feedback. Due t… ▽ More Existing recommendation systems have focused on two paradigms: 1- historical user-item interaction-based recommendations and 2- conversational recommendations. Conversational recommendation systems facilitate natural language dialogues between users and the system, allowing the system to solicit users' explicit needs while enabling users to inquire about recommendations and provide feedback. Due to substantial advancements in natural language processing, conversational recommendation systems have gained prominence. Existing conversational recommendation datasets have greatly facilitated research in their respective domains. Despite the exponential growth in mobile users and apps in recent years, research in conversational mobile app recommender systems has faced substantial constraints. This limitation can primarily be attributed to the lack of high-quality benchmark datasets specifically tailored for mobile apps. To facilitate research for conversational mobile app recommendations, we introduce MobileConvRec. MobileConvRec simulates conversations by leveraging real user interactions with mobile apps on the Google Play store, originally captured in large-scale mobile app recommendation dataset MobileRec. The proposed conversational recommendation dataset synergizes sequential user-item interactions, which reflect implicit user preferences, with comprehensive multi-turn conversations to effectively grasp explicit user needs. MobileConvRec consists of over 12K multi-turn recommendation-related conversations spanning 45 app categories. Moreover, MobileConvRec presents rich metadata for each app such as permissions data, security and privacy-related information, and binary executables of apps, among others. We demonstrate that MobileConvRec can serve as an excellent testbed for conversational mobile app recommendation through a comparative study of several pre-trained large language models. △ Less

Submitted 27 May, 2024; originally announced May 2024.

OSLO: One-Shot Label-Only Membership Inference Attacks

Authors: Yuefeng Peng, Jaechul Roh, Subhransu Maji, Amir Houmansadr

Abstract: We introduce One-Shot Label-Only (OSLO) membership inference attacks (MIAs), which accurately infer a given sample's membership in a target model's training set with high precision using just \emph{a single query}, where the target model only returns the predicted hard label. This is in contrast to state-of-the-art label-only attacks which require $\sim6000$ queries, yet get attack precisions lowe… ▽ More We introduce One-Shot Label-Only (OSLO) membership inference attacks (MIAs), which accurately infer a given sample's membership in a target model's training set with high precision using just \emph{a single query}, where the target model only returns the predicted hard label. This is in contrast to state-of-the-art label-only attacks which require $\sim6000$ queries, yet get attack precisions lower than OSLO's. OSLO leverages transfer-based black-box adversarial attacks. The core idea is that a member sample exhibits more resistance to adversarial perturbations than a non-member. We compare OSLO against state-of-the-art label-only attacks and demonstrate that, despite requiring only one query, our method significantly outperforms previous attacks in terms of precision and true positive rate (TPR) under the same false positive rates (FPR). For example, compared to previous label-only MIAs, OSLO achieves a TPR that is 7$\times$ to 28$\times$ stronger under a 0.1\% FPR on CIFAR10 for a ResNet model. We evaluated multiple defense mechanisms against OSLO. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Feedback in emerging extragalactic star clusters, FEAST: The relation between 3.3 $μ$m PAH emission and Star Formation Rate traced by ionized gas in NGC 628

Authors: Benjamin Gregg, Daniela Calzetti, Angela Adamo, Varun Bajaj, Jenna E. Ryon, Sean T. Linden, Matteo Correnti, Michele Cignoni, Matteo Messa, Elena Sabbi, John S. Gallagher, Kathryn Grasha, Alex Pedrini, Robert A. Gutermuth, Jens Melinder, Ralf Kotulla, Gustavo Pérez, Mark R. Krumholz, Arjan Bik, Göran Östlin, Kelsey E. Johnson, Giacomo Bortolini, Linda J. Smith, Monica Tosi, Subhransu Maji , et al. (1 additional authors not shown)

Abstract: We present maps of ionized gas (traced by Pa$α$ and Br$α$) and 3.3 $μ$m Polycyclic Aromatic Hydrocarbon (PAH) emission in the nearby spiral galaxy NGC 628, derived from new JWST/NIRCam data from the FEAST survey. With this data, we investigate and calibrate the relation between 3.3 $μ$m PAH emission and star formation rate (SFR) in and around emerging young star clusters (eYSCs) on a scale of… ▽ More We present maps of ionized gas (traced by Pa$α$ and Br$α$) and 3.3 $μ$m Polycyclic Aromatic Hydrocarbon (PAH) emission in the nearby spiral galaxy NGC 628, derived from new JWST/NIRCam data from the FEAST survey. With this data, we investigate and calibrate the relation between 3.3 $μ$m PAH emission and star formation rate (SFR) in and around emerging young star clusters (eYSCs) on a scale of ${\sim}40$ pc. We find a tight (correlation coefficient $ρ$${\sim}$0.9) sub-linear (power-law exponent $α$${\sim}$0.75) relation between the 3.3 $μ$m PAH luminosity surface density and SFR traced by Br$α$ for compact, cospatial (within 0.16$''$ or ${\sim}$7 pc) peaks in Pa$α$, Br$α$, and 3.3 $μ$m (eYSC-I). The scatter in the relationship does not correlate well with variations in local interstellar medium (ISM) metallicity due to a radial metallicity gradient, but rather is likely due to stochastic sampling of the stellar initial mass function (IMF) and variations in the PAH heating and age of our sources. The deviation from a linear relation may be explained by PAH destruction in more intense ionizing environments, variations in age, and IMF stochasticity at intermediate to low luminosities. We test our results with various continuum subtraction techniques using combinations of NIRCam bands and find that they remain robust with only minor differences in the derived slope and intercept. An unexpected discrepancy is identified between the relations of hydrogen recombination lines (Pa$α$ versus Br$α$; H$α$ versus Br$α$). △ Less

Submitted 15 May, 2024; originally announced May 2024.

Comments: 28 pages, 10 figures, 3 tables

Task2Box: Box Embeddings for Modeling Asymmetric Task Relationships

Authors: Rangel Daroya, Aaron Sun, Subhransu Maji

Abstract: Modeling and visualizing relationships between tasks or datasets is an important step towards solving various meta-tasks such as dataset discovery, multi-tasking, and transfer learning. However, many relationships, such as containment and transferability, are naturally asymmetric and current approaches for representation and visualization (e.g., t-SNE) do not readily support this. We propose Task2… ▽ More Modeling and visualizing relationships between tasks or datasets is an important step towards solving various meta-tasks such as dataset discovery, multi-tasking, and transfer learning. However, many relationships, such as containment and transferability, are naturally asymmetric and current approaches for representation and visualization (e.g., t-SNE) do not readily support this. We propose Task2Box, an approach to represent tasks using box embeddings -- axis-aligned hyperrectangles in low dimensional spaces -- that can capture asymmetric relationships between them through volumetric overlaps. We show that Task2Box accurately predicts unseen hierarchical relationships between nodes in ImageNet and iNaturalist datasets, as well as transferability between tasks in the Taskonomy benchmark. We also show that box embeddings estimated from task representations (e.g., CLIP, Task2Vec, or attribute based) can be used to predict relationships between unseen tasks more accurately than classifiers trained on the same representations, as well as handcrafted asymmetric distances (e.g., KL divergence). This suggests that low-dimensional box embeddings can effectively capture these task relationships and have the added advantage of being interpretable. We use the approach to visualize relationships among publicly available image classification datasets on popular dataset hosting platform called Hugging Face. △ Less

Submitted 29 March, 2024; v1 submitted 25 March, 2024; originally announced March 2024.

Efficient data selection employing Semantic Similarity-based Graph Structures for model training

Authors: Roxana Petcu, Subhadeep Maji

Abstract: Recent developments in natural language processing (NLP) have highlighted the need for substantial amounts of data for models to capture textual information accurately. This raises concerns regarding the computational resources and time required for training such models. This paper introduces Semantics for data SAliency in Model performance Estimation (SeSaME). It is an efficient data sampling mec… ▽ More Recent developments in natural language processing (NLP) have highlighted the need for substantial amounts of data for models to capture textual information accurately. This raises concerns regarding the computational resources and time required for training such models. This paper introduces Semantics for data SAliency in Model performance Estimation (SeSaME). It is an efficient data sampling mechanism solely based on textual information without passing the data through a compute-heavy model or other intensive pre-processing transformations. The application of this approach is demonstrated in the use case of low-resource automated speech recognition (ASR) models, which excessively rely on text-to-speech (TTS) calls when using augmented data. SeSaME learns to categorize new incoming data points into speech recognition difficulty buckets by employing semantic similarity-based graph structures and discrete ASR information from homophilous neighbourhoods through message passing. The results indicate reliable projections of ASR performance, with a 93% accuracy increase when using the proposed method compared to random predictions, bringing non-trivial information on the impact of textual representations in speech models. Furthermore, a series of experiments show both the benefits and challenges of using the ASR information on incoming data to fine-tune the model. We report a 7% drop in validation loss compared to random sampling, 7% WER drop with non-local aggregation when evaluating against a highly difficult dataset, and 1.8% WER drop with local aggregation and high semantic similarity between datasets. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: ICML 2023 Workshop: Sampling and Optimization in Discrete Space

Generalized Red-Blue Circular Annulus Cover Problem

Authors: Sukanya Maji, Supantha Pandit, Sanjib Sadhu

Abstract: We study the Generalized Red-Blue Annulus Cover problem for two sets of points, red ($R$) and blue ($B$), where each point $p \in R\cup B$ is associated with a positive penalty ${\cal P}(p)$. The red points have non-covering penalties, and the blue points have covering penalties. The objective is to compute a circular annulus ${\cal A}$ such that the value of the function ${\cal P}({R}^{out})$ +… ▽ More We study the Generalized Red-Blue Annulus Cover problem for two sets of points, red ($R$) and blue ($B$), where each point $p \in R\cup B$ is associated with a positive penalty ${\cal P}(p)$. The red points have non-covering penalties, and the blue points have covering penalties. The objective is to compute a circular annulus ${\cal A}$ such that the value of the function ${\cal P}({R}^{out})$ + ${\cal P}({ B}^{in})$ is minimum, where ${R}^{out} \subseteq {R}$ is the set of red points not covered by ${\cal A}$ and ${B}^{in} \subseteq {B}$ is the set of blue points covered by $\cal A$. We also study another version of this problem, where all the red points in $R$ and the minimum number of points in $B$ are covered by the circular annulus in two dimensions. We design polynomial-time algorithms for all such circular annulus problems. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Comments: 6 figures

The AGORA High-resolution Galaxy Simulations Comparison Project. VI. Similarities and Differences in the Circumgalactic Medium

Authors: Clayton Strawn, Santi Roca-Fàbrega, Joel R. Primack, Ji-hoon Kim, Anna Genina, Loic Hausammann, Hyeonyong Kim, Alessandro Lupi, Kentaro Nagamine, Johnny W. Powell, Yves Revaz, Ikkoh Shimizu, Héctor Velázquez, Tom Abel, Daniel Ceverino, Bili Dong, Minyong Jung, Thomas R. Quinn, Eun-jin Shin, Kirk S. S. Barrow, Avishai Dekel, Boon Kiat Oh, Nir Mandelker, Romain Teyssier, Cameron Hummels , et al. (4 additional authors not shown)

Abstract: We analyze the circumgalactic medium (CGM) for eight commonly-used cosmological codes in the AGORA collaboration. The codes are calibrated to use identical initial conditions, cosmology, heating and cooling, and star formation thresholds, but each evolves with its own unique code architecture and stellar feedback implementation. Here, we analyze the results of these simulations in terms of the str… ▽ More We analyze the circumgalactic medium (CGM) for eight commonly-used cosmological codes in the AGORA collaboration. The codes are calibrated to use identical initial conditions, cosmology, heating and cooling, and star formation thresholds, but each evolves with its own unique code architecture and stellar feedback implementation. Here, we analyze the results of these simulations in terms of the structure, composition, and phase dynamics of the CGM. We show properties such as metal distribution, ionization levels, and kinematics are effective tracers of the effects of the different code feedback and implementation methods, and as such they can be highly divergent between simulations. This is merely a fiducial set of models, against which we will in the future compare multiple feedback recipes for each code. Nevertheless, we find that the large parameter space these simulations establish can help disentangle the different variables that affect observable quantities in the CGM, e.g., showing that abundances for ions with higher ionization energy are more strongly determined by the simulation's metallicity, while abundances for ions with lower ionization energy are more strongly determined by the gas density and temperature. △ Less

Submitted 7 February, 2024; originally announced February 2024.

Comments: 32 pages, 17 figures. Published in ApJ

Journal ref: ApJ 962 29 (2024)

Improved Zero-Shot Classification by Adapting VLMs with Text Descriptions

Authors: Oindrila Saha, Grant Van Horn, Subhransu Maji

Abstract: The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of information -- descriptions of categories generated by large language models (LLMs) and abundant, fine-grained image classification datasets -- to improve the zero-… ▽ More The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of information -- descriptions of categories generated by large language models (LLMs) and abundant, fine-grained image classification datasets -- to improve the zero-shot classification performance of VLMs across fine-grained domains. On the technical side, we develop methods to train VLMs with this "bag-level" image-text supervision. We find that simply using these attributes at test-time does not improve performance, but our training strategy, for example, on the iNaturalist dataset, leads to an average improvement of 4-5% in zero-shot classification accuracy for novel categories of birds and flowers. Similar improvements are observed in domains where a subset of the categories was used to fine-tune the model. By prompting LLMs in various ways, we generate descriptions that capture visual appearance, habitat, and geographic regions and pair them with existing attributes such as the taxonomic structure of the categories. We systematically evaluate their ability to improve zero-shot categorization in natural domains. Our findings suggest that geographic priors can be just as effective and are complementary to visual appearance. Our method also outperforms prior work on prompt-based tuning of VLMs. We release the benchmark, consisting of 14 datasets at https://github.com/cvl-umass/AdaptCLIPZS , which will contribute to future research in zero-shot recognition. △ Less

Submitted 3 April, 2024; v1 submitted 4 January, 2024; originally announced January 2024.

Human-in-the-Loop Visual Re-ID for Population Size Estimation

Authors: Gustavo Perez, Daniel Sheldon, Grant Van Horn, Subhransu Maji

Abstract: Computer vision-based re-identification (Re-ID) systems are increasingly being deployed for estimating population size in large image collections. However, the estimated size can be significantly inaccurate when the task is challenging or when deployed on data from new distributions. We propose a human-in-the-loop approach for estimating population size driven by a pairwise similarity derived from… ▽ More Computer vision-based re-identification (Re-ID) systems are increasingly being deployed for estimating population size in large image collections. However, the estimated size can be significantly inaccurate when the task is challenging or when deployed on data from new distributions. We propose a human-in-the-loop approach for estimating population size driven by a pairwise similarity derived from an off-the-shelf Re-ID system. Our approach, based on nested importance sampling, selects pairs of images for human vetting driven by the pairwise similarity, and produces asymptotically unbiased population size estimates with associated confidence intervals. We perform experiments on various animal Re-ID datasets and demonstrate that our method outperforms strong baselines and active clustering approaches. In many cases, we are able to reduce the error rates of the estimated size from around 80% using CV alone to less than 20% by vetting a fraction (often less than 0.002%) of the total pairs. The cost of vetting reduces with the increase in accuracy and provides a practical approach for population size estimation within a desired tolerance when deploying Re-ID systems. △ Less

Submitted 15 July, 2024; v1 submitted 8 December, 2023; originally announced December 2023.

Counting $\mathcal{N} = 8$ Black Holes as Algebraic Varieties

Authors: Abhishek Chowdhury, Sourav Maji

Abstract: We calculate the helicity trace index $B_{14}$ for $\mathcal{N} = 8$ pure D-brane black holes using various techniques of computational algebraic geometry and find perfect agreement with the existing results in the literature. For these black holes, microstate counting is equivalent to finding the number of supersymmetric vacua of a multi-variable supersymmetric quantum mechanics which in turn is… ▽ More We calculate the helicity trace index $B_{14}$ for $\mathcal{N} = 8$ pure D-brane black holes using various techniques of computational algebraic geometry and find perfect agreement with the existing results in the literature. For these black holes, microstate counting is equivalent to finding the number of supersymmetric vacua of a multi-variable supersymmetric quantum mechanics which in turn is equivalent to solving a set of multi-variable polynomial equations with syzygies. We explore four different techniques to solve a set of polynomial equations, namely Newton Polytopes, Homotopy continuation, Monodromy and Hilbert series. Unlike other schemes, these methods are almost exact with a very high success rate for finding all solutions. A gauge invariant analysis is also possible using the symbolic Hilbert series. Furthermore, exploiting various exchange symmetries, we show the non-existence of a quartic and(or) higher order terms in the potential which if present would have spoiled the counting. Incorporating recent developments in mathematics, algorithms and multi-threading, we have extended the scope of one of the author's previous works to other charges and presented a new perspective for the microstate counting problem. This further establishes the pure D-brane system as a consistent model, bringing us a step closer to $\mathcal{N} = 2$ black hole counting. △ Less

Submitted 24 April, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

Comments: v2, shortened, added clarification on zero angular mom, (accepted in JHEP)

Scanning gate microscopy of nonretracing electron-hole trajectories in a normal-superconductor junction

Authors: S. Maji, K. Sowa, M. P. Nowak

Abstract: We theoretically study scanning gate microscopy (SGM) of electron and hole trajectories in a quantum point contact (QPC) embedded in a normal-superconductor (NS) junction. At zero voltage bias, the electrons and holes transported through the QPC form angular lobes and are subject to self-interference, which marks the SGM conductance maps with interference fringes analogously as in normal systems.… ▽ More We theoretically study scanning gate microscopy (SGM) of electron and hole trajectories in a quantum point contact (QPC) embedded in a normal-superconductor (NS) junction. At zero voltage bias, the electrons and holes transported through the QPC form angular lobes and are subject to self-interference, which marks the SGM conductance maps with interference fringes analogously as in normal systems. We predict that for an NS junction at non-zero bias a beating pattern is to occur in the conductance probed with the use of the SGM technique owing to a mismatch of the Fermi wavevectors of electrons and holes. Moreover, the SGM technique exposes a pronounced disturbance in the angular conductance pattern, as the retroreflected hole does not retrace the electron path due to wavevector difference. △ Less

Submitted 12 March, 2024; v1 submitted 5 October, 2023; originally announced October 2023.

Journal ref: Phys. Rev. B 109, 115410 (2024)

PARTICLE: Part Discovery and Contrastive Learning for Fine-grained Recognition

Authors: Oindrila Saha, Subhransu Maji

Abstract: We develop techniques for refining representations for fine-grained classification and segmentation tasks in a self-supervised manner. We find that fine-tuning methods based on instance-discriminative contrastive learning are not as effective, and posit that recognizing part-specific variations is crucial for fine-grained categorization. We present an iterative learning approach that incorporates… ▽ More We develop techniques for refining representations for fine-grained classification and segmentation tasks in a self-supervised manner. We find that fine-tuning methods based on instance-discriminative contrastive learning are not as effective, and posit that recognizing part-specific variations is crucial for fine-grained categorization. We present an iterative learning approach that incorporates part-centric equivariance and invariance objectives. First, pixel representations are clustered to discover parts. We analyze the representations from convolutional and vision transformer networks that are best suited for this task. Then, a part-centric learning step aggregates and contrasts representations of parts within an image. We show that this improves the performance on image classification and part segmentation tasks across datasets. For example, under a linear-evaluation scheme, the classification accuracy of a ResNet50 trained on ImageNet using DetCon, a self-supervised learning approach, improves from 35.4% to 42.0% on the Caltech-UCSD Birds, from 35.5% to 44.1% on the FGVC Aircraft, and from 29.7% to 37.4% on the Stanford Cars. We also observe significant gains in few-shot part segmentation tasks using the proposed technique, while instance-discriminative learning was not as effective. Smaller, yet consistent, improvements are also observed for stronger networks based on transformers. △ Less

Submitted 24 September, 2023; originally announced September 2023.

Eigenfunction localization and nodal geometry on dumbbell domains

Authors: Saikat Maji, Soumyajit Saha

Abstract: In this article, we study the location of the first nodal line and hot spots under different boundary conditions on dumbbell-shaped domains. Apart from its intrinsic interest, dumbbell domains are also geometrically contrasting to the extensively studied convex domains. For dumbbells with Dirichlet boundary, we investigate the location of the supremum level set of the first eigenfunction and discu… ▽ More In this article, we study the location of the first nodal line and hot spots under different boundary conditions on dumbbell-shaped domains. Apart from its intrinsic interest, dumbbell domains are also geometrically contrasting to the extensively studied convex domains. For dumbbells with Dirichlet boundary, we investigate the location of the supremum level set of the first eigenfunction and discuss the optimal positioning of obstacles. Considering the other end of level sets, the nodal sets, we establish that the first nodal set of a Neumann dumbbell (with sufficiently narrow connectors) lies within a neighborhood of the connectors. The article demonstrates the utilization of the asymptotic $L^2$-localization (or its absence, characterized by either Dirichlet or Neumann boundaries) of dumbbell domains in tackling the aforementioned nodal geometry problems. △ Less

Submitted 20 September, 2023; originally announced September 2023.

Comments: 18 pages, 4 figures. Comments are most welcome!

COSE: A Consistency-Sensitivity Metric for Saliency on Image Classification

Authors: Rangel Daroya, Aaron Sun, Subhransu Maji

Abstract: We present a set of metrics that utilize vision priors to effectively assess the performance of saliency methods on image classification tasks. To understand behavior in deep learning models, many methods provide visual saliency maps emphasizing image regions that most contribute to a model prediction. However, there is limited work on analyzing the reliability of saliency methods in explaining mo… ▽ More We present a set of metrics that utilize vision priors to effectively assess the performance of saliency methods on image classification tasks. To understand behavior in deep learning models, many methods provide visual saliency maps emphasizing image regions that most contribute to a model prediction. However, there is limited work on analyzing the reliability of saliency methods in explaining model decisions. We propose the metric COnsistency-SEnsitivity (COSE) that quantifies the equivariant and invariant properties of visual model explanations using simple data augmentations. Through our metrics, we show that although saliency methods are thought to be architecture-independent, most methods could better explain transformer-based models over convolutional-based models. In addition, GradCAM was found to outperform other methods in terms of COSE but was shown to have limitations such as lack of variability for fine-grained datasets. The duality between consistency and sensitivity allow the analysis of saliency methods from different angles. Ultimately, we find that it is important to balance these two metrics for a saliency map to faithfully show model behavior. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Superconvergence analysis of interior penalty discontinuous Galerkin method for a class of time-fractional diffusion problems

Authors: Sandip Maji, Srinivasan Natesan

Abstract: In this study, we consider a class of non-autonomous time-fractional partial advection-diffusion-reaction (TF-ADR) equations with Caputo type fractional derivative. To obtain the numerical solution of the model problem, we apply the non-symmetric interior penalty Galerkin (NIPG) method in space on a uniform mesh and the L1-scheme in time on a graded mesh. It is demonstrated that the computed solut… ▽ More In this study, we consider a class of non-autonomous time-fractional partial advection-diffusion-reaction (TF-ADR) equations with Caputo type fractional derivative. To obtain the numerical solution of the model problem, we apply the non-symmetric interior penalty Galerkin (NIPG) method in space on a uniform mesh and the L1-scheme in time on a graded mesh. It is demonstrated that the computed solution is discretely stable. Superconvergence of error estimates for the proposed method are obtained using the discrete energy-norm. Also, we have applied the proposed method to solve semilinear problems after linearizing by the Newton linearization process. The theoretical results are verified through numerical experiments. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Vacaspati: A Diverse Corpus of Bangla Literature

Authors: Pramit Bhattacharyya, Joydeep Mondal, Subhadip Maji, Arnab Bhattacharya

Abstract: Bangla (or Bengali) is the fifth most spoken language globally; yet, the state-of-the-art NLP in Bangla is lagging for even simple tasks such as lemmatization, POS tagging, etc. This is partly due to lack of a varied quality corpus. To alleviate this need, we build Vacaspati, a diverse corpus of Bangla literature. The literary works are collected from various websites; only those works that are pu… ▽ More Bangla (or Bengali) is the fifth most spoken language globally; yet, the state-of-the-art NLP in Bangla is lagging for even simple tasks such as lemmatization, POS tagging, etc. This is partly due to lack of a varied quality corpus. To alleviate this need, we build Vacaspati, a diverse corpus of Bangla literature. The literary works are collected from various websites; only those works that are publicly available without copyright violations or restrictions are collected. We believe that published literature captures the features of a language much better than newspapers, blogs or social media posts which tend to follow only a certain literary pattern and, therefore, miss out on language variety. Our corpus Vacaspati is varied from multiple aspects, including type of composition, topic, author, time, space, etc. It contains more than 11 million sentences and 115 million words. We also built a word embedding model, Vac-FT, using FastText from Vacaspati as well as trained an Electra model, Vac-BERT, using the corpus. Vac-BERT has far fewer parameters and requires only a fraction of resources compared to other state-of-the-art transformer models and yet performs either better or similar on various downstream tasks. On multiple downstream tasks, Vac-FT outperforms other FastText-based models. We also demonstrate the efficacy of Vacaspati as a corpus by showing that similar models built from other corpora are not as effective. The models are available at https://bangla.iitk.ac.in/. △ Less

Submitted 11 July, 2023; originally announced July 2023.

Report number: Accepted at IJCNLP-AACL 2023 main

LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs

Authors: Zezhou Cheng, Carlos Esteves, Varun Jampani, Abhishek Kar, Subhransu Maji, Ameesh Makadia

Abstract: A critical obstacle preventing NeRF models from being deployed broadly in the wild is their reliance on accurate camera poses. Consequently, there is growing interest in extending NeRF models to jointly optimize camera poses and scene representation, which offers an alternative to off-the-shelf SfM pipelines which have well-understood failure modes. Existing approaches for unposed NeRF operate und… ▽ More A critical obstacle preventing NeRF models from being deployed broadly in the wild is their reliance on accurate camera poses. Consequently, there is growing interest in extending NeRF models to jointly optimize camera poses and scene representation, which offers an alternative to off-the-shelf SfM pipelines which have well-understood failure modes. Existing approaches for unposed NeRF operate under limited assumptions, such as a prior pose distribution or coarse pose initialization, making them less effective in a general setting. In this work, we propose a novel approach, LU-NeRF, that jointly estimates camera poses and neural radiance fields with relaxed assumptions on pose configuration. Our approach operates in a local-to-global manner, where we first optimize over local subsets of the data, dubbed mini-scenes. LU-NeRF estimates local pose and geometry for this challenging few-shot task. The mini-scene poses are brought into a global reference frame through a robust pose synchronization step, where a final global optimization of pose and scene can be performed. We show our LU-NeRF pipeline outperforms prior attempts at unposed NeRF without making restrictive assumptions on the pose prior. This allows us to operate in the general SE(3) pose setting, unlike the baselines. Our results also indicate our model can be complementary to feature-based SfM pipelines as it compares favorably to COLMAP on low-texture and low-resolution images. △ Less

Submitted 8 June, 2023; originally announced June 2023.

Comments: Project website: https://people.cs.umass.edu/~zezhoucheng/lu-nerf/

DISCount: Counting in Large Image Collections with Detector-Based Importance Sampling

Authors: Gustavo Perez, Subhransu Maji, Daniel Sheldon

Abstract: Many modern applications use computer vision to detect and count objects in massive image collections. However, when the detection task is very difficult or in the presence of domain shifts, the counts may be inaccurate even with significant investments in training data and model development. We propose DISCount -- a detector-based importance sampling framework for counting in large image collecti… ▽ More Many modern applications use computer vision to detect and count objects in massive image collections. However, when the detection task is very difficult or in the presence of domain shifts, the counts may be inaccurate even with significant investments in training data and model development. We propose DISCount -- a detector-based importance sampling framework for counting in large image collections that integrates an imperfect detector with human-in-the-loop screening to produce unbiased estimates of counts. We propose techniques for solving counting problems over multiple spatial or temporal regions using a small number of screened samples and estimate confidence intervals. This enables end-users to stop screening when estimates are sufficiently accurate, which is often the goal in a scientific study. On the technical side we develop variance reduction techniques based on control variates and prove the (conditional) unbiasedness of the estimators. DISCount leads to a 9-12x reduction in the labeling costs over naive screening for tasks we consider, such as counting birds in radar imagery or estimating damaged buildings in satellite imagery, and also surpasses alternative covariate-based screening approaches in efficiency. △ Less

Submitted 5 June, 2023; originally announced June 2023.

A Comparative Analysis of Portfolio Optimization Using Mean-Variance, Hierarchical Risk Parity, and Reinforcement Learning Approaches on the Indian Stock Market

Authors: Jaydip Sen, Aditya Jaiswal, Anshuman Pathak, Atish Kumar Majee, Kushagra Kumar, Manas Kumar Sarkar, Soubhik Maji

Abstract: This paper presents a comparative analysis of the performances of three portfolio optimization approaches. Three approaches of portfolio optimization that are considered in this work are the mean-variance portfolio (MVP), hierarchical risk parity (HRP) portfolio, and reinforcement learning-based portfolio. The portfolios are trained and tested over several stock data and their performances are com… ▽ More This paper presents a comparative analysis of the performances of three portfolio optimization approaches. Three approaches of portfolio optimization that are considered in this work are the mean-variance portfolio (MVP), hierarchical risk parity (HRP) portfolio, and reinforcement learning-based portfolio. The portfolios are trained and tested over several stock data and their performances are compared on their annual returns, annual risks, and Sharpe ratios. In the reinforcement learning-based portfolio design approach, the deep Q learning technique has been utilized. Due to the large number of possible states, the construction of the Q-table is done using a deep neural network. The historical prices of the 50 premier stocks from the Indian stock market, known as the NIFTY50 stocks, and several stocks from 10 important sectors of the Indian stock market are used to create the environment for training the agent. △ Less

Submitted 27 May, 2023; originally announced May 2023.

Comments: The report is 52 pages long. It is based on the capstone project done in the post graduate course of data science in Praxis Business School, Kolkata, India, of the Autumn Batch, 2022

Accidental Turntables: Learning 3D Pose by Watching Objects Turn

Authors: Zezhou Cheng, Matheus Gadelha, Subhransu Maji

Abstract: We propose a technique for learning single-view 3D object pose estimation models by utilizing a new source of data -- in-the-wild videos where objects turn. Such videos are prevalent in practice (e.g., cars in roundabouts, airplanes near runways) and easy to collect. We show that classical structure-from-motion algorithms, coupled with the recent advances in instance detection and feature matching… ▽ More We propose a technique for learning single-view 3D object pose estimation models by utilizing a new source of data -- in-the-wild videos where objects turn. Such videos are prevalent in practice (e.g., cars in roundabouts, airplanes near runways) and easy to collect. We show that classical structure-from-motion algorithms, coupled with the recent advances in instance detection and feature matching, provides surprisingly accurate relative 3D pose estimation on such videos. We propose a multi-stage training scheme that first learns a canonical pose across a collection of videos and then supervises a model for single-view pose estimation. The proposed technique achieves competitive performance with respect to existing state-of-the-art on standard benchmarks for 3D pose estimation, without requiring any pose labels during training. We also contribute an Accidental Turntables Dataset, containing a challenging set of 41,212 images of cars in cluttered backgrounds, motion blur and illumination changes that serves as a benchmark for 3D pose estimation. △ Less

Submitted 12 December, 2022; originally announced December 2022.

Comments: Project website: https://people.cs.umass.edu/~zezhoucheng/acci-turn/

MvDeCor: Multi-view Dense Correspondence Learning for Fine-grained 3D Segmentation

Authors: Gopal Sharma, Kangxue Yin, Subhransu Maji, Evangelos Kalogerakis, Or Litany, Sanja Fidler

Abstract: We propose to utilize self-supervised techniques in the 2D domain for fine-grained 3D shape segmentation tasks. This is inspired by the observation that view-based surface representations are more effective at modeling high-resolution surface details and texture than their 3D counterparts based on point clouds or voxel occupancy. Specifically, given a 3D shape, we render it from multiple views, an… ▽ More We propose to utilize self-supervised techniques in the 2D domain for fine-grained 3D shape segmentation tasks. This is inspired by the observation that view-based surface representations are more effective at modeling high-resolution surface details and texture than their 3D counterparts based on point clouds or voxel occupancy. Specifically, given a 3D shape, we render it from multiple views, and set up a dense correspondence learning task within the contrastive learning framework. As a result, the learned 2D representations are view-invariant and geometrically consistent, leading to better generalization when trained on a limited number of labeled shapes compared to alternatives that utilize self-supervision in 2D or 3D alone. Experiments on textured (RenderPeople) and untextured (PartNet) 3D datasets show that our method outperforms state-of-the-art alternatives in fine-grained part segmentation. The improvements over baselines are greater when only a sparse set of views is available for training or when shapes are textured, indicating that MvDeCor benefits from both 2D processing and 3D geometric reasoning. △ Less

Submitted 17 August, 2022; originally announced August 2022.

Comments: project page: https://nv-tlabs.github.io/MvDeCor/

Cross-Modal 3D Shape Generation and Manipulation

Authors: Zezhou Cheng, Menglei Chai, Jian Ren, Hsin-Ying Lee, Kyle Olszewski, Zeng Huang, Subhransu Maji, Sergey Tulyakov

Abstract: Creating and editing the shape and color of 3D objects require tremendous human effort and expertise. Compared to direct manipulation in 3D interfaces, 2D interactions such as sketches and scribbles are usually much more natural and intuitive for the users. In this paper, we propose a generic multi-modal generative model that couples the 2D modalities and implicit 3D representations through shared… ▽ More Creating and editing the shape and color of 3D objects require tremendous human effort and expertise. Compared to direct manipulation in 3D interfaces, 2D interactions such as sketches and scribbles are usually much more natural and intuitive for the users. In this paper, we propose a generic multi-modal generative model that couples the 2D modalities and implicit 3D representations through shared latent spaces. With the proposed model, versatile 3D generation and manipulation are enabled by simply propagating the editing from a specific 2D controlling modality through the latent spaces. For example, editing the 3D shape by drawing a sketch, re-colorizing the 3D surface via painting color scribbles on the 2D rendering, or generating 3D shapes of a certain category given one or a few reference images. Unlike prior works, our model does not require re-training or fine-tuning per editing task and is also conceptually simple, easy to implement, robust to input domain shifts, and flexible to diverse reconstruction on partial 2D inputs. We evaluate our framework on two representative 2D modalities of grayscale line sketches and rendered color images, and demonstrate that our method enables various shape manipulation and generation tasks with these 2D modalities. △ Less

Submitted 24 July, 2022; originally announced July 2022.

Comments: ECCV 2022. Project page: https://people.cs.umass.edu/~zezhoucheng/edit3d/

Star Cluster Formation and Evolution in M101: An Investigation with the Legacy Extragalactic UV Survey

Authors: S. T. Linden, G. Perez, D. Calzetti, S. Maji, M. Messa, B. C. Whitmore, R. Chandar, A. Adamo, K. Grasha, D. O. Cook, B. G. Elmegreen, D. A. Dale, E. Sacchi, E. Sabbi, E. K. Grebel, L. Smith

Abstract: We present Hubble Space Telescope WFC3/UVIS (F275W, F336W) and ACS/WFC optical (F435W, F555W, and F814W) observations of the nearby grand-design spiral galaxy M101 as part of the Legacy Extragalactic UV Survey (LEGUS). Compact sources detected in at least four bands were classified by both human experts and the convolutional neural network StarcNet. Human experts classified the 2,351 brightest sou… ▽ More We present Hubble Space Telescope WFC3/UVIS (F275W, F336W) and ACS/WFC optical (F435W, F555W, and F814W) observations of the nearby grand-design spiral galaxy M101 as part of the Legacy Extragalactic UV Survey (LEGUS). Compact sources detected in at least four bands were classified by both human experts and the convolutional neural network StarcNet. Human experts classified the 2,351 brightest sources, retrieving $N_{c} = 965$ star clusters. StarcNet, trained on LEGUS data not including M101, classified all 4,725 sources detected in four bands, retrieving $N_{c} = 2,270$ star clusters. The combined catalog represents the most complete census to date of compact star clusters in M101. We find that for the 2,351 sources with both a visual- and ML-classification StarcNet is able to reproduce the human classifications at high levels of accuracy ($\sim 80-90\%$), which is equivalent to the level of agreement between human classifiers in LEGUS. The derived cluster age distribution implies a disruption rate of $dN/dτ\propto τ^{-0.45 \pm 0.14}$ over $10^{7} < τ< 10^{8.5}$yr for cluster masses $\geq 10^{3.55} M_{\odot}$ for the central region of M101 and $dN/dτ\propto τ^{-0.02 \pm 0.15}$ for cluster masses $\geq 10^{3.38} M_{\odot}$ in the northwest region of the galaxy. The trends we recover are weaker than those of other nearby spirals (e.g. M51) and starbursts, consistent with the M101 environment having a lower-density interstellar medium, and providing evidence in favor of environmentally-dependent cluster disruption in the central, southeast, and northwest regions of M101. △ Less

Submitted 28 June, 2022; originally announced June 2022.

Comments: 24 pages, 18 figures, 3 tables. Accepted for publication in the Astrophysical Journal

Perceptually Optimized Color Selection for Visualization

Authors: Subhrajyoti Maji, John Dingliana

Abstract: We propose an approach, called the Equilibrium Distribution Model (EDM), for automatically selecting colors with optimum perceptual contrast for scientific visualization. Given any number of features that need to be emphasized in a visualization task, our approach derives evenly distributed points in the CIELAB color space to assign colors to the features so that the minimum Euclidean Distance amo… ▽ More We propose an approach, called the Equilibrium Distribution Model (EDM), for automatically selecting colors with optimum perceptual contrast for scientific visualization. Given any number of features that need to be emphasized in a visualization task, our approach derives evenly distributed points in the CIELAB color space to assign colors to the features so that the minimum Euclidean Distance among the colors are optimized. Our approach can assign colors with high perceptual contrast even for very high numbers of features, where other color selection methods typically fail. We compare our approach with the widely used Harmonic color selection scheme and demonstrate that while the harmonic scheme can achieve reasonable color contrast for visualizing up to 20 different features, our Equilibrium scheme provides significantly better contrast and achieves perceptible contrast for visualizing even up to 100 unique features. △ Less

Submitted 28 May, 2022; originally announced May 2022.

Comments: 2 pages, 4 figures, 1 table, Poster presented at IEEE Visualization Conference, Oct 21 - 26, 2018, Berlin, Germany

Improving Few-Shot Part Segmentation using Coarse Supervision

Authors: Oindrila Saha, Zezhou Cheng, Subhransu Maji

Abstract: A significant bottleneck in training deep networks for part segmentation is the cost of obtaining detailed annotations. We propose a framework to exploit coarse labels such as figure-ground masks and keypoint locations that are readily available for some categories to improve part segmentation models. A key challenge is that these annotations were collected for different tasks and with different l… ▽ More A significant bottleneck in training deep networks for part segmentation is the cost of obtaining detailed annotations. We propose a framework to exploit coarse labels such as figure-ground masks and keypoint locations that are readily available for some categories to improve part segmentation models. A key challenge is that these annotations were collected for different tasks and with different labeling styles and cannot be readily mapped to the part labels. To this end, we propose to jointly learn the dependencies between labeling styles and the part segmentation model, allowing us to utilize supervision from diverse labels. To evaluate our approach we develop a benchmark on the Caltech-UCSD birds and OID Aircraft dataset. Our approach outperforms baselines based on multi-task learning, semi-supervised learning, and competitive methods relying on loss functions manually designed to exploit sparse-supervision. △ Less

Submitted 27 July, 2022; v1 submitted 11 April, 2022; originally announced April 2022.

Comments: ECCV'22 Camera Ready

How well does CLIP understand texture?

Authors: Chenyun Wu, Subhransu Maji

Abstract: We investigate how well CLIP understands texture in natural images described by natural language. To this end, we analyze CLIP's ability to: (1) perform zero-shot learning on various texture and material classification datasets; (2) represent compositional properties of texture such as red dots or yellow stripes on the Describable Texture in Detail(DTDD) dataset; and (3) aid fine-grained categoriz… ▽ More We investigate how well CLIP understands texture in natural images described by natural language. To this end, we analyze CLIP's ability to: (1) perform zero-shot learning on various texture and material classification datasets; (2) represent compositional properties of texture such as red dots or yellow stripes on the Describable Texture in Detail(DTDD) dataset; and (3) aid fine-grained categorization of birds in photographs described by color and texture of their body parts. △ Less

Submitted 4 November, 2022; v1 submitted 22 March, 2022; originally announced March 2022.

Comments: ECCV 2022 CVinW Workshop

Graph Neural Network Enhanced Language Models for Efficient Multilingual Text Classification

Authors: Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar

Abstract: Online social media works as a source of various valuable and actionable information during disasters. These information might be available in multiple languages due to the nature of user generated content. An effective system to automatically identify and categorize these actionable information should be capable to handle multiple languages and under limited supervision. However, existing works m… ▽ More Online social media works as a source of various valuable and actionable information during disasters. These information might be available in multiple languages due to the nature of user generated content. An effective system to automatically identify and categorize these actionable information should be capable to handle multiple languages and under limited supervision. However, existing works mostly focus on English language only with the assumption that sufficient labeled data is available. To overcome these challenges, we propose a multilingual disaster related text classification system which is capable to work under \{mono, cross and multi\} lingual scenarios and under limited supervision. Our end-to-end trainable framework combines the versatility of graph neural networks, by applying over the corpus, with the power of transformer based large language models, over examples, with the help of cross-attention between the two. We evaluate our framework over total nine English, Non-English and monolingual datasets in \{mono, cross and multi\} lingual classification scenarios. Our framework outperforms state-of-the-art models in disaster domain and multilingual BERT baseline in terms of Weighted F$_1$ score. We also show the generalizability of the proposed model under limited supervision. △ Less

Submitted 6 March, 2022; originally announced March 2022.

Comments: Under Review

Probing spin dynamics of 2D excitons with twisted light

Authors: A. K. Pattanayak, P. Das, D. Chakrabarty, A. Dhara, S. Paul, S. Maji, M. M. Brundavanam, S. Dhara

Abstract: We propose a mechanism of intravalley spin-flip scattering in spin-valley coupled two dimensional systems by transferring momentum of light into exciton center of mass using optical vortex (OV) beams. By varying the dispersion of light using the topological charge of OV beam, we demonstrate a unique approach to control the intra-valley spin-flip scattering rate of excitons. From our photoluminesce… ▽ More We propose a mechanism of intravalley spin-flip scattering in spin-valley coupled two dimensional systems by transferring momentum of light into exciton center of mass using optical vortex (OV) beams. By varying the dispersion of light using the topological charge of OV beam, we demonstrate a unique approach to control the intra-valley spin-flip scattering rate of excitons. From our photoluminescence measurements, we demonstrate that the intra-valley scattering rate in W-based TMDs can be tuned externally by OV beams. Variation of photoluminescence intensity with topological charges shows a crossover temperature (> 150 K), indicating competitions among time scales involving radiative recombination, spin-flip scattering, and thermal relaxations. Our proposed technique utilizing a structured light beam can open up a new approach to explore the physics of excitons in 2D systems. △ Less

Submitted 4 October, 2022; v1 submitted 23 February, 2022; originally announced February 2022.

Comments: 14 pages, 3 figures (Main text); 13 pages, 12 figures (Supporting Information)

Journal ref: ACS Photonics (2022)

PriFit: Learning to Fit Primitives Improves Few Shot Point Cloud Segmentation

Authors: Gopal Sharma, Bidya Dash, Aruni RoyChowdhury, Matheus Gadelha, Marios Loizou, Liangliang Cao, Rui Wang, Erik Learned-Miller, Subhransu Maji, Evangelos Kalogerakis

Abstract: We present PriFit, a semi-supervised approach for label-efficient learning of 3D point cloud segmentation networks. PriFit combines geometric primitive fitting with point-based representation learning. Its key idea is to learn point representations whose clustering reveals shape regions that can be approximated well by basic geometric primitives, such as cuboids and ellipsoids. The learned point r… ▽ More We present PriFit, a semi-supervised approach for label-efficient learning of 3D point cloud segmentation networks. PriFit combines geometric primitive fitting with point-based representation learning. Its key idea is to learn point representations whose clustering reveals shape regions that can be approximated well by basic geometric primitives, such as cuboids and ellipsoids. The learned point representations can then be re-used in existing network architectures for 3D point cloud segmentation, and improves their performance in the few-shot setting. According to our experiments on the widely used ShapeNet and PartNet benchmarks, PriFit outperforms several state-of-the-art methods in this setting, suggesting that decomposability into primitives is a useful prior for learning representations predictive of semantic parts. We present a number of ablative experiments varying the choice of geometric primitives and downstream tasks to demonstrate the effectiveness of the method. △ Less

Submitted 23 June, 2022; v1 submitted 27 December, 2021; originally announced December 2021.

Supervised Graph Contrastive Pretraining for Text Classification

Authors: Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar

Abstract: Contrastive pretraining techniques for text classification has been largely studied in an unsupervised setting. However, oftentimes labeled data from related tasks which share label semantics with current task is available. We hypothesize that using this labeled data effectively can lead to better generalization on current task. In this paper, we propose a novel way to effectively utilize labeled… ▽ More Contrastive pretraining techniques for text classification has been largely studied in an unsupervised setting. However, oftentimes labeled data from related tasks which share label semantics with current task is available. We hypothesize that using this labeled data effectively can lead to better generalization on current task. In this paper, we propose a novel way to effectively utilize labeled data from related tasks with a graph based supervised contrastive learning approach. We formulate a token-graph by extrapolating the supervised information from examples to tokens. Our formulation results in an embedding space where tokens with high/low probability of belonging to same class are near/further-away from one another. We also develop detailed theoretical insights which serve as a motivation for our method. In our experiments with $13$ datasets, we show our method outperforms pretraining schemes by $2.5\%$ and also example-level contrastive learning based formulation by $1.8\%$ on average. In addition, we show cross-domain effectiveness of our method in a zero-shot setting by $3.91\%$ on average. Lastly, we also demonstrate our method can be used as a noisy teacher in a knowledge distillation setting to significantly improve performance of transformer based models in low labeled data regime by $4.57\%$ on average. △ Less

Submitted 21 December, 2021; originally announced December 2021.

Comments: A condensed version of this paper has been accepted to ACM SAC'22. DOI: https://doi.org/10.1145/3477314.3507194

GANORCON: Are Generative Models Useful for Few-shot Segmentation?

Authors: Oindrila Saha, Zezhou Cheng, Subhransu Maji

Abstract: Advances in generative modeling based on GANs has motivated the community to find their use beyond image generation and editing tasks. In particular, several recent works have shown that GAN representations can be re-purposed for discriminative tasks such as part segmentation, especially when training data is limited. But how do these improvements stack-up against recent advances in self-supervise… ▽ More Advances in generative modeling based on GANs has motivated the community to find their use beyond image generation and editing tasks. In particular, several recent works have shown that GAN representations can be re-purposed for discriminative tasks such as part segmentation, especially when training data is limited. But how do these improvements stack-up against recent advances in self-supervised learning? Motivated by this we present an alternative approach based on contrastive learning and compare their performance on standard few-shot part segmentation benchmarks. Our experiments reveal that not only do the GAN-based approach offer no significant performance advantage, their multi-step training is complex, nearly an order-of-magnitude slower, and can introduce additional bias. These experiments suggest that the inductive biases of generative models, such as their ability to disentangle shape and texture, are well captured by standard feed-forward networks trained using contrastive learning. These experiments suggest that the inductive biases present in current generative models, such as their ability to disentangle shape and texture, are well captured by standard feed-forward networks trained using contrastive learning. △ Less

Submitted 28 April, 2022; v1 submitted 1 December, 2021; originally announced December 2021.

Comments: CVPR 2022 Camera Ready Version

Semi-Supervised Learning with Taxonomic Labels

Authors: Jong-Chyi Su, Subhransu Maji

Abstract: We propose techniques to incorporate coarse taxonomic labels to train image classifiers in fine-grained domains. Such labels can often be obtained with a smaller effort for fine-grained domains such as the natural world where categories are organized according to a biological taxonomy. On the Semi-iNat dataset consisting of 810 species across three Kingdoms, incorporating Phylum labels improves th… ▽ More We propose techniques to incorporate coarse taxonomic labels to train image classifiers in fine-grained domains. Such labels can often be obtained with a smaller effort for fine-grained domains such as the natural world where categories are organized according to a biological taxonomy. On the Semi-iNat dataset consisting of 810 species across three Kingdoms, incorporating Phylum labels improves the Species level classification accuracy by 6% in a transfer learning setting using ImageNet pre-trained models. Incorporating the hierarchical label structure with a state-of-the-art semi-supervised learning algorithm called FixMatch improves the performance further by 1.3%. The relative gains are larger when detailed labels such as Class or Order are provided, or when models are trained from scratch. However, we find that most methods are not robust to the presence of out-of-domain data from novel classes. We propose a technique to select relevant data from a large collection of unlabeled images guided by the hierarchy which improves the robustness. Overall, our experiments show that semi-supervised learning with coarse taxonomic labels are practical for training classifiers in fine-grained domains. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: BMVC 2021

Domain Adaptor Networks for Hyperspectral Image Recognition

Authors: Gustavo Perez, Subhransu Maji

Abstract: We consider the problem of adapting a network trained on three-channel color images to a hyperspectral domain with a large number of channels. To this end, we propose domain adaptor networks that map the input to be compatible with a network trained on large-scale color image datasets such as ImageNet. Adaptors enable learning on small hyperspectral datasets where training a network from scratch m… ▽ More We consider the problem of adapting a network trained on three-channel color images to a hyperspectral domain with a large number of channels. To this end, we propose domain adaptor networks that map the input to be compatible with a network trained on large-scale color image datasets such as ImageNet. Adaptors enable learning on small hyperspectral datasets where training a network from scratch may not be effective. We investigate architectures and strategies for training adaptors and evaluate them on a benchmark consisting of multiple hyperspectral datasets. We find that simple schemes such as linear projection or subset selection are often the most effective, but can lead to a loss in performance in some cases. We also propose a novel multi-view adaptor where of the inputs are combined in an intermediate layer of the network in an order invariant manner that provides further improvements. We present extensive experiments by varying the number of training examples in the benchmark to characterize the accuracy and computational trade-offs offered by these adaptors. △ Less

Submitted 3 August, 2021; originally announced August 2021.

On Measuring and Controlling the Spectral Bias of the Deep Image Prior

Authors: Zenglin Shi, Pascal Mettes, Subhransu Maji, Cees G. M. Snoek

Abstract: The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers from two practical limitations. First, it remains unclear how to control the prior beyond the choice of the network architecture. Second, training requires an or… ▽ More The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers from two practical limitations. First, it remains unclear how to control the prior beyond the choice of the network architecture. Second, training requires an oracle stopping criterion as during the optimization the performance degrades after reaching an optimum value. To address these challenges we introduce a frequency-band correspondence measure to characterize the spectral bias of the deep image prior, where low-frequency image signals are learned faster and better than high-frequency counterparts. Based on our observations, we propose techniques to prevent the eventual performance degradation and accelerate convergence. We introduce a Lipschitz-controlled convolution layer and a Gaussian-controlled upsampling layer as plug-in replacements for layers used in the deep architectures. The experiments show that with these changes the performance does not degrade during optimization, relieving us from the need for an oracle stopping criterion. We further outline a stopping criterion to avoid superfluous computation. Finally, we show that our approach obtains favorable results compared to current approaches across various denoising, deblocking, inpainting, super-resolution and detail enhancement tasks. Code is available at \url{https://github.com/shizenglin/Measure-and-Control-Spectral-Bias}. △ Less

Submitted 30 December, 2021; v1 submitted 2 July, 2021; originally announced July 2021.

Comments: IJCV 2022; Spectral bias; Deep image prior; 24 pages

DCoM: A Deep Column Mapper for Semantic Data Type Detection

Authors: Subhadip Maji, Swapna Sourav Rout, Sudeep Choudhary

Abstract: Detection of semantic data types is a very crucial task in data science for automated data cleaning, schema matching, data discovery, semantic data type normalization and sensitive data identification. Existing methods include regular expression-based or dictionary lookup-based methods that are not robust to dirty as well unseen data and are limited to a very less number of semantic data types to… ▽ More Detection of semantic data types is a very crucial task in data science for automated data cleaning, schema matching, data discovery, semantic data type normalization and sensitive data identification. Existing methods include regular expression-based or dictionary lookup-based methods that are not robust to dirty as well unseen data and are limited to a very less number of semantic data types to predict. Existing Machine Learning methods extract large number of engineered features from data and build logistic regression, random forest or feedforward neural network for this purpose. In this paper, we introduce DCoM, a collection of multi-input NLP-based deep neural networks to detect semantic data types where instead of extracting large number of features from the data, we feed the raw values of columns (or instances) to the model as texts. We train DCoM on 686,765 data columns extracted from VizNet corpus with 78 different semantic data types. DCoM outperforms other contemporary results with a quite significant margin on the same dataset. △ Less

Submitted 24 June, 2021; originally announced June 2021.

Comments: 9 pages, 2 figures, 7 tables

The Semi-Supervised iNaturalist Challenge at the FGVC8 Workshop

Authors: Jong-Chyi Su, Subhransu Maji

Abstract: Semi-iNat is a challenging dataset for semi-supervised classification with a long-tailed distribution of classes, fine-grained categories, and domain shifts between labeled and unlabeled data. This dataset is behind the second iteration of the semi-supervised recognition challenge to be held at the FGVC8 workshop at CVPR 2021. Different from the previous one, this dataset (i) includes images of sp… ▽ More Semi-iNat is a challenging dataset for semi-supervised classification with a long-tailed distribution of classes, fine-grained categories, and domain shifts between labeled and unlabeled data. This dataset is behind the second iteration of the semi-supervised recognition challenge to be held at the FGVC8 workshop at CVPR 2021. Different from the previous one, this dataset (i) includes images of species from different kingdoms in the natural taxonomy, (ii) is at a larger scale -- with 810 in-class and 1629 out-of-class species for a total of 330k images, and (iii) does not provide in/out-of-class labels, but provides coarse taxonomic labels (kingdom and phylum) for the unlabeled images. This document describes baseline results and the details of the dataset which is available here: \url{https://github.com/cvl-umass/semi-inat-2021}. △ Less

Submitted 2 June, 2021; originally announced June 2021.

Comments: Tech report for Semi-iNat 2021 challenge, competition page: https://github.com/cvl-umass/semi-inat-2021

Unsupervised Domain Adaptation with Global and Local Graph Neural Networks in Limited Labeled Data Scenario: Application to Disaster Management

Authors: Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar

Abstract: Identification and categorization of social media posts generated during disasters are crucial to reduce the sufferings of the affected people. However, lack of labeled data is a significant bottleneck in learning an effective categorization system for a disaster. This motivates us to study the problem as unsupervised domain adaptation (UDA) between a previous disaster with labeled data (source) a… ▽ More Identification and categorization of social media posts generated during disasters are crucial to reduce the sufferings of the affected people. However, lack of labeled data is a significant bottleneck in learning an effective categorization system for a disaster. This motivates us to study the problem as unsupervised domain adaptation (UDA) between a previous disaster with labeled data (source) and a current disaster (target). However, if the amount of labeled data available is limited, it restricts the learning capabilities of the model. To handle this challenge, we utilize limited labeled data along with abundantly available unlabeled data, generated during a source disaster to propose a novel two-part graph neural network. The first-part extracts domain-agnostic global information by constructing a token level graph across domains and the second-part preserves local instance-level semantics. In our experiments, we show that the proposed method outperforms state-of-the-art techniques by $2.74\%$ weighted F$_1$ score on average on two standard public dataset in the area of disaster management. We also report experimental results for granular actionable multi-label classification datasets in disaster domain for the first time, on which we outperform BERT by $3.00\%$ on average w.r.t weighted F$_1$. Additionally, we show that our approach can retain performance when very limited labeled data is available. △ Less

Submitted 3 April, 2021; originally announced April 2021.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification

Authors: Jong-Chyi Su, Zezhou Cheng, Subhransu Maji

Abstract: We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification datasets obtained by sampling classes from the Aves and Fungi taxonomy. We find that recently proposed SSL methods provide significant benefits, and can effectively… ▽ More We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification datasets obtained by sampling classes from the Aves and Fungi taxonomy. We find that recently proposed SSL methods provide significant benefits, and can effectively use out-of-class data to improve performance when deep networks are trained from scratch. Yet their performance pales in comparison to a transfer learning baseline, an alternative approach for learning from a few examples. Furthermore, in the transfer setting, while existing SSL methods provide improvements, the presence of out-of-class is often detrimental. In this setting, standard fine-tuning followed by distillation-based self-training is the most robust. Our work suggests that semi-supervised learning with experts on realistic datasets may require different strategies than those currently prevalent in the literature. △ Less

Submitted 1 April, 2021; originally announced April 2021.

Comments: CVPR 2021 (oral)

Quasi-one-dimensional uniform spin-$\frac{1}{2}$ Heisenberg antiferromagnet KNaCuP$_2$O$_7$ probed by $^{31}$P and $^{23}$Na NMR

Authors: S. Guchhait, Qing-Ping Ding, M. Sahoo, A. Giri, S. Maji, Y. Furukawa, R. Nath

Abstract: We present the structural and magnetic properties of KNaCuP$_2$O$_7$ investigated via x-ray diffraction, magnetization, specific heat, and $^{31}$P NMR and $^{23}$Na NMR measurements and complementary electronic structure calculations. The temperature dependent magnetic susceptibility and $^{31}$P NMR shift could be modeled very well by the uniform spin-$1/2$ Heisenberg antiferromagnetic chain mod… ▽ More We present the structural and magnetic properties of KNaCuP$_2$O$_7$ investigated via x-ray diffraction, magnetization, specific heat, and $^{31}$P NMR and $^{23}$Na NMR measurements and complementary electronic structure calculations. The temperature dependent magnetic susceptibility and $^{31}$P NMR shift could be modeled very well by the uniform spin-$1/2$ Heisenberg antiferromagnetic chain model with nearest-neighbour interaction $J/k_{\rm B}\simeq 58.7$ K. The corresponding mapping using first principles electronic structure calculations leads to $J^{\rm DFT}/k_{\rm B} \simeq 59$ K with negligibly small inter-chain couplings ($J^{\prime}/k_{\rm B}$, $J^{\prime \prime}/k_{\rm B} < 0.1$ K), further confirming that the system is indeed an one-dimensional uniform spin-$1/2$ Heisenberg antiferromagnet. The temperature-dependent unit cell volume could be described well using the Debye approximation with a Debye temperature of $Θ_{\rm D} \simeq 294$ K, consistent with the heat capacity data. The diverging trend of the NMR spin-lattice relaxation rates ($^{31}1/T_1$ and $^{23}1/T_1$) imply the onset of a magnetic long-range-ordering at very low temperatures supporting the anticipated $T_{\rm N} \simeq 0.38$ K from the inter-chain couplings. Moreover, the NMR spin-lattice relaxation rates show the dominant contributions from uniform ($q=0$) and staggered ($q = \pm π/a$) spin fluctuations in the high and low temperature regimes, respectively mimicking one-dimensionality of the spin-lattice. We have also demonstrated that $^{31}1/T_1$ in high temperatures varies linearly with $1/\sqrt{H}$ reflecting the effect of spin diffusion on the dynamic susceptibility. Further, the inter-chain frustration also substantially impede the magnetic ordering rendering the spin-lattice a perfect one-dimensional uniform spin-$1/2$ Heisenberg antiferromagnet over a wide temperature range. △ Less

Submitted 22 June, 2021; v1 submitted 31 March, 2021; originally announced March 2021.

Comments: 15 pages, 13 figures, 1 table

Journal ref: Phys. Rev. B 103, 224415 (2021)

Leaky Nets: Recovering Embedded Neural Network Models and Inputs through Simple Power and Timing Side-Channels -- Attacks and Defenses

Authors: Saurav Maji, Utsav Banerjee, Anantha P. Chandrakasan

Abstract: With the recent advancements in machine learning theory, many commercial embedded micro-processors use neural network models for a variety of signal processing applications. However, their associated side-channel security vulnerabilities pose a major concern. There have been several proof-of-concept attacks demonstrating the extraction of their model parameters and input data. But, many of these a… ▽ More With the recent advancements in machine learning theory, many commercial embedded micro-processors use neural network models for a variety of signal processing applications. However, their associated side-channel security vulnerabilities pose a major concern. There have been several proof-of-concept attacks demonstrating the extraction of their model parameters and input data. But, many of these attacks involve specific assumptions, have limited applicability, or pose huge overheads to the attacker. In this work, we study the side-channel vulnerabilities of embedded neural network implementations by recovering their parameters using timing-based information leakage and simple power analysis side-channel attacks. We demonstrate our attacks on popular micro-controller platforms over networks of different precisions such as floating point, fixed point, binary networks. We are able to successfully recover not only the model parameters but also the inputs for the above networks. Countermeasures against timing-based attacks are implemented and their overheads are analyzed. △ Less

Submitted 26 March, 2021; originally announced March 2021.

Journal ref: IEEE Internet of Things Journal, 2021

The Semi-Supervised iNaturalist-Aves Challenge at FGVC7 Workshop

Authors: Jong-Chyi Su, Subhransu Maji

Abstract: This document describes the details and the motivation behind a new dataset we collected for the semi-supervised recognition challenge~\cite{semi-aves} at the FGVC7 workshop at CVPR 2020. The dataset contains 1000 species of birds sampled from the iNat-2018 dataset for a total of nearly 150k images. From this collection, we sample a subset of classes and their labels, while adding the images from… ▽ More This document describes the details and the motivation behind a new dataset we collected for the semi-supervised recognition challenge~\cite{semi-aves} at the FGVC7 workshop at CVPR 2020. The dataset contains 1000 species of birds sampled from the iNat-2018 dataset for a total of nearly 150k images. From this collection, we sample a subset of classes and their labels, while adding the images from the remaining classes to the unlabeled set of images. The presence of out-of-domain data (novel classes), high class-imbalance, and fine-grained similarity between classes poses significant challenges for existing semi-supervised recognition techniques in the literature. The dataset is available here: \url{https://github.com/cvl-umass/semi-inat-2020} △ Less

Submitted 11 March, 2021; originally announced March 2021.

Comments: Tech report for Semi-iNat 2020 challenge, please see http://github.com/cvl-umass/semi-inat-2020

Supervised Momentum Contrastive Learning for Few-Shot Classification

Authors: Orchid Majumder, Avinash Ravichandran, Subhransu Maji, Alessandro Achille, Marzia Polito, Stefano Soatto

Abstract: Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate the complementary roles of these two sources of information by combining instance-discriminative contrastive learning and supervised learning in a single framework called Supervise… ▽ More Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate the complementary roles of these two sources of information by combining instance-discriminative contrastive learning and supervised learning in a single framework called Supervised Momentum Contrastive learning (SUPMOCO). Our approach avoids a problem observed in supervised learning where information in images not relevant to the task is discarded, which hampers their generalization to novel tasks. We show that (self-supervised) contrastive learning and supervised learning are mutually beneficial, leading to a new state-of-the-art on the META-DATASET - a recently introduced benchmark for few-shot learning. Our method is based on a simple modification of MOCO and scales better than prior work on combining supervised and self-supervised learning. This allows us to easily combine data from multiple domains leading to further improvements. △ Less

Submitted 21 June, 2021; v1 submitted 26 January, 2021; originally announced January 2021.

Comments: V2 version; updated with new experiments and figures

Reproducibility, Replicability and Beyond: Assessing Production Readiness of Aspect Based Sentiment Analysis in the Wild

Authors: Rajdeep Mukherjee, Shreyas Shetty, Subrata Chattopadhyay, Subhadeep Maji, Samik Datta, Pawan Goyal

Abstract: With the exponential growth of online marketplaces and user-generated content therein, aspect-based sentiment analysis has become more important than ever. In this work, we critically review a representative sample of the models published during the past six years through the lens of a practitioner, with an eye towards deployment in production. First, our rigorous empirical evaluation reveals poor… ▽ More With the exponential growth of online marketplaces and user-generated content therein, aspect-based sentiment analysis has become more important than ever. In this work, we critically review a representative sample of the models published during the past six years through the lens of a practitioner, with an eye towards deployment in production. First, our rigorous empirical evaluation reveals poor reproducibility: an average 4-5% drop in test accuracy across the sample. Second, to further bolster our confidence in empirical evaluation, we report experiments on two challenging data slices, and observe a consistent 12-55% drop in accuracy. Third, we study the possibility of transfer across domains and observe that as little as 10-25% of the domain-specific training dataset, when used in conjunction with datasets from other domains within the same locale, largely closes the gap between complete cross-domain and complete in-domain predictive performance. Lastly, we open-source two large-scale annotated review corpora from a large e-commerce portal in India in order to aid the study of replicability and transfer, with the hope that it will fuel further growth of the field. △ Less

Submitted 23 January, 2021; originally announced January 2021.

Comments: 12 pages, accepted at ECIR 2021

ACM Class: I.2.7

Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learning

Authors: Zhaowei Cai, Avinash Ravichandran, Subhransu Maji, Charless Fowlkes, Zhuowen Tu, Stefano Soatto

Abstract: We present a plug-in replacement for batch normalization (BN) called exponential moving average normalization (EMAN), which improves the performance of existing student-teacher based self- and semi-supervised learning techniques. Unlike the standard BN, where the statistics are computed within each batch, EMAN, used in the teacher, updates its statistics by exponential moving average from the BN s… ▽ More We present a plug-in replacement for batch normalization (BN) called exponential moving average normalization (EMAN), which improves the performance of existing student-teacher based self- and semi-supervised learning techniques. Unlike the standard BN, where the statistics are computed within each batch, EMAN, used in the teacher, updates its statistics by exponential moving average from the BN statistics of the student. This design reduces the intrinsic cross-sample dependency of BN and enhances the generalization of the teacher. EMAN improves strong baselines for self-supervised learning by 4-6/1-2 points and semi-supervised learning by about 7/2 points, when 1%/10% supervised labels are available on ImageNet. These improvements are consistent across methods, network architectures, training duration, and datasets, demonstrating the general effectiveness of this technique. The code is available at https://github.com/amazon-research/exponential-moving-average-normalization. △ Less

Submitted 18 June, 2021; v1 submitted 21 January, 2021; originally announced January 2021.

Comments: accepted by CVPR21 as Oral presentation

StarcNet: Machine Learning for Star Cluster Identification

Authors: Gustavo Perez, Matteo Messa, Daniela Calzetti, Subhransu Maji, Dooseok Jung, Angela Adamo, Mattia Siressi

Abstract: We present a machine learning (ML) pipeline to identify star clusters in the multi{color images of nearby galaxies, from observations obtained with the Hubble Space Telescope as part of the Treasury Project LEGUS (Legacy ExtraGalactic Ultraviolet Survey). StarcNet (STAR Cluster classification NETwork) is a multi-scale convolutional neural network (CNN) which achieves an accuracy of 68.6% (4 classe… ▽ More We present a machine learning (ML) pipeline to identify star clusters in the multi{color images of nearby galaxies, from observations obtained with the Hubble Space Telescope as part of the Treasury Project LEGUS (Legacy ExtraGalactic Ultraviolet Survey). StarcNet (STAR Cluster classification NETwork) is a multi-scale convolutional neural network (CNN) which achieves an accuracy of 68.6% (4 classes)/86.0% (2 classes: cluster/non-cluster) for star cluster classification in the images of the LEGUS galaxies, nearly matching human expert performance. We test the performance of StarcNet by applying pre-trained CNN model to galaxies not included in the training set, finding accuracies similar to the reference one. We test the effect of StarcNet predictions on the inferred cluster properties by comparing multi-color luminosity functions and mass-age plots from catalogs produced by StarcNet and by human-labeling; distributions in luminosity, color, and physical characteristics of star clusters are similar for the human and ML classified samples. There are two advantages to the ML approach: (1) reproducibility of the classifications: the ML algorithm's biases are fixed and can be measured for subsequent analysis; and (2) speed of classification: the algorithm requires minutes for tasks that humans require weeks to months to perform. By achieving comparable accuracy to human classifiers, StarcNet will enable extending classifications to a larger number of candidate samples than currently available, thus increasing significantly the statistics for cluster studies. △ Less

Submitted 16 December, 2020; originally announced December 2020.

Description of turbulent dynamics in the interstellar medium: multifractal/microcanonical analysis I. Application to Herschel observations of the Musca filament

Authors: H. Yahia, N. Schneider, S. Bontemps, L. Bonne, G. Attuel, S. Dib, V. Ossenkopf, A. Turiel, A. Zebadua, D. Elia, S. K. Maji, F. G. Schmitt, J. -F Robitaille

Abstract: Observations of the interstellar medium (ISM) show a complex density and velocity structure which is in part attributed to turbulence. We here present a self-contained introduction to the multifractal formalism in a microcanonical version which allows us for the first time to compute precise turbulence characteristic parameters from a single observational map without the need for averages in a gra… ▽ More Observations of the interstellar medium (ISM) show a complex density and velocity structure which is in part attributed to turbulence. We here present a self-contained introduction to the multifractal formalism in a microcanonical version which allows us for the first time to compute precise turbulence characteristic parameters from a single observational map without the need for averages in a grand ensemble of statistical observables. We focus on studying the 250 mu-m Herschel map of the Musca filament and make use of MHD simulations. We find a clear signature of a multiplicative cascade in Musca with an inertial range from 0.05 to 0.65 pc. We show that the proposed microcanonical approach provides singularity spectra which are truly scale invariant as required to validate any method to analyze multifractality. The obtained, for the first time precise enough, singularity spectrum of Musca is clearly not as symmetric as usually observed in log-normal behavior. We claim that the ISM towards Musca features more a log-Poisson shape of its singularity spectrum. Since log-Poisson behavior is claimed to exist when dissipation is stronger for rare events in turbulent flows in contrast to more homogeneous (in volume and time) dissipation events, we suggest that this deviation from log-normality could trace enhanced dissipation in rare events at small scales, which may explain or is at least consistent with the dominant filamentary structure in Musca. Moreover we find that sub-regions in Musca tends to show different multifractal properties. It strongly suggests that different types of dynamics exist inside the Musca cloud. These differences between sub-regions appear only after eliminating noise features which have the tendency to "log-normalize" an observational map. Our study sets up fundamental tools which will be applied to other galactic clouds and simulations in forthcoming studies. △ Less

Submitted 8 November, 2020; originally announced November 2020.

Comments: 25 pages. 27 figures. Submitted to Astronomy & Astrophysics, November 2020

Journal ref: A&A 649, A33 (2021)

Multicollinearity Correction and Combined Feature Effect in Shapley Values

Authors: Indranil Basu, Subhadip Maji

Abstract: Model interpretability is one of the most intriguing problems in most of the Machine Learning models, particularly for those that are mathematically sophisticated. Computing Shapley Values are arguably the best approach so far to find the importance of each feature in a model, at the row level. In other words, Shapley values represent the importance of a feature for a particular row, especially fo… ▽ More Model interpretability is one of the most intriguing problems in most of the Machine Learning models, particularly for those that are mathematically sophisticated. Computing Shapley Values are arguably the best approach so far to find the importance of each feature in a model, at the row level. In other words, Shapley values represent the importance of a feature for a particular row, especially for Classification or Regression problems. One of the biggest limitations of Shapley vales is that, Shapley value calculations assume all the features are uncorrelated (independent of each other), this assumption is often incorrect. To address this problem, we present a unified framework to calculate Shapley values with correlated features. To be more specific, we do an adjustment (Matrix formulation) of the features while calculating Independent Shapley values for the rows. Moreover, we have given a Mathematical proof against the said adjustments. With these adjustments, Shapley values (Importance) for the features become independent of the correlations existing between them. We have also enhanced this adjustment concept for more than features. As the Shapley values are additive, to calculate combined effect of two features, we just have to add their individual Shapley values. This is again not right if one or more of the features (used in the combination) are correlated with the other features (not in the combination). We have addressed this problem also by extending the correlation adjustment for one feature to multiple features in the said combination for which Shapley values are determined. Our implementation of this method proves that our method is computationally efficient also, compared to original Shapley method. △ Less

Submitted 3 November, 2020; originally announced November 2020.

Comments: 10 pages