Machine Learning

Authors and titles for February 2022

[1] arXiv:2202.00004 [pdf, other]

Title: On Polynomial Approximation of Activation Function

John Chiang

Comments: In this work, we proposed an interesting method to approximate the activation function by a polynomial the degree of which is preset low. Our method to approximate the activation function is much more flexible compared to the least square method in the sense that the additional parameters could better control the shape of the resulting polynomial to approximate

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR)

[2] arXiv:2202.00009 [pdf, other]

Title: Identifying Dementia Subtypes with Electronic Health Records

Sayantan Kumar, Zachary Abrams, Suzanne Schindler, Nupur Ghoshal, Philip Payne

Comments: ACM Conference on Bioinformatics, Computational Biology, and Health Informatics 13 pages, 7 figures, 3 tables

Subjects: Machine Learning (cs.LG)

[3] arXiv:2202.00035 [pdf, other]

Title: Learning Fair Representations via Rate-Distortion Maximization

Somnath Basu Roy Chowdhury, Snigdha Chaturvedi

Comments: Accepted at TACL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[4] arXiv:2202.00045 [pdf, other]

Title: Unsupervised Network Intrusion Detection System for AVTP in Automotive Ethernet Networks

Natasha Alkhatib, Maria Mushtaq, Hadi Ghauch, Jean-Luc Danger

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Networking and Internet Architecture (cs.NI)

[5] arXiv:2202.00060 [pdf, other]

Title: SnAKe: Bayesian Optimization with Pathwise Exploration

Jose Pablo Folch, Shiqiang Zhang, Robert M Lee, Behrang Shafei, David Walz, Calvin Tsay, Mark van der Wilk, Ruth Misener

Comments: 10 main pages, 39 with appendix, 30 figures, 10 tables. Final camera-ready version for NeurIPS, with supplementary material included

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[6] arXiv:2202.00063 [pdf, other]

Title: Efficient Reinforcement Learning in Block MDPs: A Model-free Representation Learning Approach

Xuezhou Zhang, Yuda Song, Masatoshi Uehara, Mengdi Wang, Alekh Agarwal, Wen Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[7] arXiv:2202.00070 [pdf, other]

Title: Implicit Concept Drift Detection for Multi-label Data Streams

Ege Berkay Gulcan, Fazli Can

Comments: 18 pages, 7 figures, submitted to Artificial Intelligence Review

Subjects: Machine Learning (cs.LG); Information Retrieval (cs.IR)

[8] arXiv:2202.00071 [pdf, other]

Title: JULIA: Joint Multi-linear and Nonlinear Identification for Tensor Completion

Cheng Qian, Kejun Huang, Lucas Glass, Rakshith S. Srinivasa, Jimeng Sun

Subjects: Machine Learning (cs.LG); Information Retrieval (cs.IR); Machine Learning (stat.ML)

[9] arXiv:2202.00075 [pdf, other]

Title: SUGAR: Efficient Subgraph-level Training via Resource-aware Graph Partitioning

Zihui Xue, Yuedong Yang, Mengtian Yang, Radu Marculescu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[10] arXiv:2202.00079 [pdf, other]

Title: You May Not Need Ratio Clipping in PPO

Mingfei Sun, Vitaly Kurin, Guoqing Liu, Sam Devlin, Tao Qin, Katja Hofmann, Shimon Whiteson

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[11] arXiv:2202.00082 [pdf, other]

Title: Trust Region Bounds for Decentralized PPO Under Non-stationarity

Mingfei Sun, Sam Devlin, Jacob Beck, Katja Hofmann, Shimon Whiteson

Comments: AAMAS 2023

Subjects: Machine Learning (cs.LG)

[12] arXiv:2202.00088 [pdf, other]

Title: Reinforcement Learning with Heterogeneous Data: Estimation and Inference

Elynn Y. Chen, Rui Song, Michael I. Jordan

Subjects: Machine Learning (cs.LG); Methodology (stat.ME)

[13] arXiv:2202.00089 [pdf, other]

Title: Understanding AdamW through Proximal Methods and Scale-Freeness

Zhenxun Zhuang, Mingrui Liu, Ashok Cutkosky, Francesco Orabona

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[14] arXiv:2202.00091 [pdf, other]

Title: Query Efficient Decision Based Sparse Attacks Against Black-Box Deep Learning Models

Viet Quoc Vo, Ehsan Abbasnejad, Damith C. Ranasinghe

Comments: Published as a conference paper at the International Conference on Learning Representations (ICLR 2022). Code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[15] arXiv:2202.00097 [pdf, other]

Title: Self-supervised Graphs for Audio Representation Learning with Limited Labeled Data

Amir Shirian, Krishna Somandepalli, Tanaya Guha

Subjects: Machine Learning (cs.LG); Sound (cs.SD)

[16] arXiv:2202.00104 [pdf, other]

Title: Generalization in Cooperative Multi-Agent Systems

Anuj Mahajan, Mikayel Samvelyan, Tarun Gupta, Benjamin Ellis, Mingfei Sun, Tim Rocktäschel, Shimon Whiteson

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)

[17] arXiv:2202.00113 [pdf, other]

Title: Imbedding Deep Neural Networks

Andrew Corbett, Dmitry Kangin

Comments: Accepted as a spotlight paper at the 10th International Conference on Learning Representations (ICLR), 2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[18] arXiv:2202.00117 [pdf, other]

Title: Continuous Forecasting via Neural Eigen Decomposition

Stav Belogolovsky, Ido Greenberg, Danny Eitan, Shie Mannor

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY)

[19] arXiv:2202.00132 [pdf, other]

Title: Submodularity In Machine Learning and Artificial Intelligence

Jeff Bilmes

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[20] arXiv:2202.00145 [pdf, other]

Title: Step-size Adaptation Using Exponentiated Gradient Updates

Ehsan Amid, Rohan Anil, Christopher Fifty, Manfred K. Warmuth

Subjects: Machine Learning (cs.LG)

[21] arXiv:2202.00146 [pdf, other]

Title: Evaluating Deep Vs. Wide & Deep Learners As Contextual Bandits For Personalized Email Promo Recommendations

Aleksey A. Kocherzhenko, Nirmal Sobha Kartha, Tengfei Li, Hsin-Yi (Jenny)Shih, Marco Mandic, Mike Fuller, Arshak Navruzyan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[22] arXiv:2202.00150 [pdf, other]

Title: Learning Infinite-Horizon Average-Reward Markov Decision Processes with Constraints

Liyu Chen, Rahul Jain, Haipeng Luo

Subjects: Machine Learning (cs.LG)

[23] arXiv:2202.00153 [pdf, other]

Title: Transformer-based Models of Text Normalization for Speech Applications

Jae Hun Ro, Felix Stahlberg, Ke Wu, Shankar Kumar

Subjects: Machine Learning (cs.LG)

[24] arXiv:2202.00155 [pdf, other]

Title: Fortuitous Forgetting in Connectionist Networks

Hattie Zhou, Ankit Vani, Hugo Larochelle, Aaron Courville

Comments: ICLR Camera Ready

Journal-ref: ICLR 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[25] arXiv:2202.00161 [pdf, other]

Title: CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery

Michael Laskin, Hao Liu, Xue Bin Peng, Denis Yarats, Aravind Rajeswaran, Pieter Abbeel

Comments: Project website: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[26] arXiv:2202.00195 [pdf, other]

Title: Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning

Jin-Hyun Ahn, Kyungsang Kim, Jeongwan Koh, Quanzheng Li

Comments: 13 pages, 9 figures, submitted for conference publication

Subjects: Machine Learning (cs.LG)

[27] arXiv:2202.00211 [pdf, other]

Title: GNNRank: Learning Global Rankings from Pairwise Comparisons via Directed Graph Neural Networks

Yixuan He, Quan Gan, David Wipf, Gesine Reinert, Junchi Yan, Mihai Cucuringu

Comments: ICML 2022 spotlight; 32 pages (9 pages for main text)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[28] arXiv:2202.00255 [pdf, other]

Title: DoCoM: Compressed Decentralized Optimization with Near-Optimal Sample Complexity

Chung-Yiu Yau, Hoi-To Wai

Comments: Accepted at TMLR, 41 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC)

[29] arXiv:2202.00263 [pdf, other]

Title: Fully Online Meta-Learning Without Task Boundaries

Jathushan Rajasegaran, Chelsea Finn, Sergey Levine

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[30] arXiv:2202.00264 [pdf, other]

Title: Graph-based Neural Acceleration for Nonnegative Matrix Factorization

Jens Sjölund, Maria Bånkestad

Comments: Authors contributed equally

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC); Machine Learning (stat.ML)

[31] arXiv:2202.00270 [pdf, other]

Title: Factorized-FL: Agnostic Personalized Federated Learning with Kernel Factorization & Similarity Matching

Wonyong Jeong, Sung Ju Hwang

Subjects: Machine Learning (cs.LG)

[32] arXiv:2202.00273 [pdf, other]

Title: StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

Axel Sauer, Katja Schwarz, Andreas Geiger

Comments: To appear in SIGGRAPH 2022. Project Page: this https URL

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[33] arXiv:2202.00275 [pdf, other]

Title: Architecture Matters in Continual Learning

Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin, Timothy Nguyen, Razvan Pascanu, Dilan Gorur, Mehrdad Farajtabar

Comments: preprint

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[34] arXiv:2202.00280 [pdf, other]

Title: Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?

Sheikh Shams Azam, Seyyedali Hosseinalipour, Qiang Qiu, Christopher Brinton

Comments: In Proceedings of the 10th International Conference on Learning Representations (ICLR) 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[35] arXiv:2202.00299 [pdf, other]

Title: Learning Physics-Consistent Particle Interactions

Zhichao Han, David S. Kammer, Olga Fink

Comments: Under review. 19 pages main content + 18 pages SI. Links of supporting code and data can be found at the end of main content

Subjects: Machine Learning (cs.LG); Computational Physics (physics.comp-ph)

[36] arXiv:2202.00308 [pdf, other]

Title: PAGE-PG: A Simple and Loopless Variance-Reduced Policy Gradient Method with Probabilistic Gradient Estimation

Matilde Gargiani, Andrea Zanelli, Andrea Martinelli, Tyler Summers, John Lygeros

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[37] arXiv:2202.00339 [pdf, other]

Title: Quantifying Relevance in Learning and Inference

Matteo Marsili, Yasser Roudi

Comments: review article, 63 pages, 14 figures

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[38] arXiv:2202.00345 [pdf, other]

Title: Exploring layerwise decision making in DNNs

Coenraad Mouton, Marelie H. Davel

Journal-ref: In Communications in Computer and Information Science, vol 1551. Springer, Cham (2022)

Subjects: Machine Learning (cs.LG)

[39] arXiv:2202.00386 [pdf, other]

Title: A Comparative Study of Calibration Methods for Imbalanced Class Incremental Learning

Umang Aggarwal, Adrian Popescu, Eden Belouadah, Céline Hudelot

Journal-ref: Multimedia Tools and Applications (2021)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[40] arXiv:2202.00390 [pdf, other]

Title: Minority Class Oriented Active Learning for Imbalanced Datasets

Umang Aggarwal, Adrian Popescu, Céline Hudelot

Journal-ref: 2020 25th International Conference on Pattern Recognition (ICPR)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[41] arXiv:2202.00391 [pdf, other]

Title: Right for the Right Latent Factors: Debiasing Generative Models via Disentanglement

Xiaoting Shao, Karl Stelzner, Kristian Kersting

Subjects: Machine Learning (cs.LG)

[42] arXiv:2202.00395 [pdf, other]

Title: Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classification

Takashi Ishida, Ikko Yamane, Nontawat Charoenphakdee, Gang Niu, Masashi Sugiyama

Comments: ICLR 2023 (notable-top-5%)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[43] arXiv:2202.00408 [pdf, other]

Title: Dimensionality Reduction Meets Message Passing for Graph Node Embeddings

Krzysztof Sadowski, Michał Szarmach, Eddie Mattia

Comments: Changed colors in figures 3 and 5 to match the others

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[44] arXiv:2202.00423 [pdf, other]

Title: Memory-based Message Passing: Decoupling the Message for Propogation from Discrimination

Jie Chen, Weiqi Liu, Jian Pu

Comments: Accepted by ICASSP 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[45] arXiv:2202.00441 [pdf, other]

Title: Few-Bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction

Georgii Novikov, Daniel Bershatsky, Julia Gusak, Alex Shonenkov, Denis Dimitrov, Ivan Oseledets

Comments: Submitted

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[46] arXiv:2202.00450 [pdf, other]

Title: Approximation of Images via Generalized Higher Order Singular Value Decomposition over Finite-dimensional Commutative Semisimple Algebra

Liang Liao, Sen Lin, Lun Li, Xiuwei Zhang, Song Zhao, Yan Wang, Xinqiang Wang, Qi Gao, Jingyu Wang

Comments: 21 pages, 11 figures, several typos in the appendix corrected

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Commutative Algebra (math.AC); Representation Theory (math.RT); Spectral Theory (math.SP)

[47] arXiv:2202.00458 [pdf, other]

Title: Machine learning to assess relatedness: the advantage of using firm-level data

Giambattista Albora, Andrea Zaccaria

Comments: 14 pages, 4 figures

Subjects: Machine Learning (cs.LG)

[48] arXiv:2202.00504 [pdf, other]

Title: Fine-grained differentiable physics: a yarn-level model for fabrics

Deshan Gong, Zhanxing Zhu, Andrew J.Bulpitt, He Wang

Subjects: Machine Learning (cs.LG)

[49] arXiv:2202.00512 [pdf, other]

Title: Progressive Distillation for Fast Sampling of Diffusion Models

Tim Salimans, Jonathan Ho

Comments: Published as a conference paper at ICLR 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[50] arXiv:2202.00517 [pdf, other]

Title: Empirical complexity of comparator-based nearest neighbor descent

Jacob D. Baron, R. W. R. Darling

Comments: 8 pages, 1 figure

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)