Machine Learning

Authors and titles for October 2022

[1] arXiv:2210.00079 [pdf, other]

Title: Causal Estimation for Text Data with (Apparent) Overlap Violations

Lin Gui, Victor Veitch

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[2] arXiv:2210.00437 [pdf, other]

Title: A Unified Framework for Optimization-Based Graph Coarsening

Manoj Kumar, Anurag Sharma, Sandeep Kumar

Comments: 34 pages, 15 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[3] arXiv:2210.00688 [pdf, other]

Title: On the infinite-depth limit of finite-width neural networks

Soufiane Hayou

Comments: 71 pages, 21 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[4] arXiv:2210.00736 [pdf, other]

Title: A large sample theory for infinitesimal gradient boosting

Clement Dombry, Jean-Jil Duchamps

Comments: 37 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[5] arXiv:2210.00928 [pdf, other]

Title: PAC-Bayes Generalisation Bounds for Heavy-Tailed Losses through Supermartingales

Maxime Haddouche, Benjamin Guedj

Comments: New Section 3 on Online PAC-Bayes

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[6] arXiv:2210.00950 [pdf, other]

Title: Optimal consumption-investment choices under wealth-driven risk aversion

Ruoxin Xiao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Mathematical Finance (q-fin.MF)

[7] arXiv:2210.00953 [pdf, other]

Title: Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes

Dongyan Huo, Yudong Chen, Qiaomin Xie

Comments: SIGMETRICS 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[8] arXiv:2210.00974 [pdf, other]

Title: Dealing with Unknown Variances in Best-Arm Identification

Marc Jourdan, Rémy Degenne, Emilie Kaufmann

Comments: 73 pages, 5 figures, 3 tables. To be published in the 34th International Conference on Algorithmic Learning Theory, Singapore, 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[9] arXiv:2210.00997 [pdf, other]

Title: Online Self-Concordant and Relatively Smooth Minimization, With Applications to Online Portfolio Selection and Learning Quantum States

Chung-En Tsai, Hao-Chung Cheng, Yen-Huan Li

Comments: 34th Int. Conf. Algorithmic Learning Theory (ALT 2023). A typo in the last equation in the proof of Lemma 10 is corrected

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Portfolio Management (q-fin.PM); Quantum Physics (quant-ph)

[10] arXiv:2210.01019 [pdf, other]

Title: Plateau in Monotonic Linear Interpolation -- A "Biased" View of Loss Landscape for Deep Networks

Xiang Wang, Annie N. Wang, Mo Zhou, Rong Ge

Comments: ICLR 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[11] arXiv:2210.01071 [pdf, other]

Title: New Paradigms for Exploiting Parallel Experiments in Bayesian Optimization

Leonardo D. González, Victor M. Zavala

Comments: 36 pages, 16 figures, 8 algorithms

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO)

[12] arXiv:2210.01295 [pdf, other]

Title: Max-Quantile Grouped Infinite-Arm Bandits

Ivan Lau, Yan Hao Ling, Mayank Shrivastava, Jonathan Scarlett

Comments: ALT 2023

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[13] arXiv:2210.01300 [pdf, other]

Title: Revealing Unobservables by Deep Learning: Generative Element Extraction Networks (GEEN)

Yingyao Hu, Yang Liu, Jiaxiong Yao

Comments: 19 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM)

[14] arXiv:2210.01329 [pdf, other]

Title: Active Learning for Regression with Aggregated Outputs

Tomoharu Iwata

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[15] arXiv:2210.01383 [pdf, other]

Title: Generalizing Bayesian Optimization with Decision-theoretic Entropies

Willie Neiswanger, Lantao Yu, Shengjia Zhao, Chenlin Meng, Stefano Ermon

Comments: Appears in Proceedings of the 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[16] arXiv:2210.01534 [pdf, other]

Title: Multi-fidelity Monte Carlo: a pseudo-marginal approach

Diana Cai, Ryan P. Adams

Comments: 22 pages, 7 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[17] arXiv:2210.01680 [pdf, other]

Title: New Machine Learning Techniques for Simulation-Based Inference: InferoStatic Nets, Kernel Score Estimation, and Kernel Likelihood Ratio Estimation

Kyoungchul Kong, Konstantin T. Matchev, Stephen Mrenna, Prasanth Shyamsundar

Comments: 36 pages, 10 figures. Submission to SciPost

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); High Energy Physics - Phenomenology (hep-ph)

[18] arXiv:2210.01863 [pdf, other]

Title: Group Personalized Federated Learning

Zhe Liu, Yue Hui, Fuchun Peng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[19] arXiv:2210.02015 [pdf, other]

Title: Conformalized Fairness via Quantile Regression

Meichen Liu, Lei Ding, Dengdeng Yu, Wulong Liu, Linglong Kong, Bei Jiang

Comments: 18 pages, 5 figures, 2 tables

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Machine Learning (cs.LG)

[20] arXiv:2210.02129 [pdf, other]

Title: Decentralized Hyper-Gradient Computation over Time-Varying Directed Networks

Naoyuki Terashita, Satoshi Hara

Comments: Under review

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[21] arXiv:2210.02157 [pdf, other]

Title: The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks

Blake Bordelon, Cengiz Pehlevan

Comments: ICLR 2023 Camera Ready

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG)

[22] arXiv:2210.02286 [pdf, other]

Title: Efficient probabilistic reconciliation of forecasts for real-valued and count time series

Lorenzo Zambon, Dario Azzimonti, Giorgio Corani

Comments: 27 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[23] arXiv:2210.02482 [pdf, other]

Title: Fisher information lower bounds for sampling

Sinho Chewi, Patrik Gerber, Holden Lee, Chen Lu

Comments: 35 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[24] arXiv:2210.02604 [pdf, other]

Title: Spectral Regularization Allows Data-frugal Learning over Combinatorial Spaces

Amirali Aghazadeh, Nived Rajaraman, Tony Tu, Kannan Ramchandran

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[25] arXiv:2210.02851 [pdf, html, other]

Title: Anomaly detection using data depth: multivariate case

Pavlo Mozharovskyi, Romain Valla

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)

[26] arXiv:2210.02882 [pdf, other]

Title: Scaling up Stochastic Gradient Descent for Non-convex Optimisation

Saad Mohamad, Hamad Alamri, Abdelhamid Bouchachia

Subjects: Machine Learning (stat.ML); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Optimization and Control (math.OC)

[27] arXiv:2210.03047 [pdf, other]

Title: Conditional Feature Importance for Mixed Data

Kristin Blesch, David S. Watson, Marvin N. Wright

Journal-ref: AStA Advances in Statistical Analysis (2023)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[28] arXiv:2210.03067 [pdf, other]

Title: Few-Shot Calibration of Set Predictors via Meta-Learned Cross-Validation-Based Conformal Prediction

Sangwoo Park, Kfir M. Cohen, Osvaldo Simeone

Comments: submitted for journal publication

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[29] arXiv:2210.03155 [pdf, other]

Title: Understanding Neural Coding on Latent Manifolds by Sharing Features and Dividing Ensembles

Martin Bjerke, Lukas Schott, Kristopher T. Jensen, Claudia Battistin, David A. Klindt, Benjamin A. Dunn

Comments: ICLR2023. The last two authors contributed equally

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

[30] arXiv:2210.03178 [pdf, other]

Title: Probabilistic Model Incorporating Auxiliary Covariates to Control FDR

Lin Qiu, Nils Murrugarra-Llerena, Vítor Silva, Lin Lin, Vernon M. Chinchilli

Comments: Short Version of NeurT-FDR, accepted at CIKM 2022. arXiv admin note: substantial text overlap with arXiv:2101.09809

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[31] arXiv:2210.03242 [pdf, other]

Title: Disentangling Mixtures of Unknown Causal Interventions

Abhinav Kumar, Gaurav Sinha

Journal-ref: Proceedings of the Thirty-Seventh Conference on Uncertainty in Artificial Intelligence, PMLR, Pages 2093-2102, Volume-161, Year-2021

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[32] arXiv:2210.03354 [pdf, other]

Title: Adversarial network training using higher-order moments in a modified Wasserstein distance

Oliver Serang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[33] arXiv:2210.03612 [pdf, other]

Title: 1st ICLR International Workshop on Privacy, Accountability, Interpretability, Robustness, Reasoning on Structured Data (PAIR^2Struct)

Hao Wang, Wanyu Lin, Hao He, Di Wang, Chengzhi Mao, Muhan Zhang

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[34] arXiv:2210.03702 [pdf, other]

Title: Class-wise and reduced calibration methods

Michael Panchenko, Anes Benmerzoug, Miguel de Benito Delgado

Comments: Accepted at the 21st IEEE International Conference on Machine Learning and Applications, ICMLA 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[35] arXiv:2210.03859 [pdf, html, other]

Title: Spectrally-Corrected and Regularized Linear Discriminant Analysis for Spiked Covariance Model

Hua Li, Wenya Luo, Zhidong Bai, Huanchao Zhou, Zhangni Pu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[36] arXiv:2210.04253 [pdf, other]

Title: A Concentration Bound for Distributed Stochastic Approximation

Harsh Dolhare, Vivek Borkar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[37] arXiv:2210.04318 [pdf, other]

Title: Prediction intervals for neural network models using weighted asymmetric loss functions

Milo Grillo, Yunpeng Han, Agnieszka Werpachowska

Comments: 14 pages, 3 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[38] arXiv:2210.04389 [pdf, other]

Title: DeepMed: Semiparametric Causal Mediation Analysis with Debiased Deep Learning

Siqi Xu, Lin Liu, Zhonghua Liu

Comments: Accepted by NeurIPS 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[39] arXiv:2210.04508 [pdf, other]

Title: Scale Equivariant U-Net

Mateus Sangalli (CMM), Samy Blusseau (CMM), Santiago Velasco-Forero (CMM), Jesus Angulo (CMM)

Journal-ref: 33rd British Machine Vision Conference, Nov 2022, Londres, United Kingdom

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[40] arXiv:2210.04635 [pdf, other]

Title: FaDIn: Fast Discretized Inference for Hawkes Processes with General Parametric Kernels

Guillaume Staerman, Cédric Allain, Alexandre Gramfort, Thomas Moreau

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[41] arXiv:2210.04815 [pdf, other]

Title: Truncated proposals for scalable and hassle-free simulation-based inference

Michael Deistler, Pedro J Goncalves, Jakob H Macke

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[42] arXiv:2210.04872 [pdf, html, other]

Title: Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models

Louis Sharrock, Jack Simons, Song Liu, Mark Beaumont

Comments: ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[43] arXiv:2210.04974 [pdf, other]

Title: Function-space regularized R\'enyi divergences

Jeremiah Birrell, Yannis Pantazis, Paul Dupuis, Markos A. Katsoulakis, Luc Rey-Bellet

Comments: 24 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[44] arXiv:2210.04994 [pdf, other]

Title: Sampling-based inference for large linear models, with application to linearised Laplace

Javier Antorán, Shreyas Padhy, Riccardo Barbano, Eric Nalisnick, David Janz, José Miguel Hernández-Lobato

Comments: Published at ICLR 2023. This latest Arxiv version is extended with a demonstration of the proposed methods on the Imagenet dataset

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[45] arXiv:2210.05165 [pdf, other]

Title: Combining datasets to increase the number of samples and improve model fitting

Thu Nguyen, Rabindra Khadka, Nhan Phan, Anis Yazidi, Pål Halvorsen, Michael A. Riegler

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[46] arXiv:2210.05262 [pdf, other]

Title: Factors of Influence of the Overestimation Bias of Q-Learning

Julius Wagenbach, Matthia Sabatelli

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[47] arXiv:2210.05354 [pdf, other]

Title: Constructing Prediction Intervals with Neural Networks: An Empirical Evaluation of Bootstrapping and Conformal Inference Methods

Alex Contarino, Christine Schubert Kabban, Chancellor Johnstone, Fairul Mohd-Zaid

Comments: 59 pages, 35 figures, 12 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[48] arXiv:2210.05431 [pdf, other]

Title: Non-Asymptotic Analysis of a UCB-based Top Two Algorithm

Marc Jourdan, Rémy Degenne

Comments: 32 pages, 5 figures, 3 tables. To be published in the Thirty-seventh Conference on Neural Information Processing Systems

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[49] arXiv:2210.05446 [pdf, other]

Title: Disentangling Causal Effects from Sets of Interventions in the Presence of Unobserved Confounders

Olivier Jeunen, Ciarán M. Gilligan-Lee, Rishabh Mehrotra, Mounia Lalmas

Comments: Accepted at the 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[50] arXiv:2210.05475 [pdf, other]

Title: GENIE: Higher-Order Denoising Diffusion Solvers

Tim Dockhorn, Arash Vahdat, Karsten Kreis

Comments: NeurIPS 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)