Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Showing 1–10 of 10 results for author: Husain, H

Searching in archive stat. Search in all archives.
.
  1. arXiv:2405.18686  [pdf, other

    stat.ML cs.LG

    Rejection via Learning Density Ratios

    Authors: Alexander Soen, Hisham Husain, Philip Schulz, Vu Nguyen

    Abstract: Classification with rejection emerges as a learning paradigm which allows models to abstain from making predictions. The predominant approach is to alter the supervised learning pipeline by augmenting typical loss functions, letting model rejection incur a lower loss than an incorrect prediction. Instead, we propose a different distributional perspective, where we seek to find an idealized data di… ▽ More

    Submitted 28 May, 2024; originally announced May 2024.

  2. arXiv:2203.02128  [pdf, other

    cs.LG math.OC stat.ML

    Distributionally Robust Bayesian Optimization with $\varphi$-divergences

    Authors: Hisham Husain, Vu Nguyen, Anton van den Hengel

    Abstract: The study of robustness has received much attention due to its inevitability in data-driven settings where many systems face uncertainty. One such example of concern is Bayesian Optimization (BO), where uncertainty is multi-faceted, yet there only exists a limited number of works dedicated to this direction. In particular, there is the work of Kirschner et al. (2020), which bridges the existing li… ▽ More

    Submitted 27 October, 2023; v1 submitted 3 March, 2022; originally announced March 2022.

    Comments: NeurIPS 2023 camera ready paper

  3. arXiv:2102.08093   

    stat.ML cs.LG

    A Law of Robustness for Weight-bounded Neural Networks

    Authors: Hisham Husain, Borja Balle

    Abstract: Robustness of deep neural networks against adversarial perturbations is a pressing concern motivated by recent findings showing the pervasive nature of such vulnerabilities. One method of characterizing the robustness of a neural network model is through its Lipschitz constant, which forms a robustness certificate. A natural question to ask is, for a fixed model class (such as neural networks) and… ▽ More

    Submitted 12 March, 2021; v1 submitted 16 February, 2021; originally announced February 2021.

    Comments: The main result does not resolve the conjecture as claimed. However the proof technique can be used to obtain a weaker result. The manuscript will be updated at a later date

  4. arXiv:2101.07012  [pdf, other

    cs.LG stat.ML

    Regularized Policies are Reward Robust

    Authors: Hisham Husain, Kamil Ciosek, Ryota Tomioka

    Abstract: Entropic regularization of policies in Reinforcement Learning (RL) is a commonly used heuristic to ensure that the learned policy explores the state-space sufficiently before overfitting to a local optimal policy. The primary motivation for using entropy is for exploration and disambiguating optimal policies; however, the theoretical effects are not entirely understood. In this work, we study the… ▽ More

    Submitted 18 January, 2021; originally announced January 2021.

  5. arXiv:2012.00188  [pdf, other

    stat.ML cs.LG

    Fair Densities via Boosting the Sufficient Statistics of Exponential Families

    Authors: Alexander Soen, Hisham Husain, Richard Nock

    Abstract: We introduce a boosting algorithm to pre-process data for fairness. Starting from an initial fair but inaccurate distribution, our approach shifts towards better data fitting while still ensuring a minimal fairness guarantee. To do so, it learns the sufficient statistics of an exponential family with boosting-compliant convergence. Importantly, we are able to theoretically prove that the learned d… ▽ More

    Submitted 15 August, 2023; v1 submitted 30 November, 2020; originally announced December 2020.

    Comments: Published in Proceedings of the 40th International Conference on Machine Learning (ICML2023)

  6. arXiv:2006.05188  [pdf, other

    cs.LG cs.AI stat.ML

    Optimal Continual Learning has Perfect Memory and is NP-hard

    Authors: Jeremias Knoblauch, Hisham Husain, Tom Diethe

    Abstract: Continual Learning (CL) algorithms incrementally learn a predictor or representation across multiple sequentially observed tasks. Designing CL algorithms that perform reliably and avoid so-called catastrophic forgetting has proven a persistent challenge. The current paper develops a theoretical approach that explains why. In particular, we derive the computational properties which CL algorithms wo… ▽ More

    Submitted 9 June, 2020; originally announced June 2020.

    Comments: Accepted for publication at ICML (International Conference on Machine Learning) 2020; 13 pages, 8 Figures

  7. arXiv:2006.04349  [pdf, other

    stat.ML cs.LG

    Distributional Robustness with IPMs and links to Regularization and GANs

    Authors: Hisham Husain

    Abstract: Robustness to adversarial attacks is an important concern due to the fragility of deep neural networks to small perturbations and has received an abundance of attention in recent years. Distributionally Robust Optimization (DRO), a particularly promising way of addressing this challenge, studies robustness via divergence-based uncertainty sets and has provided valuable insights into robustificatio… ▽ More

    Submitted 8 June, 2020; originally announced June 2020.

  8. arXiv:1909.09436  [pdf, other

    cs.LG cs.IR cs.SE stat.ML

    CodeSearchNet Challenge: Evaluating the State of Semantic Code Search

    Authors: Hamel Husain, Ho-Hsiang Wu, Tiferet Gazit, Miltiadis Allamanis, Marc Brockschmidt

    Abstract: Semantic code search is the task of retrieving relevant code given a natural language query. While related to other information retrieval tasks, it requires bridging the gap between the language used in code (often abbreviated and highly technical) and natural language more suitable to describe vague concepts and ideas. To enable evaluation of progress on code search, we are releasing the CodeSe… ▽ More

    Submitted 8 June, 2020; v1 submitted 20 September, 2019; originally announced September 2019.

    Comments: Updated evaluation numbers after fixing indexing bug

  9. arXiv:1902.00985  [pdf, ps, other

    stat.ML cs.LG

    Adversarial Networks and Autoencoders: The Primal-Dual Relationship and Generalization Bounds

    Authors: Hisham Husain, Richard Nock, Robert C. Williamson

    Abstract: Since the introduction of Generative Adversarial Networks (GANs) and Variational Autoencoders (VAE), the literature on generative modelling has witnessed an overwhelming resurgence. The impressive, yet elusive empirical performance of GANs has lead to the rise of many GAN-VAE hybrids, with the hopes of GAN level performance and additional benefits of VAE, such as an encoder for feature reduction,… ▽ More

    Submitted 26 April, 2019; v1 submitted 3 February, 2019; originally announced February 2019.

  10. arXiv:1806.04819  [pdf, other

    stat.ML cs.LG

    Integral Privacy for Sampling

    Authors: Hisham Husain, Zac Cranko, Richard Nock

    Abstract: Differential privacy is a leading protection setting, focused by design on individual privacy. Many applications, in medical / pharmaceutical domains or social networks, rather posit privacy at a group level, a setting we call integral privacy. We aim for the strongest form of privacy: the group size is in particular not known in advance. We study a problem with related applications in domains cit… ▽ More

    Submitted 2 July, 2019; v1 submitted 12 June, 2018; originally announced June 2018.