Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Showing 1–19 of 19 results for author: Wichert, A

Searching in archive cs. Search in all archives.
.
  1. arXiv:2301.02196  [pdf, other

    q-bio.NC cs.NE

    Competitive learning to generate sparse representations for associative memory

    Authors: Luis Sacouto, Andreas Wichert

    Abstract: One of the most well established brain principles, hebbian learning, has led to the theoretical concept of neural assemblies. Based on it, many interesting brain theories have spawned. Palm's work implements this concept through binary associative memory, in a model that not only has a wide cognitive explanatory power but also makes neuroscientific predictions. Yet, associative memory can only wor… ▽ More

    Submitted 5 January, 2023; originally announced January 2023.

  2. arXiv:2211.14347  [pdf, other

    cs.LG

    The smooth output assumption, and why deep networks are better than wide ones

    Authors: Luis Sa-Couto, Jose Miguel Ramos, Andreas Wichert

    Abstract: When several models have similar training scores, classical model selection heuristics follow Occam's razor and advise choosing the ones with least capacity. Yet, modern practice with large neural networks has often led to situations where two networks with exactly the same number of parameters score similar on the training set, but the deeper one generalizes better to unseen examples. With this i… ▽ More

    Submitted 25 November, 2022; originally announced November 2022.

  3. arXiv:2211.10322  [pdf, other

    cs.LG

    Understanding the double descent curve in Machine Learning

    Authors: Luis Sa-Couto, Jose Miguel Ramos, Miguel Almeida, Andreas Wichert

    Abstract: The theory of bias-variance used to serve as a guide for model selection when applying Machine Learning algorithms. However, modern practice has shown success with over-parameterized models that were expected to overfit but did not. This led to the proposal of the double descent curve of performance by Belkin et al. Although it seems to describe a real, representative phenomenon, the field is lack… ▽ More

    Submitted 18 November, 2022; originally announced November 2022.

  4. arXiv:2210.14855  [pdf, other

    cs.LG

    Multi-level Data Representation For Training Deep Helmholtz Machines

    Authors: Jose Miguel Ramos, Luis Sa-Couto, Andreas Wichert

    Abstract: A vast majority of the current research in the field of Machine Learning is done using algorithms with strong arguments pointing to their biological implausibility such as Backpropagation, deviating the field's focus from understanding its original organic inspiration to a compulsive search for optimal performance. Yet, there have been a few proposed models that respect most of the biological cons… ▽ More

    Submitted 26 October, 2022; originally announced October 2022.

  5. arXiv:2208.12564  [pdf, other

    cs.NE cs.AI cs.LG

    Can a Hebbian-like learning rule be avoiding the curse of dimensionality in sparse distributed data?

    Authors: Maria Osório, Luís Sa-Couto, Andreas Wichert

    Abstract: It is generally assumed that the brain uses something akin to sparse distributed representations. These representations, however, are high-dimensional and consequently they affect classification performance of traditional Machine Learning models due to "the curse of dimensionality". In tasks for which there is a vast amount of labeled data, Deep Networks seem to solve this issue with many layers a… ▽ More

    Submitted 20 July, 2022; originally announced August 2022.

    Comments: 15 pages, 6 figures

  6. Classification and Generation of real-world data with an Associative Memory Model

    Authors: Rodrigo Simas, Luis Sa-Couto, Andreas Wichert

    Abstract: Drawing from memory the face of a friend you have not seen in years is a difficult task. However, if you happen to cross paths, you would easily recognize each other. The biological memory is equipped with an impressive compression algorithm that can store the essential, and then infer the details to match perception. The Willshaw Memory is a simple abstract model for cortical computations which i… ▽ More

    Submitted 13 July, 2023; v1 submitted 11 July, 2022; originally announced July 2022.

    Comments: 10 pages, 15 figures. Neurocomputing, 2023

    MSC Class: 68T07 ACM Class: I.2.6

  7. arXiv:2104.14970  [pdf, other

    cs.CV cs.NE

    Using brain inspired principles to unsupervisedly learn good representations for visual pattern recognition

    Authors: Luis Sa-Couto, Andreas Wichert

    Abstract: Although deep learning has solved difficult problems in visual pattern recognition, it is mostly successful in tasks where there are lots of labeled training data available. Furthermore, the global back-propagation based training rule and the amount of employed layers represents a departure from biological inspiration. The brain is able to perform most of these tasks in a very general way from lim… ▽ More

    Submitted 30 April, 2021; originally announced April 2021.

  8. arXiv:2002.09192  [pdf, other

    cs.LG stat.ML

    An Investigation of Interpretability Techniques for Deep Learning in Predictive Process Analytics

    Authors: Catarina Moreira, Renuka Sindhgatta, Chun Ouyang, Peter Bruza, Andreas Wichert

    Abstract: This paper explores interpretability techniques for two of the most successful learning algorithms in medical decision-making literature: deep neural networks and random forests. We applied these algorithms in a real-world medical dataset containing information about patients with cancer, where we learn models that try to predict the type of cancer of the patient, given their set of medical activi… ▽ More

    Submitted 21 February, 2020; originally announced February 2020.

  9. Towards a Quantum-Like Cognitive Architecture for Decision-Making

    Authors: Catarina Moreira, Lauren Fell, Shahram Dehdashti, Peter Bruza, Andreas Wichert

    Abstract: We propose an alternative and unifying framework for decision-making that, by using quantum mechanics, provides more generalised cognitive and decision models with the ability to represent more information than classical models. This framework can accommodate and predict several cognitive biases reported in Lieder & Griffiths without heavy reliance on heuristics nor on assumptions of the computati… ▽ More

    Submitted 8 November, 2020; v1 submitted 11 May, 2019; originally announced May 2019.

  10. arXiv:1807.06142  [pdf, other

    cs.AI

    Introducing Quantum-Like Influence Diagrams for Violations of the Sure Thing Principle

    Authors: Catarina Moreira, Andreas Wichert

    Abstract: It is the focus of this work to extend and study the previously proposed quantum-like Bayesian networks to deal with decision-making scenarios by incorporating the notion of maximum expected utility in influence diagrams. The general idea is to take advantage of the quantum interference terms produced in the quantum-like Bayesian Network to influence the probabilities used to compute the expected… ▽ More

    Submitted 29 December, 2020; v1 submitted 16 July, 2018; originally announced July 2018.

    Journal ref: Quantum Interactions, 2018

  11. arXiv:1710.00490  [pdf, other

    cs.AI quant-ph

    The Dutch's Real World Financial Institute: Introducing Quantum-Like Bayesian Networks as an Alternative Model to deal with Uncertainty

    Authors: Catarina Moreira, Emmanuel Haven, Sandro Sozzo, Andreas Wichert

    Abstract: In this work, we analyse and model a real life financial loan application belonging to a sample bank in the Netherlands. The log is robust in terms of data, containing a total of 262 200 event logs, belonging to 13 087 different credit applications. The dataset is heterogeneous and consists of a mixture of computer generated automatic processes and manual human tasks. The goal is to work out a dec… ▽ More

    Submitted 2 October, 2017; originally announced October 2017.

    Comments: 15 images, 33 pages

  12. arXiv:1508.06973  [pdf, other

    cs.AI

    The Relation Between Acausality and Interference in Quantum-Like Bayesian Networks

    Authors: Catarina Moreira, Andreas Wichert

    Abstract: We analyse a quantum-like Bayesian Network that puts together cause/effect relationships and semantic similarities between events. These semantic similarities constitute acausal connections according to the Synchronicity principle and provide new relationships to quantum like probabilistic graphical models. As a consequence, beliefs (or any other event) can be represented in vector spaces, in whic… ▽ More

    Submitted 26 August, 2015; originally announced August 2015.

    Comments: In proceedings of the 9th International Conference on Quantum Interactions, 2015

  13. On Projection Based Operators in Lp space for Exact Similarity Search

    Authors: Andreas Wichert, Catarina Moreira

    Abstract: We investigate exact indexing for high dimensional Lp norms based on the 1-Lipschitz property and projection operators. The orthogonal projection that satisfies the 1-Lipschitz property for the Lp norm is described. The adaptive projection defined by the first principal component is introduced.

    Submitted 12 February, 2015; originally announced February 2015.

    Journal ref: Fundamenta Informaticae: Annales Societatis Mathematicae Polonae, 136: 1-14, 2015

  14. arXiv:1502.02030  [pdf, ps, other

    quant-ph cs.FL cs.LO

    Quantum Iterative Deepening with an application to the Halting problem

    Authors: Luís Tarrataca, Andreas Wichert

    Abstract: Classical models of computation traditionally resort to halting schemes in order to enquire about the state of a computation. In such schemes, a computational process is responsible for signalling an end of a calculation by setting a halt bit, which needs to be systematically checked by an observer. The capacity of quantum computational models to operate on a superposition of states requires an al… ▽ More

    Submitted 6 February, 2015; originally announced February 2015.

    Journal ref: PLOS One, March 2013

  15. A Quantum Production Model

    Authors: Luís Tarrataca, Andreas Wichert

    Abstract: The production system is a theoretical model of computation relevant to the artificial intelligence field allowing for problem solving procedures such as hierarchical tree search. In this work we explore some of the connections between artificial intelligence and quantum computation by presenting a model for a quantum production system. Our approach focuses on initially developing a model for a re… ▽ More

    Submitted 6 February, 2015; originally announced February 2015.

    Journal ref: Quantum Information Processing, 2012,11:1, 189-209

  16. Can Quantum Entanglement Detection Schemes Improve Search?

    Authors: Luís Tarrataca, Andreas Wichert

    Abstract: Quantum computation, in particular Grover's algorithm, has aroused a great deal of interest since it allows for a quadratic speedup to be obtained in search procedures. Classical search procedures for an $N$ element database require at most $O(N)$ time complexity. Grover's algorithm is able to find a solution with high probability in $O(\sqrt{N})$ time through an amplitude amplification scheme. In… ▽ More

    Submitted 6 February, 2015; originally announced February 2015.

    Journal ref: Quantum Information Processing, 2012, 11:1, 55-66

  17. Tree Search and Quantum Computation

    Authors: Luís Tarrataca, Andreas Wichert

    Abstract: Traditional tree search algorithms supply a blueprint for modeling problem solving behaviour. A diverse spectrum of problems can be formulated in terms of tree search. Quantum computation, in particular Grover's algorithm, has aroused a great deal of interest since it allows for a quadratic speedup to be obtained in search procedures. In this work we consider the impact of incorporating classical… ▽ More

    Submitted 6 February, 2015; originally announced February 2015.

    Journal ref: Quantum Information Processing, 2011, 10:4, 475-500

  18. Interference Effects in Quantum Belief Networks

    Authors: Catarina Moreira, Andreas Wichert

    Abstract: Probabilistic graphical models such as Bayesian Networks are one of the most powerful structures known by the Computer Science community for deriving probabilistic inferences. However, modern cognitive psychology has revealed that human decisions could not follow the rules of classical probability theory, because humans cannot process large amounts of data in order to make judgements. Consequently… ▽ More

    Submitted 30 September, 2014; originally announced September 2014.

    Journal ref: Applied Soft Computing, Volume 25, December 2014, Pages 64 - 85

  19. Finding Academic Experts on a MultiSensor Approach using Shannon's Entropy

    Authors: Catarina Moreira, Andreas Wichert

    Abstract: Expert finding is an information retrieval task concerned with the search for the most knowledgeable people, in some topic, with basis on documents describing peoples activities. The task involves taking a user query as input and returning a list of people sorted by their level of expertise regarding the user query. This paper introduces a novel approach for combining multiple estimators of expert… ▽ More

    Submitted 12 June, 2013; originally announced June 2013.

    Journal ref: Journal of Expert Systems with Applications, 2013, volume 40, issue 14