-
Fast post-hoc method for updating moments of large datasets
Authors:
Benjamin J. Q. Woods
Abstract:
Moments of large datasets utilise the mean of the dataset; consequently, updating the dataset traditionally requires one to update the mean, which then requires one to recalculate the moment. This means that metrics such as the standard deviation, $R^2$ correlation, and other statistics have to be `refreshed' for dataset updates, requiring large data storage and taking long times to process. Here,…
▽ More
Moments of large datasets utilise the mean of the dataset; consequently, updating the dataset traditionally requires one to update the mean, which then requires one to recalculate the moment. This means that metrics such as the standard deviation, $R^2$ correlation, and other statistics have to be `refreshed' for dataset updates, requiring large data storage and taking long times to process. Here, a method is shown for updating moments that only requires the previous moments (which are computationally cheaper to store), and the new data to be appended. This leads to a dramatic decrease in data storage requirements, and significant computational speed-up for large datasets or low-order moments (n $\lesssim$ 10).
△ Less
Submitted 21 December, 2018;
originally announced December 2018.
-
Expanding search in the space of empirical ML
Authors:
Bronwyn Woods
Abstract:
As researchers and practitioners of applied machine learning, we are given a set of requirements on the problem to be solved, the plausibly obtainable data, and the computational resources available. We aim to find (within those bounds) reliably useful combinations of problem, data, and algorithm. An emphasis on algorithmic or technical novelty in ML conference publications leads to exploration of…
▽ More
As researchers and practitioners of applied machine learning, we are given a set of requirements on the problem to be solved, the plausibly obtainable data, and the computational resources available. We aim to find (within those bounds) reliably useful combinations of problem, data, and algorithm. An emphasis on algorithmic or technical novelty in ML conference publications leads to exploration of one dimension of this space. Data collection and ML deployment at scale in industry settings offers an environment for exploring the others. Our conferences and reviewing criteria can better support empirical ML by soliciting and incentivizing experimentation and synthesis independent of algorithmic innovation.
△ Less
Submitted 4 December, 2018;
originally announced December 2018.
-
Mechanomyography based closed-loop Functional Electrical Stimulation cycling system
Authors:
Billy Woods,
Mahendran Subramanian,
Ali Shafti,
A. Aldo Faisal
Abstract:
Functional Electrical Stimulation (FES) systems are successful in restoring motor function and supporting paralyzed users. Commercially available FES products are open loop, meaning that the system is unable to adapt to changing conditions with the user and their muscles which results in muscle fatigue and poor stimulation protocols. This is because it is difficult to close the loop between stimul…
▽ More
Functional Electrical Stimulation (FES) systems are successful in restoring motor function and supporting paralyzed users. Commercially available FES products are open loop, meaning that the system is unable to adapt to changing conditions with the user and their muscles which results in muscle fatigue and poor stimulation protocols. This is because it is difficult to close the loop between stimulation and monitoring of muscle contraction using adaptive stimulation. FES causes electrical artefacts which make it challenging to monitor muscle contractions with traditional methods such as electromyography (EMG). We look to overcome this limitation by combining FES with novel mechanomyographic (MMG) sensors to be able to monitor muscle activity during stimulation in real time. To provide a meaningful task we built an FES cycling rig with a software interface that enabled us to perform adaptive recording and stimulation, and then combine this with sensors to record forces applied to the pedals using force sensitive resistors (FSRs), crank angle position using a magnetic incremental encoder and inputs from the user using switches and a potentiometer. We illustrated this with a closed-loop stimulation algorithm that used the inputs from the sensors to control the output of a programmable RehaStim 1 FES stimulator (Hasomed) in real-time. This recumbent bicycle rig was used as a testing platform for FES cycling. The algorithm was designed to respond to a change in requested speed (RPM) from the user and change the stimulation power (% of maximum current mA) until this speed was achieved and then maintain it.
△ Less
Submitted 30 July, 2018;
originally announced July 2018.
-
A characterization of Linearizable instances of the Quadratic Traveling Salesman Problem
Authors:
Abraham P. Punnen,
Matthias Walter,
Brad D. Woods
Abstract:
We consider the linearization problem associated with the quadratic traveling salesman problem (QTSP). Necessary and sufficient conditions are given for a cost matrix $Q$ of QTSP to be linearizable. It is shown that these conditions can be verified in $O(n^5)$ time. Some simpler sufficient conditions for linearization are also given along with related open problems.
We consider the linearization problem associated with the quadratic traveling salesman problem (QTSP). Necessary and sufficient conditions are given for a cost matrix $Q$ of QTSP to be linearizable. It is shown that these conditions can be verified in $O(n^5)$ time. Some simpler sufficient conditions for linearization are also given along with related open problems.
△ Less
Submitted 8 April, 2018; v1 submitted 23 August, 2017;
originally announced August 2017.
-
A class of exponential neighbourhoods for the quadratic travelling salesman problem
Authors:
Brad Woods,
Abraham Punnen
Abstract:
The Quadratic Travelling Salesman Problem (QTSP) is to find a least-cost Hamiltonian cycle in an edge-weighted graph, where costs are defined on all pairs of edges such that each edge in the pair is contained in the Hamiltonian cycle. This is a more general version than the one that appears in the literature as the QTSP, denoted here as the \emph{adjacent quadratic} TSP, which only considers costs…
▽ More
The Quadratic Travelling Salesman Problem (QTSP) is to find a least-cost Hamiltonian cycle in an edge-weighted graph, where costs are defined on all pairs of edges such that each edge in the pair is contained in the Hamiltonian cycle. This is a more general version than the one that appears in the literature as the QTSP, denoted here as the \emph{adjacent quadratic} TSP, which only considers costs for pairs of adjacent edges. Major directions of research work on the linear TSP include exact algorithms, heuristics, approximation algorithms, polynomially solvable special cases and exponential neighbourhoods among others. In this paper we explore the complexity of searching exponential neighbourhoods for QTSP, the fixed-rank QTSP, and the adjacent quadratic TSP. The fixed-rank QTSP is introduced as a restricted version of the QTSP where the cost matrix has fixed rank $p$. It is shown that fixed-rank QTSP is solvable in pseudopolynomial time and admits an FPTAS for each of the special cases studied, except for the case of matching edge ejection tours. The adjacent quadratic TSP is shown to be polynomially-solvable in many of the cases for which the linear TSP is polynomially-solvable. Interestingly, optimizing over the matching edge ejection tour neighbourhood is shown to be pseudopolynomial for the rank 1 case without a linear term in the objective function, but NP-hard for the adjacent quadratic TSP case.
We also show that the quadratic shortest path problem on an acyclic digraph can be solved in pseudopolynomial time and by an FPTAS when the rank of the associated cost matrix is fixed.
△ Less
Submitted 18 June, 2019; v1 submitted 15 May, 2017;
originally announced May 2017.
-
Solving constrained quadratic binary problems via quantum adiabatic evolution
Authors:
Pooya Ronagh,
Brad Woods,
Ehsan Iranmanesh
Abstract:
Quantum adiabatic evolution is perceived as useful for binary quadratic programming problems that are a priori unconstrained. For constrained problems, it is a common practice to relax linear equality constraints as penalty terms in the objective function. However, there has not yet been proposed a method for efficiently dealing with inequality constraints using the quantum adiabatic approach. In…
▽ More
Quantum adiabatic evolution is perceived as useful for binary quadratic programming problems that are a priori unconstrained. For constrained problems, it is a common practice to relax linear equality constraints as penalty terms in the objective function. However, there has not yet been proposed a method for efficiently dealing with inequality constraints using the quantum adiabatic approach. In this paper, we give a method for solving the Lagrangian dual of a binary quadratic programming (BQP) problem in the presence of inequality constraints and employ this procedure within a branch-and-bound framework for constrained BQP (CBQP) problems.
△ Less
Submitted 9 February, 2018; v1 submitted 16 September, 2015;
originally announced September 2015.
-
Building an iterative heuristic solver for a quantum annealer
Authors:
Gili Rosenberg,
Mohammad Vazifeh,
Brad Woods,
Eldad Haber
Abstract:
A quantum annealer heuristically minimizes quadratic unconstrained binary optimization (QUBO) problems, but is limited by the physical hardware in the size and density of the problems it can handle. We have developed a meta-heuristic solver that utilizes D-Wave Systems' quantum annealer (or any other QUBO problem optimizer) to solve larger or denser problems, by iteratively solving subproblems, wh…
▽ More
A quantum annealer heuristically minimizes quadratic unconstrained binary optimization (QUBO) problems, but is limited by the physical hardware in the size and density of the problems it can handle. We have developed a meta-heuristic solver that utilizes D-Wave Systems' quantum annealer (or any other QUBO problem optimizer) to solve larger or denser problems, by iteratively solving subproblems, while keeping the rest of the variables fixed. We present our algorithm, several variants, and the results for the optimization of standard QUBO problem instances from OR-Library of sizes 500 and 2500 as well as the Palubeckis instances of sizes 3000 to 7000. For practical use of the solver, we show the dependence of the time to best solution on the desired gap to the best known solution. In addition, we study the dependence of the gap and the time to best solution on the size of the problems solved by the underlying optimizer.
△ Less
Submitted 28 August, 2015; v1 submitted 27 July, 2015;
originally announced July 2015.
-
A Linear Time Algorithm for the $3$-neighbour Traveling Salesman Problem on Halin graphs and extensions
Authors:
Brad Woods,
Abraham Punnen,
Tamon Stephen
Abstract:
The Quadratic Travelling Salesman Problem (QTSP) is to find a least cost Hamilton cycle in an edge-weighted graph, where costs are defined on all pairs of edges contained in the Hamilton cycle. This is a more general version than the commonly studied QTSP which only considers pairs of adjacent edges. We define a restricted version of QTSP, the $k$-neighbour TSP (TSP($k$)), and give a linear time a…
▽ More
The Quadratic Travelling Salesman Problem (QTSP) is to find a least cost Hamilton cycle in an edge-weighted graph, where costs are defined on all pairs of edges contained in the Hamilton cycle. This is a more general version than the commonly studied QTSP which only considers pairs of adjacent edges. We define a restricted version of QTSP, the $k$-neighbour TSP (TSP($k$)), and give a linear time algorithm to solve TSP($k$) on a Halin graph for $k\leq 3$. This algorithm can be extended to solve TSP($k$) on any fully reducible class of graphs for any fixed $k$ in polynomial time. This result generalizes corresponding results for the standard TSP. TSP($k$) can be used to model various machine scheduling problems as well as an optimal routing problem for unmanned aerial vehicles (UAVs).
△ Less
Submitted 4 September, 2017; v1 submitted 8 April, 2015;
originally announced April 2015.