Showing 1–50 of 290 results for author: Ortega, A

Feature-Preserving Rate-Distortion Optimization in Image Coding for Machines

Authors: Samuel Fernández Menduiña, Eduardo Pavez, Antonio Ortega

Abstract: With the increasing number of images and videos consumed by computer vision algorithms, compression methods are evolving to consider both perceptual quality and performance in downstream tasks. Traditional codecs can tackle this problem by performing rate-distortion optimization (RDO) to minimize the distance at the output of a feature extractor. However, neural network non-linearities can make th… ▽ More With the increasing number of images and videos consumed by computer vision algorithms, compression methods are evolving to consider both perceptual quality and performance in downstream tasks. Traditional codecs can tackle this problem by performing rate-distortion optimization (RDO) to minimize the distance at the output of a feature extractor. However, neural network non-linearities can make the rate-distortion landscape irregular, leading to reconstructions with poor visual quality even for high bit rates. Moreover, RDO decisions are made block-wise, while the feature extractor requires the whole image to exploit global information. In this paper, we address these limitations in three steps. First, we apply Taylor's expansion to the feature extractor, recasting the metric as an input-dependent squared error involving the Jacobian matrix of the neural network. Second, we make a localization assumption to compute the metric block-wise. Finally, we use randomized dimensionality reduction techniques to approximate the Jacobian. The resulting expression is monotonic with the rate and can be evaluated in the transform domain. Simulations with AVC show that our approach provides bit-rate savings while preserving accuracy in downstream tasks with less complexity than using the feature distance directly. △ Less

Submitted 13 August, 2024; originally announced August 2024.

Comments: 6 pages, 6 figures, MMSP

Defining and Measuring Disentanglement for non-Independent Factors of Variation

Authors: Antonio Almudévar, Alfonso Ortega, Luis Vicente, Antonio Miguel, Eduardo Lleida

Abstract: Representation learning is an approach that allows to discover and extract the factors of variation from the data. Intuitively, a representation is said to be disentangled if it separates the different factors of variation in a way that is understandable to humans. Definitions of disentanglement and metrics to measure it usually assume that the factors of variation are independent of each other. H… ▽ More Representation learning is an approach that allows to discover and extract the factors of variation from the data. Intuitively, a representation is said to be disentangled if it separates the different factors of variation in a way that is understandable to humans. Definitions of disentanglement and metrics to measure it usually assume that the factors of variation are independent of each other. However, this is generally false in the real world, which limits the use of these definitions and metrics to very specific and unrealistic scenarios. In this paper we give a definition of disentanglement based on information theory that is also valid when the factors of variation are not independent. Furthermore, we relate this definition to the Information Bottleneck Method. Finally, we propose a method to measure the degree of disentanglement from the given definition that works when the factors of variation are not independent. We show through different experiments that the method proposed in this paper correctly measures disentanglement with non-independent factors of variation, while other methods fail in this scenario. △ Less

Submitted 13 August, 2024; originally announced August 2024.

Out-of-Distribution Detection through Soft Clustering with Non-Negative Kernel Regression

Authors: Aryan Gulati, Xingjian Dong, Carlos Hurtado, Sarath Shekkizhar, Swabha Swayamdipta, Antonio Ortega

Abstract: As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for detecting OOD data are computationally complex and storage-intensive. We propose a novel soft clustering approach for OOD detection based on non-negative kernel regress… ▽ More As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for detecting OOD data are computationally complex and storage-intensive. We propose a novel soft clustering approach for OOD detection based on non-negative kernel regression. Our approach greatly reduces computational and space complexities (up to 11x improvement in inference time and 87% reduction in storage requirements) and outperforms existing approaches by up to 4 AUROC points on four different benchmarks. We also introduce an entropy-constrained version of our algorithm, which leads to further reductions in storage requirements (up to 97% lower than comparable approaches) while retaining competitive performance. Our soft clustering approach for OOD detection highlights its potential for detecting tail-end phenomena in extreme-scale data settings. △ Less

Submitted 17 July, 2024; originally announced July 2024.

Predefined Prototypes for Intra-Class Separation and Disentanglement

Authors: Antonio Almudévar, Théo Mariotte, Alfonso Ortega, Marie Tahon, Luis Vicente, Antonio Miguel, Eduardo Lleida

Abstract: Prototypical Learning is based on the idea that there is a point (which we call prototype) around which the embeddings of a class are clustered. It has shown promising results in scenarios with little labeled data or to design explainable models. Typically, prototypes are either defined as the average of the embeddings of a class or are designed to be trainable. In this work, we propose to predefi… ▽ More Prototypical Learning is based on the idea that there is a point (which we call prototype) around which the embeddings of a class are clustered. It has shown promising results in scenarios with little labeled data or to design explainable models. Typically, prototypes are either defined as the average of the embeddings of a class or are designed to be trainable. In this work, we propose to predefine prototypes following human-specified criteria, which simplify the training pipeline and brings different advantages. Specifically, in this work we explore two of these advantages: increasing the inter-class separability of embeddings and disentangling embeddings with respect to different variance factors, which can translate into the possibility of having explainable predictions. Finally, we propose different experiments that help to understand our proposal and demonstrate empirically the mentioned advantages. △ Less

Submitted 23 June, 2024; originally announced June 2024.

Explainable by-design Audio Segmentation through Non-Negative Matrix Factorization and Probing

Authors: Martin Lebourdais, Théo Mariotte, Antonio Almudévar, Marie Tahon, Alfonso Ortega

Abstract: Audio segmentation is a key task for many speech technologies, most of which are based on neural networks, usually considered as black boxes, with high-level performances. However, in many domains, among which health or forensics, there is not only a need for good performance but also for explanations about the output decision. Explanations derived directly from latent representations need to sati… ▽ More Audio segmentation is a key task for many speech technologies, most of which are based on neural networks, usually considered as black boxes, with high-level performances. However, in many domains, among which health or forensics, there is not only a need for good performance but also for explanations about the output decision. Explanations derived directly from latent representations need to satisfy "good" properties, such as informativeness, compactness, or modularity, to be interpretable. In this article, we propose an explainable-by-design audio segmentation model based on non-negative matrix factorization (NMF) which is a good candidate for the design of interpretable representations. This paper shows that our model reaches good segmentation performances, and presents deep analyses of the latent representation extracted from the non-negative matrix. The proposed approach opens new perspectives toward the evaluation of interpretable representations according to "good" properties. △ Less

Submitted 19 June, 2024; originally announced June 2024.

Comments: Accepted at Interspeech 2024, 5 pages, 2 figures, 3 tables

Full reference point cloud quality assessment using support vector regression

Authors: Ryosuke Watanabe, Shashank N. Sridhara, Haoran Hong, Eduardo Pavez, Keisuke Nonaka, Tatsuya Kobayashi, Antonio Ortega

Abstract: Point clouds are a general format for representing realistic 3D objects in diverse 3D applications. Since point clouds have large data sizes, developing efficient point cloud compression methods is crucial. However, excessive compression leads to various distortions, which deteriorates the point cloud quality perceived by end users. Thus, establishing reliable point cloud quality assessment (PCQA)… ▽ More Point clouds are a general format for representing realistic 3D objects in diverse 3D applications. Since point clouds have large data sizes, developing efficient point cloud compression methods is crucial. However, excessive compression leads to various distortions, which deteriorates the point cloud quality perceived by end users. Thus, establishing reliable point cloud quality assessment (PCQA) methods is essential as a benchmark to develop efficient compression methods. This paper presents an accurate full-reference point cloud quality assessment (FR-PCQA) method called full-reference quality assessment using support vector regression (FRSVR) for various types of degradations such as compression distortion, Gaussian noise, and down-sampling. The proposed method demonstrates accurate PCQA by integrating five FR-based metrics covering various types of errors (e.g., considering geometric distortion, color distortion, and point count) using support vector regression (SVR). Moreover, the proposed method achieves a superior trade-off between accuracy and calculation speed because it includes only the calculation of these five simple metrics and SVR, which can perform fast prediction. Experimental results with three types of open datasets show that the proposed method is more accurate than conventional FR-PCQA methods. In addition, the proposed method is faster than state-of-the-art methods that utilize complicated features such as curvature and multi-scale features. Thus, the proposed method provides excellent performance in terms of the accuracy of PCQA and processing speed. Our method is available from https://github.com/STAC-USC/FRSVR-PCQA. △ Less

Submitted 15 June, 2024; originally announced June 2024.

Comments: Source code: https://github.com/STAC-USC/FRSVR-PCQA

Full-reference Point Cloud Quality Assessment Using Spectral Graph Wavelets

Authors: Ryosuke Watanabe, Keisuke Nonaka, Eduardo Pavez, Tatsuya Kobayashi, Antonio Ortega

Abstract: Point clouds in 3D applications frequently experience quality degradation during processing, e.g., scanning and compression. Reliable point cloud quality assessment (PCQA) is important for developing compression algorithms with good bitrate-quality trade-offs and techniques for quality improvement (e.g., denoising). This paper introduces a full-reference (FR) PCQA method utilizing spectral graph w… ▽ More Point clouds in 3D applications frequently experience quality degradation during processing, e.g., scanning and compression. Reliable point cloud quality assessment (PCQA) is important for developing compression algorithms with good bitrate-quality trade-offs and techniques for quality improvement (e.g., denoising). This paper introduces a full-reference (FR) PCQA method utilizing spectral graph wavelets (SGWs). First, we propose novel SGW-based PCQA metrics that compare SGW coefficients of coordinate and color signals between reference and distorted point clouds. Second, we achieve accurate PCQA by integrating several conventional FR metrics and our SGW-based metrics using support vector regression. To our knowledge, this is the first study to introduce SGWs for PCQA. Experimental results demonstrate the proposed PCQA metric is more accurately correlated with subjective quality scores compared to conventional PCQA metrics. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Existence of solutions for a system with general Hardy--Sobolev singular criticalities

Authors: Ángel Arroyo, Rafael López-Soriano, Alejandro Ortega

Abstract: In this paper we study a class of Hardy--Sobolev type systems defined in $\mathbb{R}^N$ and coupled by a singular critical Hardy--Sobolev term. The main novelty of this work is that the orders of the singularities are independent and contained in a wide range. By means of variational techniques, we will prove the existence of positive bound and ground states for such a system. In particular, we fi… ▽ More In this paper we study a class of Hardy--Sobolev type systems defined in $\mathbb{R}^N$ and coupled by a singular critical Hardy--Sobolev term. The main novelty of this work is that the orders of the singularities are independent and contained in a wide range. By means of variational techniques, we will prove the existence of positive bound and ground states for such a system. In particular, we find solutions as minimizers or Mountain--Pass critical points of the energy functional on the underlying Nehari manifold. △ Less

Submitted 31 May, 2024; originally announced May 2024.

Comments: arXiv admin note: text overlap with arXiv:2211.17047

Topics in the Study of the Pragmatic Functions of Phonetic Reduction in Dialog

Authors: Nigel G. Ward, Carlos A. Ortega

Abstract: Reduced articulatory precision is common in speech, but for dialog its acoustic properties and pragmatic functions have been little studied. We here try to remedy this gap. This technical report contains content that was omitted from the journal article (Ward et al. 2024, submitted). Specifically, we here report 1) lessons learned about annotating for perceived reduction, 2) the finding that, unli… ▽ More Reduced articulatory precision is common in speech, but for dialog its acoustic properties and pragmatic functions have been little studied. We here try to remedy this gap. This technical report contains content that was omitted from the journal article (Ward et al. 2024, submitted). Specifically, we here report 1) lessons learned about annotating for perceived reduction, 2) the finding that, unlike in read speech, the correlates of reduction in dialog include high pitch, wide pitch range, and intensity, and 3) a baseline model for predicting reduction in dialog, using simple acoustic/prosodic features, that achieves correlations with human perceptions of 0.24 for English, and 0.17 for Spanish. We also provide examples of additional possible pragmatic functions of reduction in English, and various discussion, observations and speculations △ Less

Submitted 2 May, 2024; originally announced May 2024.

Thermographic study of freezing water drops: An insight on Mpemba effect

Authors: Argelia Balbuena Ortega, Emiliano Hernández-Figueroa, J. Antonio del Río

Abstract: Despite decades of research, the Mpemba Effect challenges scientists, prompting further investigation and refinement of existing hypotheses. This work uses optical tools such as thermography to analyze and study the Mpemba effect on drops. We analyze times and contact angle changes with temperature with an easily controlled experiment. This work contributes to the ongoing discourse surrounding the… ▽ More Despite decades of research, the Mpemba Effect challenges scientists, prompting further investigation and refinement of existing hypotheses. This work uses optical tools such as thermography to analyze and study the Mpemba effect on drops. We analyze times and contact angle changes with temperature with an easily controlled experiment. This work contributes to the ongoing discourse surrounding the Mpemba Effect, emphasizing the need for interdisciplinary collaboration and experimental rigor to unravel the complexities of this intriguing phenomenon. A deeper understanding of the Mpemba Effect enhances our knowledge of thermodynamics and fluid dynamics and opens avenues for practical applications in fields such as cryopreservation, meteorology, and materials science. △ Less

Submitted 17 April, 2024; originally announced April 2024.

Comments: 14 pages, color figures

Journal ref: Rev. Mex. Fis. 7, 050601 (2024)

New functional inequalities with applications to the arctan-fast diffusion equation

Authors: Rafael Granero-Belinchón, Martina Magliocca, Alejandro Ortega

Abstract: In this paper, we prove a couple of new nonlinear functional inequalities of Sobolev type akin to the logarithmic Sobolev inequality. In particular, one of the inequalities reads $$ \int_{\mathbb{S}^1}\arctan\left(\frac{\partial_x u}{u}\right)\partial_xu \,dx\geq \arctan\left(\|u(t)\|_{\dot{W}^{1,1}(\mathbb{S}^1)}\right)\|u(t)\|_{\dot{W}^{1,1}(\mathbb{S}^1)}. $$ Then, these inequalities are used i… ▽ More In this paper, we prove a couple of new nonlinear functional inequalities of Sobolev type akin to the logarithmic Sobolev inequality. In particular, one of the inequalities reads $$ \int_{\mathbb{S}^1}\arctan\left(\frac{\partial_x u}{u}\right)\partial_xu \,dx\geq \arctan\left(\|u(t)\|_{\dot{W}^{1,1}(\mathbb{S}^1)}\right)\|u(t)\|_{\dot{W}^{1,1}(\mathbb{S}^1)}. $$ Then, these inequalities are used in the study of the nonlinear \emph{arctan}-fast diffusion equation $$ \partial_t u-\partial_x\arctan\left(\frac{\partial_x u}{u}\right)=0. $$ For this highly nonlinear PDE we establish a number of well-posedness results and qualitative properties. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Development of control algorithms for mobile robotics focused on their potential use for FPGA-based robots

Authors: Andrés-David Suárez-Gómez, Andres A. Hernandez Ortega

Abstract: This paper investigates the development and optimization of control algorithms for mobile robotics, with a keen focus on their implementation in Field-Programmable Gate Arrays (FPGAs). It delves into both classical control approaches such as PID and modern techniques including deep learning, addressing their application in sectors ranging from industrial automation to medical care. The study highl… ▽ More This paper investigates the development and optimization of control algorithms for mobile robotics, with a keen focus on their implementation in Field-Programmable Gate Arrays (FPGAs). It delves into both classical control approaches such as PID and modern techniques including deep learning, addressing their application in sectors ranging from industrial automation to medical care. The study highlights the practical challenges and advancements in embedding these algorithms into FPGAs, which offer significant benefits for mobile robotics due to their high-speed processing and parallel computation capabilities. Through an analysis of various control strategies, the paper showcases the improvements in robot performance, particularly in navigation and obstacle avoidance. It emphasizes the critical role of FPGAs in enhancing the efficiency and adaptability of control algorithms in dynamic environments. Additionally, the research discusses the difficulties in benchmarking and evaluating the performance of these algorithms in real-world applications, suggesting a need for standardized evaluation criteria. The contribution of this work lies in its comprehensive examination of control algorithms' potential in FPGA-based mobile robotics, offering insights into future research directions for improving robotic autonomy and operational efficiency. △ Less

Submitted 14 March, 2024; originally announced March 2024.

Comments: 10 pages, 1 figure

Single-level Robust Bidding of Renewable-only Virtual Power Plant in Energy and Ancillary Service Markets for Worst-case Profit

Authors: Hadi Nemati, Pedro Sánchez-Martín, Ana Baringo, Álvaro Ortega

Abstract: This paper proposes a novel single-level robust mathematical approach to model the RES-only Virtual Power Plant (RVPP) bidding problem in the simultaneous Day Ahead Market (DAM) and Secondary Reserve Market (SRM). The worst-case profit of RVPP due to uncertainties related to electricity prices, Non-dispatchable Renewable Energy Sources (ND-RES) production, and flexible demand is captured. In order… ▽ More This paper proposes a novel single-level robust mathematical approach to model the RES-only Virtual Power Plant (RVPP) bidding problem in the simultaneous Day Ahead Market (DAM) and Secondary Reserve Market (SRM). The worst-case profit of RVPP due to uncertainties related to electricity prices, Non-dispatchable Renewable Energy Sources (ND-RES) production, and flexible demand is captured. In order to find the worst-case profit in a single-level model, the relationship between price and energy uncertainties leads to some non-linear constraints, which are appropriately linearized. The simulation results show the superiority of the proposed robust model compared to those in the literature, as well as its computational efficiency. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Adaptive Online Learning of Separable Path Graph Transforms for Intra-prediction

Authors: Wen-Yang Lu, Eduardo Pavez, Antonio Ortega, Xin Zhao, Shan Liu

Abstract: Current video coding standards, including H.264/AVC, HEVC, and VVC, employ discrete cosine transform (DCT), discrete sine transform (DST), and secondary to Karhunen-Loeve transforms (KLTs) decorrelate the intra-prediction residuals. However, the efficiency of these transforms in decorrelation can be limited when the signal has a non-smooth and non-periodic structure, such as those occurring in tex… ▽ More Current video coding standards, including H.264/AVC, HEVC, and VVC, employ discrete cosine transform (DCT), discrete sine transform (DST), and secondary to Karhunen-Loeve transforms (KLTs) decorrelate the intra-prediction residuals. However, the efficiency of these transforms in decorrelation can be limited when the signal has a non-smooth and non-periodic structure, such as those occurring in textures with intricate patterns. This paper introduces a novel adaptive separable path graph-based transform (GBT) that can provide better decorrelation than the DCT for intra-predicted texture data. The proposed GBT is learned in an online scenario with sequential K-means clustering, which groups similar blocks during encoding and decoding to adaptively learn the GBT for the current block from previously reconstructed areas with similar characteristics. A signaling overhead is added to the bitstream of each coding block to indicate the usage of the proposed graph-based transform. We assess the performance of this method combined with H.264/AVC intra-coding tools and demonstrate that it can significantly outperform H.264/AVC DCT for intra-predicted texture data. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Comments: 5 pages, 4 figures

Choi representation of completely positive maps: a technical introduction

Authors: G. Homa, A. Ortega, M. Koniorczyk

Abstract: This is a very brief operational introduction to the Choi representation of completely positive maps, i.e. quantum channels. It focuses on certain useful calculational techniques which are presented in full detail. This is a very brief operational introduction to the Choi representation of completely positive maps, i.e. quantum channels. It focuses on certain useful calculational techniques which are presented in full detail. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Flexible Robust Optimal Bidding of Renewable Virtual Power Plants in Sequential Markets

Authors: Hadi Nemati, Pedro Sánchez-Martín, Álvaro Ortega, Lukas Sigrist, Enrique Lobato, Luis Rouco

Abstract: In this paper, a novel approach to define the optimal bidding of renewable-only virtual power plants (RVPPs) in the day-ahead, secondary reserve, and intra-day markets is proposed. To this aim, a robust optimization algorithm is developed to account for the asymmetric nature of the uncertainties that characterize the market prices, as well as the energy production of the RVPP stochastic sources an… ▽ More In this paper, a novel approach to define the optimal bidding of renewable-only virtual power plants (RVPPs) in the day-ahead, secondary reserve, and intra-day markets is proposed. To this aim, a robust optimization algorithm is developed to account for the asymmetric nature of the uncertainties that characterize the market prices, as well as the energy production of the RVPP stochastic sources and flexible demand consumption. Simulation results show increased RVPP benefits compared to other existing solutions and demonstrate the potential of renewable sources to further increase their economic competitiveness. The simplicity of the implementation, the computational efficiency, and the flexible robustness are also verified. △ Less

Submitted 19 February, 2024; originally announced February 2024.

Lossy Compression of Adjacency Matrices by Graph Filter Banks

Authors: Kenta Yanagiya, Junya Hara, Hiroshi Higashi, Yuichi Tanaka, Antonio Ortega

Abstract: This paper proposes a compression framework for adjacency matrices of weighted graphs based on graph filter banks. Adjacency matrices are widely used mathematical representations of graphs and are used in various applications in signal processing, machine learning, and data mining. In many problems of interest, these adjacency matrices can be large, so efficient compression methods are crucial. In… ▽ More This paper proposes a compression framework for adjacency matrices of weighted graphs based on graph filter banks. Adjacency matrices are widely used mathematical representations of graphs and are used in various applications in signal processing, machine learning, and data mining. In many problems of interest, these adjacency matrices can be large, so efficient compression methods are crucial. In this paper, we propose a lossy compression of weighted adjacency matrices, where the binary adjacency information is encoded losslessly (so the topological information of the graph is preserved) while the edge weights are compressed lossily. For the edge weight compression, the target graph is converted into a line graph, whose nodes correspond to the edges of the original graph, and where the original edge weights are regarded as a graph signal on the line graph. We then transform the edge weights on the line graph with a graph filter bank for sparse representation. Experiments on synthetic data validate the effectiveness of the proposed method by comparing it with existing lossy matrix compression methods. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Fast graph-based denoising for point cloud color information

Authors: Ryosuke Watanabe, Keisuke Nonaka, Eduardo Pavez, Tatsuya Kobayashi, Antonio Ortega

Abstract: Point clouds are utilized in various 3D applications such as cross-reality (XR) and realistic 3D displays. In some applications, e.g., for live streaming using a 3D point cloud, real-time point cloud denoising methods are required to enhance the visual quality. However, conventional high-precision denoising methods cannot be executed in real time for large-scale point clouds owing to the complexit… ▽ More Point clouds are utilized in various 3D applications such as cross-reality (XR) and realistic 3D displays. In some applications, e.g., for live streaming using a 3D point cloud, real-time point cloud denoising methods are required to enhance the visual quality. However, conventional high-precision denoising methods cannot be executed in real time for large-scale point clouds owing to the complexity of graph constructions with K nearest neighbors and noise level estimation. This paper proposes a fast graph-based denoising (FGBD) for a large-scale point cloud. First, high-speed graph construction is achieved by scanning a point cloud in various directions and searching adjacent neighborhoods on the scanning lines. Second, we propose a fast noise level estimation method using eigenvalues of the covariance matrix on a graph. Finally, we also propose a new low-cost filter selection method to enhance denoising accuracy to compensate for the degradation caused by the acceleration algorithms. In our experiments, we succeeded in reducing the processing time dramatically while maintaining accuracy relative to conventional denoising methods. Denoising was performed at 30fps, with frames containing approximately 1 million points. △ Less

Submitted 15 June, 2024; v1 submitted 17 January, 2024; originally announced January 2024.

Comments: Published in the proceeding of 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2024)

Unsupervised Multiple Domain Translation through Controlled Disentanglement in Variational Autoencoder

Authors: Antonio Almudévar, Théo Mariotte, Alfonso Ortega, Marie Tahon

Abstract: Unsupervised Multiple Domain Translation is the task of transforming data from one domain to other domains without having paired data to train the systems. Typically, methods based on Generative Adversarial Networks (GANs) are used to address this task. However, our proposal exclusively relies on a modified version of a Variational Autoencoder. This modification consists of the use of two latent v… ▽ More Unsupervised Multiple Domain Translation is the task of transforming data from one domain to other domains without having paired data to train the systems. Typically, methods based on Generative Adversarial Networks (GANs) are used to address this task. However, our proposal exclusively relies on a modified version of a Variational Autoencoder. This modification consists of the use of two latent variables disentangled in a controlled way by design. One of this latent variables is imposed to depend exclusively on the domain, while the other one must depend on the rest of the variability factors of the data. Additionally, the conditions imposed over the domain latent variable allow for better control and understanding of the latent space. We empirically demonstrate that our approach works on different vision datasets improving the performance of other well known methods. Finally, we prove that, indeed, one of the latent variables stores all the information related to the domain and the other one hardly contains any domain information. △ Less

Submitted 18 January, 2024; v1 submitted 17 January, 2024; originally announced January 2024.

An Explainable Proxy Model for Multiabel Audio Segmentation

Authors: Théo Mariotte, Antonio Almudévar, Marie Tahon, Alfonso Ortega

Abstract: Audio signal segmentation is a key task for automatic audio indexing. It consists of detecting the boundaries of class-homogeneous segments in the signal. In many applications, explainable AI is a vital process for transparency of decision-making with machine learning. In this paper, we propose an explainable multilabel segmentation model that solves speech activity (SAD), music (MD), noise (ND),… ▽ More Audio signal segmentation is a key task for automatic audio indexing. It consists of detecting the boundaries of class-homogeneous segments in the signal. In many applications, explainable AI is a vital process for transparency of decision-making with machine learning. In this paper, we propose an explainable multilabel segmentation model that solves speech activity (SAD), music (MD), noise (ND), and overlapped speech detection (OSD) simultaneously. This proxy uses the non-negative matrix factorization (NMF) to map the embedding used for the segmentation to the frequency domain. Experiments conducted on two datasets show similar performances as the pre-trained black box model while showing strong explainability features. Specifically, the frequency bins used for the decision can be easily identified at both the segment level (local explanations) and global level (class prototypes). △ Less

Submitted 17 January, 2024; v1 submitted 16 January, 2024; originally announced January 2024.

Comments: Accepted at ICASSP 2024

Report number: AA001

Optimizing $k$ in $k$NN Graphs with Graph Learning Perspective

Authors: Asuka Tamaru, Junya Hara, Hiroshi Higashi, Yuichi Tanaka, Antonio Ortega

Abstract: In this paper, we propose a method, based on graph signal processing, to optimize the choice of $k$ in $k$-nearest neighbor graphs ($k$NNGs). $k$NN is one of the most popular approaches and is widely used in machine learning and signal processing. The parameter $k$ represents the number of neighbors that are connected to the target node; however, its appropriate selection is still a challenging pr… ▽ More In this paper, we propose a method, based on graph signal processing, to optimize the choice of $k$ in $k$-nearest neighbor graphs ($k$NNGs). $k$NN is one of the most popular approaches and is widely used in machine learning and signal processing. The parameter $k$ represents the number of neighbors that are connected to the target node; however, its appropriate selection is still a challenging problem. Therefore, most $k$NNGs use ad hoc selection methods for $k$. In the proposed method, we assume that a different $k$ can be chosen for each node. We formulate a discrete optimization problem to seek the best $k$ with a constraint on the sum of distances of the connected nodes. The optimal $k$ values are efficiently obtained without solving a complex optimization. Furthermore, we reveal that the proposed method is closely related to existing graph learning methods. In experiments on real datasets, we demonstrate that the $k$NNGs obtained with our method are sparse and can determine an appropriate variable number of edges per node. We validate the effectiveness of the proposed method for point cloud denoising, comparing our denoising performance with achievable graph construction methods that can be scaled to typical point cloud sizes (e.g., thousands of nodes). △ Less

Submitted 16 January, 2024; originally announced January 2024.

Implementation of space-division multiplexed entanglement-based quantum cryptography over multicore fiber

Authors: Evelyn A. Ortega, Jorge Fuenzalida, Krishna Dovzhik, Rodrigo F. Shiozaki, Juan Carlos Alvarado-Zacarias, Rodrigo Amezcua-Correa, Martin Bohmann, Sören Wengerowsky, Rupert Ursin

Abstract: Quantum communication implementations require efficient and reliable quantum channels. Optical fibers have proven to be an ideal candidate for distributing quantum states. Thus, today's efforts address overcoming issues towards high data transmission and long-distance implementations. Here, we experimentally demonstrate the secret key rate enhancement via space-division multiplexing using a multic… ▽ More Quantum communication implementations require efficient and reliable quantum channels. Optical fibers have proven to be an ideal candidate for distributing quantum states. Thus, today's efforts address overcoming issues towards high data transmission and long-distance implementations. Here, we experimentally demonstrate the secret key rate enhancement via space-division multiplexing using a multicore fiber. Our multiplexing technique exploits the momentum correlation of photon pairs generated by spontaneous parametric down-conversion. We distributed polarization-entangled photon pairs into opposite cores within a 19-core multicore fiber. We estimated the secret key rates in a configuration with 6 and 12 cores from the entanglement visibility after transmission through 411 m long multicore fiber. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Randomized SearchRank: A Semiclassical Approach to a Quantum Search Engine

Authors: Sergio A. Ortega, Miguel A. Martin-Delgado

Abstract: The quantum SearchRank algorithm is a promising tool for a future quantum search engine based on PageRank quantization. However, this algorithm loses its functionality when the $N/M$ ratio between the network size $N$ and the number of marked nodes $M$ is sufficiently large. We propose a modification of the algorithm, replacing the underlying Szegedy quantum walk with a semiclassical walk. To main… ▽ More The quantum SearchRank algorithm is a promising tool for a future quantum search engine based on PageRank quantization. However, this algorithm loses its functionality when the $N/M$ ratio between the network size $N$ and the number of marked nodes $M$ is sufficiently large. We propose a modification of the algorithm, replacing the underlying Szegedy quantum walk with a semiclassical walk. To maintain the same time complexity as the quantum SearchRank algorithm we propose a simplification of the algorithm. This new algorithm is called Randomized SearchRank, since it corresponds to a quantum walk over a randomized mixed state. The performance of the SearchRank algorithms is first analyzed on an example network, and then statistically on a set of different networks of increasing size and different number of marked nodes. On the one hand, to test the search ability of the algorithms, it is computed how the probability of measuring the marked nodes decreases with $N/M$ for the quantum SearchRank, but remarkably it remains at a high value around $0.9$ for our semiclassical algorithms, solving the quantum SearchRank problem. The time complexity of the algorithms is also analyzed, obtaining a quadratic speedup with respect to the classical ones. On the other hand, the ranking functionality of the algorithms has been investigated, obtaining a good agreement with the classical PageRank distribution. Finally, the dependence of these algorithms on the intrinsic PageRank damping parameter has been clarified. Our results suggest that this parameter should be below a threshold so that the execution time does not increase drastically. △ Less

Submitted 3 January, 2024; originally announced January 2024.

Comments: RevTex 4.2, 14 color figures, 2 tables

PAC-Bayes-Chernoff bounds for unbounded losses

Authors: Ioar Casado, Luis A. Ortega, Andrés R. Masegosa, Aritz Pérez

Abstract: We introduce a new PAC-Bayes oracle bound for unbounded losses. This result can be understood as a PAC-Bayesian version of the Cramér-Chernoff bound. The proof technique relies on controlling the tails of certain random variables involving the Cramér transform of the loss. We highlight several applications of the main theorem. First, we show that our result naturally allows exact optimization of t… ▽ More We introduce a new PAC-Bayes oracle bound for unbounded losses. This result can be understood as a PAC-Bayesian version of the Cramér-Chernoff bound. The proof technique relies on controlling the tails of certain random variables involving the Cramér transform of the loss. We highlight several applications of the main theorem. First, we show that our result naturally allows exact optimization of the free parameter on many PAC-Bayes bounds. Second, we recover and generalize previous results. Finally, we show that our approach allows working with richer assumptions that result in more informative and potentially tighter bounds. In this direction, we provide a general bound under a new ``model-dependent bounded CGF" assumption from which we obtain bounds based on parameter norms and log-Sobolev inequalities. All these bounds can be minimized to obtain novel posteriors. △ Less

Submitted 6 February, 2024; v1 submitted 2 January, 2024; originally announced January 2024.

Comments: Updated Section 5

Frequency analysis and filter design for directed graphs with polar decomposition

Authors: Semin Kwak, Laura Shimabukuro, Antonio Ortega

Abstract: In this study, we challenge the traditional approach of frequency analysis on directed graphs, which typically relies on a single measure of signal variation such as total variation. We argue that the inherent directionality in directed graphs necessitates a multifaceted analytical approach that incorporates multiple signal variations definitions. Our methodology leverages the polar decomposition… ▽ More In this study, we challenge the traditional approach of frequency analysis on directed graphs, which typically relies on a single measure of signal variation such as total variation. We argue that the inherent directionality in directed graphs necessitates a multifaceted analytical approach that incorporates multiple signal variations definitions. Our methodology leverages the polar decomposition to define two distinct variations, each associated with different matrices derived from this decomposition. This approach provides a novel interpretation in the node domain and reveals aspects of graph signals that may be overlooked with a singular measure of variation. Additionally, we develop graph filters specifically designed to smooth graph signals in accordance with our proposed variations. These filters allow for bypassing costly filtering operations associated with the original graph through effective cascading. We demonstrate the efficacy of our methodology using an M-block cyclic graph example, validating our claims and showcasing the advantages of our multifaceted approach in analyzing signals on directed graphs. △ Less

Submitted 15 January, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

Comments: Conference paper accepted for ICASSP 2024

Irregularity-Aware Bandlimited Approximation for Graph Signal Interpolation

Authors: Darukeesan Pakiyarajah, Eduardo Pavez, Antonio Ortega

Abstract: In most work to date, graph signal sampling and reconstruction algorithms are intrinsically tied to graph properties, assuming bandlimitedness and optimal sampling set choices. However, practical scenarios often defy these assumptions, leading to suboptimal performance. In the context of sampling and reconstruction, graph irregularities lead to varying contributions from sampled nodes for interpol… ▽ More In most work to date, graph signal sampling and reconstruction algorithms are intrinsically tied to graph properties, assuming bandlimitedness and optimal sampling set choices. However, practical scenarios often defy these assumptions, leading to suboptimal performance. In the context of sampling and reconstruction, graph irregularities lead to varying contributions from sampled nodes for interpolation and differing levels of reliability for interpolated nodes. The existing GFT-based methods in the literature make bandlimited signal approximations without considering graph irregularities and the relative significance of nodes, resulting in suboptimal reconstruction performance under various mismatch conditions. In this paper, we leverage the GFT equipped with a specific inner product to address graph irregularities and account for the relative importance of nodes during the bandlimited signal approximation and interpolation process. Empirical evidence demonstrates that the proposed method outperforms other GFT-based approaches for bandlimited signal interpolation in challenging scenarios, such as sampling sets selected independently of the underlying graph, low sampling rates, and high noise levels. △ Less

Submitted 21 January, 2024; v1 submitted 14 December, 2023; originally announced December 2023.

Comments: Conference paper accepted for ICASSP 2024 (5 pages, 1 figure)

Towards a geometric understanding of Spatio Temporal Graph Convolution Networks

Authors: Pratyusha Das, Sarath Shekkizhar, Antonio Ortega

Abstract: Spatiotemporal graph convolutional networks (STGCNs) have emerged as a desirable model for skeleton-based human action recognition. Despite achieving state-of-the-art performance, there is a limited understanding of the representations learned by these models, which hinders their application in critical and real-world settings. While layerwise analysis of CNN models has been studied in the literat… ▽ More Spatiotemporal graph convolutional networks (STGCNs) have emerged as a desirable model for skeleton-based human action recognition. Despite achieving state-of-the-art performance, there is a limited understanding of the representations learned by these models, which hinders their application in critical and real-world settings. While layerwise analysis of CNN models has been studied in the literature, to the best of our knowledge, there exists no study on the layerwise explainability of the embeddings learned on spatiotemporal data using STGCNs. In this paper, we first propose to use a local Dataset Graph (DS-Graph) obtained from the feature representation of input data at each layer to develop an understanding of the layer-wise embedding geometry of the STGCN. To do so, we develop a window-based dynamic time warping (DTW) method to compute the distance between data sequences with varying temporal lengths. To validate our findings, we have developed a layer-specific Spatiotemporal Graph Gradient-weighted Class Activation Mapping (L-STG-GradCAM) technique tailored for spatiotemporal data. This approach enables us to visually analyze and interpret each layer within the STGCN network. We characterize the functions learned by each layer of the STGCN using the label smoothness of the representation and visualize them using our L-STG-GradCAM approach. Our proposed method is generic and can yield valuable insights for STGCN architectures in different applications. However, this paper focuses on the human activity recognition task as a representative application. Our experiments show that STGCN models learn representations that capture general human motion in their initial layers while discriminating different actions only in later layers. This justifies experimental observations showing that fine-tuning deeper layers works well for transfer between related tasks. △ Less

Submitted 12 December, 2023; originally announced December 2023.

Review of control algorithms for mobile robotics

Authors: Andres-David Suarez-Gomez, Andres A. Hernandez Ortega

Abstract: This article presents a comprehensive review of control algorithms used in mobile robotics, a field in constant evolution. Mobile robotics has seen significant advances in recent years, driven by the demand for applications in various sectors, such as industrial automation, space exploration, and medical care. The review focuses on control algorithms that address specific challenges in navigation,… ▽ More This article presents a comprehensive review of control algorithms used in mobile robotics, a field in constant evolution. Mobile robotics has seen significant advances in recent years, driven by the demand for applications in various sectors, such as industrial automation, space exploration, and medical care. The review focuses on control algorithms that address specific challenges in navigation, localization, mapping, and path planning in changing and unknown environments. Classical approaches, such as PID control and methods based on classical control theory, as well as modern techniques, including deep learning and model-based planning, are discussed in detail. In addition, practical applications and remaining challenges in implementing these algorithms in real-world mobile robots are highlighted. Ultimately, this review provides a comprehensive overview of the diversity and complexity of control algorithms in mobile robotics, helping researchers and practitioners to better understand the options available to address specific problems in this exciting area of study. △ Less

Submitted 9 October, 2023; originally announced October 2023.

Comments: 8 pages, in Spanish

If there is no underfitting, there is no Cold Posterior Effect

Authors: Yijie Zhang, Yi-Shan Wu, Luis A. Ortega, Andrés R. Masegosa

Abstract: The cold posterior effect (CPE) (Wenzel et al., 2020) in Bayesian deep learning shows that, for posteriors with a temperature $T<1$, the resulting posterior predictive could have better performances than the Bayesian posterior ($T=1$). As the Bayesian posterior is known to be optimal under perfect model specification, many recent works have studied the presence of CPE as a model misspecification p… ▽ More The cold posterior effect (CPE) (Wenzel et al., 2020) in Bayesian deep learning shows that, for posteriors with a temperature $T<1$, the resulting posterior predictive could have better performances than the Bayesian posterior ($T=1$). As the Bayesian posterior is known to be optimal under perfect model specification, many recent works have studied the presence of CPE as a model misspecification problem, arising from the prior and/or from the likelihood function. In this work, we provide a more nuanced understanding of the CPE as we show that misspecification leads to CPE only when the resulting Bayesian posterior underfits. In fact, we theoretically show that if there is no underfitting, there is no CPE. △ Less

Submitted 2 October, 2023; originally announced October 2023.

Comments: 9 pages, 3 figures, ICLR 2024

SQUWALS: A Szegedy QUantum WALks Simulator

Authors: Sergio A. Ortega, Miguel A. Martin-Delgado

Abstract: Szegedy's quantum walk is an algorithm for quantizing a general Markov chain. It has plenty of applications such as many variants of optimizations. In order to check its properties in an error-free environment, it is important to have a classical simulator. However, the current simulation algorithms require a great deal of memory due to the particular formulation of this quantum walk. In this pape… ▽ More Szegedy's quantum walk is an algorithm for quantizing a general Markov chain. It has plenty of applications such as many variants of optimizations. In order to check its properties in an error-free environment, it is important to have a classical simulator. However, the current simulation algorithms require a great deal of memory due to the particular formulation of this quantum walk. In this paper we propose a memory-saving algorithm that scales as $\mathcal{O}(N^2)$ with the size $N$ of the graph. We provide additional procedures for simulating Szegedy's quantum walk over mixed states and also the Semiclassical Szegedy walk. With these techniques we have built a classical simulator in Python called SQUWALS. We show that our simulator scales as $\mathcal{O}(N^2)$ in both time and memory resources. This package provides some high-level applications for algorithms based on Szegedy's quantum walk, as for example the quantum PageRank. △ Less

Submitted 26 July, 2023; originally announced July 2023.

Comments: RevTex 4.2, 16 pages, 9 color figures

Journal ref: Advanced Quantum Technologies, 2400022, (2024)

The faces of Convolution: from the Fourier theory to algebraic signal processing

Authors: Feng Ji, Wee Peng Tay, Antonio Ortega

Abstract: In this expository article, we provide a self-contained overview of the notion of convolution embedded in different theories: from the classical Fourier theory to the theory of algebraic signal processing. We discuss their relations and differences. Toward the end, we provide an opinion on whether there is a consistent approach to convolution that unifies seemingly different approaches by differen… ▽ More In this expository article, we provide a self-contained overview of the notion of convolution embedded in different theories: from the classical Fourier theory to the theory of algebraic signal processing. We discuss their relations and differences. Toward the end, we provide an opinion on whether there is a consistent approach to convolution that unifies seemingly different approaches by different theories. △ Less

Submitted 15 July, 2023; originally announced July 2023.

Nowcasting Temporal Trends Using Indirect Surveys

Authors: Ajitesh Srivastava, Juan Marcos Ramírez, Sergio Díaz-Aranda, Jose Aguilar, Antonio Ortega, Antonio Fernández Anta, Rosa Elvira Lillo

Abstract: Indirect surveys, in which respondents provide information about other people they know, have been proposed for estimating (nowcasting) the size of a \emph{hidden population} where privacy is important or the hidden population is hard to reach. Examples include estimating casualties in an earthquake, conditions among female sex workers, and the prevalence of drug use and infectious diseases. The N… ▽ More Indirect surveys, in which respondents provide information about other people they know, have been proposed for estimating (nowcasting) the size of a \emph{hidden population} where privacy is important or the hidden population is hard to reach. Examples include estimating casualties in an earthquake, conditions among female sex workers, and the prevalence of drug use and infectious diseases. The Network Scale-up Method (NSUM) is the classical approach to developing estimates from indirect surveys, but it was designed for one-shot surveys. Further, it requires certain assumptions and asking for or estimating the number of individuals in each respondent's network. In recent years, surveys have been increasingly deployed online and can collect data continuously (e.g., COVID-19 surveys on Facebook during much of the pandemic). Conventional NSUM can be applied to these scenarios by analyzing the data independently at each point in time, but this misses the opportunity of leveraging the temporal dimension. We propose to use the responses from indirect surveys collected over time and develop analytical tools (i) to prove that indirect surveys can provide better estimates for the trends of the hidden population over time, as compared to direct surveys and (ii) to identify appropriate temporal aggregations to improve the estimates. We demonstrate through extensive simulations that our approach outperforms traditional NSUM and direct surveying methods. We also empirically demonstrate the superiority of our approach on a real indirect survey dataset of COVID-19 cases. △ Less

Submitted 14 December, 2023; v1 submitted 13 July, 2023; originally announced July 2023.

Comments: Accepted at AAAI 2024

ACM Class: G.3

On the energy density in quantum mechanics

Authors: Francisco Torres Arvizu, Adrian Ortega, Hernán Larralde

Abstract: There are several definitions of energy density in quantum mechanics. These yield expressions that differ locally, but all satisfy a continuity equation and integrate to the value of the expected energy of the system under consideration. Thus, the question of whether there are physical grounds to choose one definition over another arises naturally. In this work, we propose a way to probe a system… ▽ More There are several definitions of energy density in quantum mechanics. These yield expressions that differ locally, but all satisfy a continuity equation and integrate to the value of the expected energy of the system under consideration. Thus, the question of whether there are physical grounds to choose one definition over another arises naturally. In this work, we propose a way to probe a system by varying the size of a well containing a quantum particle. We show that the mean work done by moving the wall is closely related to one of the definitions for energy density. Specifically, the appropriate energy density, evaluated at the wall corresponds to the force exerted by the particle locally, against which the work is done. We show that this identification extends to two and three dimensional systems. △ Less

Submitted 28 June, 2023; originally announced June 2023.

PAC-Chernoff Bounds: Understanding Generalization in the Interpolation Regime

Authors: Andrés R. Masegosa, Luis A. Ortega

Abstract: This paper introduces a distribution-dependent PAC-Chernoff bound that exhibits perfect tightness for interpolators, even within over-parameterized model classes. This bound, which relies on basic principles of Large Deviation Theory, defines a natural measure of the smoothness of a model, characterized by simple real-valued functions. Building upon this bound and the new concept of smoothness, we… ▽ More This paper introduces a distribution-dependent PAC-Chernoff bound that exhibits perfect tightness for interpolators, even within over-parameterized model classes. This bound, which relies on basic principles of Large Deviation Theory, defines a natural measure of the smoothness of a model, characterized by simple real-valued functions. Building upon this bound and the new concept of smoothness, we present an unified theoretical framework revealing why certain interpolators show an exceptional generalization, while others falter. We theoretically show how a wide spectrum of modern learning methodologies, encompassing techniques such as $\ell_2$-norm, distance-from-initialization and input-gradient regularization, in combination with data augmentation, invariant architectures, and over-parameterization, collectively guide the optimizer toward smoother interpolators, which, according to our theoretical framework, are the ones exhibiting superior generalization performance. This study shows that distribution-dependent bounds serve as a powerful tool to understand the complex dynamics behind the generalization capabilities of over-parameterized interpolators. △ Less

Submitted 29 April, 2024; v1 submitted 19 June, 2023; originally announced June 2023.

Comments: 56 pages, 11 figures, Pre-print

Maximal Algebraic Connectivity for Paths with Fixed Effective Resistance

Authors: Alonso Cruz Ortega, Federico Menéndez-Conde

Abstract: We consider the problem on finding the edge weights that maximize the algebraic connectivity of a graph (smallest positive eigenvalue of the Laplacian), subject to the condition that the total effective resistance is kept constant. We propose the conjecture that for every graph the maximum is attained for weights that are invariant under automorphisms. The solution to the problem is given explicit… ▽ More We consider the problem on finding the edge weights that maximize the algebraic connectivity of a graph (smallest positive eigenvalue of the Laplacian), subject to the condition that the total effective resistance is kept constant. We propose the conjecture that for every graph the maximum is attained for weights that are invariant under automorphisms. The solution to the problem is given explicitly for the paths $P_3$ y $P_4$, where the conjecture holds. △ Less

Submitted 13 June, 2023; originally announced June 2023.

Cyclic Coverings of genus 2 curves of Sophie Germain type

Authors: J. C. Naranjo, A. Ortega, I. Spelta

Abstract: We consider cyclic unramified coverings of degree d of irreducible complex smooth genus 2 curves and their corresponding Prym varieties. They provide natural examples of polarized abelian varieties with automorphisms of order d. The rich geometry of the associated Prym map, has been studied in several papers, and the cases d=2, 3, 5, 7 are quite well-understood. Nevertheless, very few is known for… ▽ More We consider cyclic unramified coverings of degree d of irreducible complex smooth genus 2 curves and their corresponding Prym varieties. They provide natural examples of polarized abelian varieties with automorphisms of order d. The rich geometry of the associated Prym map, has been studied in several papers, and the cases d=2, 3, 5, 7 are quite well-understood. Nevertheless, very few is known for higher values of d. In this article we investigate if the covering can be reconstructed from its Prym variety, that is, if the generic Prym Torelli Theorem holds for these coverings. We prove this is so for the so-called Sophie Germain prime numbers, that is, for $d\ge 11$ prime such that $(d-1)/2$ is also prime. We use results of arithmetic nature on $GL_2$-type abelian varieties combined with theta-duality techniques. △ Less

Submitted 3 June, 2023; originally announced June 2023.

MSC Class: 14H40 14K10

Fractional Schrödinger systems coupled by Hardy-Sobolev critical terms

Authors: Alejandro Ortega

Abstract: In this work we analyze a class of nonlinear fractional elliptic systems involving Hardy--type potentials and coupled by critical Hardy-Sobolev--type nonlinearities in $\mathbb{R}^N$. Due to the lack of compactness at the critical exponent the variational approach requires a careful analysis of the Palais-Smale sequences. In order to overcome this loss of compactness, by means of a concentration--… ▽ More In this work we analyze a class of nonlinear fractional elliptic systems involving Hardy--type potentials and coupled by critical Hardy-Sobolev--type nonlinearities in $\mathbb{R}^N$. Due to the lack of compactness at the critical exponent the variational approach requires a careful analysis of the Palais-Smale sequences. In order to overcome this loss of compactness, by means of a concentration--compactness argument the compactness of PS sequences is derived. This, combined with a energy characterization of the semi-trivial solutions, allow us to conclude the existence of positive ground and bound state solutions en terms of coupling parameter $ν>0$ and the involved exponents $α,β$. △ Less

Submitted 21 June, 2023; v1 submitted 26 May, 2023; originally announced May 2023.

Comments: arXiv admin note: text overlap with arXiv:2211.17047

MSC Class: 35R11; 47G30; 35J50; 35A15 (Primary); 35Q55; 49J35; 35J60; 35Q40 (Secondary)

Subcritical nonlocal problems with mixed boundary conditions

Authors: Giovanni Molica Bisci, Alejandro Ortega, Luca Vilasi

Abstract: In this paper, by variational and topological arguments based on linking and $\nabla$-theorems, we prove the existence of multiple solutions for the following nonlocal problem with mixed Dirichlet-Neumann boundary data,… ▽ More In this paper, by variational and topological arguments based on linking and $\nabla$-theorems, we prove the existence of multiple solutions for the following nonlocal problem with mixed Dirichlet-Neumann boundary data, $$ \left\{ \begin{array}{lcl} (-Δ)^su=λu+f(x,u) & &\text{in } Ω, \\[2pt] \mkern+39mu u=0& &\text{on } Σ_{\mathcal{D}}, \\[2pt] \mkern+26mu \displaystyle \frac{\partial u}{\partial ν}=0& &\text{on } Σ_{\mathcal{N}}, \end{array} \right. $$ where $(-Δ)^s$, $s\in (1/2,1)$, is the spectral fractional Laplacian operator, $Ω\subset\mathbb{R}^N$, $N>2s$, is a smooth bounded domain, $λ>0$ is a real parameter, $ν$ is the outward normal to $\partialΩ$, $Σ_{\mathcal{D}}$, $Σ_{\mathcal{N}}$ are smooth $(N-1)$-dimensional submanifolds of $\partialΩ$ such that $Σ_{\mathcal{D}}\cupΣ_{\mathcal{N}}=\partialΩ$, $Σ_{\mathcal{D}}\capΣ_{\mathcal{N}}=\emptyset$ and $Σ_{\mathcal{D}}\cap\overlineΣ_{\mathcal{N}}=Γ$ is a smooth $(N-2)$-dimensional submanifold of $\partialΩ$. △ Less

Submitted 8 May, 2023; originally announced May 2023.

MSC Class: 35J20; 35A15; 35S15 (Primary) 49J35; 35J61 (Secondary)

Improved Vocal Effort Transfer Vector Estimation for Vocal Effort-Robust Speaker Verification

Authors: Iván López-Espejo, Santi Prieto, Alfonso Ortega, Eduardo Lleida

Abstract: Despite the maturity of modern speaker verification technology, its performance still significantly degrades when facing non-neutrally-phonated (e.g., shouted and whispered) speech. To address this issue, in this paper, we propose a new speaker embedding compensation method based on a minimum mean square error (MMSE) estimator. This method models the joint distribution of the vocal effort transfer… ▽ More Despite the maturity of modern speaker verification technology, its performance still significantly degrades when facing non-neutrally-phonated (e.g., shouted and whispered) speech. To address this issue, in this paper, we propose a new speaker embedding compensation method based on a minimum mean square error (MMSE) estimator. This method models the joint distribution of the vocal effort transfer vector and non-neutrally-phonated embedding spaces and operates in a principal component analysis domain to cope with non-neutrally-phonated speech data scarcity. Experiments are carried out using a cutting-edge speaker verification system integrating a powerful self-supervised pre-trained model for speech representation. In comparison with a state-of-the-art embedding compensation method, the proposed MMSE estimator yields superior and competitive equal error rate results when tackling shouted and whispered speech, respectively. △ Less

Submitted 4 July, 2023; v1 submitted 3 May, 2023; originally announced May 2023.

Pervasiveness of the $p$-Laplace operator under localization of fractional $g$-Laplace operators

Authors: Alejandro Ortega

Abstract: In this work we analyze the behavior of truncated functionals as \begin{equation*} \int_{\mathbb{R}^N}\int_{B(x,δ)} G\left(\frac{|u(x)-u(y)|}{|x-y|^{s}}\right)\frac{dydx}{|x-y|^N}\qquad\text{for }δ\to0^+. \end{equation*} Here the function $G$ is an Orlicz function that in addition is assumed to be a regularly varying function at $0$. A prototype of such function is given by… ▽ More In this work we analyze the behavior of truncated functionals as \begin{equation*} \int_{\mathbb{R}^N}\int_{B(x,δ)} G\left(\frac{|u(x)-u(y)|}{|x-y|^{s}}\right)\frac{dydx}{|x-y|^N}\qquad\text{for }δ\to0^+. \end{equation*} Here the function $G$ is an Orlicz function that in addition is assumed to be a regularly varying function at $0$. A prototype of such function is given by $G(t)=t^p(1+|\log(t)|)$ with $p\geq2$. These kind of functionals arise naturally in {\it peridynamics}, where long-range interactions are neglected and only those exerted at distance smaller than $δ>0$ are taken into account, i.e., the {\it horizon} $δ>0$ represents the range of interactions or nonlocality.\\ This work is inspired by the celebrated result by Bourgain, Brezis and Mironescu, who analyzed the limit $s\to1^-$ with $G(t)=t^p$. In particular, we prove that, under appropriate conditions, \begin{equation*} \lim\limits_{δ\to0^+}\frac{p(1-s)}{G(δ^{1-s})}\int_{\mathbb{R}^N}\int_{B(x,δ)}G\left(\frac{|u(x)-u(y)|}{|x-y|^{s}}\right)\frac{dydx}{|x-y|^N}=K_{N,p}\int_{\mathbb{R}^N}|\nabla u(x)|^p dx, \end{equation*} for $p=index(G)$ and an explicit constant $K_{N,p}>0$. Moreover, the converse is also true, if the above localization limit exist as $δ\to0^+$, the Orlicz function $G$ is a regularly varying function with $index(G)=p$. △ Less

Submitted 2 May, 2023; originally announced May 2023.

MSC Class: 46E30; 35R11; 49J45; 26A12

Signal Variation Metrics and Graph Fourier Transforms for Directed Graphs

Authors: Laura Shimabukuro, Antonio Ortega

Abstract: In this paper we consider the problem of constructing graph Fourier transforms (GFTs) for directed graphs (digraphs), with a focus on developing multiple GFT designs that can capture different types of variation over the digraph node-domain. Specifically, for any given digraph we propose three GFT designs based on the polar decomposition. Our method is closely related to existing polar decompositi… ▽ More In this paper we consider the problem of constructing graph Fourier transforms (GFTs) for directed graphs (digraphs), with a focus on developing multiple GFT designs that can capture different types of variation over the digraph node-domain. Specifically, for any given digraph we propose three GFT designs based on the polar decomposition. Our method is closely related to existing polar decomposition based GFT designs, but with added interpretability in the digraph node-domain. Each of our proposed digraph GFTs has a clear node domain variation interpretation, so that one or more of the GFTs can be used to extract different insights from available graph signals. We demonstrate the benefits of our approach experimentally using M-block cyclic graphs, showing that the diffusion of signals on the graph leads to changes in the spectrum obtained from our proposed GFTs, but cannot be observed with the conventional GFT definition. △ Less

Submitted 9 April, 2023; originally announced April 2023.

Comments: 5 pages, 4 figures

Discrete-time Semiclassical Szegedy Quantum Walks

Authors: Sergio A. Ortega, Miguel A. Martin-Delgado

Abstract: Quantum walks are promising tools based on classical random walks, with plenty of applications such as many variants of optimization. Here we introduce the semiclassical walks in discrete time, which are algorithms that combines classical and quantum dynamics. Specifically, a semiclassical walk can be understood as a classical walk where the transition matrix encodes the quantum evolution. We have… ▽ More Quantum walks are promising tools based on classical random walks, with plenty of applications such as many variants of optimization. Here we introduce the semiclassical walks in discrete time, which are algorithms that combines classical and quantum dynamics. Specifically, a semiclassical walk can be understood as a classical walk where the transition matrix encodes the quantum evolution. We have applied this algorithm to Szegedy's quantum walk, which can be applied to any arbitrary weighted graph. We first have solved the problem analytically on regular 1D cycles to show the performance of the semiclassical walks. Next, we have simulated our algorithm in a general inhomogeneous symmetric graph, finding that the inhomogeneity drives a symmetry breaking on the graph. Moreover, we show that this phenomenon is useful for the problem of ranking nodes in symmetric graphs, where the classical PageRank fails. We have demonstrated experimentally that the semiclassical walks can be applied on real quantum computers using the platform IBM Quantum. △ Less

Submitted 24 July, 2023; v1 submitted 31 March, 2023; originally announced March 2023.

Comments: RevTex 4.2, 16 pages, 11 color figures

Journal ref: Physica A: Statistical Mechanics and its Applications 625, 129021 (2023)

Graph Signal Processing: History, Development, Impact, and Outlook

Authors: Geert Leus, Antonio G. Marques, José M. F. Moura, Antonio Ortega, David I Shuman

Abstract: Graph signal processing (GSP) generalizes signal processing (SP) tasks to signals living on non-Euclidean domains whose structure can be captured by a weighted graph. Graphs are versatile, able to model irregular interactions, easy to interpret, and endowed with a corpus of mathematical results, rendering them natural candidates to serve as the basis for a theory of processing signals in more irre… ▽ More Graph signal processing (GSP) generalizes signal processing (SP) tasks to signals living on non-Euclidean domains whose structure can be captured by a weighted graph. Graphs are versatile, able to model irregular interactions, easy to interpret, and endowed with a corpus of mathematical results, rendering them natural candidates to serve as the basis for a theory of processing signals in more irregular domains. In this article, we provide an overview of the evolution of GSP, from its origins to the challenges ahead. The first half is devoted to reviewing the history of GSP and explaining how it gave rise to an encompassing framework that shares multiple similarities with SP. A key message is that GSP has been critical to develop novel and technically sound tools, theory, and algorithms that, by leveraging analogies with and the insights of digital SP, provide new ways to analyze, process, and learn from graph signals. In the second half, we shift focus to review the impact of GSP on other disciplines. First, we look at the use of GSP in data science problems, including graph learning and graph-based deep learning. Second, we discuss the impact of GSP on applications, including neuroscience and image and video processing. We conclude with a brief discussion of the emerging and future directions of GSP. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Joint Graph and Vertex Importance Learning

Authors: Benjamin Girault, Eduardo Pavez, Antonio Ortega

Abstract: In this paper, we explore the topic of graph learning from the perspective of the Irregularity-Aware Graph Fourier Transform, with the goal of learning the graph signal space inner product to better model data. We propose a novel method to learn a graph with smaller edge weight upper bounds compared to combinatorial Laplacian approaches. Experimentally, our approach yields much sparser graphs comp… ▽ More In this paper, we explore the topic of graph learning from the perspective of the Irregularity-Aware Graph Fourier Transform, with the goal of learning the graph signal space inner product to better model data. We propose a novel method to learn a graph with smaller edge weight upper bounds compared to combinatorial Laplacian approaches. Experimentally, our approach yields much sparser graphs compared to a combinatorial Laplacian approach, with a more interpretable model. △ Less

Submitted 15 March, 2023; originally announced March 2023.

Comments: submitted to 2023 31st European Signal Processing Conference (EUSIPCO)

Towards bandwidth estimation for graph signal reconstruction

Authors: Ajinkya Jayawant, Antonio Ortega

Abstract: In numerous graph signal processing applications, data is often missing for a variety of reasons, and predicting the missing data is essential. In this paper, we consider data on graphs modeled as bandlimited graph signals. Predicting or reconstructing the unknown signal values for such a model requires an estimate of the signal bandwidth. In this paper, we address the problem of estimating the re… ▽ More In numerous graph signal processing applications, data is often missing for a variety of reasons, and predicting the missing data is essential. In this paper, we consider data on graphs modeled as bandlimited graph signals. Predicting or reconstructing the unknown signal values for such a model requires an estimate of the signal bandwidth. In this paper, we address the problem of estimating the reconstruction errors, minimizing which would thereby provide an estimate of the signal bandwidth. In doing so, we design a cross-validation approach needed for stable graph signal reconstruction and propose a method for estimating the reconstruction errors for different choices of signal bandwidth. Using this technique, we are able to estimate the reconstruction error on a variety of real-world graphs. △ Less

Submitted 12 March, 2023; originally announced March 2023.

Rate-Distortion Optimization With Alternative References For UGC Video Compression

Authors: Xin Xiong, Eduardo Pavez, Antonio Ortega, Balu Adsumilli

Abstract: User generated content (UGC) refers to videos that are uploaded by users and shared over the Internet. UGC may have low quality due to noise and previous compression. When re-encoding UGC for streaming or downloading, a traditional video coding pipeline will perform rate-distortion (RD) optimization to choose coding parameters. However, in the UGC video coding case, since the input is not pristine… ▽ More User generated content (UGC) refers to videos that are uploaded by users and shared over the Internet. UGC may have low quality due to noise and previous compression. When re-encoding UGC for streaming or downloading, a traditional video coding pipeline will perform rate-distortion (RD) optimization to choose coding parameters. However, in the UGC video coding case, since the input is not pristine, quality ``saturation'' (or even degradation) can be observed, i.e., increased bitrate only leads to improved representation of coding artifacts and noise present in the UGC input. In this paper, we study the saturation problem in UGC compression, where the goal is to identify and avoid during encoding, the coding parameters and rates that lead to quality saturation. We proposed a geometric criterion for saturation detection that works with rate-distortion optimization, and only requires a few frames from the UGC video. In addition, we show how to combine the proposed saturation detection method with existing video coding systems that implement rate-distortion optimization for efficient compression of UGC videos. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: 5 pages, 6 figures, accepted at International Conference on Acoustics, Speech, & Signal Processing (ICASSP) 2023

Image Coding via Perceptually Inspired Graph Learning

Authors: Samuel Fernández-Menduiña, Eduardo Pavez, Antonio Ortega

Abstract: Most codec designs rely on the mean squared error (MSE) as a fidelity metric in rate-distortion optimization, which allows to choose the optimal parameters in the transform domain but may fail to reflect perceptual quality. Alternative distortion metrics, such as the structural similarity index (SSIM), can be computed only pixel-wise, so they cannot be used directly for transform-domain bit alloca… ▽ More Most codec designs rely on the mean squared error (MSE) as a fidelity metric in rate-distortion optimization, which allows to choose the optimal parameters in the transform domain but may fail to reflect perceptual quality. Alternative distortion metrics, such as the structural similarity index (SSIM), can be computed only pixel-wise, so they cannot be used directly for transform-domain bit allocation. Recently, the irregularity-aware graph Fourier transform (IAGFT) emerged as a means to include pixel-wise perceptual information in the transform design. This paper extends this idea by also learning a graph (and corresponding transform) for sets of blocks that share similar perceptual characteristics and are observed to differ statistically, leading to different learned graphs. We demonstrate the effectiveness of our method with both SSIM- and saliency-based criteria. We also propose a framework to derive separable transforms, including separable IAGFTs. An empirical evaluation based on the 5th CLIC dataset shows that our approach achieves improvements in terms of MS-SSIM with respect to existing methods. △ Less

Submitted 2 March, 2023; originally announced March 2023.

Involutions on hyperelliptic curves and Prym maps

Authors: Paweł Borówka, Angela Ortega

Abstract: We investigate the geometry of smooth hyperelliptic curves that possess additional involutions, especially from the point of view of the Prym theory. Our main result is the injectivity of the Prym map for hyperelliptic $\mathbb{Z}_2^2$-coverings over hyperelliptic curves of positive genus. We investigate the geometry of smooth hyperelliptic curves that possess additional involutions, especially from the point of view of the Prym theory. Our main result is the injectivity of the Prym map for hyperelliptic $\mathbb{Z}_2^2$-coverings over hyperelliptic curves of positive genus. △ Less

Submitted 25 February, 2023; originally announced February 2023.

Comments: 21 pages

MSC Class: 14H40; 14H30; 14H37

Variational Linearized Laplace Approximation for Bayesian Deep Learning

Authors: Luis A. Ortega, Simón Rodríguez Santana, Daniel Hernández-Lobato

Abstract: The Linearized Laplace Approximation (LLA) has been recently used to perform uncertainty estimation on the predictions of pre-trained deep neural networks (DNNs). However, its widespread application is hindered by significant computational costs, particularly in scenarios with a large number of training points or DNN parameters. Consequently, additional approximations of LLA, such as Kronecker-fac… ▽ More The Linearized Laplace Approximation (LLA) has been recently used to perform uncertainty estimation on the predictions of pre-trained deep neural networks (DNNs). However, its widespread application is hindered by significant computational costs, particularly in scenarios with a large number of training points or DNN parameters. Consequently, additional approximations of LLA, such as Kronecker-factored or diagonal approximate GGN matrices, are utilized, potentially compromising the model's performance. To address these challenges, we propose a new method for approximating LLA using a variational sparse Gaussian Process (GP). Our method is based on the dual RKHS formulation of GPs and retains, as the predictive mean, the output of the original DNN. Furthermore, it allows for efficient stochastic optimization, which results in sub-linear training time in the size of the training dataset. Specifically, its training cost is independent of the number of training points. We compare our proposed method against accelerated LLA (ELLA), which relies on the Nyström approximation, as well as other LLA variants employing the sample-then-optimize principle. Experimental results, both on regression and classification datasets, show that our method outperforms these already existing efficient variants of LLA, both in terms of the quality of the predictive distribution and in terms of total computational time. △ Less

Submitted 22 May, 2024; v1 submitted 24 February, 2023; originally announced February 2023.

Comments: 22 pages, 8 figures, ICML 2024

Journal ref: PMLR 235 (2024)

Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment

Authors: Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez, Alfonso Ortega, Ainhoa Herrarte, Manuel Alcantara, Javier Ortega-Garcia

Abstract: The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. There is a certain consensus about the need to develop AI applications with a Human-Centric approach. Human-Centric Machine Learning needs to be developed based on four main requirem… ▽ More The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. There is a certain consensus about the need to develop AI applications with a Human-Centric approach. Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes. All these four Human-Centric requirements are closely related to each other. With the aim of studying how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data, we propose a fictitious case study focused on automated recruitment: FairCVtest. We train automatic recruitment algorithms using a set of multimodal synthetic profiles including image, text, and structured data, which are consciously scored with gender and racial biases. FairCVtest shows the capacity of the Artificial Intelligence (AI) behind automatic recruitment tools built this way (a common practice in many other application scenarios beyond recruitment) to extract sensitive information from unstructured data and exploit it in combination to data biases in undesirable (unfair) ways. We present an overview of recent works developing techniques capable of removing sensitive information and biases from the decision-making process of deep learning architectures, as well as commonly used databases for fairness research in AI. We demonstrate how learning approaches developed to guarantee privacy in latent spaces can lead to unbiased and fair automatic decision-making process. △ Less

Submitted 13 February, 2023; originally announced February 2023.

Comments: arXiv admin note: text overlap with arXiv:2004.07173

Journal ref: SN COMPUT. SCI. 4, 434 (2023)