-
Fast variational Bayesian inference for correlated survival data: an application to invasive mechanical ventilation duration analysis
Authors:
Chengqian Xian,
Camila P. E. de Souza,
Wenqing He,
Felipe F. Rodrigues,
Renfang Tian
Abstract:
Correlated survival data are prevalent in various clinical settings and have been extensively discussed in literature. One of the most common types of correlated survival data is clustered survival data, where the survival times from individuals in a cluster are associated. Our study is motivated by invasive mechanical ventilation data from different intensive care units (ICUs) in Ontario, Canada,…
▽ More
Correlated survival data are prevalent in various clinical settings and have been extensively discussed in literature. One of the most common types of correlated survival data is clustered survival data, where the survival times from individuals in a cluster are associated. Our study is motivated by invasive mechanical ventilation data from different intensive care units (ICUs) in Ontario, Canada, forming multiple clusters. The survival times from patients within the same ICU cluster are correlated. To address this association, we introduce a shared frailty log-logistic accelerated failure time model that accounts for intra-cluster correlation through a cluster-specific random intercept. We present a novel, fast variational Bayes (VB) algorithm for parameter inference and evaluate its performance using simulation studies varying the number of clusters and their sizes. We further compare the performance of our proposed VB algorithm with the h-likelihood method and a Markov Chain Monte Carlo (MCMC) algorithm. The proposed algorithm delivers satisfactory results and demonstrates computational efficiency over the MCMC algorithm. We apply our method to the ICU ventilation data from Ontario to investigate the ICU site random effect on ventilation duration.
△ Less
Submitted 31 July, 2024;
originally announced August 2024.
-
Time-Machines Construct within Ricci-inverse Modified Gravity
Authors:
F. Ahmed,
J. C. R. de Souza,
A. F. Santos
Abstract:
In this paper, our objective is to explore a time-machine space-time formulated in general relativity, as introduced by Li (Phys. Rev. D {\bf 59}, 084016 (1999)), within the context of modified gravity theories. We consider Ricci-inverse gravity of all Classes of models, {\it i.e.}, (i) Class-{\bf I}: $f(\mathcal{R}, \mathcal{A})=(\mathcal{R}+β\,\mathcal{A})$, (ii) Class-{\bf II}:…
▽ More
In this paper, our objective is to explore a time-machine space-time formulated in general relativity, as introduced by Li (Phys. Rev. D {\bf 59}, 084016 (1999)), within the context of modified gravity theories. We consider Ricci-inverse gravity of all Classes of models, {\it i.e.}, (i) Class-{\bf I}: $f(\mathcal{R}, \mathcal{A})=(\mathcal{R}+β\,\mathcal{A})$, (ii) Class-{\bf II}: $f(\mathcal{R}, A^{μν}\,A_{μν})=(\mathcal{R}+γ\,A^{μν}\,A_{μν})$ model, and (iii) Class-{\bf III}: $f(\mathcal{R}, \mathcal{A}, A^{μν}\,A_{μν})=(\mathcal{R}+β\,\mathcal{A}+δ\,\mathcal{A}^2+γ\,A^{μν}\,A_{μν})$ model, where $A^{μν}$ is the anti-curvature tensor, the reciprocal of the Ricci tensor, $R_{μν}$, $\mathcal{A}=g_{μν}\,A^{μν}$ is its scalar, and $β, γ, δ$ are the coupling constants. In fact, we show that Li time-machine space-time serve as valid solution within this Ricci-inverse gravity theory. Thus, this new theory allows the formation of closed time-like curves analogue to general relativity, representing a possible time machine model in Ricci-inverse modified gravity theoretically.
△ Less
Submitted 16 July, 2024;
originally announced July 2024.
-
Teaching and Learning Ethnography for Software Engineering Contexts
Authors:
Yvonne Dittrich,
Helen Sharp,
Cleidson de Souza
Abstract:
Ethnography has become one of the established methods for empirical research on software engineering. Although there is a wide variety of introductory books available, there has been no material targeting software engineering students particularly, until now. In this chapter we provide an introduction to teaching and learning ethnography for faculty teaching ethnography to software engineering gra…
▽ More
Ethnography has become one of the established methods for empirical research on software engineering. Although there is a wide variety of introductory books available, there has been no material targeting software engineering students particularly, until now. In this chapter we provide an introduction to teaching and learning ethnography for faculty teaching ethnography to software engineering graduate students and for the students themselves of such courses.
The contents of the chapter focuses on what we think is the core basic knowledge for newbies to ethnography as a research method. We complement the text with proposals for exercises, tips for teaching, and pitfalls that we and our students have experienced.
The chapter is designed to support part of a course on empirical software engineering and provides pointers and literature for further reading.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
Tame fields, Graded Rings and Finite Complete Sequences of Key Polynomials
Authors:
Caio Henrique Silva de Souza
Abstract:
In this paper, we link the concept of tame field to the study of graded rings and complete sequences of key polynomials. We review some definitions and results on the theory of key polynomials and Mac Lane-Vaquié chains which enable us to prove that a valued field $(K,v)$ is tame if and only if the Frobenius endomorphism on the associated graded ring is surjective and every simple algebraic extens…
▽ More
In this paper, we link the concept of tame field to the study of graded rings and complete sequences of key polynomials. We review some definitions and results on the theory of key polynomials and Mac Lane-Vaquié chains which enable us to prove that a valued field $(K,v)$ is tame if and only if the Frobenius endomorphism on the associated graded ring is surjective and every simple algebraic extension of $K$ admits a finite complete sequence of key polynomials. We present a criterion for $(K,v)$ to be henselian and defectless in terms of finite complete sequences of key polynomials. We also make some considerations on purely inertial and purely ramified extensions and their relations to properties of the associated graded ring and the module of Kähler differentials.
△ Less
Submitted 1 July, 2024;
originally announced July 2024.
-
Ratchet current and scaling properties in a nontwist mapping
Authors:
Matheus Rolim Sales,
Daniel Borin,
Leonardo Costa de Souza,
José Danilo Szezech Jr.,
Ricardo Luiz Viana,
Iberê Luiz Caldas,
Edson Denis Leonel
Abstract:
We investigate the transport of particles in the chaotic component of phase space for a two-dimensional, area-preserving nontwist map. The survival probability for particles within the chaotic sea is described by an exponential decay for regions in phase space predominantly chaotic and it is scaling invariant in this case. Alternatively, when considering mixed chaotic and regular regions, there is…
▽ More
We investigate the transport of particles in the chaotic component of phase space for a two-dimensional, area-preserving nontwist map. The survival probability for particles within the chaotic sea is described by an exponential decay for regions in phase space predominantly chaotic and it is scaling invariant in this case. Alternatively, when considering mixed chaotic and regular regions, there is a deviation from the exponential decay, characterized by a power law tail for long times, a signature of the stickiness effect. Furthermore, due to the asymmetry of the chaotic component of phase space with respect to the line $I = 0$, there is an unbalanced stickiness which generates a ratchet current in phase space. Finally, we perform a phenomenological description of the diffusion of chaotic particles by identifying three scaling hypotheses, and obtaining the critical exponents via extensive numerical simulations.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Model-based Clustering of Zero-Inflated Single-Cell RNA Sequencing Data via the EM Algorithm
Authors:
Zahra AghahosseinaliShirazi,
Pedro A. Rangel,
Camila P. E. de Souza
Abstract:
Biological cells can be distinguished by their phenotype or at the molecular level, based on their genome, epigenome, and transcriptome. This paper focuses on the transcriptome, which encompasses all the RNA transcripts in a given cell population, indicating the genes being expressed at a given time. We consider single-cell RNA sequencing data and develop a novel model-based clustering method to g…
▽ More
Biological cells can be distinguished by their phenotype or at the molecular level, based on their genome, epigenome, and transcriptome. This paper focuses on the transcriptome, which encompasses all the RNA transcripts in a given cell population, indicating the genes being expressed at a given time. We consider single-cell RNA sequencing data and develop a novel model-based clustering method to group cells based on their transcriptome profiles. Our clustering approach takes into account the presence of zero inflation in the data, which can occur due to genuine biological zeros or technological noise. The proposed model for clustering involves a mixture of zero-inflated Poisson or zero-inflated negative binomial distributions, and parameter estimation is carried out using the EM algorithm. We evaluate the performance of our proposed methodology through simulation studies and analyses of publicly available datasets.
△ Less
Submitted 29 July, 2024; v1 submitted 31 May, 2024;
originally announced June 2024.
-
QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translation
Authors:
Gonçalo R. A. Faria,
Sweta Agrawal,
António Farinhas,
Ricardo Rei,
José G. C. de Souza,
André F. T. Martins
Abstract:
An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correlates poorly with translation quality. In contrast, quality evaluation metrics (such as COMET or BLEURT) exhibit high correlations with human judgments, which has motivated their use as rerankers (such as quality-aware an…
▽ More
An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correlates poorly with translation quality. In contrast, quality evaluation metrics (such as COMET or BLEURT) exhibit high correlations with human judgments, which has motivated their use as rerankers (such as quality-aware and minimum Bayes risk decoding). However, relying on a single translation with high estimated quality increases the chances of "gaming the metric''. In this paper, we address the problem of sampling a set of high-quality and diverse translations. We provide a simple and effective way to avoid over-reliance on noisy quality estimates by using them as the energy function of a Gibbs distribution. Instead of looking for a mode in the distribution, we generate multiple samples from high-density areas through the Metropolis-Hastings algorithm, a simple Markov chain Monte Carlo approach. The results show that our proposed method leads to high-quality and diverse outputs across multiple language pairs (English$\leftrightarrow${German, Russian}) with two strong decoder-only LLMs (Alma-7b, Tower-7b).
△ Less
Submitted 28 May, 2024;
originally announced June 2024.
-
Fast Bayesian Basis Selection for Functional Data Representation with Correlated Errors
Authors:
Ana Carolina da Cruz,
Camila P. E. de Souza,
Pedro H. T. O. Sousa
Abstract:
Functional data analysis (FDA) finds widespread application across various fields, due to data being recorded continuously over a time interval or at several discrete points. Since the data is not observed at every point but rather across a dense grid, smoothing techniques are often employed to convert the observed data into functions. In this work, we propose a novel Bayesian approach for selecti…
▽ More
Functional data analysis (FDA) finds widespread application across various fields, due to data being recorded continuously over a time interval or at several discrete points. Since the data is not observed at every point but rather across a dense grid, smoothing techniques are often employed to convert the observed data into functions. In this work, we propose a novel Bayesian approach for selecting basis functions for smoothing one or multiple curves simultaneously. Our method differentiates from other Bayesian approaches in two key ways: (i) by accounting for correlated errors and (ii) by developing a variational EM algorithm instead of a Gibbs sampler. Simulation studies demonstrate that our method effectively identifies the true underlying structure of the data across various scenarios and it is applicable to different types of functional data. Our variational EM algorithm not only recovers the basis coefficients and the correct set of basis functions but also estimates the existing within-curve correlation. When applied to the motorcycle dataset, our method demonstrates comparable, and in some cases superior, performance in terms of adjusted $R^2$ compared to other techniques such as regression splines, Bayesian LASSO and LASSO. Additionally, when assuming independence among observations within a curve, our method, utilizing only a variational Bayes algorithm, is in the order of thousands faster than a Gibbs sampler on average. Our proposed method is implemented in R and codes are available at https://github.com/acarolcruz/VB-Bases-Selection.
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
Tower: An Open Multilingual Large Language Model for Translation-Related Tasks
Authors:
Duarte M. Alves,
José Pombal,
Nuno M. Guerreiro,
Pedro H. Martins,
João Alves,
Amin Farajian,
Ben Peters,
Ricardo Rei,
Patrick Fernandes,
Sweta Agrawal,
Pierre Colombo,
José G. C. de Souza,
André F. T. Martins
Abstract:
While general-purpose large language models (LLMs) demonstrate proficiency on multiple tasks within the domain of translation, approaches based on open LLMs are competitive only when specializing on a single task. In this paper, we propose a recipe for tailoring LLMs to multiple tasks present in translation workflows. We perform continued pretraining on a multilingual mixture of monolingual and pa…
▽ More
While general-purpose large language models (LLMs) demonstrate proficiency on multiple tasks within the domain of translation, approaches based on open LLMs are competitive only when specializing on a single task. In this paper, we propose a recipe for tailoring LLMs to multiple tasks present in translation workflows. We perform continued pretraining on a multilingual mixture of monolingual and parallel data, creating TowerBase, followed by finetuning on instructions relevant for translation processes, creating TowerInstruct. Our final model surpasses open alternatives on several tasks relevant to translation workflows and is competitive with general-purpose closed LLMs. To facilitate future research, we release the Tower models, our specialization dataset, an evaluation framework for LLMs focusing on the translation ecosystem, and a collection of model generations, including ours, on our benchmark.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
PANDAS: Prototype-based Novel Class Discovery and Detection
Authors:
Tyler L. Hayes,
César R. de Souza,
Namil Kim,
Jiwon Kim,
Riccardo Volpi,
Diane Larlus
Abstract:
Object detectors are typically trained once and for all on a fixed set of classes. However, this closed-world assumption is unrealistic in practice, as new classes will inevitably emerge after the detector is deployed in the wild. In this work, we look at ways to extend a detector trained for a set of base classes so it can i) spot the presence of novel classes, and ii) automatically enrich its re…
▽ More
Object detectors are typically trained once and for all on a fixed set of classes. However, this closed-world assumption is unrealistic in practice, as new classes will inevitably emerge after the detector is deployed in the wild. In this work, we look at ways to extend a detector trained for a set of base classes so it can i) spot the presence of novel classes, and ii) automatically enrich its repertoire to be able to detect those newly discovered classes together with the base ones. We propose PANDAS, a method for novel class discovery and detection. It discovers clusters representing novel classes from unlabeled data, and represents old and new classes with prototypes. During inference, a distance-based classifier uses these prototypes to assign a label to each detected object instance. The simplicity of our method makes it widely applicable. We experimentally demonstrate the effectiveness of PANDAS on the VOC 2012 and COCO-to-LVIS benchmarks. It performs favorably against the state of the art for this task while being computationally more affordable.
△ Less
Submitted 30 April, 2024; v1 submitted 27 February, 2024;
originally announced February 2024.
-
Cosmological constant Petrov type-N space-time in Ricci-inverse gravity
Authors:
F. Ahmed,
J. C. R. de Souza,
A. F. Santos
Abstract:
Our focus is on a specific type-N space-time that exhibits closed time-like curves in general relativity theory within the framework of Ricci-inverse gravity model. The matter-energy content is solely composed of a pure radiation field, and it adheres to the energy conditions while featuring a negative cosmological constant. One of the key findings in this investigation is the non-zero determinant…
▽ More
Our focus is on a specific type-N space-time that exhibits closed time-like curves in general relativity theory within the framework of Ricci-inverse gravity model. The matter-energy content is solely composed of a pure radiation field, and it adheres to the energy conditions while featuring a negative cosmological constant. One of the key findings in this investigation is the non-zero determinant of the Ricci tensor ($R_{μν}$), which implies the existence of an anti-curvature tensor ($A^{μν}$) and, as a consequence, an anti-curvature scalar ($A \neq R^{-1}$). Furthermore, we establish that this type-N space-time serves as a solution within modified gravity theories via the Ricci-inverse model, which involves adjustments to the cosmological constant ($Λ$) and the energy density ($ρ$) of the radiation field expressed in terms of a coupling constant. As a result, our findings suggest that causality violations remain possible within the framework of this Ricci-inverse gravity model, alongside the predictions of general relativity.
△ Less
Submitted 26 December, 2023;
originally announced December 2023.
-
Polar order, shear banding, and clustering in confined active matter
Authors:
Daniel Canavello,
Rubens H. Damascena,
Leonardo R. E. Cabral,
Clécio C. de Souza Silva
Abstract:
We investigate the collective behavior of sterically interacting self-propelled particles confined in a harmonic potential. Our theoretical and numerical study unveils the emergence of distinctive collective polar organizations, revealing how different levels of interparticle torques and noise influence the system. The observed phases include the shear-banded vortex, where the system self organize…
▽ More
We investigate the collective behavior of sterically interacting self-propelled particles confined in a harmonic potential. Our theoretical and numerical study unveils the emergence of distinctive collective polar organizations, revealing how different levels of interparticle torques and noise influence the system. The observed phases include the shear-banded vortex, where the system self organizes in two concentric bands rotating in opposite directions around the potential center; the uniform vortex, where the two bands merge into a close packed configurations rotating uniformly as a quasi-rigid body; and the orbiting polar state, characterized by parallel orientation vectors and the cluster revolving around the potential center, without rotation, as a rigid body. Intriguingly, at lower filling fractions, the vortex and polar phases merge into a single phase where the trapped cluster breaks into smaller polarized clusters, each one orbiting the potential center as a rigid body.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functions
Authors:
Esteban Real,
Yao Chen,
Mirko Rossini,
Connal de Souza,
Manav Garg,
Akhil Verghese,
Moritz Firsching,
Quoc V. Le,
Ekin Dogus Cubuk,
David H. Park
Abstract:
Computers calculate transcendental functions by approximating them through the composition of a few limited-precision instructions. For example, an exponential can be calculated with a Taylor series. These approximation methods were developed over the centuries by mathematicians, who emphasized the attainability of arbitrary precision. Computers, however, operate on few limited precision types, su…
▽ More
Computers calculate transcendental functions by approximating them through the composition of a few limited-precision instructions. For example, an exponential can be calculated with a Taylor series. These approximation methods were developed over the centuries by mathematicians, who emphasized the attainability of arbitrary precision. Computers, however, operate on few limited precision types, such as the popular float32. In this study, we show that when aiming for limited precision, existing approximation methods can be outperformed by programs automatically discovered from scratch by a simple evolutionary algorithm. In particular, over real numbers, our method can approximate the exponential function reaching orders of magnitude more precision for a given number of operations when compared to previous approaches. More practically, over float32 numbers and constrained to less than 1 ULP of error, the same method attains a speedup over baselines by generating code that triggers better XLA/LLVM compilation paths. In other words, in both cases, evolution searched a vast space of possible programs, without knowledge of mathematics, to discover previously unknown optimized approximations to high precision, for the first time. We also give evidence that these results extend beyond the exponential. The ubiquity of transcendental functions suggests that our method has the potential to reduce the cost of scientific computing applications.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Developer Experiences with a Contextualized AI Coding Assistant: Usability, Expectations, and Outcomes
Authors:
Gustavo Pinto,
Cleidson de Souza,
Thayssa Rocha,
Igor Steinmacher,
Alberto de Souza,
Edward Monteiro
Abstract:
In the rapidly advancing field of artificial intelligence, software development has emerged as a key area of innovation. Despite the plethora of general-purpose AI assistants available, their effectiveness diminishes in complex, domain-specific scenarios. Noting this limitation, both the academic community and industry players are relying on contextualized coding AI assistants. These assistants su…
▽ More
In the rapidly advancing field of artificial intelligence, software development has emerged as a key area of innovation. Despite the plethora of general-purpose AI assistants available, their effectiveness diminishes in complex, domain-specific scenarios. Noting this limitation, both the academic community and industry players are relying on contextualized coding AI assistants. These assistants surpass general-purpose AI tools by integrating proprietary, domain-specific knowledge, offering precise and relevant solutions. Our study focuses on the initial experiences of 62 participants who used a contextualized coding AI assistant -- named StackSpot AI -- in a controlled setting. According to the participants, the assistants' use resulted in significant time savings, easier access to documentation, and the generation of accurate codes for internal APIs. However, challenges associated with the knowledge sources necessary to make the coding assistant access more contextual information as well as variable responses and limitations in handling complex codes were observed. The study's findings, detailing both the benefits and challenges of contextualized AI assistants, underscore their potential to revolutionize software development practices, while also highlighting areas for further refinement.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Lessons from Building StackSpot AI: A Contextualized AI Coding Assistant
Authors:
Gustavo Pinto,
Cleidson de Souza,
João Batista Neto,
Alberto de Souza,
Tarcísio Gotto,
Edward Monteiro
Abstract:
With their exceptional natural language processing capabilities, tools based on Large Language Models (LLMs) like ChatGPT and Co-Pilot have swiftly become indispensable resources in the software developer's toolkit. While recent studies suggest the potential productivity gains these tools can unlock, users still encounter drawbacks, such as generic or incorrect answers. Additionally, the pursuit o…
▽ More
With their exceptional natural language processing capabilities, tools based on Large Language Models (LLMs) like ChatGPT and Co-Pilot have swiftly become indispensable resources in the software developer's toolkit. While recent studies suggest the potential productivity gains these tools can unlock, users still encounter drawbacks, such as generic or incorrect answers. Additionally, the pursuit of improved responses often leads to extensive prompt engineering efforts, diverting valuable time from writing code that delivers actual value. To address these challenges, a new breed of tools, built atop LLMs, is emerging. These tools aim to mitigate drawbacks by employing techniques like fine-tuning or enriching user prompts with contextualized information.
In this paper, we delve into the lessons learned by a software development team venturing into the creation of such a contextualized LLM-based application, using retrieval-based techniques, called CodeBuddy. Over a four-month period, the team, despite lacking prior professional experience in LLM-based applications, built the product from scratch. Following the initial product release, we engaged with the development team responsible for the code generative components. Through interviews and analysis of the application's issue tracker, we uncover various intriguing challenges that teams working on LLM-based applications might encounter. For instance, we found three main group of lessons: LLM-based lessons, User-based lessons, and Technical lessons. By understanding these lessons, software development teams could become better prepared to build LLM-based applications.
△ Less
Submitted 4 January, 2024; v1 submitted 30 November, 2023;
originally announced November 2023.
-
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning
Authors:
Duarte M. Alves,
Nuno M. Guerreiro,
João Alves,
José Pombal,
Ricardo Rei,
José G. C. de Souza,
Pierre Colombo,
André F. T. Martins
Abstract:
Large language models (LLMs) are a promising avenue for machine translation (MT). However, current LLM-based MT systems are brittle: their effectiveness highly depends on the choice of few-shot examples and they often require extra post-processing due to overgeneration. Alternatives such as finetuning on translation instructions are computationally expensive and may weaken in-context learning capa…
▽ More
Large language models (LLMs) are a promising avenue for machine translation (MT). However, current LLM-based MT systems are brittle: their effectiveness highly depends on the choice of few-shot examples and they often require extra post-processing due to overgeneration. Alternatives such as finetuning on translation instructions are computationally expensive and may weaken in-context learning capabilities, due to overspecialization. In this paper, we provide a closer look at this problem. We start by showing that adapter-based finetuning with LoRA matches the performance of traditional finetuning while reducing the number of training parameters by a factor of 50. This method also outperforms few-shot prompting and eliminates the need for post-processing or in-context examples. However, we show that finetuning generally degrades few-shot performance, hindering adaptation capabilities. Finally, to obtain the best of both worlds, we propose a simple approach that incorporates few-shot examples during finetuning. Experiments on 10 language pairs show that our proposed approach recovers the original few-shot capabilities while keeping the added benefits of finetuning.
△ Less
Submitted 20 October, 2023;
originally announced October 2023.
-
An Empirical Study of Translation Hypothesis Ensembling with Large Language Models
Authors:
António Farinhas,
José G. C. de Souza,
André F. T. Martins
Abstract:
Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. In this paper, we investigate how hypothesis ensembling can improve the quality of the generated text for the specific problem of LLM-based machine translation. We experiment with several techniques for ensembling hypotheses produced by LLMs such as ChatGPT, LLaMA, and A…
▽ More
Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. In this paper, we investigate how hypothesis ensembling can improve the quality of the generated text for the specific problem of LLM-based machine translation. We experiment with several techniques for ensembling hypotheses produced by LLMs such as ChatGPT, LLaMA, and Alpaca. We provide a comprehensive study along multiple dimensions, including the method to generate hypotheses (multiple prompts, temperature-based sampling, and beam search) and the strategy to produce the final translation (instruction-based, quality-based reranking, and minimum Bayes risk (MBR) decoding). Our results show that MBR decoding is a very effective method, that translation quality can be improved using a small number of samples, and that instruction tuning has a strong impact on the relation between the diversity of the hypotheses and the sampling temperature.
△ Less
Submitted 17 October, 2023;
originally announced October 2023.
-
Effects of Distributed Generation on the Bidirectional Operation of Cascaded Step Voltage Regulators: Case Study of a Real 34.5 kV Distribution Feeder
Authors:
Hugo Rodrigues de Brito,
Valéria Monteiro de Souza,
João Paulo Abreu Vieira,
Maria Emília de Lima Tostes,
Ubiratan Holanda Bezerra,
Vanderson Carvalho de Souza,
Daniel da Conceição Pinheiro,
Heitor Alves Barata,
Hugo Nazareno de Souza Cardoso,
Marcelo Sousa Costa
Abstract:
This work investigates the impact of feeder bidirectional active power flow on the operation of two cascaded step voltage regulators (SVRs) located at a 34.5 kV rural distribution feeder. It shows that, when active power flow reversal is possible both by network reconfiguration and by high penetration levels of distributed generation (DG), typical SVR control mode settings are unable to prevent th…
▽ More
This work investigates the impact of feeder bidirectional active power flow on the operation of two cascaded step voltage regulators (SVRs) located at a 34.5 kV rural distribution feeder. It shows that, when active power flow reversal is possible both by network reconfiguration and by high penetration levels of distributed generation (DG), typical SVR control mode settings are unable to prevent the occurrence of runaway condition, a phenomenon characterized by loss of SVR voltage control capabilities. Such developments are the basis for a DG pre-dispatch control strategy that aims to avoid the adverse effects of the described power flow reversal scenarios, as well as to ensure reliable operation of the utility distribution network.
△ Less
Submitted 13 October, 2023;
originally announced October 2023.
-
Back-Propagation Optimization and Multi-Valued Artificial Neural Networks for Highly Vivid Structural Color Filter Metasurfaces
Authors:
Arthur Clini de Souza,
Stéphane Lanteri,
Hugo Enrique Hernandez-Figueroa,
Marco Abbarchi,
David Grosso,
Badre Kerzabi,
Mahmoud Elsawy
Abstract:
We introduce a novel technique for designing color filter metasurfaces using a data-driven approach based on deep learning. Our innovative approach employs inverse design principles to identify highly efficient designs that outperform all the configurations in the dataset, which consists of 585 distinct geometries solely. By combining Multi-Valued Artificial Neural Networks and back-propagation op…
▽ More
We introduce a novel technique for designing color filter metasurfaces using a data-driven approach based on deep learning. Our innovative approach employs inverse design principles to identify highly efficient designs that outperform all the configurations in the dataset, which consists of 585 distinct geometries solely. By combining Multi-Valued Artificial Neural Networks and back-propagation optimization, we overcome the limitations of previous approaches, such as poor performance due to extrapolation and undesired local minima. Consequently, we successfully create reliable and highly efficient configurations for metasurface color filters capable of producing exceptionally vivid colors that go beyond the sRGB gamut. Furthermore, our deep learning technique can be extended to design various pixellated metasurface configurations with different functionalities.
△ Less
Submitted 18 October, 2023; v1 submitted 2 October, 2023;
originally announced October 2023.
-
Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task
Authors:
Ricardo Rei,
Nuno M. Guerreiro,
José Pombal,
Daan van Stigt,
Marcos Treviso,
Luisa Coheur,
José G. C. de Souza,
André F. T. Martins
Abstract:
We present the joint contribution of Unbabel and Instituto Superior Técnico to the WMT 2023 Shared Task on Quality Estimation (QE). Our team participated on all tasks: sentence- and word-level quality prediction (task 1) and fine-grained error span detection (task 2). For all tasks, we build on the COMETKIWI-22 model (Rei et al., 2022b). Our multilingual approaches are ranked first for all tasks,…
▽ More
We present the joint contribution of Unbabel and Instituto Superior Técnico to the WMT 2023 Shared Task on Quality Estimation (QE). Our team participated on all tasks: sentence- and word-level quality prediction (task 1) and fine-grained error span detection (task 2). For all tasks, we build on the COMETKIWI-22 model (Rei et al., 2022b). Our multilingual approaches are ranked first for all tasks, reaching state-of-the-art performance for quality estimation at word-, span- and sentence-level granularity. Compared to the previous state-of-the-art COMETKIWI-22, we show large improvements in correlation with human judgements (up to 10 Spearman points). Moreover, we surpass the second-best multilingual submission to the shared-task with up to 3.8 absolute points.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
An axially symmetric spacetime with causality violation in Ricci-inverse gravity
Authors:
J. C. R. de Souza,
A. F. Santos
Abstract:
In this paper, Ricci-inverse gravity is investigated. It is an alternative theory of gravity that introduces into the Einstein-Hilbert action an anti-curvature scalar that is obtained from the anti-curvature tensor which is the inverse of the Ricci tensor. An axially symmetric spacetime with causality violation is studied. Two classes of the model are discussed. Different sources of matter are con…
▽ More
In this paper, Ricci-inverse gravity is investigated. It is an alternative theory of gravity that introduces into the Einstein-Hilbert action an anti-curvature scalar that is obtained from the anti-curvature tensor which is the inverse of the Ricci tensor. An axially symmetric spacetime with causality violation is studied. Two classes of the model are discussed. Different sources of matter are considered. Then a direct relation between the content of matter and causality violation is shown. Our results confirm that Ricci-inverse gravity allows the existence of Closed Time-like Curves (CTCs) that lead to the violation of causality. Furthermore, a comparison is made between the results of general relativity and Ricci-inverse gravity. Other spacetimes, such as Gödel and Gödel-type universes, which are exact solutions of general relativity and allow for causality violations, are also explored in Ricci-inverse gravity framework.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
Geometry of vectorial martingale optimal transport and robust option pricing
Authors:
Joshua Zoen-Git Hiew,
Tongseok Lim,
Brendan Pass,
Marcelo Cruz de Souza
Abstract:
This paper addresses robust finance, which is concerned with the development of models and approaches that account for market uncertainties. Specifically, we investigate the Vectorial Martingale Optimal Transport (VMOT) problem, the geometry of its solutions, and its application with robust option pricing problems in finance. To this end, we consider two-period market models and show that when the…
▽ More
This paper addresses robust finance, which is concerned with the development of models and approaches that account for market uncertainties. Specifically, we investigate the Vectorial Martingale Optimal Transport (VMOT) problem, the geometry of its solutions, and its application with robust option pricing problems in finance. To this end, we consider two-period market models and show that when the spatial dimension $d$ (the number of underlying assets) is 2, the extremal model for the cap option with a sub- or super-modular payout reduces to a single factor model in the first period, but not in general when $d > 2$. The result demonstrates a subtle relationship between spatial dimension, cost function supermodularity, and their effect on the geometry of solutions to the VMOT problem. We investigate applications of the model to financial problems and demonstrate how the dimensional reduction caused by monotonicity can be used to improve existing computational methods.
△ Less
Submitted 18 September, 2023; v1 submitted 10 September, 2023;
originally announced September 2023.
-
How life-table right-censoring affected the Brazilian Social Security Factor: an application of the gamma-Gompertz-Makeham model
Authors:
Filipe Costa de Souza,
Wilton Bernardino,
Silvio Cabral Patricio
Abstract:
Automatic Adjustment Mechanisms (AAM) are legal instruments that help social security systems respond to demographic and economic changes. In Brazil, the Social Security Factor (SSF) was introduced in the late 1990s as an AAM to link retirement benefits to life expectancy at the retirement age, with the hope of promoting contributory justice and discouraging early retirement. Recent research has h…
▽ More
Automatic Adjustment Mechanisms (AAM) are legal instruments that help social security systems respond to demographic and economic changes. In Brazil, the Social Security Factor (SSF) was introduced in the late 1990s as an AAM to link retirement benefits to life expectancy at the retirement age, with the hope of promoting contributory justice and discouraging early retirement. Recent research has highlighted the limitations of right-censored life tables, such as those used in Brazil. It has recommended using the gamma-Gompertz-Makeham (GGM) model to estimate adult and old-age mortality. This study investigated the impact of right-censoring on the SSF by comparing the official SSF and other social security metrics with a counterfactual scenario computed based on fitted GGM models. The results indicate that from 2004 to 2012, official life tables may have negatively impacted retirees' income, particularly for those who delayed their retirement. Furthermore, the GGM-fitted models' life expectancies had more stable paths over time, which could have helped with long-term planning. This study's findings are significant for policymakers as they highlight the importance of using appropriate mortality metrics in AAMs to ensure accurate retirement benefit payments. They also underscore the need to consider the potential impacts of seemingly innocuous hypotheses on public action outcomes. Overall, this study provides valuable insights for public planners and policymakers looking to enhance the effectiveness and fairness of social security systems.
△ Less
Submitted 12 September, 2023; v1 submitted 7 September, 2023;
originally announced September 2023.
-
Parametrizations of subsets of the space of valuations
Authors:
Josnei Antonio Novacoski,
Caio Henrique Silva de Souza
Abstract:
In this paper we present different ways to parametrize subsets of the space of valuations on $K[x]$ extending a given valuation on $K$. We discuss the methods using pseudo-Cauchy sequences and approximation types. The method presented here is slightly different than the ones in the literature and we believe that our approach is more accurate.
In this paper we present different ways to parametrize subsets of the space of valuations on $K[x]$ extending a given valuation on $K$. We discuss the methods using pseudo-Cauchy sequences and approximation types. The method presented here is slightly different than the ones in the literature and we believe that our approach is more accurate.
△ Less
Submitted 25 August, 2023;
originally announced August 2023.
-
ProWis: A Visual Approach for Building, Managing, and Analyzing Weather Simulation Ensembles at Runtime
Authors:
Carolina Veiga Ferreira de Souza,
Suzanna Maria Bonnet,
Daniel de Oliveira,
Marcio Cataldi,
Fabio Miranda,
Marcos Lage
Abstract:
Weather forecasting is essential for decision-making and is usually performed using numerical modeling. Numerical weather models, in turn, are complex tools that require specialized training and laborious setup and are challenging even for weather experts. Moreover, weather simulations are data-intensive computations and may take hours to days to complete. When the simulation is finished, the expe…
▽ More
Weather forecasting is essential for decision-making and is usually performed using numerical modeling. Numerical weather models, in turn, are complex tools that require specialized training and laborious setup and are challenging even for weather experts. Moreover, weather simulations are data-intensive computations and may take hours to days to complete. When the simulation is finished, the experts face challenges analyzing its outputs, a large mass of spatiotemporal and multivariate data. From the simulation setup to the analysis of results, working with weather simulations involves several manual and error-prone steps. The complexity of the problem increases exponentially when the experts must deal with ensembles of simulations, a frequent task in their daily duties. To tackle these challenges, we propose ProWis: an interactive and provenance-oriented system to help weather experts build, manage, and analyze simulation ensembles at runtime. Our system follows a human-in-the-loop approach to enable the exploration of multiple atmospheric variables and weather scenarios. ProWis was built in close collaboration with weather experts, and we demonstrate its effectiveness by presenting two case studies of rainfall events in Brazil.
△ Less
Submitted 9 August, 2023;
originally announced August 2023.
-
BayesCPclust: A Bayesian Approach for Clustering Constant-Wise Change-Point Data
Authors:
Ana Carolina da Cruz,
Camila P. E. de Souza
Abstract:
Change-point models deal with ordered data sequences. Their primary goal is to infer the locations where an aspect of the data sequence changes. In this paper, we propose and implement a nonparametric Bayesian model for clustering observations based on their constant-wise change-point profiles via Gibbs sampler. Our model incorporates a Dirichlet Process on the constant-wise change-point structure…
▽ More
Change-point models deal with ordered data sequences. Their primary goal is to infer the locations where an aspect of the data sequence changes. In this paper, we propose and implement a nonparametric Bayesian model for clustering observations based on their constant-wise change-point profiles via Gibbs sampler. Our model incorporates a Dirichlet Process on the constant-wise change-point structures to cluster observations while simultaneously performing multiple change-point estimation. Additionally, our approach controls the number of clusters in the model, not requiring the specification of the number of clusters \textit{a priori}. Satisfactory clustering and estimation results were obtained when evaluating our method under various simulated scenarios and on a real dataset from single-cell genomic sequencing. Our proposed methodology is implemented as an R package called BayesCPclust and is available at \texttt{https://github.com/acarolcruz/BayesCPclust}.
△ Less
Submitted 24 November, 2023; v1 submitted 28 May, 2023;
originally announced May 2023.
-
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation
Authors:
Patrick Fernandes,
Aman Madaan,
Emmy Liu,
António Farinhas,
Pedro Henrique Martins,
Amanda Bertsch,
José G. C. de Souza,
Shuyan Zhou,
Tongshuang Wu,
Graham Neubig,
André F. T. Martins
Abstract:
Many recent advances in natural language generation have been fueled by training large language models on internet-scale data. However, this paradigm can lead to models that generate toxic, inaccurate, and unhelpful content, and automatic evaluation metrics often fail to identify these behaviors. As models become more capable, human feedback is an invaluable signal for evaluating and improving mod…
▽ More
Many recent advances in natural language generation have been fueled by training large language models on internet-scale data. However, this paradigm can lead to models that generate toxic, inaccurate, and unhelpful content, and automatic evaluation metrics often fail to identify these behaviors. As models become more capable, human feedback is an invaluable signal for evaluating and improving models. This survey aims to provide an overview of the recent research that has leveraged human feedback to improve natural language generation. First, we introduce an encompassing formalization of feedback, and identify and organize existing research into a taxonomy following this formalization. Next, we discuss how feedback can be described by its format and objective, and cover the two approaches proposed to use feedback (either for training or decoding): directly using the feedback or training feedback models. We also discuss existing datasets for human-feedback data collection, and concerns surrounding feedback collection. Finally, we provide an overview of the nascent field of AI feedback, which exploits large language models to make judgments based on a set of principles and minimize the need for human intervention.
△ Less
Submitted 31 May, 2023; v1 submitted 1 May, 2023;
originally announced May 2023.
-
Variational Bayesian analysis of survival data using a log-logistic accelerated failure time model
Authors:
Chengqian Xian,
Camila P. E. de Souza,
Wenqing He,
Felipe F. Rodrigues,
Renfang Tian
Abstract:
The log-logistic regression model is one of the most commonly used accelerated failure time (AFT) models in survival analysis, for which statistical inference methods are mainly established under the frequentist framework. Recently, Bayesian inference for log-logistic AFT models using Markov chain Monte Carlo (MCMC) techniques has also been widely developed. In this work, we develop an alternative…
▽ More
The log-logistic regression model is one of the most commonly used accelerated failure time (AFT) models in survival analysis, for which statistical inference methods are mainly established under the frequentist framework. Recently, Bayesian inference for log-logistic AFT models using Markov chain Monte Carlo (MCMC) techniques has also been widely developed. In this work, we develop an alternative approach to MCMC methods and infer the parameters of the log-logistic AFT model via a mean-field variational Bayes (VB) algorithm. A piecewise approximation technique is embedded in deriving the VB algorithm to achieve conjugacy. The proposed VB algorithm is evaluated and compared with typical frequentist inferences and MCMC inference using simulated data under various scenarios. A publicly available dataset is employed for illustration. We demonstrate that the proposed VB algorithm can achieve good estimation accuracy and has a lower computational cost compared with MCMC methods.
△ Less
Submitted 10 October, 2023; v1 submitted 16 March, 2023;
originally announced March 2023.
-
Bayesian Variable Selection for Function-on-Scalar Regression Models: a comparative analysis
Authors:
Pedro Henrique T. O. Sousa,
Camila P. E. de Souza,
Ronaldo Dias
Abstract:
In this work, we developed a new Bayesian method for variable selection in function-on-scalar regression (FOSR). Our method uses a hierarchical Bayesian structure and latent variables to enable an adaptive covariate selection process for FOSR. Extensive simulation studies show the proposed method's main properties, such as its accuracy in estimating the coefficients and high capacity to select var…
▽ More
In this work, we developed a new Bayesian method for variable selection in function-on-scalar regression (FOSR). Our method uses a hierarchical Bayesian structure and latent variables to enable an adaptive covariate selection process for FOSR. Extensive simulation studies show the proposed method's main properties, such as its accuracy in estimating the coefficients and high capacity to select variables correctly. Furthermore, we conducted a substantial comparative analysis with the main competing methods, the BGLSS (Bayesian Group Lasso with Spike and Slab prior) method, the group LASSO (Least Absolute Shrinkage and Selection Operator), the group MCP (Minimax Concave Penalty), and the group SCAD (Smoothly Clipped Absolute Deviation). Our results demonstrate that the proposed methodology is superior in correctly selecting covariates compared with the existing competing methods while maintaining a satisfactory level of goodness of fit. In contrast, the competing methods could not balance selection accuracy with goodness of fit. We also considered a COVID-19 dataset and some socioeconomic data from Brazil as an application and obtained satisfactory results. In short, the proposed Bayesian variable selection model is highly competitive, showing significant predictive and selective quality.
△ Less
Submitted 24 April, 2024; v1 submitted 6 March, 2023;
originally announced March 2023.
-
Element-Wise Attention Layers: an option for optimization
Authors:
Giovanni Araujo Bacochina,
Rodrigo Clemente Thom de Souza
Abstract:
The use of Attention Layers has become a trend since the popularization of the Transformer-based models, being the key element for many state-of-the-art models that have been developed through recent years. However, one of the biggest obstacles in implementing these architectures - as well as many others in Deep Learning Field - is the enormous amount of optimizing parameters they possess, which m…
▽ More
The use of Attention Layers has become a trend since the popularization of the Transformer-based models, being the key element for many state-of-the-art models that have been developed through recent years. However, one of the biggest obstacles in implementing these architectures - as well as many others in Deep Learning Field - is the enormous amount of optimizing parameters they possess, which make its use conditioned on the availability of robust hardware. In this paper, it's proposed a new method of attention mechanism that adapts the Dot-Product Attention, which uses matrices multiplications, to become element-wise through the use of arrays multiplications. To test the effectiveness of such approach, two models (one with a VGG-like architecture and one with the proposed method) have been trained in a classification task using Fashion MNIST and CIFAR10 datasets. Each model has been trained for 10 epochs in a single Tesla T4 GPU from Google Colaboratory. The results show that this mechanism allows for an accuracy of 92% of the VGG-like counterpart in Fashion MNIST dataset, while reducing the number of parameters in 97%. For CIFAR10, the accuracy is still equivalent to 60% of the VGG-like counterpart while using 50% less parameters.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
Unified Functional Hashing in Automatic Machine Learning
Authors:
Ryan Gillard,
Stephen Jonany,
Yingjie Miao,
Michael Munn,
Connal de Souza,
Jonathan Dungay,
Chen Liang,
David R. So,
Quoc V. Le,
Esteban Real
Abstract:
The field of Automatic Machine Learning (AutoML) has recently attained impressive results, including the discovery of state-of-the-art machine learning solutions, such as neural image classifiers. This is often done by applying an evolutionary search method, which samples multiple candidate solutions from a large space and evaluates the quality of each candidate through a long training process. As…
▽ More
The field of Automatic Machine Learning (AutoML) has recently attained impressive results, including the discovery of state-of-the-art machine learning solutions, such as neural image classifiers. This is often done by applying an evolutionary search method, which samples multiple candidate solutions from a large space and evaluates the quality of each candidate through a long training process. As a result, the search tends to be slow. In this paper, we show that large efficiency gains can be obtained by employing a fast unified functional hash, especially through the functional equivalence caching technique, which we also present. The central idea is to detect by hashing when the search method produces equivalent candidates, which occurs very frequently, and this way avoid their costly re-evaluation. Our hash is "functional" in that it identifies equivalent candidates even if they were represented or coded differently, and it is "unified" in that the same algorithm can hash arbitrary representations; e.g. compute graphs, imperative code, or lambda functions. As evidence, we show dramatic improvements on multiple AutoML domains, including neural architecture search and algorithm discovery. Finally, we consider the effect of hash collisions, evaluation noise, and search distribution through empirical analysis. Altogether, we hope this paper may serve as a guide to hashing techniques in AutoML.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
Robust Switching Control of DC-DC Boost Converter for EV Charging Stations
Authors:
Saif Ahmad,
Ryan P. C. de Souza,
Pauline Kergus,
Zohra Kader,
Stephane Caux
Abstract:
In this work, the problem of switching control design for DC-DC boost converter is considered, in the case of operation under uncertain equilibrium condition arising due to perturbations in the input and load parameters. Assuming that these uncertain parameters are generated via a known linear exo-system, a parameter estimator is designed to update the equilibrium point for the switching controlle…
▽ More
In this work, the problem of switching control design for DC-DC boost converter is considered, in the case of operation under uncertain equilibrium condition arising due to perturbations in the input and load parameters. Assuming that these uncertain parameters are generated via a known linear exo-system, a parameter estimator is designed to update the equilibrium point for the switching controller in real-time. In order to mitigate the noise amplification problem associated with the designed parameter estimator, the estimation error injection term is filtered via a set of first-order filters to obtain the desired level of noise suppression in the final set of estimates. To demonstrate the efficiency of the developed scheme, a realistic application scenario of a DC charging station for electric vehicles is considered, with photovoltaic array as the source and a battery connected at the load side.
△ Less
Submitted 6 December, 2022;
originally announced December 2022.
-
A Bibliometrics Analysis on 28 years of Authentication and Threat Model Area
Authors:
Wesley dos Reis Bezerra,
Cristiano Antônio de Souza,
Carla Merkle Westphall,
Carlos Becker Westphall
Abstract:
The large volume of publications in any research area can make it difficult for researchers to track their research areas' trends, challenges, and characteristics. Bibliometrics solves this problem by bringing statistical tools to help the analysis of selected publications from an online database. Although there are different works in security, our study aims to fill the bibliometric gap in the au…
▽ More
The large volume of publications in any research area can make it difficult for researchers to track their research areas' trends, challenges, and characteristics. Bibliometrics solves this problem by bringing statistical tools to help the analysis of selected publications from an online database. Although there are different works in security, our study aims to fill the bibliometric gap in the authentication and threat model area. As a result, a description of the dataset obtained, an overview of some selected variables, and an analysis of the ten most cited articles in this selected dataset is presented, which brings together publications from the last 28 years in these areas combined.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
Characteristics and Main Threats about Multi-Factor Authentication: A Survey
Authors:
Wesley dos Reis Bezerra,
Cristiano Antônio de Souza,
Carla Merkle Westphall,
Carlos Becker Westphall
Abstract:
This work reports that the Systematic Literature Review process is responsible for providing theoretical support to research in the Threat Model and Multi-Factor Authentication. However, different from the related works, this study aims to evaluate the main characteristics of authentication solutions and their threat model. Also, it intends to list characteristics, threats, and related content to…
▽ More
This work reports that the Systematic Literature Review process is responsible for providing theoretical support to research in the Threat Model and Multi-Factor Authentication. However, different from the related works, this study aims to evaluate the main characteristics of authentication solutions and their threat model. Also, it intends to list characteristics, threats, and related content to a state-of-art. As a result, we brought a portfolio analysis through charts, figures, and tables presented in the discussion section.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task
Authors:
Ricardo Rei,
Marcos Treviso,
Nuno M. Guerreiro,
Chrysoula Zerva,
Ana C. Farinha,
Christine Maroti,
José G. C. de Souza,
Taisiya Glushkova,
Duarte M. Alves,
Alon Lavie,
Luisa Coheur,
André F. T. Martins
Abstract:
We present the joint contribution of IST and Unbabel to the WMT 2022 Shared Task on Quality Estimation (QE). Our team participated on all three subtasks: (i) Sentence and Word-level Quality Prediction; (ii) Explainable QE; and (iii) Critical Error Detection. For all tasks we build on top of the COMET framework, connecting it with the predictor-estimator architecture of OpenKiwi, and equipping it w…
▽ More
We present the joint contribution of IST and Unbabel to the WMT 2022 Shared Task on Quality Estimation (QE). Our team participated on all three subtasks: (i) Sentence and Word-level Quality Prediction; (ii) Explainable QE; and (iii) Critical Error Detection. For all tasks we build on top of the COMET framework, connecting it with the predictor-estimator architecture of OpenKiwi, and equipping it with a word-level sequence tagger and an explanation extractor. Our results suggest that incorporating references during pretraining improves performance across several language pairs on downstream tasks, and that jointly training with sentence and word-level objectives yields a further boost. Furthermore, combining attention and gradient information proved to be the top strategy for extracting good explanations of sentence-level QE models. Overall, our submissions achieved the best results for all three tasks for almost all language pairs by a considerable margin.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Clustering Functional Data via Variational Inference
Authors:
Chengqian Xian,
Camila de Souza,
John Jewell,
Ronaldo Dias
Abstract:
Functional data analysis deals with data recorded densely over time (or any other continuum) with one or more observed curves per subject. Conceptually, functional data are continuously defined, but in practice, they are usually observed at discrete points. Among different kinds of functional data analyses, clustering analysis aims to determine underlying groups of curves in the dataset when there…
▽ More
Functional data analysis deals with data recorded densely over time (or any other continuum) with one or more observed curves per subject. Conceptually, functional data are continuously defined, but in practice, they are usually observed at discrete points. Among different kinds of functional data analyses, clustering analysis aims to determine underlying groups of curves in the dataset when there is no information on the group membership of each individual curve. In this work, we propose a new model-based approach for clustering and smoothing functional data simultaneously via variational inference. We derive coordinate ascent mean-field variational Bayes algorithms to approximate the posterior distribution of our model parameters by finding the variational distribution with the smallest Kullback-Leibler divergence to the posterior. The performance of our proposed method is evaluated using simulated data and publicly available datasets.
△ Less
Submitted 18 January, 2023; v1 submitted 26 May, 2022;
originally announced May 2022.
-
Graded rings associated to valuations and direct limits
Authors:
Caio Henrique Silva de Souza,
Josnei Antonio Novacoski,
Mark Spivakovsky
Abstract:
In this paper, we study the structure of the graded ring associated to a limit key polynomial $Q_n$ in terms of the key polynomials that define $Q_n$. In order to do that, we use direct limits. In general, we describe the direct limit of a family of graded rings associated to a totally ordered set of valuations. As an example, we describe the graded ring associated to a valuation-algebraic valuati…
▽ More
In this paper, we study the structure of the graded ring associated to a limit key polynomial $Q_n$ in terms of the key polynomials that define $Q_n$. In order to do that, we use direct limits. In general, we describe the direct limit of a family of graded rings associated to a totally ordered set of valuations. As an example, we describe the graded ring associated to a valuation-algebraic valuation as a direct limit of graded rings associated to residue-transcendental valuations.
△ Less
Submitted 20 October, 2022; v1 submitted 10 May, 2022;
originally announced May 2022.
-
Quality-Aware Decoding for Neural Machine Translation
Authors:
Patrick Fernandes,
António Farinhas,
Ricardo Rei,
José G. C. de Souza,
Perez Ogayo,
Graham Neubig,
André F. T. Martins
Abstract:
Despite the progress in machine translation quality estimation and evaluation in the last years, decoding in neural machine translation (NMT) is mostly oblivious to this and centers around finding the most probable translation according to the model (MAP decoding), approximated with beam search. In this paper, we bring together these two lines of research and propose quality-aware decoding for NMT…
▽ More
Despite the progress in machine translation quality estimation and evaluation in the last years, decoding in neural machine translation (NMT) is mostly oblivious to this and centers around finding the most probable translation according to the model (MAP decoding), approximated with beam search. In this paper, we bring together these two lines of research and propose quality-aware decoding for NMT, by leveraging recent breakthroughs in reference-free and reference-based MT evaluation through various inference methods like $N$-best reranking and minimum Bayes risk decoding. We perform an extensive comparison of various possible candidate generation and ranking methods across four datasets and two model classes and find that quality-aware decoding consistently outperforms MAP-based decoding according both to state-of-the-art automatic metrics (COMET and BLEURT) and to human assessments. Our code is available at https://github.com/deep-spin/qaware-decode.
△ Less
Submitted 2 May, 2022;
originally announced May 2022.
-
Bayesian Adaptive Selection of Basis Functions for Functional Data Representation
Authors:
Pedro Henrique T. O. Sousa,
Camila P. E. de Souza,
Ronaldo Dias
Abstract:
Considering the context of functional data analysis, we developed and applied a new Bayesian approach via Gibbs sampler to select basis functions for a finite representation of functional data. The proposed methodology uses Bernoulli latent variables to assign zero to some of the basis function coefficients with a positive probability. This procedure allows for an adaptive basis selection since it…
▽ More
Considering the context of functional data analysis, we developed and applied a new Bayesian approach via Gibbs sampler to select basis functions for a finite representation of functional data. The proposed methodology uses Bernoulli latent variables to assign zero to some of the basis function coefficients with a positive probability. This procedure allows for an adaptive basis selection since it can determine the number of bases and which should be selected to represent functional data. Moreover, the proposed procedure measures the uncertainty of the selection process and can be applied to multiple curves simultaneously. The methodology developed can deal with observed curves that may differ due to experimental error and random individual differences between subjects, which one can observe in a real dataset application involving daily numbers of COVID-19 cases in Brazil. Simulation studies show the main properties of the proposed method, such as its accuracy in estimating the coefficients and the strength of the procedure to find the true set of basis functions. Despite having been developed in the context of functional data analysis, we also compared the proposed model via simulation with the well-established LASSO and Bayesian LASSO, which are methods developed for non-functional data.
△ Less
Submitted 26 May, 2022; v1 submitted 6 April, 2022;
originally announced April 2022.
-
Algorithms for the Maximum Eulerian Cycle Decomposition Problem
Authors:
Pedro O. Pinheiro,
Alexsandro Oliveira Alexandrino,
Andre R. Oliveira,
Cid C. de Souza,
Zanoni Dias
Abstract:
Given an Eulerian graph G, in the Maximum Eulerian Cycle Decomposition problem, we are interested in finding a collection of edge-disjoint cycles {E_1, E_2, ..., E_k} in G such that all edges of G are in exactly one cycle and k is maximum. We present an algorithm to solve the pricing problem of a column generation Integer Linear Programming (ILP) model introduced by Lancia and Serafini (2016). Fur…
▽ More
Given an Eulerian graph G, in the Maximum Eulerian Cycle Decomposition problem, we are interested in finding a collection of edge-disjoint cycles {E_1, E_2, ..., E_k} in G such that all edges of G are in exactly one cycle and k is maximum. We present an algorithm to solve the pricing problem of a column generation Integer Linear Programming (ILP) model introduced by Lancia and Serafini (2016). Furthermore, we propose a greedy heuristic, which searches for minimum size cycles starting from a random vertex, and a heuristic based on partially solving the ILP model. We performed tests comparing the three approaches in relation to the quality of solutions and execution time, using distinct sets of Eulerian graphs, each set grouping graphs with different numbers of vertices and edges. Our experimental results show that the ILP based heuristic outperforms the other methods.
△ Less
Submitted 10 March, 2022;
originally announced March 2022.
-
J-PLUS: A catalogue of globular cluster candidates around the M81/M82/NGC3077 triplet of galaxies
Authors:
Ana L. Chies-Santos,
Rafael S. de Souza,
Juan P. Caso,
Ana I. Ennis,
Camila P. E. de Souza,
Renan S. Barbosa,
Peng Chen,
A. Javier Cenarro,
Alessandro Ederoclite,
David Cristóbal-Hornillos,
Carlos Hernández-Monteagudo,
Carlos López-Sanjuan,
Antonio Marín-Franch,
Mariano Moles,
Jesús Varela,
Héctor Vázquez Ramió,
Renato Dupke,
Laerte Sodré Jr.,
Raul E. Angulo
Abstract:
Globular clusters (GCs) are proxies of the formation assemblies of their host galaxies. However, few studies exist targeting GC systems of spiral galaxies up to several effective radii. Through 12-band Javalambre Photometric Local Universe Survey (J-PLUS) imaging, we study the point sources around the M81/M82/NGC3077 triplet in search of new GC candidates. We develop a tailored classification sche…
▽ More
Globular clusters (GCs) are proxies of the formation assemblies of their host galaxies. However, few studies exist targeting GC systems of spiral galaxies up to several effective radii. Through 12-band Javalambre Photometric Local Universe Survey (J-PLUS) imaging, we study the point sources around the M81/M82/NGC3077 triplet in search of new GC candidates. We develop a tailored classification scheme to search for GC candidates based on their similarity to known GCs via a principal components analysis (PCA) projection. Our method accounts for missing data and photometric errors. We report 642 new GC candidates in a region of 3.5 deg$^2$ around the triplet, ranked according to their Gaia astrometric proper motions when available. We find tantalising evidence for an overdensity of GC candidate sources forming a bridge connecting M81 and M82. Finally, the spatial distribution of the GC candidates $(g-i)$ colours is consistent with halo/intra-cluster GCs, i.e. it gets bluer as they get further from the closest galaxy in the field. We further employ a regression-tree based model to estimate the metallicity distribution of the GC candidates based on their J-PLUS bands. The metallicity distribution of the sample candidates is broad and displays a bump towards the metal-rich end. Our list increases the population of GC candidates around the triplet by 3-fold, stresses the usefulness of multi-band surveys in finding these objects, and provides a testbed for further studies analysing their spatial distribution around nearby (spirals) galaxies.
△ Less
Submitted 13 July, 2022; v1 submitted 23 February, 2022;
originally announced February 2022.
-
Sequence-to-Sequence Models for Extracting Information from Registration and Legal Documents
Authors:
Ramon Pires,
Fábio C. de Souza,
Guilherme Rosa,
Roberto A. Lotufo,
Rodrigo Nogueira
Abstract:
A typical information extraction pipeline consists of token- or span-level classification models coupled with a series of pre- and post-processing scripts. In a production pipeline, requirements often change, with classes being added and removed, which leads to nontrivial modifications to the source code and the possible introduction of bugs. In this work, we evaluate sequence-to-sequence models a…
▽ More
A typical information extraction pipeline consists of token- or span-level classification models coupled with a series of pre- and post-processing scripts. In a production pipeline, requirements often change, with classes being added and removed, which leads to nontrivial modifications to the source code and the possible introduction of bugs. In this work, we evaluate sequence-to-sequence models as an alternative to token-level classification methods for information extraction of legal and registration documents. We finetune models that jointly extract the information and generate the output already in a structured format. Post-processing steps are learned during training, thus eliminating the need for rule-based methods and simplifying the pipeline. Furthermore, we propose a novel method to align the output with the input text, thus facilitating system inspection and auditing. Our experiments on four real-world datasets show that the proposed method is an alternative to classical pipelines.
△ Less
Submitted 14 January, 2022;
originally announced January 2022.
-
Aggregated functional data model applied on clustering and disaggregation of UK electrical load profiles
Authors:
Gabriel Franco,
Camila P. E. de Souza,
Nancy L. Garcia
Abstract:
Understanding electrical energy demand at the consumer level plays an important role in planning the distribution of electrical networks and offering of off-peak tariffs, but observing individual consumption patterns is still expensive. On the other hand, aggregated load curves are normally available at the substation level. The proposed methodology separates substation aggregated loads into estim…
▽ More
Understanding electrical energy demand at the consumer level plays an important role in planning the distribution of electrical networks and offering of off-peak tariffs, but observing individual consumption patterns is still expensive. On the other hand, aggregated load curves are normally available at the substation level. The proposed methodology separates substation aggregated loads into estimated mean consumption curves, called typical curves, including information given by explanatory variables. In addition, a model-based clustering approach for substations is proposed based on the similarity of their consumers typical curves and covariance structures. The methodology is applied to a real substation load monitoring dataset from the United Kingdom and tested in eight simulated scenarios.
△ Less
Submitted 26 June, 2021; v1 submitted 21 June, 2021;
originally announced June 2021.
-
Parameter Estimation for Grouped Data Using EM and MCEM Algorithms
Authors:
Zahra A. Shirazi,
João Pedro A. R. da Silva,
Camila P. E. de Souza
Abstract:
Nowadays, the confidentiality of data and information is of great importance for many companies and organizations. For this reason, they may prefer not to release exact data, but instead to grant researchers access to approximate data. For example, rather than providing the exact measurements of their clients, they may only provide researchers with grouped data, that is, the number of clients fall…
▽ More
Nowadays, the confidentiality of data and information is of great importance for many companies and organizations. For this reason, they may prefer not to release exact data, but instead to grant researchers access to approximate data. For example, rather than providing the exact measurements of their clients, they may only provide researchers with grouped data, that is, the number of clients falling in each of a set of non-overlapping measurement intervals. The challenge is to estimate the mean and variance structure of the hidden ungrouped data based on the observed grouped data. To tackle this problem, this work considers the exact observed data likelihood and applies the Expectation-Maximization (EM) and Monte-Carlo EM (MCEM) algorithms for cases where the hidden data follow a univariate, bivariate, or multivariate normal distribution. Simulation studies are conducted to evaluate the performance of the proposed EM and MCEM algorithms. The well-known Galton data set is considered as an application example.
△ Less
Submitted 22 December, 2021; v1 submitted 5 June, 2021;
originally announced June 2021.
-
Mesoscale phase separation of skyrmion-vortex matter in chiral magnet-superconductor heterostructures
Authors:
José F. Neto,
Clécio C. de Souza Silva
Abstract:
We investigate theoretically the equilibrium configurations of many magnetic skyrmions interacting with many superconducting vortices in a superconductor-chiral magnet bilayer. We show that miscible mixtures of vortices and skyrmions in this system breaks down at a particular wave number for sufficiently strong coupling, giving place to remarkably diverse mesoscale patterns: gel, stripes, clusters…
▽ More
We investigate theoretically the equilibrium configurations of many magnetic skyrmions interacting with many superconducting vortices in a superconductor-chiral magnet bilayer. We show that miscible mixtures of vortices and skyrmions in this system breaks down at a particular wave number for sufficiently strong coupling, giving place to remarkably diverse mesoscale patterns: gel, stripes, clusters, intercalated stripes and composite gel-cluster structures. We also demonstrate that, by appropriate choice of parameters, one can thermally tune between the homogeneous and density-modulated phases.
△ Less
Submitted 30 December, 2021; v1 submitted 19 April, 2021;
originally announced April 2021.
-
On truncations of valuations
Authors:
Josnei Antonio Novacoski,
Caio Henrique Silva de Souza
Abstract:
In this paper we study the truncation $ν_q$ of a valuation $ν$ on a polynomial $q$. It is known that when $q$ is a key polynomial, then $ν_q$ is a valuation. It is also known that the converse does not hold. We show that when $q$ is a key polynomial, then $ν_q$ is the restriction of the truncation given by an optimizing root of $q$. We also discuss which conditions assure that $ν_q=ν$. Finally, we…
▽ More
In this paper we study the truncation $ν_q$ of a valuation $ν$ on a polynomial $q$. It is known that when $q$ is a key polynomial, then $ν_q$ is a valuation. It is also known that the converse does not hold. We show that when $q$ is a key polynomial, then $ν_q$ is the restriction of the truncation given by an optimizing root of $q$. We also discuss which conditions assure that $ν_q=ν$. Finally, we assume that $ν_q$ is a valuation and present some conditions, given in terms of the graded algebra, to assure that $q$ is a key polynomial.
△ Less
Submitted 17 April, 2021;
originally announced April 2021.
-
Solving the Minimum Convex Partition of Point Sets with Integer Programming
Authors:
Allan Sapucaia,
Pedro J. de Rezende,
Cid C. de Souza
Abstract:
The partition of a problem into smaller sub-problems satisfying certain properties is often a key ingredient in the design of divide-and-conquer algorithms. For questions related to location, the partition problem can be modeled, in geometric terms, as finding a subdivision of a planar map -- which represents, say, a geographical area -- into regions subject to certain conditions while optimizing…
▽ More
The partition of a problem into smaller sub-problems satisfying certain properties is often a key ingredient in the design of divide-and-conquer algorithms. For questions related to location, the partition problem can be modeled, in geometric terms, as finding a subdivision of a planar map -- which represents, say, a geographical area -- into regions subject to certain conditions while optimizing some objective function. In this paper, we investigate one of these geometric problems known as the Minimum Convex Partition Problem (MCPP). A convex partition of a point set $P$ in the plane is a subdivision of the convex hull of $P$ whose edges are segments with both endpoints in $P$ and such that all internal faces are empty convex polygons. The MCPP is an NP-hard problem where one seeks to find a convex partition with the least number of faces.
We present a novel polygon-based integer programming formulation for the MCPP, which leads to better dual bounds than the previously known edge-based model. Moreover, we introduce a primal heuristic, a branching rule and a pricing algorithm. The combination of these techniques leads to the ability to solve instances with twice as many points as previously possible while constrained to identical computational resources. A comprehensive experimental study is presented to show the impact of our design choices.
△ Less
Submitted 6 December, 2020;
originally announced December 2020.
-
Second layer data governance for permissioned blockchains: the privacy management challenge
Authors:
Paulo Henrique Alves,
Isabella Z. Frajhof,
Fernando A. Correia,
Clarisse de Souza,
Helio Lopes
Abstract:
Data privacy is a trending topic in the internet era. Given such importance, many challenges emerged in order to collect, manage, process, and publish data. In this sense, personal data have got attention, and many regulations emerged, such as GDPR in the European Union and LGPD in Brazil. This regulation model aims to protect users' data from misusage and leakage and allow users to request an exp…
▽ More
Data privacy is a trending topic in the internet era. Given such importance, many challenges emerged in order to collect, manage, process, and publish data. In this sense, personal data have got attention, and many regulations emerged, such as GDPR in the European Union and LGPD in Brazil. This regulation model aims to protect users' data from misusage and leakage and allow users to request an explanation from companies when needed. In pandemic situations, such as the COVID-19 and Ebola outbreak, the action related to sharing health data between different organizations is/ was crucial to develop a significant movement to avoid the massive infection and decrease the number of deaths. However, the data subject, i.e., the users, should have the right to request the purpose of data use, anonymization, and data deletion. In this sense, permissioned blockchain technology emerges to empower users to get their rights providing data ownership, transparency, and security through an immutable, unified, and distributed database ruled by smart contracts. The governance model discussed in blockchain applications is usually regarding the first layer governance, i.e., public and permissioned models. However, this discussion is too superficial, and they do not cover compliance with the data regulations. Therefore, in order to organize the relationship between data owners and the stakeholders, i.e., companies and governmental entities, we developed a second layer data governance model for permissioned blockchains based on the Governance Analytical Framework principles applied in pandemic situations preserving the users' privacy and their duties. From the law perspective, we based our model on the UE GDPR in regard to data privacy concerns.
△ Less
Submitted 22 October, 2020;
originally announced October 2020.
-
Short-time Monte Carlo simulation of the majority-vote model on cubic lattices
Authors:
K. P. do Nascimento,
L. C. de Souza,
André L. M. Vilela,
H. Eugene Stanley,
A. J. F. de Souza
Abstract:
We perform short-time Monte Carlo simulations to study the criticality of the isotropic two-state majority-vote model on cubic lattices of volume $N = L^3$, with $L$ up to $2048$. We obtain the precise location of the critical point by examining the scaling properties of a new auxiliary function $Ψ$. We perform finite-time scaling analysis to accurately calculate the whole set of critical exponent…
▽ More
We perform short-time Monte Carlo simulations to study the criticality of the isotropic two-state majority-vote model on cubic lattices of volume $N = L^3$, with $L$ up to $2048$. We obtain the precise location of the critical point by examining the scaling properties of a new auxiliary function $Ψ$. We perform finite-time scaling analysis to accurately calculate the whole set of critical exponents, including the dynamical critical exponent $z=2.027(9)$, and the initial slip exponent $θ= 0.1081(1)$. Our results indicate that the majority-vote model in three dimensions belongs to the same universality class of the three-dimensional Ising model.
△ Less
Submitted 27 August, 2020; v1 submitted 26 August, 2020;
originally announced August 2020.
-
Robust Image Retrieval-based Visual Localization using Kapture
Authors:
Martin Humenberger,
Yohann Cabon,
Nicolas Guerin,
Julien Morat,
Vincent Leroy,
Jérôme Revaud,
Philippe Rerole,
Noé Pion,
Cesar de Souza,
Gabriela Csurka
Abstract:
Visual localization tackles the challenge of estimating the camera pose from images by using correspondence analysis between query images and a map. This task is computation and data intensive which poses challenges on thorough evaluation of methods on various datasets. However, in order to further advance in the field, we claim that robust visual localization algorithms should be evaluated on mul…
▽ More
Visual localization tackles the challenge of estimating the camera pose from images by using correspondence analysis between query images and a map. This task is computation and data intensive which poses challenges on thorough evaluation of methods on various datasets. However, in order to further advance in the field, we claim that robust visual localization algorithms should be evaluated on multiple datasets covering a broad domain variety. To facilitate this, we introduce kapture, a new, flexible, unified data format and toolbox for visual localization and structure-from-motion (SFM). It enables easy usage of different datasets as well as efficient and reusable data processing. To demonstrate this, we present a versatile pipeline for visual localization that facilitates the use of different local and global features, 3D data (e.g. depth maps), non-vision sensor data (e.g. IMU, GPS, WiFi), and various processing algorithms. Using multiple configurations of the pipeline, we show the great versatility of kapture in our experiments. Furthermore, we evaluate our methods on eight public datasets where they rank top on all and first on many of them. To foster future research, we release code, models, and all datasets used in this paper in the kapture format open source under a permissive BSD license. github.com/naver/kapture, github.com/naver/kapture-localization
△ Less
Submitted 7 January, 2022; v1 submitted 27 July, 2020;
originally announced July 2020.