Search Results (1,391)

Image–text matching is a fundamental task in the multimodal research field, connecting computer vision and natural language processing by aligning visual content with corresponding textual descriptions. Accurate matching is critical for applications such as image captioning and text-based image retrieval yet remains challenging due to the differences in data modalities. This paper addresses these challenges by proposing a robust image–text matching model inspired by Contrastive Language–Image Pre-training (CLIP). Our approach employs the Vision Transformer (ViT) model as the image encoder and Bidirectional Encoder Representations from Transformers (Bert) as the text encoder, integrating these into a shared vector space to measure semantic similarity. We enhance the model’s training efficiency using the LiT-tuning paradigm to optimize learning through a cosine decay strategy for dynamic adjustment of the learning rate. We validate our method on two benchmark datasets, WuKong and Flickr30k, demonstrating that our model achieves superior performance and significantly improves key evaluation metrics. The results underscore the model’s effectiveness in achieving accurate and robust image–text alignment. Full article

Tomato fungal diseases can cause significant economic losses to farmers. Advanced disease detection methods based on symptom recognition in images face challenges when identifying fungal diseases in tomatoes, especially with limited training images. This study utilized novel techniques designed for limited data scenarios, such as one-shot and few-shot learning, to identify three tomato fungal diseases, i.e., Alternaria solani, Alternaria alternata, and Botrytis cinerea. Automated feature extraction was performed using the ResNet-12 deep model, and a cosine similarity approach was employed during shot learning. The accuracy of diagnosing the three diseases and healthy leaves using the 4-way 1-shot learning method was 91.64, 92.37, 92.93, and 100%. For the 4-way 3-shot learning method, the accuracy improved to 92.75, 95.07, 96.63, and 100%, respectively. These results demonstrate that the proposed method effectively reduces the dependence on experts labeling images, working well with small datasets and enhancing plant disease identification. Full article

Existing rotated object detection methods usually use angular parameters to represent the object orientation. However, due to the symmetry and periodicity of these angular parameters, a well-known boundary discontinuity problem often results. More specifically, when the object orientation angle approaches the periodic boundary, the predicted angle may change rapidly and adversely affect model training. To address this problem, this paper introduces a new method that can effectively solve the boundary discontinuity problem related to angle parameters in rotated object detection. Our approach involves a novel vector-based encoding and decoding technique for angular parameters, and a cosine distance loss function for angular accuracy evaluation. By utilizing the characteristics of unit vectors and cosine similarity functions, our method parameterizes the orientation angle as components of the unit vector during the encoding process and redefines the orientation angle prediction task as a vector prediction problem, effectively avoiding the boundary discontinuity problem. The proposed method achieved a mean average precision (mAP) of 87.48% and an average cosine similarity (CS) of 0.997 on the MVTec test set. It also achieved an mAP score of 90.54% on the HRSC2016 test set, which is better than several existing state-of-the-art methods and proves its accuracy and effectiveness. Full article

This paper presents the development and application of the JADESCA optimization algorithm for solving complex engineering design problems, including the welded beam, pressure vessel, spring, and speed reducer design problems. JADESCA, a hybrid algorithm that combines elements of JADE (differential evolution with adaptive parameters) and the sine cosine algorithm (SCA), is evaluated against a range of benchmark functions from the CEC2022 competition as well as specific engineering problems. The algorithm’s performance is analyzed through convergence curves, search history diagrams, and statistical results. In engineering design problems, JADESCA consistently demonstrates superior performance by achieving optimal or near-optimal solutions with high precision and consistency. In particular, JADESCA outperforms 25 state-of-the-art optimizers over the CEC2022 benchmark functions, further proving its robustness and adaptability. Statistical comparisons and Wilcoxon rank-sum tests reinforce the superiority of JADESCA in achieving competitive results across various test cases, solidifying its effectiveness in handling complex, constrained optimization problems for engineering applications. Full article

Recent advancements in low-rank adaptation (LoRA) have shown its effectiveness in fine-tuning diffusion models for generating images tailored to new downstream tasks. Research on integrating multiple LoRA modules to accommodate new tasks has also gained traction. One emerging approach constructs several LoRA modules, but more than three typically decrease the generation performance of pre-trained models. The mixture-of-experts model solves the performance issue, but LoRA modules are not combined using text prompts; hence, generating images by combining LoRA modules does not dynamically reflect the user’s desired requirements. This paper proposes a LoRA fusion method that applies an attention mechanism to effectively capture the user’s text-prompting intent. This method computes the cosine similarity between predefined keys and queries and uses the weighted sum of the corresponding values to generate task-specific LoRA modules without the need for retraining. This method ensures stability when merging multiple LoRA modules and performs comparably to fully retrained LoRA models. The technique offers a more efficient and scalable solution for domain adaptation in large language models, effectively maintaining stability and performance as it adapts to new tasks. In the experiments, the proposed method outperformed existing methods in text–image alignment and image similarity. Specifically, the proposed method achieved a text–image alignment score of 0.744, surpassing an SVDiff score of 0.724, and a normalized linear arithmetic composition score of 0.698. Moreover, the proposed method generates superior semantically accurate and visually coherent images. Full article

Accurate electricity demand forecasting is crucial for ensuring the sustainability and reliability of power systems. Least square support vector machines (LSSVM) are well suited to handle complex non-linear power load series. However, the less optimal regularization parameter and the Gaussian kernel function in the LSSVM model have contributed to flawed forecasting accuracy and random generalization ability. Thus, these parameters of LSSVM need to be chosen appropriately using intelligent optimization algorithms. This study proposes a new hybrid model based on the LSSVM optimized by the improved bacterial foraging optimization algorithm (IBFOA) for forecasting the short-term daily electricity load in Peninsular Malaysia. The IBFOA based on the sine cosine equation addresses the limitations of fixed chemotaxis constants in the original bacterial foraging optimization algorithm (BFOA), enhancing its exploration and exploitation capabilities. Finally, the load forecasting model based on LSSVM-IBFOA is constructed using mean absolute percentage error (MAPE) as the objective function. The comparative analysis demonstrates the model, achieving the highest determination coefficient (R²) of 0.9880 and significantly reducing the average MAPE value by 28.36%, 27.72%, and 5.47% compared to the deep neural network (DNN), LSSVM, and LSSVM-BFOA, respectively. Additionally, IBFOA exhibits faster convergence times compared to BFOA, highlighting the practicality of LSSVM-IBFOA for short-term load forecasting. Full article

High-resolution planetary remote sensing imagery provides detailed information for geomorphological and topographic analyses. However, acquiring such imagery is constrained by limited deep-space communication bandwidth and challenging imaging environments. Conventional super-resolution methods typically employ separate models for different scales, treating them as independent tasks. This approach limits deployment and real-time applications in planetary remote sensing. Moreover, capturing global context is crucial in planetary remote sensing images due to their contextual similarities. To address these limitations, we propose Discrete Cosine Transform (DCT)–Global Super Resolution Neural Operator (DG-SRNO), a global context-aware arbitrary-scale super-resolution model. DG-SRNO achieves super-resolution at any scale using a single framework by learning the mapping between low-resolution (LR) and high-resolution (HR) function spaces. We mathematically prove the global receptive field of DG-SRNO. To evaluate DG-SRNO’s performance in planetary remote sensing tasks, we introduce the Ceres 800 dataset, a planetary remote sensing super-resolution dataset. Extensive quantitative and qualitative experiments demonstrate DG-SRNO’s impressive reconstruction capabilities. Full article

In view of the fact that the technology of polarization detection performs better at identifying targets through clouds and fog, the recognition ability of the space target detection system under haze conditions will be improved by applying the technology. However, due to the low ambient brightness and limited target radiation information during space target detection, the polarization information of space target is seriously lost, and the advantages of polarization detection technology in identifying targets through clouds and fog cannot be effectively exerted under the condition of haze detection. In order to solve the above problem, a dehazing enhancement strategy specifically applied to polarization images of space targets is proposed. Firstly, a hybrid multi-channel interpolation method based on regional correlation analysis is proposed to improve the calculation accuracy of polarization information during preprocessing. Secondly, an image processing method based on full polarization information inversion is proposed to obtain the degree of polarization of the image after inversion and the intensity of the image after dehazing. Finally, the image fusion method based on discrete cosine transform is used to obtain the dehazing polarization fusion enhancement image. The effectiveness of the proposed image processing strategy is verified by carrying out simulated and real space target detection experiments. Compared with other methods, by using the proposed image processing strategy, the quality of the polarization images of space targets obtained under the haze condition is significantly improved. Our research results have important practical implications for promoting the wide application of polarization detection technology in the field of space target detection. Full article

The flower-growing sector in Latin America presents significant health risks for workers, which highlights the need for technological updates in their production processes. Likewise, outdated machinery leads to losses that need to be avoided. The method of productive innovation developed in this document involves optimizing a mechanism of agricultural machinery used in carnation classification. The optimization is achieved by minimizing the jerk of the mechanism’s movement using metaheuristic methods. The results of three metaheuristic methods are compared against a brute force methodology. Optimization using these metaheuristic methods allows for achieving satisfactory results with up to 98% time reduction in the optimization process. This jerk optimization gives a longer useful life to the machinery, reduces the production stops needed for maintenance from once an hour to once every three hours, and reduces the damage done by the machine to the carnation stems. Full article

In this study, we consider the problem of self-supervised learning (SSL) utilizing the 1-Wasserstein distance on a tree structure (a.k.a., Tree-Wasserstein distance (TWD)), where TWD is defined as the L1 distance between two tree-embedded vectors. In SSL methods, the cosine similarity is often utilized as an objective function; however, it has not been well studied when utilizing the Wasserstein distance. Training the Wasserstein distance is numerically challenging. Thus, this study empirically investigates a strategy for optimizing the SSL with the Wasserstein distance and finds a stable training procedure. More specifically, we evaluate the combination of two types of TWD (total variation and ClusterTree) and several probability models, including the softmax function, the ArcFace probability model, and simplicial embedding. We propose a simple yet effective Jeffrey divergence-based regularization method to stabilize optimization. Through empirical experiments on STL10, CIFAR10, CIFAR100, and SVHN, we find that a simple combination of the softmax function and TWD can obtain significantly lower results than the standard SimCLR. Moreover, a simple combination of TWD and SimSiam fails to train the model. We find that the model performance depends on the combination of TWD and probability model, and that the Jeffrey divergence regularization helps in model training. Finally, we show that the appropriate combination of the TWD and probability model outperforms cosine similarity-based representation learning. Full article

This study proposes the Pairwise Attention Enhancement (PAE) model to address the limitations of the Vision Transformer (ViT). While the ViT effectively models global relationships between image patches, it encounters challenges in medical image analysis where fine-grained local features are crucial. Although the ViT excels at capturing global interactions within the entire image, it may potentially underperform due to its inadequate representation of local features such as color, texture, and edges. The proposed PAE model enhances local features by calculating cosine similarity between the attention maps of training and reference images and integrating attention maps in regions with high similarity. This approach complements the ViT’s global capture capability, allowing for a more accurate reflection of subtle visual differences. Experiments using Clock Drawing Test data demonstrated that the PAE model achieved a precision of 0.9383, recall of 0.8916, F1-Score of 0.9133, and accuracy of 92.69%, showing a 12% improvement over API-Net and a 1% improvement over the ViT. This study suggests that the PAE model can enhance performance in computer vision fields where local features are crucial by overcoming the limitations of the ViT. Full article

Investigation of the generalized trigonometric and hyperbolic functions containing two parameters has been a very active research area over the last decade. We believe, however, that their monotonicity and convexity properties with respect to parameters have not been thoroughly studied. In this paper, we make an attempt to fill this gap. Our results are not complete; for some functions, we manage to establish (log)-convexity/concavity in parameters, while for others, we only managed the prove monotonicity, in which case we present necessary and sufficient conditions for convexity/concavity. In the course of the investigation, we found two hypergeometric representations for the generalized cosine and hyperbolic cosine functions which appear to be new. In the last section of the paper, we present four explicit integral evaluations of combinations of generalized trigonometric/hyperbolic functions in terms of hypergeometric functions. Full article

This study addresses the challenge of automating the creation of Exchange Information Requirements (EIRs) for construction projects using Building Information Modelling (BIM) and Digital Twins, as specified in the ISO 19650 standard. This paper focuses on automating the classification of EIR paragraphs according to the ISO 19650 standard’s categories, aiming to improve information management in construction projects. It addresses a gap in applying AI to enhance BIM project management, where barriers often include technological limitations, a shortage of specialists, and limited understanding of the methodology. The proposed method uses Word2Vec for text vectorisation and Support Vector Machines (SVMs) with an RBF kernel for text classification, and it attempts to apply Word2Vec with cosine similarity for text generation. The model achieved an average F1 score of 0.7, with predicted categories for provided sentences and similar matches for selected phrases. While the text classification results were promising, further refinement is required for the text generation component. This study concludes that integrating AI tools such as Word2Vec and SVM offers a feasible solution for enhancing EIR creation. However, further development of text generation, particularly using advanced techniques such as GPT, is recommended. These findings contribute to improving managing complex construction projects and advancing digitalization in the AECO sector. Full article

Nanosatellites increasingly produce more data than can be downlinked within a reasonable time due to their limited bandwidth and power. Therefore, an on-board system is required to prioritize scientifically significant data for downlinking, as described by scientists. This paper determines whether natural language processing can be used to prioritize remote sensing images on CubeSats with more flexibility compared to existing methods. Two approaches implementing the same conceptual prioritization pipeline are compared. The first uses YOLOv8 and Llama2 to extract image features and compare them with text descriptions via cosine similarity. The second approach employs CLIP, fine-tuned on remote sensing data, to achieve the same. Both approaches are evaluated on real nanosatellite hardware, the VERTECS Camera Control Board. The CLIP approach, particularly the ResNet50-based model, shows the best performance in prioritizing and sequencing remote sensing images. This paper demonstrates that on-orbit prioritization using natural language descriptions is viable and allows for more flexibility than existing methods. Full article

The purpose of this paper is to investigate some Morse-type oscillators. In its original form, it is a model for describing the vibrations of a diatomic molecule. The Morse potential generalizes the harmonic oscillator by introducing deviations from the classical theoretical model. In the present study, we perturbed the Morse differential equation by several periodic terms based on the $\mathrm{cosine}$ function and by a damping term. The frequency is driven by different coefficients. The size of the deviations is controlled by another constant. We provide two modifications w.r.t. the damping term. The Melnikov approach is applied as an indicator of the possible chaotic opportunities. We also propose a novel approach for stochastic control of the perturbations. It is based on the assumption that the coefficients of the periodic terms are the probabilities of underlying distribution. As a result, the dynamics are driven by its characteristic function. Several applications are considered. We demonstrate some specialized modules for investigating the dynamics of the proposed models, along with the synthesis of radiating antenna patterns. Full article