Search Results (196)

Phosphorylation, a reversible and widespread post-translational modification of proteins, is essential for numerous cellular processes. However, due to technical limitations, large-scale detection of phosphorylation sites, especially those infected by SARS-CoV-2, remains a challenging task. To address this gap, we propose a method called GBMPhos, a novel method that combines convolutional neural networks (CNNs) for extracting local features, gating mechanisms to selectively focus on relevant information, and a bi-directional gated recurrent unit (Bi-GRU) to capture long-range dependencies within protein sequences. GBMPhos leverages a comprehensive set of features, including sequence encoding, physicochemical properties, and structural information, to provide an in-depth analysis of phosphorylation sites. We conducted an extensive comparison of GBMPhos with traditional machine learning algorithms and state-of-the-art methods. Experimental results demonstrate the superiority of GBMPhos over existing methods. The visualization analysis further highlights its effectiveness and efficiency. Additionally, we have established a free web server platform to help researchers explore phosphorylation in SARS-CoV-2 infections. The source code of GBMPhos is publicly available on GitHub. Full article

Most of the current machine learning algorithms are applied to predict the jacking force required in micro-tunneling; in contrast, few studies about long-distance, large-section jacking projects have been reported in the literature. In this study, an intelligent framework, consisting of a differential evolution (DE), a bidirectional gated re-current unit (BiGRU), and attention mechanisms was developed to automatically identify the optimal hyperparameters and assign weights to the information features, as well as capture the bidirectional temporal features of sequential data. Based on field data from a pipe jacking project crossing underneath a canal, the model’s performance was compared with those of four conventional models (RNN, GRU, BiGRU, and DE–BiGRU). The results indicated that the DE–BiGRU–attention model performed best among these models. Then, the generalization performance of the proposed model in predicting jacking forces was evaluated with the aid of a similar case at the site. It was found that fine-tuning parameters for specific projects is essential for improving the model’s generalization performance. More generally, the proposed prediction model was found to be practically useful to professionals and engineers in making real-time adjustments to jacking parameters, predicting jacking force, and carrying out performance evaluations. Full article

Accurate prediction of the Remaining Useful Life (RUL) of lithium-ion batteries is essential for enhancing energy management and extending the lifespan of batteries across various industries. However, the raw capacity data of these batteries is often noisy and exhibits complex nonlinear degradation patterns, especially due to capacity regeneration phenomena during operation, making precise RUL prediction a significant challenge. Although various deep learning-based methods have been proposed, their performance relies heavily on the availability of large datasets, and satisfactory prediction accuracy is often achievable only with extensive training samples. To overcome this limitation, we propose a novel method that integrates sequence decomposition algorithms with an optimized neural network. Specifically, the Complementary Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) algorithm is employed to decompose the raw capacity data, effectively mitigating the noise from capacity regeneration. Subsequently, Particle Swarm Optimization (PSO) is used to fine-tune the hyperparameters of the Bidirectional Gated Recurrent Unit (BiGRU) model. The final BiGRU-based prediction model was extensively tested on eight lithium-ion battery datasets from NASA and CALCE, demonstrating robust generalization capability, even with limited data. The experimental results indicate that the CEEMDAN-PSO-BiGRU model can reliably and accurately predict the RUL and capacity of lithium-ion batteries, providing a promising and reliable method for RUL prediction in practical applications. Full article

Power consumption in the home has grown in recent years as a consequence of the use of varied residential applications. On the other hand, many families are beginning to use renewable energy, such as energy production, energy storage devices, and electric vehicles. As a result, estimating household power demand is necessary for energy consumption monitoring and planning. Power consumption forecasting is a challenging time series prediction topic. Furthermore, conventional forecasting approaches make it difficult to anticipate electric power consumption since it comprises irregular trend components, such as regular seasonal fluctuations. To address this issue, algorithms combining stationary wavelet transform (SWT) with deep learning models have been proposed. The denoised series is fitted with various benchmark models, including Long Short-Term Memory (LSTM), Gated Recurrent Units (GRUs), Bidirectional Gated Recurrent Units (Bi-GRUs), Bidirectional Long Short-Term Memory (Bi-LSTM), and Bidirectional Gated Recurrent Units Long Short-Term Memory (Bi-GRU LSTM) models. The performance of the SWT approach is evaluated using power consumption data at three different time intervals (1 min, 15 min, and 1 h). The performance of these models is evaluated using metrics such as Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), and Mean Absolute Error (MAE). The SWT/GRU model, utilizing the bior2.4 filter at level 1, has emerged as a highly reliable option for precise power consumption forecasting across various time intervals. It is observed that the bior2.4/GRU model has enhanced accuracy by over 60% compared to the deep learning model alone across all accuracy measures. The findings clearly highlight the success of the SWT denoising technique with the bior2.4 filter in improving the power consumption prediction accuracy. Full article

Accurately predicting carbon dioxide (CO₂) emissions is crucial for environmental protection. Currently, there are two main issues with predicting CO₂ emissions: (1) existing CO₂ emission prediction models mainly rely on Long Short-Term Memory (LSTM) and Gate Recurrent Unit (GRU) models, which can only model unidirectional temporal features, resulting in insufficient accuracy: (2) existing research on CO₂ emissions mainly focuses on designing predictive models, without paying attention to model optimization, resulting in models being unable to achieve their optimal performance. To address these issues, this paper proposes a framework for predicting CO₂ emissions, called CGAOA-AttBiGRU. In this framework, Attentional-Bidirectional Gate Recurrent Unit (AttBiGRU) is a prediction model that uses BiGRU units to extract bidirectional temporal features from the data, and adopts an attention mechanism to adaptively weight the bidirectional temporal features, thereby improving prediction accuracy. CGAOA is an improved Arithmetic Optimization Algorithm (AOA) used to optimize the five key hyperparameters of the AttBiGRU. We first validated the optimization performance of the improved CGAOA algorithm on 24 benchmark functions. Then, CGAOA was used to optimize AttBiGRU and compared with 12 optimization algorithms. The results indicate that the AttBiGRU optimized by CGAOA has the best predictive performance. Full article

With the global objectives of achieving a “carbon peak” and “carbon neutrality” along with the implementation of carbon reduction policies, China’s industrial structure has undergone significant adjustments, resulting in constraints on high-energy consumption and high-emission industries while promoting the rapid growth of green industries. Consequently, these changes have led to an increasingly complex power system structure and presented new challenges for electricity demand forecasting. To address this issue, this study proposes a 24-step multivariate time series short-term load forecasting algorithm model based on KNN data imputation and BiTCN bidirectional temporal convolutional networks combined with BiGRU bidirectional gated recurrent units and attention mechanism. The Kepler adaptive optimization algorithm (KOA) is employed for hyperparameter optimization to effectively enhance prediction accuracy. Furthermore, using real load data from a wind farm in Xinjiang as an example, this paper predicts the electricity load from 1 January to 30 December in 2019. Experimental results demonstrate that our comprehensive short-term load forecasting model exhibits lower prediction errors and superior performance compared to traditional methods, thus holding great value for practical applications. Full article

In recent years, deep learning (DL) methods, such as recurrent neural networks (RNN). have been used for streamflow prediction. In this study, the monthly inflow into the Dez Dam reservoir from 1955 to 2018 in southwestern Iran was simulated using various types of RNNs, including long short-term memory (LSTM), bidirectional long short-term memory (Bi-LSTM), gated recurrent unit (GRU), and stacked long short-term memory (Stacked LSTM). It was observed that considering flow discharge, temperature, and precipitation as inputs to the models yields the best results. Additionally, wavelet transform was employed to enhance the accuracy of the RNNs. Among the RNNs, the GRU model exhibited the best performance in simulating monthly streamflow without using wavelet transform, with RMSE, MAE, NSE, and R² values of 0.061 m³/s, 0.038 m³/s, 0.556, and 0.642, respectively. Moreover, in the case of using wavelet transform, the Bi-LSTM model with db5 mother wavelet and decomposition level 5 was able to simulate the monthly streamflow with high accuracy, yielding RMSE, MAE, NSE, and R² values of 0.014 m³/s, 0.008 m³/s, 0.9983, and 0.9981, respectively. Uncertainty analysis was conducted for the two mentioned superior models. To quantify the uncertainty, the concept of the 95 percent prediction uncertainty (95PPU) and the p-factor and r-factor criteria were utilized. For the GRU, the p-factor and r-factor values were 82% and 1.28, respectively. For the Bi-LSTM model, the p-factor and r-factor values were 94% and 1.06, respectively. The obtained p-factor and r-factor values for both models are within the acceptable and reliable range. Full article

An accurate forecast of typhoon tracks is crucial for disaster warning and mitigation. However, existing numerical weather prediction models, such as the Weather Research and Forecasting (WRF) model, still exhibit significant errors in track forecasts. This study aims to improve forecast accuracy by correcting WRF-forecasted tracks using deep learning models, including Bidirectional Long Short-Term Memory (BiLSTM) + Convolutional Long Short-Term Memory (ConvLSTM) + Wide and Deep Learning (WDL), BiLSTM + Convolutional Gated Recurrent Unit (ConvGRU) + WDL, and BiLSTM + ConvLSTM + Extreme Deep Factorization Machine (xDeepFM), with a comparison to the Kalman Filter. The results demonstrate that the BiLSTM + ConvLSTM + WDL model reduces the 72 h track prediction error (TPE) from 255.18 km to 159.23 km, representing a 37.6% improvement over the original WRF model, and exhibits significant advantages across all evaluation metrics, particularly in key indicators such as Bias², Mean Squared Error (MSE), and Sequence. The decomposition of MSE further validates the importance of the BiLSTM, ConvLSTM, WDL, and Temporal Normalization (TN) layers in enhancing the model’s spatio-temporal feature-capturing ability. Full article

In directed energy deposition (DED), accurately controlling and predicting melt pool characteristics is essential for ensuring desired material qualities and geometric accuracies. This paper introduces a robust surrogate model based on recurrent neural network (RNN) architectures—Long Short-Term Memory (LSTM), Bidirectional LSTM (Bi-LSTM), and Gated Recurrent Unit (GRU). Leveraging a time series dataset from multi-physics simulations and a three-factor, three-level experimental design, the model accurately predicts melt pool peak temperatures, lengths, widths, and depths under varying conditions. RNN algorithms, particularly Bi-LSTM, demonstrate high predictive accuracy, with an R-square of 0.983 for melt pool peak temperatures. For melt pool geometry, the GRU-based model excels, achieving R-square values above 0.88 and reducing computation time by at least 29%, showcasing its accuracy and efficiency. The RNN-based surrogate model built in this research enhances understanding of melt pool dynamics and supports precise DED system setups. Full article

The availability of a higher resolution fine spectral bandwidth in hyperspectral images (HSI) makes it easier to identify objects of interest in them. The inclusion of noise into the resulting collection of images is a limitation of HSI and has an adverse effect on post-processing and data interpretation. Denoising HSI data is thus necessary for the effective execution of post-processing activities like image categorization and spectral unmixing. Most of the existing models cannot handle many forms of noise simultaneously. When it comes to compression, available compression models face the problems of increased processing time and lower accuracy. To overcome the existing limitations, an image denoising model using an adaptive fusion network is proposed. The denoised output is then processed through a compression model which uses an optimized deep learning technique called "chaotic Chebyshev artificial hummingbird optimization algorithm-based bidirectional gated recurrent unit" (CCAO-BiGRU). All the proposed models were tested in Python and evaluated using the Indian Pines, Washington DC Mall and CAVE datasets. The proposed model underwent qualitative and quantitative analysis and showed a PSNR value of 82 in the case of Indian Pines and 78.4 for the Washington DC Mall dataset at a compression rate of 10. The study proved that the proposed model provides the knowledge about complex nonlinear mapping between noise-free and noisy HSI for obtaining the denoised images and also results in high-quality compressed output. Full article

Since the advent of smart agriculture, technological advancements in solar energy have significantly improved farming practices, resulting in a substantial revival of different crop yields. However, the smart agriculture industry is currently facing challenges posed by climate change. This involves multi-timeframe forecasts for greenhouse operators covering short-, medium-, and long-term intervals. Solar energy not only reduces our reliance on non-renewable electricity but also plays a pivotal role in addressing climate change by lowering carbon emissions. This study aims to find a method to support consistently optimal solar energy use regardless of changes in greenhouse conditions by predicting solar energy (kWh) usage on various time steps. In this paper, we conducted solar energy usage prediction experiments on time steps using traditional Tensorflow Keras models (TF Keras), including a linear model (LM), Convolutional Neural Network (CNN), stacked—Long Short Term Memory (LSTM), stacked-Gated recurrent unit (GRU), and stacked-Bidirectional—Long Short —Term Memory (Bi-LSTM), as well as Tensor-Flow-based models for solar energy usage data from a smart farm. The stacked-Bi-LSTM outperformed the other DL models with Root Mean Squared Error (RMSE) of 0.0048, a Mean Absolute Error (MAE) of 0.0431, and R-Squared (${\mathrm{R}}^2)$ of 0.9243 in short-term prediction (2-h intervals). For mid-term (2-day) and long-term (2-week) forecasting, the stacked Bi-LSTM model also exhibited superior performance compared to other deep learning models, with RMSE values of 0.0257 and 0.0382, MAE values of 0.1103 and 0.1490, and ${\mathrm{R}}^2$ values of 0.5980 and 0.3974, respectively. The integration of multi-timeframe forecasting is expected to avoid conventional solar energy use forecasting, reduce the complexity of greenhouse energy management, and increase energy use efficiency compared to single-timeframe forecasting models. Full article

Recurrent neural networks (RNNs) have significantly advanced the field of machine learning (ML) by enabling the effective processing of sequential data. This paper provides a comprehensive review of RNNs and their applications, highlighting advancements in architectures, such as long short-term memory (LSTM) networks, gated recurrent units (GRUs), bidirectional LSTM (BiLSTM), echo state networks (ESNs), peephole LSTM, and stacked LSTM. The study examines the application of RNNs to different domains, including natural language processing (NLP), speech recognition, time series forecasting, autonomous vehicles, and anomaly detection. Additionally, the study discusses recent innovations, such as the integration of attention mechanisms and the development of hybrid models that combine RNNs with convolutional neural networks (CNNs) and transformer architectures. This review aims to provide ML researchers and practitioners with a comprehensive overview of the current state and future directions of RNN research. Full article

This study explores a novel approach utilizing acoustic emission (AE) signaling technology for pipeline leakage detection and analysis. Pipeline leaks are a significant concern in the liquids and gases industries, prompting the development of innovative detection methods. Unlike conventional methods, which often require contact and visual inspection with the pipeline surface, the proposed time-series-based deep learning approach offers real-time detection with higher safety and efficiency. In this study, we propose an automatic detection system of pipeline leakage for efficient transportation of liquid (water) and gas across the city, considering the smart city approach. We propose an AE-based framework combined with time-series deep learning algorithms to detect pipeline leaks through time-series features. The time-series AE signal detection module is designed to capture subtle changes in the AE signal state caused by leaks. Sequential deep learning models, including long short-term memory (LSTM), bi-directional LSTM (Bi-LSTM), and gated recurrent units (GRUs), are used to classify the AE response into normal and leakage detection from minor seepage, moderate leakage, and major ruptures in the pipeline. Three AE sensors are installed at different configurations on a pipeline, and data are acquired at 1 MHz sample/sec, which is decimated to 4K sample/second for efficiently utilizing the memory constraints of a remote system. The performance of these models is evaluated using metrics, namely accuracy, precision, recall, F1 score, and convergence, demonstrating classification accuracies of up to 99.78%. An accuracy comparison shows that BiLSTM performed better mostly with all hyperparameter settings. This research contributes to the advancement of pipeline leakage detection technology, offering improved accuracy and reliability in identifying and addressing pipeline integrity issues. Full article

Sound Event Detection and Localization (SELD) is a comprehensive task that aims to solve the subtasks of Sound Event Detection (SED) and Sound Source Localization (SSL) simultaneously. The task of SELD lies in the need to solve both sound recognition and spatial localization problems, and different categories of sound events may overlap in time and space, making it more difficult for the model to distinguish between different events occurring at the same time and to locate the sound source. In this study, the Dual-conv Coordinate Attention Module (DCAM) combines dual convolutional blocks and Coordinate Attention, and based on this, the network architecture based on the two-stage strategy is improved to form the SELD-oriented Two-Stage Dual-conv Coordinate Attention Model (TDCAM) for SELD. TDCAM draws on the concepts of Visual Geometry Group (VGG) networks and Coordinate Attention to effectively capture critical local information by focusing on the coordinate space information of the feature map and dealing with the relationship between the feature map channels to enhance the feature selection capability of the model. To address the limitation of a single-layer Bi-directional Gated Recurrent Unit (Bi-GRU) in the two-stage network in terms of timing processing, we add to the structure of the two-layer Bi-GRU and introduce the data enhancement techniques of the frequency mask and time mask to improve the modeling and generalization ability of the model for timing features. Through experimental validation on the TAU Spatial Sound Events 2019 development dataset, our approach significantly improves the performance of SELD compared to the two-stage network baseline model. Furthermore, the effectiveness of DCAM and the two-layer Bi-GRU structure is confirmed by performing ablation experiments. Full article

Emotion recognition plays an increasingly important role in today’s society and has a high social value. However, current emotion recognition technology faces the problems of insufficient feature extraction and imbalanced samples when processing speech and text information, which limits the performance of existing models. To overcome these challenges, this paper proposes a multi-modal emotion recognition method based on speech and text. The model is divided into two channels. In the first channel, the extended Geneva Minimalistic Acoustic Parameter Set (eGeMAPS) feature set is extracted from OpenSmile, and the original eGeMAPS feature set is merged with the wavelet transformed eGeMAPS feature set. Then, speech features are extracted through a sparse autoencoder. The second channel extracts text features through the BERT-RoBERTa model. Then, deeper text features are extracted through a gated recurrent unit (GRU), and the deeper text features are fused with the text features. Emotions are identified by the attention layer, the dual-layer Bidirectional Long Short-Term Memory (BiLSTM) model, and the loss function, combined with cross-entropy loss and focus loss. Experiments show that, compared with the existing model, the WA and UA of this model are 73.95% and 74.27%, respectively, on the imbalanced IEMOCAP dataset, which is superior to other models. This research result effectively solves the problem of feature insufficiency and sample imbalance in traditional sentiment recognition methods, and provides a new way of thinking for sentiment analysis application. Full article