Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Next Article in Journal
Mesenchymal Stem Cell Plasticity: What Role Do Culture Conditions and Substrates Play in Shaping Biomechanical Signatures?
Previous Article in Journal
Mechanical Stretch Control of Adipocyte AKT Signaling and the Role of FAK and ROCK Mechanosensors
Previous Article in Special Issue
Breath-Holding as a Stimulus to Assess Peripheral Oxygenation Flow Using Near-Infrared Spectroscopic Imaging
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Enhancing Multispectral Breast Imaging Quality Through Frame Accumulation and Hybrid GA-CPSO Registration

by
Tsabeeh Salah M. Mahmoud
1,
Adnan Munawar
1,
Muhammad Zeeshan Nawaz
1 and
Yuanyuan Chen
1,2,3,4,*
1
Medical School, Faculty of Medicine, Tianjin University, Tianjin 300072, China
2
State Key Laboratory of Advanced Medical Materials and Devices, Tianjin University, Tianjin 300072, China
3
Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300072, China
4
Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072, China
*
Author to whom correspondence should be addressed.
Bioengineering 2024, 11(12), 1281; https://doi.org/10.3390/bioengineering11121281
Submission received: 16 October 2024 / Revised: 4 December 2024 / Accepted: 10 December 2024 / Published: 17 December 2024
(This article belongs to the Special Issue Optical Imaging for Biomedical Applications)

Abstract

:
Multispectral transmission imaging has emerged as a promising technique for imaging breast tissue with high resolution. However, the method encounters challenges such as low grayscale, noisy transmission images with weak signals, primarily due to the strong absorption and scattering of light in breast tissue. A common approach to improve the signal-to-noise ratio (SNR) and overall image quality is frame accumulation. However, factors such as camera jitter and respiratory motion during image acquisition can cause frame misalignment, degrading the quality of the accumulated image. To address these issues, this study proposes a novel image registration method. A hybrid approach combining a genetic algorithm (GA) and a constriction factor-based particle swarm optimization (CPSO), referred to as GA-CPSO, is applied for image registration before frame accumulation. The efficiency of this hybrid method is enhanced by incorporating a squared constriction factor (SCF), which speeds up the registration process and improves convergence towards optimal solutions. The GA identifies potential solutions, which are then refined by CPSO to expedite convergence. This methodology was validated on the sequence of breast frames taken at 600 nm, 620 nm, 670 nm, and 760 nm wavelength of light and proved the enhancement of accuracy by various mathematical assessments. It demonstrated high accuracy (99.93%) and reduced registration time. As a result, the GA-CPSO approach significantly improves the effectiveness of frame accumulation and enhances overall image quality. This study explored the groundwork for precise multispectral transmission image segmentation and classification.

Graphical Abstract

1. Introduction

Breast cancer is a major global health issue, and is the most common cancer worldwide across various regions and socioeconomic backgrounds [1,2]. In 2020, it accounted for approximately 2.3 million new cases and 685,000 deaths, emphasizing its widespread impact [1]. Early detection is crucial for reducing mortality rates and improving treatment outcomes, underscoring the ongoing need for advancements in screening and prevention [3,4]. Current breast cancer screening methods include mammography [5], ultrasound [6], magnetic resonance imaging (MRI), and clinical breast exams [7,8]. While mammography is common, concerns about ionizing radiation persist [5]. Ultrasound may miss early-stage cancers, particularly in dense breast tissue [9], and MRI, though sensitive, is costly [10]. Clinical breast exams may also fail to detect early indicators. Thus, safer and more effective screening techniques are urgently needed for early detection.
Optical imaging has emerged as a promising alternative, using visible and near-infrared light for possible early breast cancer detection. It is cost-effective, free of radiation, and potentially suitable for home use [11,12].
Since Cheatle’s study of breast optical properties in 1929 [13], researchers have been working towards developing optical techniques that may contribute to the early diagnosis of breast diseases. The initial efforts focused on transmission imaging [14,15], which sought to detect breast abnormalities by visualizing lumps and vascular structures but often faced issues with accuracy. Recently, multispectral imaging has gained considerable attention as a potential solution to the limitations of traditional transmission imaging. Given that biological tissues have various components with unique absorption spectra, multispectral light passing through these tissues can produce monochromatic spectral images that reflect their absorption characteristics. This approach leverages the different absorption and scattering properties of tissues at multiple wavelengths, offering more detailed information that aids in identifying lesions [16]. As a result, multispectral transmission imaging—an integration of transmission and multispectral techniques—has become a valuable area of preclinical studies that may complement existing imaging techniques for early breast cancer screening [17].
However, challenges arise in breast tissue due to strong scattering and absorption characteristics, resulting in low grayscale, noisy transmission images with weak signals.
Low signal intensity affects the signal-to-noise ratio (SNR) and image quality adversely. Frame accumulation is widely used to improve the low SNR and enhance grayscale resolution [18]. Specifically, this approach integrates a given number of image frames by summing up the corresponding pixel values. The resultant image contains the accumulated signal with improved SNR [19,20]. However, the effectiveness of the frame accumulation technique in enhancing image quality may be compromised due to relative displacements between individual image frames [21,22]. The potential sources for such displacements between successive image frames include camera jitter and respiratory motion, particularly for tissue where the respiratory movement is more pronounced (e.g., breast tissues) [23]. The presence of relative displacements significantly hampers the effectiveness of SNR improvement through frame accumulation.
Image registration is an image processing technique designed to rectify relative frame displacement and enhance the accuracy of frame accumulation [24,25]. The process of image registration initiates with extracting features, such as the signal intensity of each pixel, from individual image frames. Subsequently, a suitable transformation model is selected for feature matching of different frames [26,27]. To align multiple frames with a standard reference frame [28,29], transformative operations may include corrections for changes in scale, rotation, translation, and even deformations [30,31]. Optimization techniques, such as gradient descent [32], Powell’s method [33], particle swarm optimization (PSO) [34], genetic algorithms (GAs) [35], and deep learning-based approaches [36,37], are employed to iteratively adjust transformation parameters for optimal frame alignment [38]. Finally, a cost function, acting as a similarity metric, is implemented to quantify the similarity between reference and moving images. Commonly used cost functions encompass mean squared error (MSE) [39], mutual information (MI) [40], and normalized cross-correlation (NCC) [41,42]. The frame alignment achieved through image registration facilitates accurate comparison, analysis, and combination of images.
The statement of the problem for this study was to address the displacement of image frames during sequential acquisition, which arises from respiration-associated movements and camera jitter. These displacements compromise the accuracy of frame accumulation and subsequently degrade image quality. In this study, a novel technique to improve the accuracy of image registration during frame accumulation was employed. Briefly, a hybrid approach integrated the use of GAs and CPSO algorithms for image registration. The strong global search capabilities of GAs provided the coarse refinement, while the CPSO algorithm was effective in fine-tuning. By combining these two algorithms, the hybrid GA-CPSO approach enhanced the accuracy of the image registration process. Additionally, a squared constriction factor (SCF) was introduced in the CPSO algorithm, referred to as the SCF-based CPSO algorithm, which increased the speed of registration. Validation of the approach was performed using multispectral breast images at four wavelengths: 600 nm, 620 nm, 670 nm, and 760 nm. The results demonstrated a significant improvement in registration accuracy and time efficiency, evaluated through multiple metrics and compared with other methods. The results demonstrated that the GA-CPSO technique improved the accuracy of frame accumulation for sequentially acquired images, leading to measurable enhancements in image quality, indicated by improvements in image quality metrics such as contrast, edge sharpness, and focus.

2. Theories and Methods

2.1. Squared Constriction Factor-Based Particle Swarm Optimization (CPSO) Algorithm

The PSO involves a collection of entities referred to as a swarm, with each member termed a particle. Visualized as points within the search space, particles aim to converge towards positions where optimized results are discerned [43]. In the pursuit of PSO, optimal outcomes of individual particles are adapted by considering their prior experiences and interactions with neighboring particles. This study used the PSO algorithm due to its effectiveness, simplicity, ease of implementation, applicability to diverse problems, and strong global optimization capabilities, all of which contribute to enhance image quality and registration [44]. The formulation of the PSO algorithm can be expressed as:
v i t + 1 = w t v i t + c 1 ·   rand   ·   p _ best   i x i t + c 2 · r a n d · g best   x i t
w t + 1 = w t + d w ;   d w = w m i n w m a x T
x i t + 1 = x i t + v i t + 1
During iteration t , x i   denotes the i th particle moving with a velocity vector v i , p _ b e s t i   refers to the personal best of x i , and   g b e s t represents the global best among all particles. The weight w , along with acceleration constants c 1 and c 2 , influences the particle’s movement. The term “rand” corresponds to a random number uniformly distributed between 0 to 1 [45].
During image registration in PSO, the particle x signifies the transform parameter underestimation. The p _ b e s t i   corresponds to the minimum MSE (i.e., the cost function) for each particle [46,47]. The determination of g b e s t is based on the cluster MSE.
A constriction factor is introduced to regulate the particle velocities throughout the optimization process, which encourages a balance between exploration and exploitation. The constriction factor imposes a limit on the maximum particle velocity to ensure convergence toward the best solution while preventing excessive particle movement.
The conventional constriction factor (χ) is calculated using the acceleration constants c 1 and c 2 to update the velocity, such that
χ = 2 2 2 4 ,     w h e r e   = c 1 + c 2 ,   > 4
The velocity equation of the i th particle with χ can be calculated as
v i t + 1 = χ [ w t v i t + c 1 ·   rand   · p best   i x i t + c 2 · r a n d · g best   x i t ]
A novel approach of this study was introducing a squared constriction factor ( χ 2 ) to the PSO algorithm (SCF-based CPSO). This approach amplified the benefits of the conventional constriction factor (CCF)-based CPSO. Specifically, using SCF, our approach effectively emphasized the influence of the regularization mechanism, contributing to improved convergence dynamics.
The SCF-based CPSO algorithm exhibits commendable local optimization capabilities. However, when the initial particle positions are randomly selected, it not only prolongs the early-stage search process in CPSO but also raises the risk of getting trapped in local extremes. To address this challenge, we propose the integration of a genetic algorithm (GA) to serve as the initial point for CPSO. By utilizing the best solutions obtained from the GA to initialize CPSO particles, we aimed to mitigate the disadvantages of random initialization, enhancing the efficiency of the optimization process and minimizing the likelihood of converging to local extremums.

2.2. Genetic Algorithm

Gas are a widely used optimization technique based on natural selection and genetic mechanisms [48,49]. GAs use an evolutionary process to find optimal solutions for intricate problems. They initialize with a population of potential solutions, each represented as individuals (chromosomes). Over successive generations, these individuals undergo processes reminiscent of natural selection, crossover, and mutation [48,50].
In image registration, the selection phase hinges on choosing individuals based on their fitness, reflecting their efficacy in addressing the registration task. Crossover strategically combines genetic information from two parent solutions to produce offspring, while mutation introduces subtle random variations. This cyclic process persists, with fitter individuals being more likely to be chosen, ultimately driving the algorithm toward optimal or near-optimal solutions. GAs are particularly suitable for image registration applications because of their capacity to explore a wide solution space.
The GA employed in this study consisted of the following parameters:
  • A population size of 50 chromosomes;
  • The Roulette wheel method for selection of individual reproduction;
  • The mean squared error (MSE) as fitness evaluation function;
  • A one-point crossover operation with a probability of 0.8;
  • Introduction of Gaussian noise (mimicking mutation process) with a probability of 0.05;
  • Execution of GA for 50 generations (i.e., iterations) to identify optimal solution space.

2.3. Cost Function (Similarity Metric)

The objective was to use the hybrid GA-CPSO algorithm to effectively register and align the moving image with the fixed image, optimizing the cost function used in this study, which was the mean squared error (MSE). The cost function evaluated the alignment of the fixed and moving images during image registration. MSE is a widely used similarity metric in image registration due to its simplicity and effectiveness in quantifying image similarity [51]. MSE quantified the similarity between two images by calculating the average squared differences of pixel intensities at corresponding locations, as given by
M S E I F , I M = 1 n   i = 1 n I F ( i ) I M ( T i , p ) 2
where I F   and I M are representations of the fixed image and moving image, respectively, the variable ‘ n ’ signifies the total pixel count in the image. ‘T’ denotes the transformation applied to the moving image using two-dimensional parameters p ( t x , t y , θ) before proceeding with the MSE calculation. The transformation parameters include translation in the x and y directions, as well as the rotation angle θ.
The translation parameters and the rotation angle were initially set to zero ( t x = 0 , t y = 0 , θ = 0). However, these parameters were continuously updated throughout the process to achieve the best alignment between the two images during the execution of the hybrid GA-CPSO algorithm.
In this process, the GA first conducted a global search to identify optimal regions within the solution space by simulating evolutionary processes, treating the translation and rotation parameters as individuals in a population. The best values identified by the GA then served as the initial swarm positions for the CPSO phase. This strategic approach ensured that the CPSO starts with a refined set of parameters, enhancing its efficiency in fine-tuning the alignment. CPSO leveraged the social behavior of particles, adjusting the translation and rotation parameters ( t x ,   t y , θ) towards the most promising solutions based on both individual and collective achievements. By integrating the global search capabilities of GAs with the precise optimization of CPSO, the algorithm ensured a seamless and progressively accurate adjustment of the transformation parameters for optimal image alignment.
Figure 1 presents a schematic of the GA-CPSO algorithm for image registration. Briefly, the algorithm initialized by assuming image transformation parameters between the fixed image ( I F ) and the moving image ( I M ) at zero (i.e., t x = 0 , t y = 0 , θ = 0). In the first phase (i.e., execution of GA), random values were generated for the population of potential solutions, followed by MSE calculation between I F and I M for each individual in the population. Algorithm iteration continuously improved (i.e., reduced MSE) the population through selection, crossover, and mutation operations, until either the maximum number of generations or convergence of optimization. At this stage, the final values of transformation parameters were obtained, which served as input for the second phase of the algorithm (i.e., execution of CPSO), where the initial positions and velocities of the particles were adjusted. Afterwards, the MSE was recalculated to iteratively update the particles’ positions until the personal best ( p best   ) and global best ( g best   ) were achieved. The SCF ensured precise convergence to the global optimum. The process repeated until the CPSO phase reached the maximum iteration, outputting the final optimized parameters ( t x , t y , θ), which were applied to transform the moving image for precise alignment with the fixed image.

2.4. Principles of Frame Accumulation

Breast multispectral transmission imaging often yields a weak SNR with low grayscale due to the turbid nature of biological tissues. Frame accumulation is a promising technique to enhance such weak signals effectively. Currently, there are two primary approaches to achieve frame accumulation: superimposing multiple frame images and extending the frame integration time. While extending the frame integration time can increase signal strength, it often leads to issues such as image overexposure or blurring, thereby compromising image quality. Consequently, in this study, we adopted the method of accumulating multiple frame images captured at different times to improve the overall image quality by enhancing signal strength and reducing noise.
If x s represents the ideal signal in the image, and x n represents the random noise carried in the image, then the image SNR is:
S N R 1 = x s σ
where σ represents the standard deviation of the random noise. After frame accumulation of m frames of images, the standard deviation of the noise within the signal is reduced to / m . Consequently, the SNR of the image can be calculated as follows:
S N R m = i = 1 m x s i i = 1 m σ / m = m S N R 1
This formula indicates that through the process of frame accumulation, the SNR of the image is effectively increased by a factor of m .

2.5. Evaluation Metrics

The accuracy of the proposed image registration method was evaluated using several metrics, including correlation coefficient (CC), MI, root mean square error (RMSE), and registration accuracy.
The CC is a measure of the linear relationship between pixel intensities between two images [52], given as
C C = x = 1 m y = 1 n ( I F x , y I F ¯ ( I R e g x , y I R e g ¯ ) ] [ x = 1 m y = 1 n ( I F x , y I F ¯ ) 2 × x = 1 m y = 1 n ( I R e g x , y I R e g ¯ ) 2 ]
A value of 1 indicates a perfect positive linear correlation (i.e., identical images), a −1 implies a perfect negative correlation, while 0 indicates no linear correlation.
The MI measures the statistical dependence between the intensity distributions of two images, signifying the information each image provides about the other.
M I = x = 1 m y = 1 n P ( I F ( x , y ) ,   I R e g ( x , y ) ) × o g   P I F x , y , I R e g x , y P I F x , y × P ( I R e g x , y )
In image registration, maximizing MI aids in identifying the optimal alignment by evaluating the deviation of their joint intensity distribution from the product of their distributions [53].
The root mean square error (RMSE) calculates the average magnitude of pixel-wise differences between the registered and reference images, offering a measure of overall dissimilarity. Mathematically,
R M S E = 1 m × n x = 1 m y = 1 n ( I F x , y I R e g ( x , y ) ) 2
Smaller RMSE values indicate superior alignment, signifying close matching of pixel intensity between the registered and reference images.
Accuracy, derived from the set of moving and alignment parameters, is computed as
A = 1 3 | X x | X + | Y y | Y + | R r | R × 100 %
where x and y   are the pixel intensities at corresponding positions in the fixed image ( I F ) and registered image ( I R e g ), while m and n show the number of rows and columns, respectively. I F ¯ shows the average of the intensity values of fixed image ( I F ), and I R e g ¯ shows the average of the intensity values of the registered image ( I R e g ) . P I F x , y is the probability distribution of pixel intensities in the image I F . P ( I R e g x , y ) is the probability distribution of pixel intensities in the image I R e g x , y . P ( I F x , y , I R e g ( x , y ) ) is the joint probability distribution of pixel intensities in images I F and I R e g .
The following metrics were used to evaluate the image quality after applying the registration and accumulation techniques.
The gray level (GL) characterizes the grayscale resolution of the image, signifying its informational content, with higher values indicating increased contrast [52].
The standard deviation (SD) quantifies the degree of pixel intensity variation, offering insights into image clarity, as given by
S D = 1 m × n x = 1 m y = 1 n ( f ( x , y ) μ ) 2 ,   where   μ = 1 m × n x = 1 m y = 1 n f ( x , y )
where m and n represent the total number of rows and columns in the image, and f(x,y) denotes the gray value at the x th row and y th column.
Entropy quantifies the randomness and complexity of pixel distribution, providing information about image texture:
  Entropy   = x = 0 g P ( x ) l o g 2 P ( x )
where P(x) signifies the probability of a pixel having the value x in the image, and g is the range of gray values.
The energy of image gradient (EOG) represents the energy of image gradients, offering insights into the image’s sharpness and structural details as [52]
E O G = x = 1 m y = 1 n [ ( f x + 1 , y f ( x , y ) ) 2 + ( f x , y + 1 f ( x , y ) ) 2 ]
The Brenner gradient function (BGF) measures image sharpness by analyzing intensity variations between adjacent pixels as follows [54]
B G F = x = 1 m y = 1 n [ f x + 2 , y f ( x , y ) ] 2
The multiple of the modulus of gray difference (MMD) quantifies the sharpness and contrast of an image, offering insights into the image’s clarity and feature distinction as:
M M D = x = 1 m y = 1 n | f ( x , y ) f ( x + 1 , y ) | | f ( x , y ) f ( x , y + 1 ) |

3. Experimental Validation

To assess the efficacy of the proposed approach, we developed a multispectral breast transmission imaging system. The imaging setup was developed for pre-clinical evaluation and may not meet the standardization requirements for clinical diagnostic imaging. The focus was on demonstrating the technical feasibility of the GA-CPSO algorithm in improving image quality under experimental conditions. This section delineates the experimental setup, outlines the image acquisition process, and elaborates on the subsequent image processing steps.

3.1. Experimental Setup

The experimental setup comprised three primary components: an illumination system, an image acquisition module, and an image processing unit. The optical illumination for breast tissues consisted of four different LED systems, each emitting light at specific wavelengths (i.e., 600 nm, 620 nm, 670 nm, and 760 nm). This selection of optical wavelengths was informed by the light absorption properties of tumor tissues and the sensitivity range of the mobile phone camera, ensuring optimal detection capabilities. Moreover, for each wavelength, the LED system comprised 64 LEDs arranged in an 8 × 8 square matrix (all the LEDs in this array were designed to emit light at the same wavelength). This system was powered by portable lithium batteries, the highest current is 2.8 A; for the 600 nm and 620 nm LEDs the voltage supplied is 21 V, while for the 670 nm and 760 nm LEDs it is 14.8 V. An iPhone 12 Pro-Max rear camera was used to record videos of the human breast. The image processing was performed with an Acer desktop PC (Model Shangqi X4270) equipped with MATLAB version 2022a and Python 3.9.
Figure 2 shows a schematic of the image acquisition process.

3.2. Image Acquisition

To initiate the experiment, the breast tissue was positioned to be directly illuminated by the light source while maintaining a 6 cm separation. The image acquisition unit was composed of a glass sheet supported by six plastic bars, each 6 cm in length, to ensure a consistent 6 cm gap between the light source and the breast. The plastic bars were wrapped in black tape to prevent any light leakage during the image acquisition process. The unit was placed over the LED light source to ensure controlled and consistent illumination. Additionally, the entire experiment was conducted in a fully dark room to avoid any external light interference. Figure 3 illustrates the experimental setup.
The handheld phone camera’s distance was adjusted and oriented to ensure complete breast tissue coverage and precise focus. It was ensured that the light was transmitted effectively without excessive camera glare. The data were acquired with the mobile phone camera by recording a 10 s video for each wavelength. This process was repeated for both subjects across all four wavelengths, resulting in a comprehensive dataset. The video frame rate was set to 60 frames per second (fps) for 600, 620, and 670 nm, and 30 fps for the 760 nm wavelength. This variation in frame rates was due to the camera’s automatic adjustment, with the brighter wavelengths (600 nm, 620 nm, and 670 nm) set to 60 fps and the darker 760 nm wavelength adjusted to 30 fps to optimize image quality. The first frame for each wavelength image is shown in Figure 4 and Figure 5 for both subjects, respectively.

Declaration

Volunteers were recruited as subjects, participating voluntarily after providing informed consent with full understanding of the study. All experiments were conducted in accordance with relevant ethical guidelines and the laws of the People’s Republic of China. The study followed the ethical standards of the Tianjin University ethics committee.

3.3. Image Processing

The processing of multispectral breast images will be illustrated using an example obtained with the 670 nm illumination from Subject 1. However, the described image processing steps—image pre-processing, multi-frame image registration, and frame accumulation—were applied consistently to the data collected, as detailed in Section 3.2, from both subjects across all wavelengths. A thorough explanation of the image processing methodology is provided in Section 3.3.1, Section 3.3.2 and Section 3.3.3

3.3.1. Image Pre-Processing

Initially, 600 individual frames were extracted from the acquired video using Python software. Each extracted frame was in RGB format with a resolution of 3840 × 2160 pixels. Each frame was separated into distinct R, G, and B channels, resulting in   I R , I G , and I B . The average of these three channels for each frame resulted in the corresponding grayscale images.
We employed an image enhancement technique to address the low contrast in grayscale images. Specifically, a mean denoising filter was applied in all images to enhance the image quality. The denoised images were obtained by averaging pixel values in local 4 × 4 neighborhoods, effectively reducing image noise. This denoised image can be used for further processing, such as image registration. This process suppressed noise and enhanced the image.

3.3.2. Multi-Frame Image Registration

Either adjacent frames or all frames can be registered concerning a single reference image. In this study, the latter approach was implemented by registering all other images (moving images) to the first frame image (referred to as the fixed image). The latter method reduces superposition errors between images. In particular, the hybrid GA-CPSO image registration process was implemented by selecting the first two frames, where the first frame was designated as the fixed image ( I F ) while the second frame was denoted as the moving image ( I M ).
1.
The transformation process was initiated by applying initial input parameters ( t x = 0 , t y = 0 ,   θ = 0 ) to the moving image.
2.
The MSE between the fixed image and the transformed moving image was computed using Equation (6), which quantified the dissimilarity between the two images.
3.
The GA and CPSO techniques were integrated for optimal image registration. The GA was executed for a specified number of generations (gaMaxGen), wherein each individual’s fitness is evaluated using the objective function. Roulette wheel selection was employed for the selection operation, and the population was updated accordingly. The one-point crossover was implemented with a specified probability, facilitating gene exchange beyond a randomly chosen crossover point. Additionally, mutation introduced Gaussian noise with a certain probability, promoting genetic diversity.
Following the GA’s optimization, the best values obtained (the value of t x , t y , and θ ) were utilized to initialize particles in the CPSO phase. The constriction factor in CPSO was a critical parameter influencing particle movement in the optimization process. It was used to balance the exploration and exploitation phases. The constriction factor limited the particle’s velocity, preventing excessive movement and guiding the swarm toward optimal solutions. The proposed SCF in CPSO enhanced convergence speed and solution quality, offering improved optimization performance and stability in hybrid algorithms (Table 1). Specifically, tracking the best positions for each particle and the global best position ensured robust convergence. The “global best position” refers to the set of translation and rotation parameters ( t x ,   t y , and θ ) that result in the highest degree of alignment between the fixed and moving images, as determined by the lowest mean squared error (MSE). The final results were displayed, and the optimal translation and rotation was applied to register the moving image precisely with the fixed image, as depicted in Figure 6. The black edges in the registered image (c) indicate the shifts along the x and y axes, as well as the rotation, reflecting the changes in image alignment.
Table 1 highlights the significant advantages of the SCF in the CPSO algorithm compared to the CCF. The SCF-based CPSO achieved faster registration times, obtaining optimal values in early iterations and showcasing its efficiency in image registration. This notable difference underscores the enhanced algorithm’s superiority over CCF-based CPSO regarding both speed and effectiveness.
Figure 7 visually depicts the MSE evolution throughout the registration process, initiating from an initial value of 8.069 and steadily converging to its minimum of 6.081 by the 47th iteration. The consistent and minimal fluctuations underscored the effectiveness of the GA-CPSO algorithm in mitigating premature convergence and oscillations around suboptimal solutions. By integrating a SCF in the CPSO algorithm, the enhanced approach achieved a delicate balance between exploration and exploitation, ensuring resilience against local optimal. The resulting transformation parameters at the minimum MSE value were (x = −1.4994, y = −0.5014, θ = 0.05) highlighting the algorithm’s capability to yield accurate and stable solutions during the registration process.

3.3.3. Frame Accumulation

The novel registration method enhanced the alignment of the image sequence, which was further improved by accumulating 20 frames, as shown in Figure 8. By employing the GA-CPSO method for registration before accumulation, the approach significantly improved the signal-to-noise ratio and grayscale contrast of the images. Specifically, applying registration before accumulation improves image quality, especially noticeable in edge clarity where indicators are placed. To better illustrate the improved quality achieved by our method, we have selectively cropped the right areas of interest that show significant differences in Figure 8a,b. These regions are then magnified and displayed in Figure 8c,d, allowing for a clearer comparison of the enhancements.

4. Results and Discussion

This section evaluates the performance of the proposed hybrid GA-CPSO registration algorithm, demonstrating its significant improvements in registration accuracy and time efficiency compared to conventional methods. The method enhances the alignment of multispectral breast images. When combined with frame accumulation, it further improves overall image quality by increasing the signal-to-noise ratio, grayscale contrast, and edge clarity.

4.1. The Registration Method’s Performance Evaluation

To validate the efficiency of the novel registration algorithm proposed in this study, we conducted a thorough analysis of the registration outcomes using the set of moving images acquired with multispectral transmission of the breast tissue. To evaluate the similarity between the registered moving images and the reference image, the metrics employed were CC (Equation (9)), MI (Equation (10)), RMSE (Equation (11)), and accuracy (Equation (12)).

4.1.1. Comparison of Image Registration: CPSO vs. GA-CPSO Algorithm

We began with a set of moving images and applied specific translational and rotational transformations to create transformed reference images. These transformations included shifts in both the horizontal and vertical directions, as well as rotations by predefined angles. The original moving images were then registered to these transformed reference images using both the CPSO algorithm and the hybrid GA-CPSO-based SCF algorithm. The goal was to evaluate how accurately each method could align the moving images with the transformed reference images. The results of the registration accuracy for both methods are summarized in Table 2 and Table 3.
An example of this process is illustrated in Figure 9 for Subject 2 at 670 nm. The reference image was shifted by (25, −20, 5) and then the original (moving) image was registered to this transformed reference using the GA-CPSO algorithm, resulting in the aligned image.
Table 2 and Table 3 show that the hybrid GA-CPSO algorithm consistently outperformed CPSO alone for both subjects, achieving over 99% accuracy across all wavelengths. For Subject 1 (Table 2), the highest accuracy of 99.939% occurred with a shift of (50, −50, 10) at 670 nm. Similarly, Subject 2 (Table 3) showed a maximum accuracy of 99.935% at 760 nm with a shift of (−80, 60, 15). These results demonstrate the superior performance of GA-CPSO, particularly in handling large and small displacements, improving registration accuracy and image alignment across all cases.

4.1.2. Comparison of Image Registration: GA-CPSO Algorithm vs. Other Registration Methods

The moving images captured at four different wavelengths (600, 620, 670, and 760 nm) were registered using three distinct techniques: the proposed hybrid GA-CPSO algorithm, the Powell algorithm [54], and the terrace compression method with normalized MI (TC-NMI) [55]. The results of these comparisons, as summarized in Table 4, are based on data from Subject 1. This analysis highlights the advantages of our method in terms of registration accuracy and registration time efficiency compared to the previous approaches.
For the GA-CPSO algorithm employed for images acquired at 600 nm, a robust linear relationship between the registered and fixed images was indicated by CC~0.9950, substantial shared information by MI~4.2474, and minimal differences RMSE~1.5129; these metrics were superior to the alternative methods of the Powell algorithm and the terrace compression. Similarly, for images acquired at 620, 670, and 760 nm, the GA-CPSO method consistently outperformed other methods in all evaluation metrics. Furthermore, our method demonstrated particularly superior performance in mean squared error (MSE), achieving the best value at 670 nm, which was 1.1218, in stark contrast to the TC-NMI method’s 15.1538, indicating the superior alignment capability of our method. Additionally, in the Powell algorithm at wavelength 620 nm, the MSE was 9.2852, and at 760 nm, it was 10.7126, while our method maintained the lowest values, 1.6419 and 2.9488, respectively, further substantiating the superior accuracy and efficiency of the hybrid GA-CPSO algorithm in image registration across all tested wavelengths.
Moreover, the GA-CPSO approach demonstrated substantially higher efficiency for registration time at all four wavelengths. The image registration time for the proposed GA-CPSO algorithm has been significantly reduced compared to the CCF-based PSO algorithm (Table 1) and other reported techniques (Table 4). Specifically, the image registration time for the GA-CPSO algorithm was an order of magnitude smaller than the Powell algorithm and TC-NMI algorithm, with times of 406.5 s for GA-CPSO compared to 3638.6 s and 3515.1 s, respectively. This trend was consistently observed for images acquired at all four wavelengths (600 nm, 620 nm, 670 nm, and 760 nm). Overall, these differences highlight the efficiency of the hybrid GA-CPSO method, making it an attractive choice for image registration with high precision and speed.

4.2. Evaluation of Frame Accumulation Performance After Registration

The impact of frame accumulation following registration was evaluated by comparing the image quality metrics for frame accumulation alone (i.e., without registration) and frame accumulation integrated with GA-CPSO-based registration. The results for Subject 1 are illustrated in Figure 10, showing how registration improves image quality based on metrics such as the energy of image gradient, Brenner gradient function, gray level, standard deviation, and entropy. The results for Subject 2 are presented in Table 5, which compares the image quality of 20 frames accumulated directly with 20 frames accumulated after registration. This table highlights the improvements in image quality achieved by integrating the GA-CPSO-based registration with the frame accumulation process across all wavelengths. Figure 11 provides a visual comparison for Subject 2 at 620 nm, further confirming the enhancement of overall image quality achieved through registration before accumulation.
The results presented in Table 5 demonstrate significant improvements in image quality when registration is integrated with frame accumulation across all wavelengths. For example, at 620 nm, the EOG increased from (4.2420 × 106) for direct accumulation to (1.6499 × 107) after registration, marking a 3.89-fold improvement. This pattern of enhancement is consistent across all wavelengths, with the 670 nm wavelength showing the highest improvement in EOG, with a 4-fold increase from (4.0418 × 106) to (1.6144 × 107).
Additionally, other metrics such as Brenner gradient, gray level, standard deviation, and entropy saw notable improvements. For the gray level, the highest improvement occurred at 600 nm, increasing from (42.1654) to (49.5544), while SD and entropy metrics also showed substantial gains across all wavelengths, particularly at 670 nm, where SD increased from (25.0007) to (29.9015) and entropy from (6.0492) to (7.6781) in 620 nm. These enhancements collectively indicate that registration is essential for improving not only the sharpness and contrast but also the overall dynamic range and clarity of the images.
Figure 10 visually confirms the quantitative improvements seen in Table 5. The direct accumulation image shows more blurring and less clarity, while the image after registration displays enhanced sharpness and detail, especially in regions affected by motion or misalignment. This visual comparison aligns with the metrics shown in Table 5, validating that the registration step before accumulation plays a crucial role in improving image quality.
Moving to Figure 11 (a result of Subject 2), the quality enhancement brought by registration is further reinforced through a comparison of multiple frames. Here, the plotted metrics demonstrate the quantitative differences between frame accumulation alone and frame accumulation with GA-CPSO-based registration. As more frames are accumulated, the differences between the two methods become increasingly pronounced, with registration consistently improving sharpness, contrast, and detail retention. The increasing gap in metrics such as Brenner gradient and energy of image gradient further highlights the critical role of registration in reducing motion artifacts and enhancing the overall quality of multispectral breast images.
To further extend the comparative analyses, the performance of the GA-CPSO algorithm was also compared with another recently documented image registration technique, the repeated pair image registration and accumulation (RPIRA) based on the gradient descent method [52]. For this comparison, the evaluation metrics including EOG, BGF, and MMD were utilized. Briefly, EOG quantifies the sharpness of image edges, BGF measures image focus, and MMD indicates image contrast. To ensure consistency, we repeated the frame accumulation and registration process using the same methodology described in the RPIRA method, applying both registration algorithms to the same dataset of 20 frames acquired at 670 nm for Subject 1.
An objective comparison of the GA-CPSO and RPIRA methods, based on these metrics, is presented in Table 6. In particular, the EOG values were higher for the GA-CPSO technique than the RPIRA method (10.09 vs. 8.58), indicating sharper edges in images processed with GA-CPSO. Moreover, the GA-CPSO algorithm demonstrated a substantially higher BGF, and consequently better image focus, compared to the RPIRA method (11.35 vs. 1.69). Similarly, the significantly higher MMD metric for the GA-CPSO algorithm revealed superior contrast preservation. It is worth noting that the RPIRA method relies on gradient descent as the registration algorithm, which appears to be less effective than the GA-CPSO approach in preserving image quality metrics. Collectively, these results demonstrate that the GA-CPSO algorithm outperforms the RPIRA method in all evaluated metrics, underscoring its enhanced effectiveness in frame accumulation.
To further expand the comparative analyses, the GA-CPSO technique was compared with the Powell and the TC-NMI algorithms. To enable a one-to-one comparison, three image quality metrics (i.e., EOG, Brenner, and MMD) were computed for GA-CPSO algorithm after accumulating 10 frames of the images acquired at 670 nm. Table 7 presents a summary of these comparative analyses. Overall, the highest performance across all three performance metrics was demonstrated by the GA-CPSO algorithm. Specifically, the GA-CPSO algorithm archived higher EOG metric values, compared to the Powell and TC-NMI algorithms (6.979 × 106, 4.964 × 105, and 1.873 × 105, respectively). This indicates superior edge preservation of the image with the GA-CPSO algorithm. Similarly, the Brenner metric, which evaluates image focus, was 4.908 × 106 for GA-CPSO, compared to 6.329 × 105 for Powell and 2.508 × 105 for TC-NMI methods. Finally, the MMD value for GA-CPSO algorithm was 9.871 × 105, compared to 1.981 × 104 for Powell and 9.472 × 103 for TC-NMI techniques. These results of the objective comparison highlights the superior performance of GA-CPSO method in improving the accumulated image quality, in comparison to the reported techniques. It may be mentioned that, compared to Powell and TC-NMI algorithms, the GA-CPSO algorithm also illustrated better performance in terms of CC, MI, RMSE, and registration time (Table 4). Taken together, the GA-CPSO technique outperformed both the Powell and the TC-NMI algorithms based on a comprehensive set of metrics: CC, MI, RMSE, and registration time to assess registration accuracy and efficiency, and EOG, Brenner, and MMD to evaluate the final image quality after registration and frame accumulation.

4.3. The GA-CPSO Registration Method’s Efficiency in Mitigating Ghosting Effects

The efficiency of the GA-CPSO registration algorithm in mitigating ghosting effects during frame accumulation was evaluated. Figure 12 visually demonstrates the effectiveness of our approach in enhancing image accuracy and quality, with a specific focus on minimizing ghosting phenomena. This improvement is more pronounced in the areas within the indicators.
Figure 12a depicts a cropped section from the initial frame of a breast image captured at a 670 nm wavelength. Subsequently, Figure 12b portrays the same cropped region from a directly accumulated image of 20 frames at a 670 nm wavelength, revealing noticeable blurring or ghosting effects. These artifacts typically result from slight frame displacements induced by factors such as camera jitter or environmental disturbances during the image capture process. Figure 12c shows the diminished ghosting effect achieved by employing image registration, specifically the GA-CPSO-enhanced algorithm, prior to frame accumulation. The evident reduction in ghosting effects in Figure 12c improved image quality and enhanced accuracy in frame accumulation facilitated by our registration methodology.
Building upon these improvements, the enhancements in metrics such as CC, MI, and RMSE directly translate to improved alignment of multispectral images. The potential of the GA-CPSO algorithm to improve the SNR through accurate registration and frame accumulation reduces the likelihood of false positives or negatives, ensuring more reliable diagnoses. Additionally, by mitigating ghosting and motion artifacts caused by patient movement or respiratory-induced displacements, the hybrid algorithm ensures clearer and more interpretable images, essential for identifying tissue heterogeneity or vascular abnormalities across different wavelengths. The enhanced image quality also supports multispectral imaging’s ability to capture tissue-specific absorption and scattering properties, which are vital for distinguishing between malignant and benign tissues. The algorithm’s robustness enables integration with automated diagnostic systems, streamlining workflows. While focused on breast imaging, its adaptability extends to other modalities like optical coherence tomography and ultrasound, ensuring precise image registration.
Previous studies have reported diverse methods for image registration. For instance, a dual approach of using the TC-NMI method for registering multispectral breast phantom images has been documented [55]. However, this method was computation-intensive and time-consuming, partially due to the grayscale information. Another approach for medical image registration combined a modified MI metric with PSO, successfully incorporating both statistical and spatial information, achieving accurate registration results across CT and MRI images [56]. Moreover, this approach was extended by incorporating the Powell search algorithm to align infrared and visual images [57]. Additionally, a PSO sample consensus (PSO-SC) algorithm was developed for remote sensing image registration to improve the precision of image alignment [38]. The Powell algorithm was applied to optimize the NMI similarity metric to multispectral breast images [58], but this method took too much registration time, lacking time efficiency. The present study combined the global search capabilities of GAs with the fine-tuning attributes of the PSO algorithm in tandem with the SCF. With this novel approach, the speed of image registration and accuracy of frame alignment were significantly improved in multispectral breast images.

5. Comparison with Previous Studies

Frame displacement in sequential images acquired at different time points compromise accuracy of frame accumulation and overall image quality. A number of algorithms have been designed to eliminate variance in matching of different image frames [59]. For multispectral breast images, the registration accuracy was enhanced by using the gradient descent algorithm and summing the pixel values of multi-wavelength signals at each pixel point prior to image registration [60]. This technique resulted in a CC of ~0.668, MI of ~2.294, and RMSE of ~7.0416 for breast images captured at 620 nm [60]. A strategy integrating frame accumulation and image registration mediated by NMI was used to improve the accuracy and quality of image registration for breast transmission images [54]. Moreover, this hybrid approach diminished the image jitter-related issues and amplified operation speed [54]. The EOG, Brenner gradient, and MMD reported for breast images at 600 nm were 1.5956 × 108, 1.9440 × 108, and 3.8986 × 107, respectively [54]. In another novel approach, multispectral breast images were registered and accumulated in pairs. Briefly, from the acquired sequence, registration (based on the RPIRA method) of the first pair of multispectral breast images was followed by the registration and accumulation of next pair of images. Iteration of this process continued until all image frames of the sequence were processed. The final image thus obtained demonstrated improved accuracy. This algorithm resulted in a CC of ~0.979 and an MI of ~3.600 for breast images acquired at 600 nm [52]. For comparison, the values EOG, Brenner gradient, and MMD for the GA-CPSO technique used in this study were 1.009 × 107, 1.135 × 108, and 1.423 × 106, respectively.
To detect and correct for patient movement during imaging, a 3D rigid transformation was decomposed in two orthogonal 2D projections (i.e., in-plane transformations and out-of-plane rotations) with the use of an approximate geometric relationship. These 2D projections were then combined and converted back to a 3D rigid transformation, using a 2D–3D geometric transformation. This 2D–3D image registration algorithm claimed to provide a sub-millimeter accuracy for the frame accumulation [61]. This approach demonstrated an error (i.e., frame displacement) of 0.38, 0.21, and 0.76 mm in the directions of anterior/posterior (x-axis), left/right (y-axis), and superior/inferior (z-axis), respectively [61]. Moreover, the Powell method also offers a simple and fast algorithm for image registration. This algorithm has been integrated with other contemporary methods to increase the accuracy of medical image registration. For instance, the Powell algorithm in tandem with histogram equalization of images showed improved accuracy for frame accumulation, in terms of SNR, MSE, time-efficiency, and CC [58]. This technique resulted in an MI of ~1.906, normalized MI of ~1.255, and NCC of ~0.920 for breast images [58]. Likewise, a dual approach with Powell and slime mold algorithms enabled improved registration accuracy by homogenizing the local maxima [62].

6. Conclusions

This study demonstrated a substantial enhancement in the quality of multispectral transmission imaging of breast tissue through the utilization of the GA-CPSO algorithm for image registration before frame accumulation. By effectively optimizing the GA-CPSO approach, it overcomes challenges such as camera jitter and respiratory-induced frame displacement, significantly enhancing image quality. The hybrid method achieves high accuracy (~99.93%). The registration method’s efficiency was evaluated using multiple metrics, including registration accuracy, correlation coefficient (CC), mutual information (MI), and root mean square error (RMSE), and was compared with two other methods, demonstrating superior performance in both accuracy and time efficiency. Consequently, this method not only improves CPSO registration accuracy but also enhances the effectiveness of frame accumulation technology, showing superior performance in reducing artifacts and noise, and improving contrast and pixel intensity distribution of accumulated image. The quality of the images was further evaluated using metrics such as the energy of image gradient (EOG), Brenner gradient, gray level (GL), standard deviation (SD), and entropy, all of which showed marked improvements after the integration of registration with frame accumulation. The integration of our registration method with frame accumulation significantly enhances the signal-to-noise ratio (SNR) and overall image quality of multispectral images, providing a strong foundation for further processing techniques such as segmentation and the detection of breast tissue anomalies. The observed improvements in image quality suggest the potential of the GA-CPSO framework for complementing the existing imaging techniques in early breast cancer detection. However, further studies with standardized clinical imaging setups are necessary to validate its diagnostic utility.

Author Contributions

T.S.M.M.: Conceptualization, Methodology, Software, Validation, Formal analysis, Investigation, Visualization, Writing—Original Draft, Writing—Review & Editing. A.M.: Software, Validation. M.Z.N.: Writing—Review & Editing. Y.C.: Writing—Review, Supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the National Key Research and Development Program of China (No. 2023YFF1204300) and National Natural Science Foundation of China (82202249).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Tianjin University Ethics Committee (Approval Code: TJUE-2024-327, Approval Date: 24 May 2024).

Informed Consent Statement

Informed consent, including written consent for publication, was obtained from all subjects involved in the study.

Data Availability Statement

Data supporting the findings of this study are contained within the article.

Acknowledgments

We extend our gratitude to the Key Laboratory of Biomedical Detecting Techniques at Tianjin University for their invaluable equipment and support.

Conflicts of Interest

The authors confirm that no potential conflicts of interest, financial or personal, could have influenced the work reported in this paper.

References

  1. Bray, F.; Laversanne, M.; Sung, H.; Ferlay, J.; Siegel, R.L.; Soerjomataram, I.; Jemal, A. Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 2024, 74, 229–263. [Google Scholar] [CrossRef]
  2. Ferlay, J.; Colombet, M.; Soerjomataram, I.; Mathers, C.; Parkin, D.M.; Piñeros, M.; Znaor, A.; Bray, F. Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods. Int. J. Cancer 2019, 144, 1941–1953. [Google Scholar] [CrossRef]
  3. Fuentes, J.D.; Morgan, E.; de Luna Aguilar, A.; Mafra, A.; Shah, R.; Giusti, F.; Vignat, J.; Znaor, A.; Musetti, C.; Yip, C.H.; et al. Global Stage Distribution of Breast Cancer at Diagnosis: A Systematic Review and Meta-Analysis. JAMA Oncol. 2024, 10, 71–78. [Google Scholar] [CrossRef]
  4. Fransen, M.P.; Damman, O.C.; Bas, S.; Uiters, E.; Timmermans, D.R. Decision-making in breast cancer screening: A qualitative exploration of the match between women’s beliefs and screening information in the Netherlands. Patient Educ. Couns. 2024, 122, 108155. [Google Scholar] [CrossRef] [PubMed]
  5. Uematsu, T. Rethinking screening mammography in Japan: Next-generation breast cancer screening through breast awareness and supplemental ultrasonography. Breast Cancer 2024, 31, 24–30. [Google Scholar] [CrossRef]
  6. Iacob, R.; Iacob, E.R.; Stoicescu, E.R.; Ghenciu, D.M.; Cocolea, D.M.; Constantinescu, A.; Ghenciu, L.A.; Manolescu, D.L. Evaluating the Role of Breast Ultrasound in Early Detection of Breast Cancer in Low- and Middle-Income Countries: A Comprehensive Narrative Review. Bioengineering 2024, 11, 262. [Google Scholar] [CrossRef] [PubMed]
  7. Kuhl, C.K.; Schrading, S.; Leutner, C.C.; Morakkabati-Spitz, N.; Wardelmann, E.; Fimmers, R.; Kuhn, W.; Schild, H.H. Mammography, breast ultrasound, and magnetic resonance imaging for surveillance of women at high familial risk for breast cancer. J. Clin. Oncol. 2005, 23, 8469–8476. [Google Scholar] [CrossRef] [PubMed]
  8. Warner, E.; Plewes, D.B.; Hill, K.A.; Causer, P.A.; Zubovits, J.T.; Jong, R.A.; Cutrara, M.R.; DeBoer, G.; Yaffe, M.J.; Messner, S.J.; et al. Surveillance of BRCA1 and BRCA2 Mutation Carriers with Magnetic Resonance Imaging, Ultrasound, Mammography, and Clinical Breast Examination. JAMA 2005, 293, 1317–1325. [Google Scholar]
  9. Munteanu, B.Ş.; Murariu, A.; Nichitean, M.; Pitac, L.G.; Dioşan, L. Value of Original and Generated Ultrasound Data Towards Training Robust Classifiers for Breast Cancer Identification. Inf. Syst. Front. 2024. [Google Scholar] [CrossRef]
  10. Sardanelli, F.; Magni, V.; Rossini, G.; Kilburn-Toppin, F.; Healy, N.A.; Gilbert, F.J. The paradox of MRI for breast cancer screening: High-risk and dense breasts—Available evidence and current practice. Insights Imaging 2024, 15, 96. [Google Scholar] [CrossRef] [PubMed]
  11. Butt, S.S.; Fida, I.; Fatima, M.; Khan, M.S.; Mustafa, S.; Khan, M.N.; Ahmad, I. Quantitative phase imaging for characterization of single cell growth dynamics. Lasers Med. Sci. 2023, 38, 241. [Google Scholar] [CrossRef]
  12. Khan, F.; Naeem, K.; Khalid, A.; Khan, M.N.; Ahmad, I. Photoacoustic imaging for characterization of radiofrequency ablated cardiac tissues. Lasers Med. Sci. 2023, 38, 61. [Google Scholar] [CrossRef] [PubMed]
  13. Cheatle, S.L. Transillumination of the breast as an aid to diagnosis. J. R. Soc. Med. 1929, 22, 701. [Google Scholar] [CrossRef]
  14. Harnischmacher, N.; Rodner, E.; Schmitz, C.H. Detection of breast cancer using machine learning on time-series diffuse optical transillumination data. J. Biomed. Opt. 2024, 29, 115001. [Google Scholar] [CrossRef]
  15. Shimizu, K. Near-Infrared Transillumination for Macroscopic Functional Imaging of Animal Bodies. Biology 2023, 12, 1362. [Google Scholar] [CrossRef]
  16. Tran, M.H.; Fei, B. Compact and ultracompact spectral imagers: Technology and applications in biomedical imaging. J. Biomed. Opt. 2023, 28, 04090. [Google Scholar] [CrossRef]
  17. Pandey, R.; Fournier, D.; Root, G.; Riccio, M.; Shirvalkar, A.; Zamora, G.; Daigneault, N.; Sapack, M.; Zhong, M.; Harigopal, M. AI-Powered Biomolecular-Specific and Label-Free Multispectral Imaging Rapidly Detects Malignant Neoplasm in Surgically Excised Breast Tissue Specimens. Arch. Pathol. Lab. Med. 2023, 147, 1298–1306. [Google Scholar] [CrossRef]
  18. Ye, Y.; Li, H.; Li, G.; Lin, L. A crosstalk correction method to improve multi-wavelength LEDs imaging quality based on color camera and frame accumulation. Signal Process. Image Commun. 2022, 102, 116624. [Google Scholar] [CrossRef]
  19. Cheng, N.; Song, E.; Liu, H.; Hung, C.; Lu, Z. Improved method of frame accumulation technology using dual optical signals. J. Electron. Imaging 2018, 27, 043032. [Google Scholar] [CrossRef]
  20. Li, G.; Tang, H.; Kim, D.; Gao, J.; Lin, L. Employment of frame accumulation and shaped function for upgrading low-light-level image detection sensitivity. Opt. Lett. 2012, 37, 1361–1363. [Google Scholar] [CrossRef]
  21. Ben-Ezra, M.; Zomet, A.; Nayar, S.K. Jitter camera: A super-resolution video camera. Vis. Commun. Image Process. 2006, 6077, 607704. [Google Scholar]
  22. Ben-Ezra, M.; Zomet, A.; Nayar, S.K. Video super-resolution using controlled subpixel detector shifts. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27, 977–987. [Google Scholar] [CrossRef]
  23. Wang, W.; Den Brinker, A.C. Algorithmic insights of camera-based respiratory motion extraction. Physiol. Meas. 2022, 43, 075004. [Google Scholar] [CrossRef] [PubMed]
  24. Salvi, J.; Matabosch, C.; Fofi, D.; Forest, J. A review of recent range image registration methods with accuracy evaluation. Image Vis. Comput. 2007, 25, 578–596. [Google Scholar] [CrossRef]
  25. Antoš, J.; Nežerka, V.; Somr, M. Real-Time Optical Measurement of Displacements Using Subpixel Image Registration. Exp. Tech. 2019, 43, 315–323. [Google Scholar] [CrossRef]
  26. Jiang, X.; Ma, J.; Fan, A.; Xu, H.; Lin, G.; Lu, T.; Tian, X. Robust Feature Matching for Remote Sensing Image Registration via Linear Adaptive Filtering. IEEE Trans. Geosci. Remote Sens. 2021, 59, 1577–1591. [Google Scholar] [CrossRef]
  27. Ma, J.; Jiang, J.; Zhou, H.; Zhao, J.; Guo, X. Guided locality preserving feature matching for remote sensing image registration. IEEE Trans. Geosci. Remote Sens. 2018, 56, 4435–4447. [Google Scholar] [CrossRef]
  28. Zitová, B.; Flusser, J. Image registration methods: A survey. Image Vis. Comput. 2003, 21, 977–1000. [Google Scholar] [CrossRef]
  29. Jiang, X.; Ma, J.; Xiao, G.; Shao, Z.; Guo, X. A review of multimodal image matching: Methods and applications. Inf. Fusion 2021, 73, 22–71. [Google Scholar] [CrossRef]
  30. James, A.P.; Dasarathy, B.V. Medical image fusion: A survey of the state of the art. Inf. Fusion 2014, 19, 4–19. [Google Scholar] [CrossRef]
  31. Markelj, P.; Tomaževič, D.; Likar, B.; Pernuš, F. A review of 3D/2D registration methods for image-guided interventions. Med. Image Anal. 2012, 16, 642–661. [Google Scholar] [CrossRef] [PubMed]
  32. Klein, S.; Pluim, J.P.W.; Staring, M.; Viergever, M.A. Adaptive stochastic gradient descent optimisation for image registration. Int. J. Comput. Vis. 2009, 81, 227–239. [Google Scholar] [CrossRef]
  33. Lei, Y.; Zhang, Y. An improved 2D-3D medical image registration algorithm based on modified mutual information and expanded Powell method. In Proceedings of the 2013 IEEE International Conference on Medical Imaging Physics and Engineering, Shenyang, China, 19–20 October 2013; pp. 24–29. [Google Scholar]
  34. Talbi, H.; Batouche, M.C. Particle swam optimization for image registration. In Proceedings of the International Conference on Information and Communication Technologies: From Theory to Applications, Damascus, Syria, 23 April 2004; pp. 397–398. [Google Scholar]
  35. Valsecchi, A.; Damas, S.; Santamaria, J.; Marrakchi-Kacem, L. Genetic algorithms for Voxel-based medical image registration. In Proceedings of the 2013 Fourth International Workshop on Computational Intelligence in Medical Imaging (CIMI), Singapore, 16–19 April 2013; pp. 22–29. [Google Scholar] [CrossRef]
  36. Haskins, G.; Kruger, U.; Yan, P. Deep learning in medical image registration: A survey. Mach. Vis. Appl. 2020, 31, 8. [Google Scholar] [CrossRef]
  37. Kuppala, K.; Banda, S.; Barige, T.R. An overview of deep learning methods for image registration with focus on feature-based approaches. Int. J. Image Data Fusion 2020, 11, 113–135. [Google Scholar] [CrossRef]
  38. Arora, P.; Mehta, R.; Ahuja, R. An adaptive medical image registration using hybridization of teaching learning-based optimization with affine and speeded up robust features with projective transformation. Clust. Comput. 2023, 27, 607–627. [Google Scholar] [CrossRef]
  39. Wang, Z.; Bovik, A.C. Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures. IEEE Signal Process. Mag. 2009, 26, 98–117. [Google Scholar] [CrossRef]
  40. Klein, S.; Staring, M.; Pluim, J.P.W. Evaluation of optimization methods for nonrigid medical image registration using mutual information and B-splines. IEEE Trans. Image Process. 2007, 16, 2879–2890. [Google Scholar] [CrossRef]
  41. Liu, S.; Yang, B.; Wang, Y.; Tian, J.; Yin, L.; Zheng, W. 2D/3D Multimode Medical Image Registration Based on Normalized Cross-Correlation. Appl. Sci. 2022, 12, 2828. [Google Scholar] [CrossRef]
  42. Dinh, V.Q.; Pham, C.C.; Jeon, J.W. Robust Adaptive Normalized Cross-Correlation for Stereo Matching Cost Computation. IEEE Trans. Circuits Syst. Video Technol. 2017, 27, 1421–1434. [Google Scholar] [CrossRef]
  43. Aguerchi, K.; Jabrane, Y.; Habba, M.; El Hassani, A.H. A CNN Hyperparameters Optimization Based on Particle Swarm Optimization for Mammography Breast Cancer Classification. J. Imaging 2024, 10, 30. [Google Scholar] [CrossRef]
  44. Kazerani, R. Improving Breast Cancer Diagnosis Accuracy by Particle Swarm Optimization Feature Selection. Int. J. Comput. Intell. Syst. 2024, 17, 44. [Google Scholar] [CrossRef]
  45. Gad, A.G. Particle Swarm Optimization Algorithm and Its Applications: A Systematic Review. Arch. Comput. Methods Eng. 2022, 29, 2531–2561. [Google Scholar] [CrossRef]
  46. Wang, D.; Tan, D.; Liu, L. Particle swarm optimization algorithm: An overview. Soft Comput. 2018, 22, 387–408. [Google Scholar] [CrossRef]
  47. Refaat, A.; Elbaz, A.; Khalifa, A.E.; Elsakka, M.M.; Kalas, A.; Elfar, M.H. Performance evaluation of a novel self-tuning particle swarm optimization algorithm-based maximum power point tracker for porton exchange membrane fuel cells under different operating conditions. Energy Convers. Manag. 2024, 301, 118014. [Google Scholar] [CrossRef]
  48. Papazoglou, G.; Biskas, P. Review and Comparison of Genetic Algorithm and Particle Swarm Optimization in the Optimal Power Flow Problem. Energies 2023, 16, 1152. [Google Scholar] [CrossRef]
  49. Ghaheri, A.; Shoar, S.; Naderan, M.; Hoseini, S.S. The applications of genetic algorithms in medicine. Oman Med. J. 2015, 30, 406–416. [Google Scholar] [CrossRef] [PubMed]
  50. Kruppa, J.; Lepenies, B.; Jung, K. A genetic algorithm for simulating correlated binary data from biomedical research. Comput. Biol. Med. 2018, 92, 1–8. [Google Scholar] [CrossRef]
  51. Penney, G.P.; Weese, J.; Little, J.A.; Desmedt, P.; Hill, D.L. A comparison of similarity measures for use in 2-D-3-D medical image registration. IEEE Trans. Med. Imaging 1998, 17, 586–595. [Google Scholar] [CrossRef] [PubMed]
  52. Li, G.; Munawar, A.; WIN, N.S.S.; Fan, M.; Nawaz, M.Z.; Lin, L. Multispectral breast image grayscale and quality enhancement by repeated pair image registration & accumulation method. Spectrochim. Acta Part A Mol. Biomol. Spectrosc. 2024, 320, 124558. [Google Scholar]
  53. Young, A.L.; van den Boom, W.; Schroeder, R.A.; Krishnamoorthy, V.; Raghunathan, K.; Wu, H.T.; Dunson, D.B. Mutual information: Measuring nonlinear dependence in longitudinal epidemiological data. PLoS ONE 2023, 18, e0284904. [Google Scholar] [CrossRef] [PubMed]
  54. Song, Y.; Li, G.; Lin, L. Threshold method to improve the speed of “Registration-Frame accumulation” and its application in breast multispectral transmission images. Infrared Phys. Technol. 2023, 129, 104571. [Google Scholar] [CrossRef]
  55. Li, G.; Ye, Y.; Zhou, M.; Shang, H.; Yang, Y.; Ma, S.; Lin, L. Multi-resolution transmission image registration based on “Terrace Compression Method” and normalized mutual information. Chemom. Intell. Lab. Syst. 2022, 223, 104529. [Google Scholar] [CrossRef]
  56. Abdel-Basset, M.; Fakhry, A.E.; El-henawy, I.; Qiu, T.; Sangaiah, A.K. Feature and Intensity Based Medical Image Registration Using Particle Swarm Optimization. J. Med. Syst. 2017, 41, 197. [Google Scholar] [CrossRef] [PubMed]
  57. Zhuang, Y.; Gao, K.; Miu, X.; Han, L.; Gong, X. Infrared and visual image registration based on mutual information with a combined particle swarm optimization—Powell search algorithm. Optik 2016, 127, 188–191. [Google Scholar] [CrossRef]
  58. Song, Y.; Fan, M.; Li, G.; Lin, L. Enhance the frame accumulation accuracy of breast multispectral transmission image by the improved Powell registration algorithm. Opt. Lasers Eng. 2023, 164, 107486. [Google Scholar] [CrossRef]
  59. Ballerini, L. Particle Swarm Optimization in 3D Medical Image Registration: A Systematic Review. Arch. Comput. Methods Eng. 2024. [Google Scholar] [CrossRef]
  60. Li, G.; Li, J.; Fan, M.; Win, N.S.S.; Lin, L. Enhancing registration precision of multispectral breast images by fusing multi-wavelength information based on an improved gradient descent method. Biomed. Signal Process. Control 2024, 96, 106596. [Google Scholar] [CrossRef]
  61. Song, J.; Yang, K.; Zhang, Z.; Li, M.; Cao, T.; Ghaffari, M. Iterative PnP and its application in 3D-2D vascular image registration for robot navigation. In Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 13–17 May 2024; pp. 17560–17566. [Google Scholar]
  62. Li, X.; Lin, Z.; Lv, H.; Yu, L.; Heidari, A.A.; Zhang, Y.; Chen, H.; Liang, G. Advanced slime mould algorithm incorporating differential evolution and Powell mechanism for engineering design. iScience 2023, 26, 107736. [Google Scholar] [CrossRef]
Figure 1. Flow chart of GA-CPSO registration algorithm.
Figure 1. Flow chart of GA-CPSO registration algorithm.
Bioengineering 11 01281 g001
Figure 2. Schematic of the image acquisition system.
Figure 2. Schematic of the image acquisition system.
Bioengineering 11 01281 g002
Figure 3. Experimental setup for multispectral image acquisition.
Figure 3. Experimental setup for multispectral image acquisition.
Bioengineering 11 01281 g003
Figure 4. Illustrative multispectral transmission images of the human breast for Subject 1 captured at (a) 600 nm, (b) 620 nm, (c) 670 nm, and (d) 760 nm.
Figure 4. Illustrative multispectral transmission images of the human breast for Subject 1 captured at (a) 600 nm, (b) 620 nm, (c) 670 nm, and (d) 760 nm.
Bioengineering 11 01281 g004
Figure 5. Illustrative multispectral transmission images of the human breast for Subject 2 captured at (a) 600 nm, (b) 620 nm, (c) 670 nm, and (d) 760 nm.
Figure 5. Illustrative multispectral transmission images of the human breast for Subject 2 captured at (a) 600 nm, (b) 620 nm, (c) 670 nm, and (d) 760 nm.
Bioengineering 11 01281 g005
Figure 6. Image registration: fixed image (a), moving image (b), and registered image (c).
Figure 6. Image registration: fixed image (a), moving image (b), and registered image (c).
Bioengineering 11 01281 g006
Figure 7. Optimization of the mean squared error.
Figure 7. Optimization of the mean squared error.
Bioengineering 11 01281 g007
Figure 8. Frame accumulation comparison: (a) direct frame accumulation, and its corresponding histogram displayed in (e), (b) frame accumulation with GA-CPSO registration applied to 20 frames and its corresponding histogram shown in (f), (c) area cropped from the direct accumulation method presented in detail, (d) area cropped following GA-CPSO enhancement.
Figure 8. Frame accumulation comparison: (a) direct frame accumulation, and its corresponding histogram displayed in (e), (b) frame accumulation with GA-CPSO registration applied to 20 frames and its corresponding histogram shown in (f), (c) area cropped from the direct accumulation method presented in detail, (d) area cropped following GA-CPSO enhancement.
Bioengineering 11 01281 g008
Figure 9. Example of Image Registration for Subject 2 at 670 nm: (a) transformed (reference) image with shift of (25, −20, 5), (b) original (moving) image, and (c) aligned image post-registration using GA-CPSO.
Figure 9. Example of Image Registration for Subject 2 at 670 nm: (a) transformed (reference) image with shift of (25, −20, 5), (b) original (moving) image, and (c) aligned image post-registration using GA-CPSO.
Bioengineering 11 01281 g009
Figure 10. Comparison of image quality for direct accumulation and accumulation with registration for Subject 2 at 620 nm (20 Frames).
Figure 10. Comparison of image quality for direct accumulation and accumulation with registration for Subject 2 at 620 nm (20 Frames).
Bioengineering 11 01281 g010
Figure 11. Comparison of image quality for frame accumulation only and GA-CPSO algorithm-based registration plus frame accumulation (Subject 1). The evaluation metrics include the energy of image gradient (a), Brenner gradient function (b), gray level (c), standard deviation (d), and entropy (e).
Figure 11. Comparison of image quality for frame accumulation only and GA-CPSO algorithm-based registration plus frame accumulation (Subject 1). The evaluation metrics include the energy of image gradient (a), Brenner gradient function (b), gray level (c), standard deviation (d), and entropy (e).
Bioengineering 11 01281 g011
Figure 12. Cropped image showing ghosting effect due to frame accumulation from 670 nm wavelength images: (a) original single frame, (b) 20 frames direct accumulation, and (c) 20 frames accumulation after GA-CPSO registration.
Figure 12. Cropped image showing ghosting effect due to frame accumulation from 670 nm wavelength images: (a) original single frame, (b) 20 frames direct accumulation, and (c) 20 frames accumulation after GA-CPSO registration.
Bioengineering 11 01281 g012
Table 1. Registration speed enhancement with squared constriction factor in CPSO algorithm.
Table 1. Registration speed enhancement with squared constriction factor in CPSO algorithm.
Image PathIteration NumberBest ValueRegistration Time (s)
Wavelength (nm)CPSO with CCFCPSO with SCFCPSO with CCFCPSO with SCFCPSO with CCFCPSO with SCF
160083431.361.34411.69192.56
260093443.753.76370.09188.09
362094362.612.60373.20190.19
462064436.186.18364.11187.81
567095466.086.08362.58180.27
6670964517.3417.34370.33181.08
776082327.097.08376.42185.27
8760913722.6322.62382.70192.76
CPSO: constriction factor-based particle swarm optimization, CCF: conventional constriction factor, SCF: squared constriction factor.
Table 2. Accuracy comparison of CPSO alone and the hybrid GA-CPSO algorithm for moving image registration (Subject 1).
Table 2. Accuracy comparison of CPSO alone and the hybrid GA-CPSO algorithm for moving image registration (Subject 1).
Wavelength
Parameters
600 nm
(20, 20, 0.5)
620 nm
(30, 25, −5)
670 nm
(50, −50, 10)
760 nm
(10, 10, −15)
CPSOGA-CPSOCPSOGA-CPSOCPSOGA-CPSOCPSOGA-CPSO
x displacement19.02520.00929.41530.05549.99050.02709.59909.959
y displacement19.60019.96624.54124.990−50.689−49.95510.05910.089
Angle θ displacement00.50500.500−05.170−05.00010.18010.004−15.032−15.000
Accuracy (%)97.37599.92897.60599.92598.93499.93998.39699.566
Table 3. Accuracy comparison of CPSO alone and hybrid GA-CPSO algorithm for moving image registration (Subject 2).
Table 3. Accuracy comparison of CPSO alone and hybrid GA-CPSO algorithm for moving image registration (Subject 2).
Wavelength
Parameters
600 nm
(05, 05, 0.2)
620 nm
(50, 45, −10)
670 nm
(25, −20, 05)
760 nm
(−80, 60, 15)
CPSOGA-CPSOCPSOGA-CPSOCPSOGA-CPSOCPSOGA-CPSO
x displacement05.01605.00850.60649.89124.59625.059−79.299−79.878
y displacement05.23905.00244.89845.013−20.193−20.09060.70360.025
Angle θ displacement00.20100.200−10.160−10.00005.12005.00015.12015.000
Accuracy (%)98.13399.93398.98799.91898.34099.77199.05199.935
Table 4. Comparison of GA-CPSO algorithm with other methods.
Table 4. Comparison of GA-CPSO algorithm with other methods.
Evaluation MetricGA-CPSO AlgorithmPowell Algorithm [54]TC-NMI [55]
600 nm
CC0.99500.97020.9785
MI4.24743.23903.9065
RMSE1.51293.65456.0218
Registration time (s)406.573638.603513.10
620 nm
CC0.99820.95310.9510
MI3.99211.35333.0554
RMSE1.64199.28526.9321
Registration time (s)388.803670.602540.83
670 nm
CC0.98960.96690.9528
MI4.42184.01183.8401
RMSE1.12182.803915.1538
Registration time (s)397.154864.522691.00
760 nm
CC0.99630.92680.9697
MI4.38943.18883.9803
RMSE2.948810.71268.7365
Registration time (s)397.885864.509423.78
TC-NMI: terrace compression with normalized mutual information, CC: correlation coefficient, MI: mutual information, RMSE: root mean square error.
Table 5. Comparison of image quality for direct accumulation and GA-CPSO algorithm-based registration plus accumulation (Subject 2).
Table 5. Comparison of image quality for direct accumulation and GA-CPSO algorithm-based registration plus accumulation (Subject 2).
Final ImageEOGBrennerGLSDEntropy
600 nm
Direct accumulation2.6854 × 1063.9852 × 10642.165421.96035.2871
Registration + accumulation9.4465 × 1069.6038 × 10649.554422.80786.0456
620 nm
Direct accumulation4.2420 × 106 9.5382 × 10645.030133.49536.0492
Registration + accumulation1.6499 × 1073.3134 × 10747.393136.61957.6781
670 nm
Direct accumulation4.0418 × 1069.8232 × 10653.604625.00076.0260
Registration + accumulation1.6144 × 1073.5610 × 10756.367029.90157.4870
760 nm
Direct accumulation2.5743 × 1064.8203 × 10652.706037.03496.8005
Registration + accumulation5.7916 × 1066.7017 × 10657.100340.54027.4568
Table 6. Comparison of GA-CPSO algorithm with the RPIRA method (based on gradient descent).
Table 6. Comparison of GA-CPSO algorithm with the RPIRA method (based on gradient descent).
MetricsProposed GA-CPSOGradient Descent [52]
EOG (×106)10.09 8.58
Branner (×107)11.35 1.69
MMD (×105)14.23 8.44
Table 7. Comparison of GA-CPSO, Powell, and TCM-NMI methods after accumulating 10 frames.
Table 7. Comparison of GA-CPSO, Powell, and TCM-NMI methods after accumulating 10 frames.
MetricsProposed GA-CPSOPowell Algorithm [54] TC-NMI [55]
EOG (×105)69.794.961.87
Branner (×105)49.08 6.332.51
MMD (×104)98.711.980.95
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mahmoud, T.S.M.; Munawar, A.; Nawaz, M.Z.; Chen, Y. Enhancing Multispectral Breast Imaging Quality Through Frame Accumulation and Hybrid GA-CPSO Registration. Bioengineering 2024, 11, 1281. https://doi.org/10.3390/bioengineering11121281

AMA Style

Mahmoud TSM, Munawar A, Nawaz MZ, Chen Y. Enhancing Multispectral Breast Imaging Quality Through Frame Accumulation and Hybrid GA-CPSO Registration. Bioengineering. 2024; 11(12):1281. https://doi.org/10.3390/bioengineering11121281

Chicago/Turabian Style

Mahmoud, Tsabeeh Salah M., Adnan Munawar, Muhammad Zeeshan Nawaz, and Yuanyuan Chen. 2024. "Enhancing Multispectral Breast Imaging Quality Through Frame Accumulation and Hybrid GA-CPSO Registration" Bioengineering 11, no. 12: 1281. https://doi.org/10.3390/bioengineering11121281

APA Style

Mahmoud, T. S. M., Munawar, A., Nawaz, M. Z., & Chen, Y. (2024). Enhancing Multispectral Breast Imaging Quality Through Frame Accumulation and Hybrid GA-CPSO Registration. Bioengineering, 11(12), 1281. https://doi.org/10.3390/bioengineering11121281

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop