1. Introduction
Weather radar plays a crucial role in weather monitoring and disaster prevention, providing critical data for predicting and responding to extreme events [
1]. In order to deal with severe convective weather that develops rapidly and is potentially disastrous, the China Meteorological Administration (CMA) has constructed a national weather radar network consisting of hundreds of multi-band radar systems. However, the key devices in a radar system may all introduce systematic errors, which increase the uncertainty of the target measurement results [
2]. With the continuous development of weather radar, the data application scenarios and demands are moving beyond the traditional qualitative representation and gradually developing toward quantitative monitoring. Radar calibration and validation are the first steps toward improving the quality of the observation data, which is crucial for improving the monitoring and warning capabilities of meteorological targets. Thus, velocity measurement is one of the key parameters of quantization. Due to the complexity of atmospheric conditions and the specificity of the radar system itself, radar radial velocity data may be affected by a variety of errors and disturbances, such as ground clutter, doppler spectrum folding, systematic deviation, etc. In particular, the monitoring of severe convective weather systems, such as tornadoes and thunderstorms, has put forward new requirements for radar velocity measurement capability.
Traditional radial velocity calibration methods for weather radar systems typically use high-precision instruments to measure the internal and external radar system, which can calibrate the receive channel amplitude [
3], phase, etc. Existing methods cannot assess the accuracy of moving target velocity measurements under real-world radar operating conditions. Current simulated moving targets mostly use flying platforms mounted with external reference sources, such as tethered balloons, kites, and unmanned aerial vehicles (UAVs) [
4]. Compared with other passive carriers, UAVs have powerful flight control systems and real-time kinematic (RTK) systems and can meet the needs of a variety of application scenarios through reasonable route design. Moreover, they are flexible in flight, easy to operate, and can obtain accurate coordinate information in real time [
5], which provides a new way of achieving end-to-end calibration and validation for radar systems.
Several researchers have conducted experiments on radar antenna patterns, radar constants, reflectivity factors, differential reflectivity, and radial velocity using “UAV+” and have explored the possibility of using a UAV to calibrate radar systems. Simon et al. constructed a complete antenna pattern using a UAV system, which included the ground clutter, radome, temperature, and other human-introduced external degradation [
6]. Arturo et al. constructed a measurement method that utilizes a dual-polarized antenna system based on a UAV and a detection antenna, which achieves the cross-polarization isolation of −40 dB [
7,
8,
9]. Yin et al. used a UAV combined with the Global Navigation Satellite System, a real-time single-frequency precise point positioning system, to determine the position of the metal ball mounted on the UAV. Through the tracking and scanning of the metal ball by the radar system, the calibration of the weather radar antenna pointing, antenna pattern, and high-precision measurement of the radar constants were realized, and the calculation accuracy of the radar constants was improved [
2]. Sun et al. introduced the principle and steps for undertaking the external calibration of a meteorological radar system based on a UAV-mounted metal ball, and the Ku/Ka radar before and after calibration was used to carry out the monitoring of cloud and rain processes and mutual verification of the reflectivity factor [
10]. Earle et al. constructed a radar differential reflectivity calibration method based on the UAV with a metal ball and verified that the negative deviations of 6′′ and 12′′ metal balls on the KOUN WSR-88D radar were −0.56 and −0.52 dB, respectively [
11]. Zhu et al. implemented a differential reflectivity calibration of a dual-polarization weather radar system using a UAV and a metal ball, and the results show that the mean Zdr value of a 40 cm metal ball is −0.265 dB [
12]. In radar radial velocity measurement, Liu et al. realized the velocity calibration of a vertically pointing millimeter-wave radar system by using a UAV and a metal ball, and determined the absolute deviation between the GPS- and radar-measured results to be a maximum of 0.014 m/s and a minimum of 0.002 m/s [
13]. Li et al. carried out calibration of the weather radar reflectivity factor, differential reflectivity, and radial velocity using three types of metal balls suspended from a UAV, and the results showed that the deviation of the measured velocity of a 30 cm metal ball from the GPS-calculated velocity was less than 0.1 m/s at a sampling point number of 128 [
14].
Existing methods of weather radar radial velocity external measurement mostly measure the velocity of the metal ball mounted on the UAV in the stationary state. However, the rope suspending the metal ball can be affected by the ambient wind field to produce a pendulum effect, which prevents the metal ball from achieving the ideal stationary state. Moreover, this method can only obtain radar measurements when the target is stationary and cannot simulate a moving target such as a rapidly developing severe convective weather system. Therefore, this paper proposes a weather radar radial velocity validation method based on an RTK UAV, which complements the static calibration of internal and external instrumentation with dynamic validation based on the RTK UAV and realizes systematic weather radial velocity calibration and verification. At the same time, based on the evaluation parametric system of validation for point targets [
15], the evaluation parameter of optimal absolute accuracy is proposed. It effectively reduces the validation error caused by the attitude instability of the UAV and improves the robustness of the method and the credibility of the evaluation results. In the following sections, we provide a detailed introduction to the research methodology, experimental design, and analysis of experimental results, to comprehensively demonstrate our in-depth discussion and scientific research results on weather radar radial velocity validation. Through this series of research work, we expect to provide strong support for improving the quality and credibility of weather radar data and to promote scientific research and technological innovation in the field of meteorology.
2. Materials and Methods
The RTK UAV-based weather radar radial velocity validation consists of five key steps (
Figure 1). Firstly, the radar environment is checked to confirm the weather conditions and radar configuration parameters. Then, based on the radar position and the far-field region, the geodetic coordinates and altitude of the two endpoints of the UAV routes are theoretically calculated. After completing the preparatory work, the UAV begins to fly along the route at a preset constant velocity, and the radar is set to a tracking mode which performs a synchronized scan of the UAV to check its position and stability. Finally, using time synchronization as a benchmark, the measured radar velocity values are examined in conjunction with the UAV intensity values, and the results of the validation are evaluated both qualitatively and quantitatively and compared with the results of the internal and external instrument calibration.
2.1. Principle of Doppler Radar Velocity Measurement
The Doppler shift, a key parameter in radar measurements, relies on radar frequency and radial velocity. It is directly proportional to the radial velocity and inversely proportional to the radar wavelength. For a Doppler weather radar system operating at a frequency of
, its wavelength (
) is given by
Radar radial velocity, often referred to as Doppler velocity (
), can be derived from measuring the Doppler shift. This is expressed as
Here, represents the Doppler shift. When a target approaches the radar, the Doppler frequency is positive, indicating that the received signal’s frequency is higher than the transmitted one. Conversely, when the target moves away, the Doppler frequency becomes negative.
Additionally, Doppler velocity can be obtained from the rate of change of distance. This calculation is based on the echo phase difference between consecutive pulse pairs, as shown in Equation (3) [
16].
where
stands for pulse repetition frequency (PRF),
denotes pulse repetition time (PRT), and
represents the distance the target moves during
.
Considering the discretely sampled nature of radar data,
can only take values from
to
. The maximum unambiguous velocity is given by [
17]:
The designation “+” indicates movement away from the radar, whereas “−“ indicates movement toward the radar.
In pulse-based radar systems, a critical consideration is the pulse repetition time, in order to ensure that all echoes from one pulse return before transmitting the next. This time is crucial to avoid echoes overlapping, which could compromise ranging accuracy. The distance traveled by the electromagnetic wave before the next pulse emission, following the return of all echoes from the previous pulse, is termed the maximum unambiguous distance.
2.2. UAV Experimental Environment Selection and Radar Parameter Settings
2.2.1. Checking the Weather Conditions
The UAV-based radial velocity validation of the radar should, as far as possible, be undertaken in clear weather and with a ground wind velocity of level 1–2, reducing the interference of the ambient wind field on the state of the UAV. This could ensure that the measurement results truly reflect the radar performance.
2.2.2. Checking the Experimental Sites
Check the surroundings according to the satellite map, and stay away from electromagnetic interference, mountains, and other dangerous areas. Select a specific area that is appropriate for the operation of the UAV, with a suitable altitude, and apply to the airspace authority with the chosen location.
2.2.3. Determination of the Radar Observation Azimuth and Elevation Angle
Check the radar base data to be measured. Under the conditions permitted by the flight limit, select an area with low background noise and ground clutter interference as the azimuth and elevation angle for the UAV flight and radar observation, and check that the radar control software has completed the time synchronization of the Beidou timing system.
2.2.4. Determination of the Radar Measurement Parameters
Based on the maximum constant velocity of the UAV, parameters such as radar PRF and pulse width are determined. The PRF setting increases with the maximum unambiguous velocity value. Therefore, based on the selected UAV velocity and the maximum unambiguous velocity calculation method of the radar (Equation (4)), the minimum PRF () corresponding to the UAV velocity is determined. The PRF of the radar setting needs to be greater than . This experiment set the maximum velocity of the UAV as 10 m/s, which corresponds to the minimum PRF of about 1253 Hz. Taking into consideration the instability of the UAV velocity when affected by power, environment, etc., in this experiment the PRF was set to 1600 Hz, which corresponds to the maximum unambiguous velocity of 12.8 m/s.
Range resolution is the ability of a radar system to distinguish between two or more targets with the same orientation but at different ranges. Its size depends on the pulse width of the radar system, i.e., a smaller pulse width results in higher resolution. Radar in different bands has varying range resolutions, as shown in
Table 1, and thus requires different pulse widths to be set.
This experiment was conducted using an X-band radar system, and the pulse width required for radar observation was calculated to be 0.5 µs.
where
is the range resolution,
is the velocity of light, and
is the pulse width.
2.3. UAV Routes Design Based on Radar Geographic Information
2.3.1. Determination of the Radar Far-Field Distance
The electromagnetic field is divided into the near field and the far field according to the area of the induction field and radiation field. The correspondence between the electric field and the magnetic field within the near field is more complicated, and the electric field intensity is affected by the change in the target distance. The electric and magnetic field intensity in the far field is inversely proportional to the distance from the center of the antenna. And it has a fixed conversion relationship which is different from the near field [
18]. It is commonly assumed that electromagnetic waves in the far field are plane waves, which enables the acquisition of a stable radar cross-section of the target. In fact, electromagnetic waves are actively propagating into space as spherical waves. As the radar system used in this paper has a parabolic antenna, the far-field distance of the antenna is given by the following equation.
where
is the radar near- and far-field demarcation point (unit: m), and
is the antenna diameter (unit: m). The diameter of the X-band radar antenna used in the experiment is 2.4 m, the frequency is 9.4 GHz, and the wavelength is about 3.2 cm, so the far-field distance of the radar is 360 m.
2.3.2. Calculation of the Altitude of the Two Endpoints on the UAV Route
The first step is to determine the slant distances
and
between the two endpoints of the route and the radar. The distance of the start point
needs to be greater than the range of the radar far-field, and
needs to be determined based on the radar range resolution and the UAV constant motion range bins (
usually ≥5).
Second, based on the radar elevation angle and the slant distance between the UAV route endpoints and the radar, the actual flight altitude of the two endpoints is calculated. It is worth noting that the experiment required the UAV to always remain within the main radar beam and as close to the center as possible. Therefore, considering the altitude restrictions of the UAV, the theoretically calculated altitude of the main beam center point is determined as the optimal altitude for the UAV route.
As shown in
Figure 2, assuming that the radar elevation angle determined by the volume scan data is
, the antenna feeds altitude is
, and
is the slant distance between the UAV route point and the radar, the altitude of the radar beam center point
is given by the equation.
It should be noted that the effective input to the UAV is the altitude of the target location, so the UAV route altitude needs to be calculated by incorporating the antenna feed altitude information rather than the actual elevation information.
2.3.3. Calculation of the Geodetic Coordinates of the UAV Route Endpoints
If conditions permit, the relative orientation between the UAV route and the radar is preferred to be 0°, 90°, 180°, and 270° to facilitate checking and verification of the route coordinates. With reference to the coordinate calculation method in geodesy, the geodetic coordinates, i.e., latitude and longitude, of the two endpoints of the UAV route at a specific elevation angle are calculated by combining the horizontal distance between the two endpoints of the UAV route and the radar. Knowing the geodesic coordinates of the radar system
, we can determine that its azimuth angle to the UAV is
, and the horizontal distance between them is
. Using the geodesic function of the Python Geopy library, the geodesic coordinates
of the route endpoints are obtained by calculation. Finally, the geodetic coordinates and altitude information are entered into the UAV. The specific calculation codes are shown in the
Table 2.
2.4. UAV Velocity Reference Calculation and Accuracy Analysis
The RTK system of the DJI Matrice 300 UAV acquires the real-time position in seconds via GPS, GLONASS, BeiDou, and other satellite navigation systems. The UAV outputs the geodetic coordinates of the target location based on the position and orientation system (POS) data.
2.4.1. Calculation of the Actual UAV Velocity
The POS data include information such as photo name (including time), latitude, longitude, elevation, and three Euler angles (yaw, pitch, roll). Based on the latitude, longitude, and elevation of the two neighboring locations in the POS information, the distance–time method is used to calculate the velocity between the two points.
As shown in
Figure 3, the geodetic coordinate system describes the spatial position of the target using latitude
, longitude
, and geodetic elevation
, whereas the space rectangular coordinate system describes this using
,
and
. Thus, to calculate the distance between two neighboring points, it is necessary to first convert the geodetic coordinate system to the space rectangular coordinate system. For a point
in three-dimensional space, the seven-parameter method in geodesy is used to convert the geodetic coordinate
into the space rectangular coordinate
.
where
represents the local curvature radius of the meridian circle,
denotes the semi-major axis of the Earth ellipsoid, and
signifies the Earth’s eccentricity.
- 2.
Velocity calculation for each position point of the whole UAV route
The geodetic coordinates of two neighboring points of the route obtained from the POS data are transformed to obtain the corresponding space rectangular coordinates
and
. The spatial Euclidean distance between them can be calculated according to the following equation.
According to the time interval between the two neighboring points, the average velocity is calculated based on the distance–time formula. Since the UAV route is set to fly along the radar radial direction, the results of the following formula are used as a reference value for the radar radial velocity validation.
where
is taken as 1, 2, 3, etc.
2.4.2. Trace Validation of the UAV Actual Route
Using the radar geodetic coordinates and the route information obtained by the RTK, the theoretical elevation of the main beam center corresponding to the UAV at each position point was calculated. By comparing the actual elevation of each position recorded by the UAV, it was verified whether the UAV was flying in the main beam center of the radar system. According to the horizontal distance
between the UAV and the radar system, the radar elevation angle
and the antenna feeds elevation
, the theoretical elevation of each position is
and the beam broadening
at each point is respectively:
where
is the beam width (unit: °). By comparing the actual and theoretical elevations, the height deviation of each point and its percentage of the beam width were calculated.
2.4.3. Quality Control of the UAV Velocity
The UAV is set to operate at a constant velocity, but it is difficult to maintain absolute stability due to factors such as wind speed and power influences during flight. In this paper, we calculate the standard deviation of the UAV velocity over the whole route and analyze the maximum deviation between the actual velocity and the preset velocity to assess whether the operational accuracy meets the standard in the constant velocity state.
2.5. Time Synchronized Radial Velocity Comparison between the UAV and the Radar
When the UAV is in a stable state of motion, its radar cross-section tends to remain constant, indicating minimal fluctuations in radar intensity values within a narrow range. When affected by environmental factors such as ambient winds, the three Euler angles of the UAV can be disturbed. It caused changes in the effective radar cross section, which is exposed to electromagnetic waves, resulting in abrupt numerical changes in radar intensity. Therefore, this approach uses the maxima stable dBZ value of the UAV as a reference criterion for selecting radar-validated data. At the same time, the reference values for the UAV velocity are synchronously selected based on the time of the validated data.
The radar system records the velocity values of the UAV during both stationary hover and constant motion along the radar radial direction. A comparison is then made between these recorded velocities and the reference values of the UAV velocity. This paper refers to the evaluation method of validation for point targets and analyzes the results according to two validation criteria: relative accuracy and absolute accuracy. The relative accuracy of the velocity validation results is assessed based on the standard deviation of the radar-measured values of the UAV velocity [
15,
19,
20].
The equation defines as the relative validation accuracy, as the radar-measured velocity, as the average radar-measured velocity, and as the number of valid data points.
Theoretically, absolute validation accuracy is typically used to explain the absolute differences between measured and reference values. The absolute validation accuracy of the radial velocity is determined by taking the difference between the radar velocity values obtained from the base data and their reference values, using the maximum absolute value of these differences as an indicator [
15].
Considering that the absolute accuracy indicators are currently used mainly for satellite or airborne SAR, theoretically, the validation results could not be affected by reference targets fixedly deployed on the ground. However, a weather radar is ground-based, and the reference target can only be an airborne target such as a UAV, and as such, it will inevitably be subject to interference caused by the instability of the moving target itself. Moreover, the UAV velocity reference values are derived from the average velocity based on RTK position information, so its proximity to the instantaneous velocity is related to the frequency of positioning updates and the stability of the UAV flight state. To reduce the impact of internal and external environmental factors on the UAV velocity stability, this study, based on valid data pairs, uses the minimum deviation between measured and reference values as the optimal absolute accuracy for validating radar radial velocity.
where
is the optimum absolute accuracy,
is the radar-measured velocity values, and
is the time-synchronized UAV velocity reference values.
5. Conclusions
The accurate measurement of weather radar radial velocity is of paramount importance for quality control and applications of radar velocity data. Traditional methods for measuring radial velocity in weather radar often involve the use of high-precision instruments for internal and external static calibration. These calibrations focus on adjusting parameters such as amplitude and phase in the receive channels. There is no method to evaluate the measurement accuracy of the moving target velocity in the actual working condition of the radar system. To address this issue, we used an RTK UAV to simulate external reference targets, proposed a method to validate the weather radar radial velocity, and experimentally verified it using the X-band radar at the Changsha Meteorological Radar Calibration Center and the DJI M300 RTK UAV. Consistent with the application scenarios of the method, we introduced the evaluation parameter optimal absolute accuracy as a complementary parameter for assessing the validation of point targets. The experimental results indicate that the optimal absolute accuracy of the radar radial velocity validation is less than 0.05 m/s. Furthermore, the result is in close agreement with the velocity measurement results of the external instrument, confirming the effectiveness of this method in accurately reflecting the quality of the weather radar velocity. Compared with the conventional absolute validation accuracy, the proposed optimal absolute accuracy evaluation parameter in this method effectively reduces the validation errors caused by the instability of UAV attitudes. Moreover, the method can be effectively applied to the procedural handling of practical radial velocity validation.
The effect of the instability of the UAV on the radar velocity validation needs further quantitative study due to the limitations of the RTK system performance. (1) Influenced by the RTK system positioning frequency, data transmission, storage, etc., the UAV velocity update frequency is lower than the radar radial velocity acquisition frequency. Currently, only short-term average velocity can be compared as the instantaneous reference, and actual velocity references corresponding to each radar radial are not yet available. (2) The UAV RTK system may not operate effectively under some environmental conditions, such as harsh weather or complex terrain. This may limit the comprehensive assessment of radar validation. As RTK technology continues to improve and signal processing algorithms are optimized, future research will focus on aspects such as velocity comparisons based on high positioning frequency and the impact of sampling points and signal processing algorithms on radial velocity validation. The aim is to improve the accuracy of the RTK UAV in the validation of the weather radar radial velocity.