1. Introduction
Urban areas are subjected to thermal stresses, such as heat waves and tropical nights, due to the urban heat island (UHI) phenomenon, in which urban areas are hotter than surrounding suburban areas. This phenomenon occurs because the land surface temperature (LST) increases as urban green areas are replaced by artificial land cover materials with high solar radiation absorption, and the temperatures of urban areas become higher than those of suburban areas [
1]. Also, UHI is caused by differences in evaporation and radiation absorption during the day and heat storage on the surface at night. In order to reduce the UHI, it is necessary to identify the effect of LST on the phenomenon by considering various spatial characteristics of urban areas [
2,
3,
4,
5]. In this respect, knowledge of LSTs is important for analyzing the thermal characteristics of urban areas and the UHI.
With the recent development of remote sensing technologies, many studies have been conducted to analyze LST using satellite images. Thermal infrared (TIR) satellite images can be used to monitor UHI on a large scale and analyze time-series changes because they can periodically acquire LST data over large areas [
6,
7,
8,
9]. They can also analyze LST characteristics based on their spatial patterns, and thus can be useful in identifying the distribution of the UHI resulting from urban development [
10,
11]. The types of TIR satellite images include the Moderate Resolution Imaging Spectra radiometer (MODIS), Landsat, and the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER), each with specific spatiotemporal resolution [
12]. TIR satellite images have limitations in identifying the thermal characteristics of urban areas as a function of the complex and diverse land cover materials due to low spatial resolution (MODIS: 500 m, Landsat: 120 m, ASTER: 90 m) [
13,
14,
15]. Moreover, there are limitations in acquiring spatiotemporal satellite images because satellite images are captured according to a fixed time and route [
1,
16,
17]. To overcome these issues, studies have been actively conducted using unmanned aerial vehicles (UAVs).
UAVs can capture LST data when equipped with TIR cameras (in the bandwidth 3.5–14 μm). They can precisely identify LST characteristics as a function of the land cover material because, unlike satellite images, they can acquire high-resolution images. They can also collect image data without time and location constraints [
18]. While satellites operate at high altitudes and thus have problems acquiring accurate image data due to weather conditions in the atmosphere, UAVs can acquire more accurate and precise LST than satellite images because they fly at low altitudes of around 100 m and thus mitigate the influence of weather conditions.
For this reason, UAVs with TIR cameras are being used in various areas of research to observe LST patterns. Naughton and McDonald (2019) observed LST in a complex urban environment and reported that LST is affected by the characteristics of land cover materials, weather, urban geometry, and traffic [
1]. Kraaijenbrink et al. (2018) performed mapping of LST on the Lirung Glacier in the central Himalayas by comparing UAV TIR LSTs, Landsat 8 TIR images, and in-situ LSTs [
19]. Tucci et al. (2019) analyzed the thermal characteristics of dry-stone wall terraced vineyards in Chianti, Tuscany, Italy, and detected microclimate dynamics induced by dry-stone terracing [
20]. Gaitani et al. (2017) produced a map that combined LST, albedo, and apparent thermal inertia using a UAV to improve the classification of fine land cover materials and energy balance models in urban areas and to acquire microclimatic information [
18]. Kang et al. (2018) derived the usability of UAV TIR LSTs in analyzing the thermal environment of urban green areas. As described above, many studies have analyzed LST using TIR cameras mounted on UAVs [
21]. However, few studies have verified the accuracy of LSTs acquired from UAV TIR cameras through in-situ measurements. Although some studies compared UAV TIR LSTs with in-situ LSTs for several land cover materials using thermal imaging cameras or contact-type surface thermometers [
19,
21,
22,
23], the studies that verified the accuracy of UAV TIR LSTs for various land cover materials distributed in complex urban areas are insufficient. TIR satellite images are used in urban planning to alleviate the UHI by verifying the accuracy of LSTs and correcting them using the measured data [
11,
24,
25,
26,
27,
28]. Therefore, to identify the thermal characteristics of the land surface using LST data collected from UAVs, and to utilize such data for improving the thermal environment in urban areas, it is necessary to first verify their accuracy by comparing them with measured data.
Therefore, in this study, an attempt was made to analyze the accuracy of the LSTs acquired from a UAV TIR camera of various urban land cover materials in an area of the Changwon National University Campus located in Changwon City, South Korea. To this end, high-resolution (2 cm) LST images were collected using a UAV TIR camera and in-situ measurements were performed considering various land cover types to measure LST. In addition, the UAV TIR LSTs and in-situ LSTs for the various measurement points were compared.
2. Materials and Methods
2.1. Study Area
This study was conducted in an area of the Changwon National University Campus (35°14′30″N, 128°41′50″E) located in Changwon City, South Korea (
Figure 1). Changwon City has mild weather with an average annual temperature of approximately 15 °C, and an average annual precipitation of 1400 mm (
https://www.changwon.go.kr). It has four distinct seasons—in summer (June to August), heat waves with temperatures higher than 30 °C and tropical nights are observed, whereas intensive rainfall occurs during the rainy season [
29]. The city is located in a basin surrounded by mountains with elevations of approximately 600 m. As air circulation is not good in the city, the UHI and air quality problems occur constantly in the area.
UAV imaging and in-situ measurements were performed in a 0.15 km2 area in the Changwon National University Campus, where the engineering college building is located. Five-story buildings are located around pedestrian paths in the area. The paths are approximately 20 m in width and are covered with sidewalk bricks. Wooden decks, lawns, and trees are located around the paths. The trees are approximately 4 m high and do not have large leaves. Roads paved with asphalt occur around the paths. The building roofs are covered with water-proof paint in various colors, such as gray, green, and white. The paint on some of the building roofs has been removed considerably by aging.
2.2. Acquisition of UAV TIR Images
The UAV TIR images were captured on 31 July and 2 August 2019 at 12 noon, when the influence of shadow was minimal due to the highest solar altitude. As for the weather conditions observed by the nearby automatic weather measurement device (
http://bangjae.changwon.go.kr), the temperature was approximately 32.6 °C with no rainfall and almost no wind (wind speed: 0 m/s) on 31 July, although it was cloudy. On 2 August, it was very hot with a temperature of 37.2 °C, but the rainfall and wind speed conditions were the same as those on 31 July—it was a clear day with few clouds.
The UAV TIR LST images were captured with a FLIR Vue Pro R TIR camera (spectral range: 7.5–13.5 μm, accuracy: ±5 °C, and emissivity: 0.98) mounted on a DJI Inspire 1. Using the longwave radiance obtained from a FLIR Vue Pro R TIR camera, the LST is calculated using the following equation in the Pix4D Mapper program.
Table 1 shows the detailed specifications of the devices used for capturing UAV images.
UAV operation began at 12 noon, and TIR images of the study area were captured three times for 30 min. The UAV flight altitude was 150 m, and the image-overlapping ratio was set at 85%. Orthoimages were produced from the captured images using the Pix4D Mapper software, and the spatial resolution was set at 0.2 cm.
2.3. In-Situ Measurement of LST
A total of 160 points were selected for the in-situ measurement, taking into consideration the land cover types distributed in the study area shown in
Figure 2 and the measurement time. Fewer measurement points were selected for the barren (2 points), urethane (4), concrete (4), wooden deck (6), and gravel (8) types that occupied relatively small areas. On the other hand, many points (34 each) were selected for the sidewalk brick and asphalt types, which covered the pedestrian space and roads, while 44 points were selected for the grassland type because it occupied the largest area. In addition, the green urethane (9), gray concrete (10), and white urethane (5) that covered the building roofs were also measured.
Figure 3 shows the actual view of the land cover types.
The in-situ measurement was performed by three teams of two persons. One person performed the measurement at a 10 cm height from the land surface using an infrared thermometer (Testo 381, accuracy: ±1.5 °C, emissivity: 0.98), and the other recorded the measurements in a field book. At each measurement point, measurement was performed three times and the average value was calculated to determine the LST of the point.
The in-situ measurement was initiated at the same time as the UAV operation. The measurement was completed within 30 min to minimize changes in LST with time.
2.4. Comparison between the UAV TIR LSTs and In-Situ LSTs
The UAV TIR LSTs were compared with the in-situ LSTs for the measurement points to verify their accuracy. For the comparison, the UAV TIR LSTs were constructed at the measurement points and their differences from the measured values were analyzed, and statistical techniques, such as scatter plot analysis, linear regression analysis, and root mean square error (RMSE) were applied. In addition, buffers with 20 and 50 cm radii were set around each measurement point to allow for the inaccuracy in the measurement points in the UAV images. The average UAV TIR LST was calculated for each buffer, and the RMSE with respect to the measured values was analyzed.
3. Results
3.1. UAV TIR LST
Figure 4 and
Figure 5 showing the UAV TIR LST images. The overall LST was higher on 2 August than on 31 July 2019. When the LST profiles were analyzed for line A–B, the average LSTs were 40.45 °C on 31 July and 49.33 °C on 2 August, resulting in an 8.88 °C difference. This large difference, despite only a 3-day difference in the measurements, appears to be due to a difference in solar radiation, as it was cloudy on 31 July. The nearby weather station also showed that the temperature was approximately 5 °C higher on 2 August than on 31 July, due to the differences in solar radiation (31 July: 32.6 °C, 2 August: 37.2 °C).
When the LST characteristics of each land cover type were investigated through the profile analysis, it was found that the cover types with the highest LSTs were urethane (31 July: 54.69 °C, 2 August: 68.37 °C) and wooden deck (31 July: 53.67 °C, 2 August: 70.79 °C). On the other hand, the land cover type with the lowest LSTs was vegetation (31 July: 34.30 °C, 2 August: 38.43 °C). The LSTs of the white roof were also low (31 July: 36.84 °C, 2 August: 41.85 °C) and were not much different from those of the vegetation type.
When UAV TIR LST characteristics were analyzed for each measurement point, the difference in LST between the measurement dates was found to be 12.118 °C (31 July: 45.255 °C, 2 August: 57.373 °C), which was larger than the profile analysis result. The land cover types with the highest LSTs were wooden deck (31 July: 53.281 °C, 2 August: 71.385 °C) and urethane (31 July: 55.074 °C, 2 August: 69.004 °C). On the other hand, vegetation (31 July: 37.222 °C, 2 August: 46.104 °C) and white urethane roof (31 July: 36.313 °C, 2 August: 41.102 °C) exhibited the lowest LSTs.
When the LST characteristics of each land cover type were analyzed from the profile analysis and measurement points, similar tendencies were observed. In particular, it was found that the LST of the white roof was even lower than that of vegetation.
In locations where the UHI frequently occurs, projects to increase the reflectivity of building roofs and create cool roofs have been actively undertaken worldwide as measures to reduce indoor and outdoor temperatures. The white urethane roof in the study area was applied to create a cool roof, and its LSTs were lower than those of concrete roofs and vegetation. The effects of cool roofs have been proven in many previous studies [
30,
31,
32,
33,
34]. The TIR LST data from the UAV also demonstrated the temperature reduction effect of the cool roof through a comparison with other land cover types.
3.2. In-Situ LSTs
Table 2 shows the results of measuring the LSTs of each land cover type in the study area. The land cover types with high LSTs were found to be urethane (31 July: 61.850 °C, 2 August: 66.667 °C) and wooden deck (31 July: 59.939 °C, 2 August: 70.728 °C). On the other hand, the land cover types with low LSTs were vegetation (31 July: 37.274 °C, 2 August: 39.677 °C) and white urethane roof (31 July: 35.713 °C, 2 August: 39.467 °C). The average LST for 2 August was 7.255 °C higher than that for 31 July. The land cover types that exhibited large differences between the two dates were wooden deck (10.789 °C), asphalt (10.380 °C), and green urethane roof (10.030 °C). On the other hand, those that exhibited small differences were concrete (1.475 °C), vegetation (2.403 °C), and white urethane roof (3.754 °C).
Even the same land cover types exhibited different LSTs at different measurement points. The average standard deviation was larger on 31 July than on 2 August (31 July: 2.462 °C, 2 August: 1.93 °C). Grassland was the land cover type with the largest standard deviation as its standard deviation was 4.555 °C on 31 July and 3.887 °C on 2 August. Asphalt also exhibited relatively large standard deviations (31 July: 3.110 °C, 2 August: 2.831 °C). Wooden deck exhibited a large standard deviation of 3.028 °C on 31 July but a small value of 0.736 °C on 2 August. The land cover types with small standard deviations were found to be concrete (31 July: 1.272 °C, 2 August: 0.966 °C), green urethane roof (31 July: 1.826 °C, 2 August: 1.290 °C), and white urethane roof (31 July: 1.186 °C, 2 August: 0.648 °C). It appears that even the same land cover types exhibited different LSTs because they were covered with foreign materials or they deteriorated with aging. The land cover types located on building roofs exhibited smaller standard deviations than those located on the ground surface. This is because building roofs are less likely to deteriorate without frequent human access, but the ground surface deteriorated in many cases because it mostly comprises pedestrian paths and roads. For vegetation, on the other hand, it appears that the LSTs were significantly different depending on the measurement points, not because of deterioration due to foreign materials or aging, but because vegetation and non-vegetation areas were mixed or the absorption of solar radiation varied depending on the leaf direction. For these reasons, it is necessary to reduce differences by continually securing in-situ measurement data.
3.3. Verification of the Accuracy of the UAV TIR LSTs
3.3.1. Difference between the UAV TIR LST and In-Situ LST
Based on the results in
Table 2, the difference between the UAV TIR LST and in-situ LST was analyzed. On 31 July, the difference was 2.672 °C, indicating that the in-situ measurement was higher than the UAV TIR LST. On 2 August, however, the difference was −2.191 °C, indicating that the UAV TIR LST was higher than the in-situ LST. On 31 July, solar radiation was not consistently incident on the land surface compared to 2 August because there were many clouds and the temperature was somewhat lower. On the other hand, on 2 August, solar radiation was consistently incident because there were few clouds and the temperature was high. These results show that UAV TIR LST overestimated LST. As this study conducted analyses only on two dates in summer, it is necessary to compare the UAV TIR LSTs with in-situ LSTs considering seasonal factors and the influx of solar radiation.
When the land cover types were compared, wooden deck (6.658 °C) and urethane (6.776 °C) exhibited large differences on 31 July. They were the land cover types with the highest in-situ LSTs. On the other hand, vegetation and white urethane roof, for which the in-situ LSTs were lowest, exhibited small differences of 0.052 °C and −0.600 °C, respectively. These results indicate that land cover types with higher LSTs exhibit larger differences between the UAV TIR LSTs and in-situ LSTs. On 2 August, vegetation exhibited a large difference of −6.427 °C and the in-situ LST was lower than the UAV TIR LST. The other land cover types, however, showed differences of less than −2 °C.
When such points were examined in
Figure 6, the points with higher in-situ LSTs (red, over 10 °C) and those with higher UAV TIR LSTs (black, under 10 °C) were generally located in the vicinity of vegetation and buildings. This indicates that LSTs were not accurately detected from UAV TIR images due to the influence of shadows formed by vegetation and buildings. On 2 August, the UAV TIR LST was found to be more than 10 °C higher on asphalt that was not adjacent to buildings or trees. This appears to have been because foreign materials were measured instead of asphalt. On the other hand, the difference in LST was small (less than 3 °C) for building roofs without the influence of nearby buildings or trees. As the field of view of the TIR camera used in this study was 44° × 33°, the LST at the edge of an image could be concealed by buildings or trees. Song and Park (2014) also indicated that there were differences from the measured values in spaces with dense buildings and trees due to the off-nadir viewing angle of satellite images. Therefore, it appears that there were slight differences between the UAV TIR LSTs and in-situ LSTs when three-dimensional physical features were closely adjacent, such as buildings and trees, as a function of the field of view of the TIR camera.
3.3.2. Linear Regression and RMSE
Figure 7 shows the results of the linear regression analysis for the in-situ LST and UAV TIR LST. Both 31 July and 2 August exhibited very high correlations as the values of R
2 were higher than 0.7 (31 July: 0.7004, 2 August: 0.8136). In addition, the slopes were 0.6727 on 31 July and 0.7743 on 2 August, indicating that the increment in the UAV TIR LST was smaller than that in the in-situ LST.
In
Table 3, the RMSE between the in-situ LST and UAV TIR LST was analyzed. The mean RMSE was 4.030 °C on 31 July and 5.446 °C on 2 August, indicating that the difference between the UAV TIR LST and in-situ LST was larger on 31 July. On 31 July, the RMSE values for wooden deck (7.150 °C), concrete (6.149 °C), and urethane (7.231 °C) were higher than 6 °C, and they were larger than those of the other land cover types. The standard deviation of wooden deck was relatively high (3.03 °C) in the in-situ measurement results above (
Table 2), but it was smaller than the difference between the UAV TIR LST and in-situ LST. This indicates that the UAV TIR LST of wooden deck was somewhat different from the in-situ LST. For concrete and urethane, the standard deviations of the in-situ measurement results were 1.27 °C and 2.41 °C, respectively, which were smaller than the RMSE values, as was the case with wooden deck. The land cover types with small RMSE values were green urethane roof (1.973 °C) and white urethane roof (1.748 °C). They also exhibited the lowest standard deviations for the in-situ LSTs (1.83 °C and 1.19 °C, respectively).
On 2 August, vegetation exhibited the highest mean RMSE of 8.216 °C. The standard deviation of the in-situ LSTs was 2.93 °C, which was smaller than the RMSE value, indicating that the analysis results were reliable. Vegetation also exhibited a relatively high RMSE value of 4.748 °C on 31 July. This is because the surface of leaves was measured in in-situ measurement, but some soil material could be measured instead of leaves in UAV TIR images. In addition, trees in vegetation could be affected by shadows due to their three-dimensional geometry unlike other flat land cover types, such as asphalt and concrete. For these reasons, the vegetation type appears to have exhibited large differences between the in-situ LSTs and UAV TIR LSTs. Asphalt (4.974 °C) and concrete (4.218 °C) also exhibited high RMSE values (more than 4 °C). On the other hand, white urethane roof (1.922 °C) and green urethane roof (2.123 °C) exhibited the lowest RMSE values, as on 31 July. Wooden deck (1.222 °C) and concrete (2.103 °C) showed very high RMSE values on 31 July but low RMSE values on 2 August, thereby exhibiting the largest differences between the two dates (wooden deck: 5.928 °C, concrete: 4.042 °C). The land cover types that showed small differences in RMSE between the two dates were barren (0.479 °C), sidewalk brick (0.668 °C), gravel (0.002 °C), green urethane roof (0.151 °C), and white urethane roof (0.174 °C).
When the RMSE values were compared considering buffer ranges around the measurement points, the RMSE values were largest when the buffer range was 20 cm (31 July: 4.043 °C, 2 August: 5.456 °C), but the differences with the RMSE values of the other buffer ranges were small (less than 0.04 °C). When the differences of 20 and 50 cm buffers with the 0 cm buffer were compared by land cover type, concrete (20 cm buffer: −0.104 °C, 50 cm buffer: −0.129 °C) and urethane (20 cm buffer: −0.106 °C, 50 cm buffer: 0.201 °C) exhibited large differences in RMSE on 31 July. On 2 August, concrete also exhibited a difference of −0.148 °C with a 20 cm buffer, while gray urethane roof showed a large difference of −0.278 °C with a 50 cm buffer. For some land cover types, the RMSE between the in-situ LST and UAV TIR LST was large or small depending on the buffer range. As the differences in RMSE were less than 0.2 °C, however, the target points in the UAV TIR images appear to coincide with the measurement points.
4. Discussion
In this study, UAV TIR LSTs were compared with in-situ LSTs measured at specific measurement points, and the accuracy of the UAV TIR LSTs was examined through linear regression and RMSE analysis. The difference between the UAV TIR LST and in-situ LST varied depending on the land cover type, and it was also affected by physical factors, such as nearby vegetation and buildings. Moreover, it was found that the accuracy of the UAV TIR LSTs was affected by weather conditions, such as the influx of solar radiation and clouds. As a result of these various factors, the RMSE between the UAV TIR LSTs and in-situ LSTs was found to vary from 4 to 5 °C. The land cover types with high LSTs, such as wooden deck, urethane, and concrete, generally exhibited higher RMSE values. As shown in the results of linear regression analysis, the coefficient of determination (R2) of the model was higher than 0.7, indicating a very high correlation.
As for previous studies that compared LST data acquired using satellite images or UAVs with in-situ LSTs, Kraaijenbrink et al. (2018) measured and compared UAV TIR LSTs, Landsat 8 images, and in-situ LSTs of areas covered with glaciers [
19]. The UAV TIR LSTs exhibited differences of −1.4 ± 1.8, 11.0 ± 5.2, and 15.3 ± 4.7 °C in three flights. Kelly et al. (2019) analyzed the accuracy of a non-radiometric FLIR Vue Pro 640 camera mounted on UAVs based on laboratory and field experiments [
22]. While the accuracy was stable (approximately 0.5 °C) under laboratory conditions, it decreased to 5 °C in the field experiments due to the ambient conditions. They pointed to the non-linear relationship between the camera output and the sensor temperature under the influence of the wind and temperature generated during the UAV flight as the cause of performance degradation. As for studies on TIR satellite images, Song and Park (2014) reported that the difference between satellite image LSTs and in-situ LSTs varied depending on time, and that the difference could be larger than 10 °C in summer when the temperature is high [
24]. Voogt and Oke (2003), Hartz et al. (2006), Barring et al. (1985), and Eliasson (1992) reported that the difference between satellite image LSTs and in-situ LSTs was large in areas with very dense buildings due to the limited horizontal surface view [
11,
25,
26,
27]. According to these authors, this phenomenon is caused by the accumulation of Earth radiation energy released to the atmosphere, which is large in spaces with dense buildings [
35], and this cannot be detected by satellite images.
These results indicate that the LST data captured from satellite images and UAVs are different from in-situ LSTs for various reasons. The UAV TIR LSTs acquired in this study also appear to be different from the in-situ LSTs due to several causes, such as weather conditions in the atmosphere, the field of view of the camera, and the camera certification, as in previous studies. Also, it is determined that an error in measurement points may cause problems in the accuracy of the UAV TIR LSTs. These causes need to be clearly identified through the results of systematic experimentation. Furthermore, in order to alleviate the UHI, it is important to accurately identify the thermal characteristics of various land cover materials and spatial factors present in urban areas. This study revealed that the accuracy of the UAV TIR LSTs varies depending on the land cover material. This is a meaningful result in terms of the utilization of UAV TIR images in studying the alleviation of the UHI and indicates further research is required to improve accuracy.
5. Conclusions
In this study, the accuracy of the LSTs acquired from a UAV TIR camera was verified in a university campus area featuring various land cover materials. To this end, the UAV TIR LSTs were compared with in-situ LSTs for 160 measurement points on two dates (31 July and 2 August).
Both the UAV TIR LSTs and in-situ LSTs were high for asphalt, wooden deck, and urethane, but they were low for trees and lawns. The LSTs for the white urethane roof, referred to as a cool roof, were lower than those of trees and lawns. When the UAV TIR LSTs were compared with in-situ LSTs, the latter were 2.672 °C higher than the UAV TIR LSTs on 31 July, when the temperature was low, but the UAV TIR LSTs were 2.191 °C higher on 2 August, when the temperature was high. The results of linear regression analysis show R2 values higher than 0.7, indicating a high correlation between the UAV TIR LSTs and in-situ LSTs. The RMSE values were 4.030 °C on 31 July and 5.446 °C on 2 August, and the RMSE values varied depending on the land cover material. These results show that the UAV TIR LSTs were somewhat different from the in-situ LSTs. Various factors, such as weather conditions, UAV operation, and the certification and field of view of the TIR camera, appear to have caused these differences, which had been pointed out in previous studies.
In order to effectively alleviate the UHI, it is extremely important to identify the thermal characteristics of various spatial factors distributed in urban areas. In this respect, UAVs can be used effectively to identify the LST and thermal characteristics of each land cover material. The accuracy of the UAV TIR LST data, however, needs to be verified to accurately diagnose the UHI and to implement measures for its alleviation. In this study, there were problems with the accuracy of UAV TIR LST data derived for various land cover materials in urban areas. The causes of these problems need to be identified through further research. Based on this, the utilization of UAVs should be gradually expanded to help alleviate the UHI and to mitigate heat waves and improve thermal comfort in urban areas.