4.5.1. Polycentric Structure Detection Accuracy
To evaluate the effectiveness of the polycentric structure definition method, the centers that are derived from the master plans for 2020 that were formulated by the governments are collected for comparison with our results. The detection accuracies for Shenyang, Wuhan, and Xi’an are listed in
Table 8. The evaluation results are described as follows:
(a) Shenyang: The main center region, which consists of seven districts (
Figure 6a) that were defined by the master plan of Shenyang 2011–2020 (Shenyang Government, 2011), was detected via the proposed method.
Puhe (
Figure 6a, No. 1) was detected; Tiexichanye was covered by the main center region; and Yongan and Hunhe were not detected. In addition, another subcenter (
Figure 6a, No. 2), which is covered by the Hunnan district, is included in our results. The user accuracy of the method for Shenyang is 81.82%.
(b) Wuhan: The main center region consists of seven districts, as defined by the master plan of Wuhan 2010–2020 (Wuhan Government, 2011), and all of the districts were detected via the proposed method (
Figure 6b). Five of the six subcenters in the master plan were detected. Panlong (
Figure 6b, 1) belongs to the north, Yangluochai Lake (
Figure 6b, No. 2) belongs to the east, Tangxun Lake (
Figure 6b, No. 3) belongs to the south, Xuefeng (
Figure 6b, No. 4) belongs to the southwest, Caidian (
Figure 6b, No. 5) belongs to the west, Dongxihu (
Figure 6b, No. 6) belongs to the west, and Tianhe airport (
Figure 6b, No. 7) belongs to the north. Therefore, the user accuracy is 92.31%.
(c) Xi’an: The main center region of Xi’an includes five districts, as defined by the master plan of Xi’an 2008–2020 (Xi’an Government, 2009), and all of the districts were detected in this paper (
Figure 6c). One subcenter (Changning) of the four subcenters that were defined by the government is covered by the main center region. As the other three subcenters have not been effectively developed (
Figure 6d–f), none of them were detected. One subcenter (
Figure 6c, No. 1) that was defined by the method is covered by Weiyang district, because it is close to the main center; the other subcenter is Lintong district, which is a tourist industrial zone. The user accuracy for Xi’an is 66.7%.
4.5.2. Built-Up Area Extraction Accuracy
For calculating the built-up area extraction accuracy, the built-up reference areas are obtained via visual interpretation of Landsat satellite data for Shenyang, Wuhan, and Xi’an from 1992, 2000, and 2012. The built-up area reference data are shown as yellow areas in
Figure 14.
(a) Shenyang. The extracted built-up areas coincide with the built-up areas of the reference data. The degree of coincidence between the built-up areas that were extracted via the proposed method and those of the reference data was gradually improved.
(b) Wuhan. The extracted built-up area covers the built-up area of the reference data as well, and the extraction result had high integrity. The number of false detections was increased compared with Shenyang. There is a large amount of water in the inner part of Wuhan, and the false detections are mostly due to the surfaces of lakes and rivers. Water-based transport and tourism industries may have caused an increase in the lighting effects in the water areas.
(c) Xi’an. The extracted built-up area matches the reference data. There are many false detections in the northeast of Xi’an, where the famous tourist district of Lintong is located. The tourist area has bright lights at night, but is covered with dense vegetation. This is an important reason why the reference data and the extracted results are not consistent. In addition, because the area that connects Lintong and the main center region has not been developed, reference data for the built-up area are not included.
The confusion matrices of the built-up area extraction accuracy for Shenyang, Wuhan, and Xi’an are presented in
Table 9, where the user accuracy is denoted as
, the charting accuracy is defined as
, the overall accuracy is defined as as
, and the Kappa coefficient is defined as Kappa.
(a) Shenyang. The mean values of , , , and Kappa reach 0.84, 0.87, 0.96, and 0.84, respectively. There are no significant fluctuations in the indicators; hence, this method for extracting built-up areas in the region is robust.
(b) Wuhan. According to
Table 9,
ranged from 0.67 to 0.75. The mean values of
,
,
, and Kappa are 0.71, 0.91, 0.97, and 0.78, respectively. The accuracy of Wuhan is lower than that of Shenyang, which may be due to the light on the rivers and lakes of Wuhan.
(c) Xi’an. The mean values of and are 0.92 and 0.97, respectively, and both reach a more satisfactory level of accuracy. However, since the mean value of is 0.66, the average value of Kappa drops to 0.75. A main reason for the decrease in the detection accuracy for Xi’an may be the light in the tourism areas on the edge of the city.
We summed all the data and calculated the mean value of each precision index.
and
have ideal mean values of 0.90 and 0.97, and Kappa has a mean value of 0.79; hence, the proposed method performs well.
is influenced by the low radiation resolution of DMSP/OLS and natural human factors [
37]; its mean value is slightly lower at 0.74. Through the above precision analysis, it is demonstrated that the method that is proposed by this paper realizes satisfactory accuracy in extracting built-up areas.
The proposed method is also compared with a built-up area extraction algorithm that is based on Iterative Self Organizing Data Analysis Techniques Algorithm(ISODATA) using DMSP/OLS data to further evaluate its reliability [
38]. The accuracy of the built-up area extraction algorithm that is based on ISODATA is listed in
Table 10. Compared with
Table 9, the
value of the built-up area extraction algorithm that is based on ISODATA has an advantage. However, the
value of the built-up area extraction algorithm that is based on ISODATA is very low; hence, the results that were extracted by the algorithm have more false detections. The small value of
leads to decreases in the
and Kappa values. These results demonstrate that the proposed algorithm is more robust.
Landsat data are widely used in land-cover classification and urbanization analysis. To further analyze the reliability of the method that is proposed in this paper, we used Landsat data with the ISODATA algorithm to extract built-up areas [
39]. The confusion matrix for the extraction of built-up areas based on ISODATA using Landsat data is presented in
Table 11. Compared with the results in
Table 9, the proposed method, which uses DMSP/OLS, and the method that uses Landsat data differ in terms of their characteristics; however, the proposed method outperforms the other method in terms of the Kappa coefficient, which reflects the overall performance of the algorithm. The results are also compared with the results that were obtained using DMSP/OLS with the same classification method of ISODATA. If the same classification algorithm is adopted, the method that uses Landsat data outperforms the method that uses DSMP/OLS data on all accuracy indices except
. The value of
with Landsat data is relatively low; this may be because the integrity of the built-up areas that are extracted via the method that uses Landsat data is not as high compared to the method that uses DMSP/OLS data [
18]. The main reason for the lower
of the method that uses DSMP/OLS data may be the false detections that are caused by the light spreading effect of the DMSP/OLS data [
30,
40]. The method that uses Landsat data realized higher accuracy due to its higher spatial resolution. According to the above comparative analysis, the proposed method effectively increased the built-up area extraction accuracy using DMSP/OLS data.