Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Next Article in Journal
Navigating Immovable Assets: A Graph-Based Spatio-Temporal Data Model for Effective Information Management
Next Article in Special Issue
Universal Snow Avalanche Modeling Index Based on SAFI–Flow-R Approach in Poorly-Gauged Regions
Previous Article in Journal
CSMNER: A Toponym Entity Recognition Model for Chinese Social Media
Previous Article in Special Issue
Landslide Recognition Based on Machine Learning Considering Terrain Feature Fusion
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Integrating Sequential Backward Selection (SBS) and CatBoost for Snow Avalanche Susceptibility Mapping at Catchment Scale

1
Graduate School of Science and Engineering, Hacettepe University, Beytepe, 06800 Ankara, Türkiye
2
Department of Geomatics Engineering, Hacettepe University, Beytepe, 06800 Ankara, Türkiye
*
Author to whom correspondence should be addressed.
ISPRS Int. J. Geo-Inf. 2024, 13(9), 312; https://doi.org/10.3390/ijgi13090312
Submission received: 14 May 2024 / Revised: 21 August 2024 / Accepted: 27 August 2024 / Published: 29 August 2024

Abstract

:
Snow avalanche susceptibility (AS) mapping is a crucial step in predicting and mitigating avalanche risks in mountainous regions. The conditioning factors used in AS modeling are diverse, and the optimal set of factors depends on the environmental and geological characteristics of the region. Using a sub-optimal set of input features with a data-driven machine learning (ML) method can lead to challenges like dealing with high-dimensional data, overfitting, and reduced model generalization. This study implemented a robust framework involving the Sequential Backward Selection (SBS) algorithm and a decision-tree based ML model, CatBoost, for the automatic selection of predictive variables for AS mapping. A comprehensive inventory of a large avalanche period, previously derived from satellite images, was used for the investigations in three distinct catchment areas in the Swiss Alps. The integrated SBS-CatBoost approach achieved very high classification accuracies between 94% and 97% for the three catchments. In addition, the Shapley additive explanations (SHAP) method was employed to analyze the contributions of each feature to avalanche occurrences. The proposed methodology revealed the benefits of integrating advanced feature selection algorithms with ML techniques for AS assessment. We aimed to contribute to avalanche hazard knowledge by assessing the impact of each feature in model learning.

1. Introduction

A snow avalanche, subsequently referred to as an avalanche, is a natural phenomenon resulting from the interaction of the cryosphere, hydrosphere, atmosphere, and the living ecosystems that seriously affects humankind. Avalanche susceptibility (AS) mapping is a scientific process that involves predicting the likelihood of avalanche occurrences in an area based on a variety of environmental and topographical factors [1]. The field of AS mapping is continuously evolving with advancements in data collection, analysis techniques, and computational methodologies [2]. These advancements provide superior tools for predicting avalanches, helping to save lives and protect settlements and infrastructure by enabling effective risk management and mitigation strategies in mountainous regions.
Researchers have been using both qualitative and quantitative methods for AS mapping [3]. Qualitative approaches (knowledge-driven), such as analytical hierarchy process (AHP), fuzzy logic (e.g., see [4,5,6]), are based on expert opinion, which can be subjective. On the other hand, quantitative (data-driven) methods use numerical data, statistical analysis, and mathematical models produced without human intervention. Machine learning (ML) approaches provide valuable insights into the context of data-driven avalanche studies due to the complexity of avalanche characteristics.
The new era of computing has witnessed the great utilization of ML-based approaches with the advancements in geographic information system (GIS) and earth observation (EO) technologies in natural hazard assessments. Although relatively simple statistical analysis methods (e.g., the frequency ratio (FR), see [4,7]) can be used for AS assessments, novel ML approaches have introduced new possibilities to process large datasets and identify complex patterns and relationships among various factors that influence avalanches. In their study, Choubin et al. [8] proposed an AS mapping framework with multivariate discriminant analysis (MDA) and support vector machine (SVM) for the Sirvan watershed. The AS investigations of the Darvan and Zarrinehroud watersheds by Rahmati et al. [9] indicated that the random forest (RF) model was superior to SVM, generalized additive model (GAM), and naïve Bayes (NB) models. Wen et al. [10] presented a case study comparing the prediction capability of the SVM, K-nearest neighbors (KNN), classification and regression tree (CART), and multilayer perceptron (MLP) methods.
The tree-based ML algorithms, such as RF, categorical boosting (CatBoost), light gradient boosting (LightGBM), natural gradient boosting (NGBoost), and extreme gradient boosting (XGBoost) have yielded satisfactory prediction results in the literature ([2,11,12]). Liu et al. [2] utilized four tree-based ML methods (CatBoost, LightGBM, RF, and XGBoost) to predict AS using multi-source spatial data, including remote sensing imagery, meteorological data, and topography in the Tianshan Mountains, China. In these studies, CatBoost outperformed the others in its predictive performance, based on accuracy value (0.93). The performance measures indicated that the spatial probability of avalanches can be computed rapidly and accurately using ML methods. However, selecting the appropriate conditioning factors and ML methods remains a challenging task.
The process of feature selection has proven highly effective in investigating the correlations and potential causal relationships between parameters that influence natural hazards [13,14]. However, incorporating a large number of features can lead to overfitting and limit the ability of a model to generalize due to high dimensionality [15]. Costache et al. [13] utilized the correlation-based feature selection (CFS) method to evaluate the predictive capacity of fourteen predictors in the context of flood susceptibility assessment. Pham et al. [14] employed two established feature selection techniques, chi-square (CS) and backward elimination (BE), to determine the optimal set of input features for training artificial neural networks (ANNs) in landslide susceptibility modeling. Although several conditioning factors may influence AS at different levels, some may be redundant or less relevant in a specific environment. This can lead to inefficient computation, resource overconsumption, and reduced accuracy of ML algorithms. Table 1 summarizes the ML methods and the features used for AS mapping in the recent literature.
As shown in Table 1, the features used for AS mapping can be diverse, and the optimal set depends on the regional characteristics and data availability. Even when data availability is not an issue, a feature selection strategy needs to be implemented to identify the optimal set of descriptive features for achieving high model performance. Different feature selection methods proposed in the literature can be utilized to address this issue. These methods are broadly categorized into filter, wrapper, and embedded approaches based on their evaluation criteria [16]. Filter methods are popular for feature selection due to their relatively low computational cost compared to wrapper and embedded methods [17]. Although filter-based methods are computationally efficient, wrapper and embedded methods are indispensable because they consider the relationship between features and the learning algorithm [18]. Embedded methods integrate feature selection within the model training process, providing effective selection with a reduced risk of overfitting through model-specific optimization [19]. In contrast, wrapper methods offer high predictive accuracy by evaluating feature subsets through iterative model training and testing, thereby optimizing the selected feature subset [20].
Yariyan et al. [3] applied multicollinearity analysis and Pearson correlation to assess the suitability of eleven snow avalanche conditioning factors in their study. Their findings demonstrated that all hybrid models performed strongly in evaluating the susceptibility of locations to avalanches. Tiwari et al. [15] emphasized the importance of identifying the most pertinent parameters before training. To demonstrate this, they applied parameter importance assessment (PIA) to predict AS along the Leh-Manali highway, one of the most affected regions in India. Eleven avalanche conditioning parameters were considered, and their relevance was evaluated using the Boruta algorithm.
A number of studies have been conducted on AS mapping in the Alpine region. Ghinoi and Chung [21] employed fuzzy logic with slope, aspect, elevation, distance from crest lines, and concavities/convexities as conditioning factors in Italian Dolomites and found that the accuracies of the AS maps were between 67% and 82%. As preliminary efforts, Cetinkaya and Kocaman [12] investigated the logistic regression (LR) and the RF methods in Davos, Switzerland, using a total of 12 conditioning factors. They stated that LR provided poor accuracy (0.74) when compared to RF (0.96). The inventory employed in the study was manually generated by Hafner and Bühler [22,23] based on satellite images [24] for two avalanche periods in 2018 and 2019. Hafner et al. [25] stated that when compiled from satellite images, small and medium-sized avalanches can be missed. In addition, shadows hinder avalanche detection. In a more recent study, Cetinkaya and Kocaman [26] assessed the effect of different sampling strategies for AS mapping with RF in the Gross Spannort Mountain region, Switzerland, using a total of 18 conditioning factors. They suggested that implementing appropriate feature elimination and backward selection strategies could improve AS maps, though further research is needed. Iban and Bilgilioglu [11] studied AS mapping using DT-based methods in the province of Sondrio, Italy, using a total of 17 conditioning factors and a point-based inventory with 1880 samples representing the avalanche starting points. The geographic distribution of avalanche starting points may not be uniform across the study area. Certain regions might have a higher density of samples due to accessibility, historical avalanche occurrences, or reporting biases. This could lead to an overrepresentation of specific areas and potentially skew the model’s performance in predicting AS in underrepresented regions. Regarding conditioning factor elimination, they applied a multicollinearity test but found no collinear factors to eliminate. They observed that the XGBoost performed the best with an AUC of 0.978, although the difference between the best and the worst model outputs was merely 1%, indicating similar performances among the evaluated methods.
The present study addresses the challenges of feature selection for AS mapping by combining a comprehensive set of factors with the sequential backward selection (SBS) strategy and the CatBoost algorithm to identify the minimum set of predictive variables for the target region. The CatBoost was preferred here because it is a decision-tree based method that is known for its success in many natural hazard assessment studies. It also has the advantage of handling categorical features without requiring extensive pre-processing and is often faster than RF, especially on large datasets. To the best of our knowledge, this represents a novel application of SBS in AS mapping. Reducing feature dimensionality would decrease the need for large inventories in ML modeling for AS mapping. This study integrates SBS with CatBoost by using feature selection capabilities of SBS to identify the most relevant features based on accuracy results from CatBoost at each step. The approach was demonstrated in three catchment areas in Alpine terrain—Engelberger Aa, Meienreuss, and Göschenerreuss—using a subset of the inventory compiled by [22]. The main contributions of this study include the following:
(a)
An iterative feature selection and validation method, SBS, integrated with CatBoost was proposed for improving AS prediction accuracy.
(b)
The Shapley additive explanations (SHAP) method [27,28] was employed to interpret the model results and analyze the influence of individual input features on model learning.

2. Materials and Methods

In Figure 1, a schematic overview of the proposed framework is presented. The framework utilizes the CatBoost algorithm, an advanced ensemble method known for its effective handling of categorical data. The feature selection was performed using SBS, aiming to optimize the model by iteratively removing the least significant variables based on variations in model accuracy. The GridSearchCV method [29] was employed to fine-tune model parameters, ensuring the best possible settings for achieving the highest performance. Precision, recall, specificity, negative predictive value (NPV), accuracy, and F1-score measures were used to validate the results at each iteration, enhancing model reliability and determining significant features. The SHAP values were used to interpret feature importance [27,28] as they have been successful in several other natural hazard susceptibility assessment studies (e.g., [11,30,31]).

2.1. Study Area and the Inventory

As shown in Figure 2, three catchment areas were selected in the Alpine terrain (Engelberger Aa, Meienreuss, and Göschenerreuss). All three catchments are part of the Reuss River basin, located in the Swiss Alps. Each catchment represents unique geomorphological and hydrological characteristics that contribute to the AS within the region. The Engelberger Aa catchment is the largest one (226.5 km2) among the three, with a complex terrain that includes high-altitude peaks and steep slopes. The Meienreuss (71.4 km2) and Göschenerreuss (92.8 km2) catchments are relatively small but still characterized by steep and rugged Alpine landscapes.
The dataset of avalanche inventory polygons was produced by Hafner and Bühler [22]. The investigation focused on extreme avalanche occurrences within a large avalanche period in January 2018, when Switzerland experienced a series of significant snowfall events that resulted in the first use of the highest avalanche danger level (level 5) since 1999. This inventory, compiled using 1.5 m resolution multispectral SPOT6 satellite imagery, provides a valuable foundation for modeling the AS, enabling comprehensive analyses that capture the spatial patterns of avalanche-prone and non-avalanche pixels across the selected catchments. Although the avalanches were provided as polygons (see purple polygons in Figure 2), the inventory was rasterized with a 10 m grid interval. Thus, large numbers of avalanche and non-avalanche pixels were obtained in the Engelberger Aa (126,915 avalanche and 2,138,089 non-avalanche), Meienreuss (47,714 avalanche and 667,143 non-avalanche), and Göschenerreuss (44,175 avalanche and 883,484 non-avalanche) catchments. To ensure a balance between the avalanche and non-avalanche samples, the number of the latter one was reduced to match the number of the avalanche pixels by random sampling, resulting in equal numbers of pixels (1:1 ratio between the classes) to avoid class imbalance problems. The dataset was randomly split into training (70%) and testing (30%) datasets for AS prediction using the model.

2.2. Conditioning Factors

As shown in the methodological workflow given in Figure 1, seventeen key factors were extracted to train the susceptibility model, based on their relevance to avalanche dynamics as determined from the literature and the available geospatial data. A digital elevation model (DEM) with 2 m resolution was obtained from swissALTI3D, provided by the Swiss Federal Office of Topography [32] (Figure 3). To increase computational efficiency, the DEM was resampled to 10 m.
Similarly, the land use and land cover (LULC) data sourced from the freely available databases of Swisstopo [32] were resampled to 10 m (Figure 4). As shown in the figure, the Engelberger Aa catchment is largely covered with forest and grassland, with several settlements in the region. The Meienreuss and Göschenerreuss have greater altitudes with almost no settlements. Higher altitudes usually have bareland as the LULC type.
Several of the conditioning factors used in the analysis were derived from the DEM using the SAGA GIS software [33]. Statistical summaries of these numerical factors are provided for each catchment in Table A1, Table A2 and Table A3 in Appendix A. Altitude affects temperature and precipitation patterns, with higher elevations often receiving more snowfall [34]. The gravitational impact on snow is determined by the slope; avalanches generally occur on slopes between 30° and 45° [35]. Aspect affects solar radiation exposure, impacting the melting and refreezing cycles that lead to snow stability. The LULC type, such as forests or bareland, significantly impacts snow stability and avalanche risk. Open areas are more prone to avalanches due to the absence of natural barriers [5,36].
Plan curvature affects the lateral accumulation of water and snow on a slope, whereas profile curvature affects their downslope movement. The topographic ruggedness index (TRI) [37] measures terrain roughness by assessing elevation changes between adjacent cells and computed from the DEM using Equation (1).
T R I = i = 1 n z i z ¯ n
where z i is the elevation value of each cell, z ¯ denotes the mean elevation of all cells within the window, and n is the number of cells in the defined window.
Rugged terrain can create topographic barriers or act as a trigger for avalanches [2]. The vector ruggedness measure (VRM) is a 3D measure of ruggedness that accounts for slope and aspect variations. VRM affects snowpack stability due to variable grounding and distribution conditions, influencing avalanche potential.
The diurnal anisotropic index (DAH) represents the daytime warming of various slopes caused by solar radiation [38]. This differential temperature influences the cycles of melting and refreezing, which are crucial for establishing snowpack stability and subsequent avalanche risk. The DAH was assessed using Equation (2) [39].
D A H = cos γ m a x γ × arctan λ
where γ is the slope aspect, γ m a x denotes the aspect with the maximum total heat excess, and λ represents the slope angle.
The slope length factor (LS-Factor) assesses the combined impact of slope length and steepness [40]. Longer, steeper slopes, characterized by higher LS-factor values, accumulate more snow, increasing the avalanche risk due to greater snow depth and pressure. The topographic wetness index (TWI) is a measure of the terrain’s exposure to accumulate wetness by combining the local slope and upstream drainage area. High TWI values can indicate zones with higher wetness content, potentially destabilizing the snowpack [41]. The convergence index (CI) (Equation (3)) quantifies terrain convergence or divergence [42]. Convergent zones, such as valleys, concentrate snow and water, increasing AS due to higher snow depths.
C o n v e r g e n c e   I n d e x C I = arctan tan θ i θ c 90 n
where θ i θ c represents the angle between the aspect of the surrounding cell θ i and the aspect of the center cell θ c , while n is the total number of surrounding cells considered within the moving square window.
The valley depth (VD) quantifies the relative depth of a valley compared to the surrounding peaks or ridges. Due to the topographic convergence in valleys, substantial snow accumulation often occurs, significantly increasing AS [43]. Water movement transports sediments deposited along the river, which are subsequently deposited as avalanche debris [44]. The distance to stream (DTS) influences this sediment transport process, affecting the accumulation of snow avalanche debris.
The wind exposition index (WEI) assesses the exposure of the terrain to wind direction [6]. The MSP parameter assigns a value of 0 to mid-slope positions, while maximum vertical distances in both valley and crest directions receive a value of 1 [45]. The TPI proposed by De Reu et al. [46] describes the relative position of a location with respect to the surrounding topography.

2.3. Categorical Boosting (Catboost)

CatBoost is a gradient boosting algorithm developed by Yandex [47], designed to handle categorical variables efficiently and robustly. It features an innovative approach to processing categorical features, eliminating the need for manual encoding and reducing the risk of overfitting. CatBoost’s ability to handle categorical variables makes it particularly well suited for datasets with mixed data types, common in AS mapping. The method employs an ordered boosting strategy, effectively mitigating target leakage during model training. This is achieved through a novel mathematical formulation that adjusts feature values based on target statistics, as illustrated in Equation (4):
x p , k = j = 1 p x j , k = x i , k Y i j = 1 n x j , k = x i , k
Equation (4) computes the conditional expectation of the target variable, thereby enhancing the integrity of the data utilized for training decisions. Moreover, CatBoost incorporates permutations within the training process to refine feature values further, adapting to the inherent order of data entries as depicted in Equation (5):
x σ p , k = j = 1 p 1 x σ j , k = x σ i , k Y σ j + β P j = 1 p 1 x σ j , k = x σ i , k + β
where β and P denote the weight and the prior value, respectively.
The method facilitates a robust update mechanism that integrates both prior information and empirical data. These mathematical constructs allow CatBoost to effectively manage high-dimensional categorical data, reduce overfitting, and improve generalization across different datasets.

2.4. Sequential Backward Selection (SBS) Algorithm

SBS is a feature selection algorithm that iteratively removes features from the dataset based on specific criteria, such as the decrease in model performance upon removal. It starts with the entire set of features and progressively eliminates one feature at a time until the minimum number of features achieving high accuracy is reached. This technique helps in reducing dimensionality, improving model interpretability, and potentially enhancing model performance.
With SBS, the model is trained multiple times, each time omitting one of the features. The performance of each model configuration (with one feature removed) is evaluated and compared. The feature whose absence results in the least decrease in model performance (or even potentially cause an increase) is permanently eliminated from the dataset. The elimination process is repeated with the reduced set of features from the previous iteration. Each iteration assesses the impact of removing each feature one at a time and eliminates the least impactful feature based on model performance. The iterative process is continued until a desired number of features is reached or no further improvement in model performance is observed. If multiple subsets achieve similar performance metrics, the smallest feature set is selected to maintain model simplicity and efficiency.
Figure 5 illustrates SBS using the CatBoost algorithm, combined with GridSearchCV, to optimize feature selection for modeling. The process begins with a dataset comprising 17 different features or factors, such as altitude, slope, LULC, among others, which are considered for model training. The entire set of 17 features was used to train the initial CatBoost model, employing GridSearchCV for parameter optimization [48]. To achieve the highest accuracy, different parameters for learning rate, tree depth, and the number of iterations were tested. Learning rates of 0.2 and 0.3 were used, depending on the number of input features. A tree depth of 9 was consistently applied in all runs, with 250 and 500 iterations identified as the optimal values by GridSearchCV. This step involves systematically searching through different combinations of parameter values to find the most effective settings based on a chosen performance measure.
The training and testing subsets were partitioned using the Python-based scikit-learn package [48]. The same package was also used for the implementation of SBS, tuning of initial parameters, and the training of classifiers. Performance evaluation was subsequently carried out using the same toolkit. The LULC data, which included classes such as bareland, forest, grassland, settlement, and water bodies, were transformed into new binary features representing the presence or absence of that category with a 1 or 0 with one-hot encoding. The models were tested with feature sets ranging from 17 to 2 features, revealing how the predictive power changes with varying levels of input complexity. To ensure comprehensive model evaluation, performance metrics, including accuracy, precision, and recall (see Section 2.6 for details), were used alongside a visual inspection of the output AS maps. Here, although the minimum sets for each catchment were computed with SBS, as few as 2 features are also provided in Appendix B and Appendix C for interpretation.

2.5. SHAP (Shapley Additive Explanations)

The SHAP value quantifies the contribution of each feature to the predictive accuracy of the model for a particular sample [27,28]. The general formula for the model prediction is given in Equation (6):
y i = y base + f x i , 1 + f x i , 2 + + f x i , i
where yi is the predicted outcome for the ith sample, ybase denotes the baseline score of the model (often the mean prediction over the training set), and f(xi,j) represents the SHAP value corresponding to the jth feature’s contribution to the ith sample’s prediction. Essentially, the predicted value for a sample is composed of the baseline model score plus the cumulative contributions from each feature.
The SHAP values provide a detailed interpretation of the model, calculating the individual and collective contributions of features to the predicted output. This enables a comprehensive understanding of the model functioning on both global and local scales. Regarding the AS assessments performed here, the SHAP values helped to interpret the specific contributions of various factors to the likelihood of an avalanche.

2.6. Validation

Here, we assessed the model performances both qualitatively and quantitatively, complemented by 5-fold cross-validation (CV) to analyze model robustness and generalizability. The qualitative assessments are based on visual inspections of the AS maps. Quantitative measures include precision (Equation (7)), recall (Equation (8)), F1-score (Equation (9)), specificity (Equation (10)), NPV (Equation (11)), and accuracy (Equation (12)) given in Table 2. These values were computed using the numbers of true positive (TP), true negative (TN), false negative (FN), and false positive (FP) classifications. While additional measures such as ROC-AUC (receiver operating characteristic—area under the curve) could also be computed, these six parameters provided—precision, recall, accuracy, specificity, NPV, and F1-score—sufficiently demonstrate the reliability and completeness of the AS predictions for avalanche class. Although a prediction made with CatBoost is a probability value ranging between 0 and 1 at each sample location, a probability above 0.5 was classified as “true” (avalanche), and those below as “false” (no avalanche) for calculating the measures in Table 2. TPs refer to correctly identified objects, the TNs to correctly omitted ones, the FNs to undetected ones, and FPs to incorrectly identified objects. The values of precision, recall, F1-score, specificity, NPV, and accuracy also range from 0 to 1, where 0 indicates poor classification performance, and 1 indicates perfect classification.

2.7. Multicollinearity Analysis

The variance inflation factor (VIF) and tolerance (TOL) are common multicollinearity analyses employed by researchers to identify and eliminate conditioning factors [2,10,11]. Multicollinearity is identified when the VIF value exceeds 10 or the TOL value falls below 0.1 [11]. Table 3 presents the VIF and TOL values for numerical conditioning factors across the three catchments (Engelberger Aa, Meienreuss, and Göschenerreuss). The results shown in the table indicate that most factors exhibit acceptable or moderate multicollinearity. Although the slope slightly exceeds the mentioned limits, it has not been removed from the feature set as it is an essential parameter in predicting AS. Thus, all 17 factors were used as input and analyzed with SBS-CatBoost. The results are given in the next section.

3. Results

This study evaluated the performance of the SBS-CatBoost model trained on varying combinations of conditioning factors for AS mapping in the Engelberger Aa, Meienreuss, and Göschenerreuss catchments. The accuracy measures for each catchment are given in Table 4. The Engelberger Aa catchment, the largest of the three with 226.5 km2, achieved optimal accuracy with 11 features. In Meienreuss, the optimal accuracy was achieved with seven features, as it is also the smallest one with an area of 71.4 km2. All AS maps, generated with predicted values ranging from 0 to 1.0, were reclassified into categories of very low, low, moderate, high, and very high susceptibility areas for visual interpretation, using equal intervals of 0.2. These correspond to the intervals of 0–0.2, 0.2–0.4, 0.4–0.6, 0.6–0.8, and 0.8–1.0, respectively. The final accuracy values are ordered similarly based on the catchment size. The results demonstrate a direct relationship between catchment size, environmental complexity, and accuracy. As expected, smaller regions can be modeled with fewer features. The results for each catchment are explained in the following sub-headings. The 95% confidence intervals for the mean CV scores further validate the reliability of these models, as shown in Table 4 for Engelberger Aa, Meienreuss, and Göschenerreuss. These intervals indicate that the observed high-performance measures are consistent and robust across different CV runs, suggesting that the models are well calibrated and reliable for predicting AS in diverse catchments.

3.1. Engelberger Aa Catchment

The best-performing model utilized 11 features (Figure 6) and achieved an accuracy of 0.94, with precision and recall for the avalanche class notably high at 0.91 and 0.96, respectively (see Table 4). This indicated that the model effectively identifies avalanche-prone and non-avalanche areas with a high degree of reliability. The resulting map (Figure 6a) illustrated regions with high AS, primarily along specific elevations and terrain features. According to the SHAP graph (Figure 6b), in the Engelberger Aa region, altitude, DTS, and aspect have significant impacts on the model outputs. Higher altitude values are positively correlated with avalanche occurrences, while lower altitude values negatively influence them, as interpreted from the SHAP graph (Figure 6b). On the other hand, greater distances from streams are associated with lower susceptibility to avalanches, whereas closer proximity (low DTS value) has a positive correlation. Regarding the aspect, 0°, 90°, 180°, and 270° correspond to north, east, south, and west. Thus, it can be interpreted from Figure 6b that low aspect values (close to north) have a positive influence on avalanche occurrence.

3.2. Meienreuss Catchment

The model, using just seven features, achieved robust performance with an overall accuracy of 0.96. It balances precision (0.94) and recall (0.97) for the avalanche class, indicating a strong predictive power despite the reduced number of features. The resulting map (Figure 7a) shows highly susceptible areas concentrated in specific regions, likely reflecting the unique local topographical influences. Figure 7b shows that VD, altitude, and aspect have the greatest impact on AS in this catchment. From the graph, it can be seen that high VD values yield to lower AS. The relationship between the altitude and aspect features and the AS is similar to that observed in the Engelberger Aa catchment.

3.3. Göschenerreuss Catchment

With nine features, this model delivered outstanding performance, achieving an accuracy of 0.97. It demonstrated exceptionally high recall (0.98) for the avalanche class, highlighting its ability to identify AS accurately. The distribution of highly susceptible areas was more widespread (Figure 8a), suggesting that varied terrain or more comprehensive data coverage influenced the predictions. According to the SHAP values (Figure 8b), aspect, altitude, and DTS are highly influential, similar to the results of the Engelberger Aa catchment.

4. Discussion

In this study, a comprehensive feature selection and elimination strategy, SBS, was evaluated for AS mapping using the CatBoost algorithm in three neighbouring catchments in the Swiss Alps. As avalanches are complex natural phenomena influenced by numerous environmental and geological conditions, the probability of their spatial occurrences can be controlled by a large number of factors. However, a factor set effective in a region may be less influential in another one. For this reason, this study started from a large feature set with 17 inputs and sequentially eliminated features by analyzing their influence on model performance. The parameter optimization for CatBoost was also performed using an automated algorithm to achieve the best possible accuracy.
Across the three catchments, the model performances were robust, with accuracies ranging from 0.94 to 0.97. These results are notable, considering the complexity and variability of the factors influencing avalanche occurrences. The iterative process of feature elimination using SBS revealed that not all 17 conditional factors were equally important in all catchments, even though they were neighboring. The key factors, such as altitude, aspect, and valley depth, consistently showed a strong influence on model prediction accuracies across all catchments, proving their critical role in avalanche dynamics.
Interestingly, the results also highlighted the lesser relevance of factors like plan and profile curvature, the DAH, and the TPI, which were excluded in the optimized models at earlier stages (see Appendix B). The LULC features were included in models with larger feature sets (16 features) across all catchments, which can be associated with the weaker relation with the AS. This suggests that while LULC is informative, other factors like altitude, aspect, and distance to stream might carry more predictive weight in the reduced models, particularly when computational efficiency or model simplicity is prioritized.
The initial analysis of multicollinearity indicated that only slope revealed high correlations with the other factors. However, it was not omitted from the initial set as the level of correlation was not excessively high. On the other hand, slope was not included in the final feature set for any of the catchments, likely due to its effect being covered by other topographic features.
On the other hand, although the inventory used here is comprehensive [22,24], possibly the most extensive one in the literature, it also suffers from data collection conditions, such as shadows and image resolution [23,25], its representativeness for only a large avalanche period, and avalanche boundary uncertainty caused by operator differences [49]. Therefore, the results must be interpreted accordingly.

5. Conclusions and Future Work

This study evaluated the usability of SBS with the CatBoost model for AS modeling. By starting with a large feature set and applying advanced feature selection, the approach enhanced model accuracy and interpretability while providing insights into avalanche conditioning factors. The proposed feature elimination strategy yielded varying numbers of features across the three catchments, ranging from seven to eleven, based on the specific characteristics and sizes of each catchment. The SHAP values provided a unified measure of feature importance and enhanced interpretability by attributing the contribution of each feature to the model outputs. By incorporating SHAP values into the integrated SBS-CatBoost framework, we gained deeper insights into the relative importance of selected features and their impact on AS mapping. Features such as altitude, aspect, and VD were consistently important across all three catchments, highlighting their general significance in AS mapping. Accuracy values ranged from 0.94 to 0.97, showing a linear relationship with catchment size.
The SBS algorithm can be computationally intensive, especially with a large number of features, as it involves features and retraining the model, which can be time-consuming and resource-intensive. Future work could explore assessing multicollinearity results with or without VIF and TOL in conjunction with SBS.
Despite the strengths of the integrated SBS-CatBoost approach, the study faces limitations related to the inherent challenges of modeling this natural phenomenon. The variability in feature importance across different catchments suggested that regional characteristics can significantly influence model performance and feature selection. Additionally, the reliance on historical data and the assumptions inherent in the modeling process may affect the generalizability of the results to other regions or future scenarios.

Author Contributions

Sinem Cetinkaya contributed to conceptualization, methodology, validation, writing—original draft preparation, software, data curation, investigation, and visualization. Sultan Kocaman contributed to conceptualization, methodology, validation, writing—original draft preparation, writing—review and editing, and supervision. All authors have read and agreed to the published version of the manuscript.

Funding

Sinem Cetinkaya received the PhD grant from the YOK 100/2000 program.

Data Availability Statement

The avalanche data used in this study were originally provided by Hafner and Bühler [22] https://doi.org/10.16904/envidat.77 (accessed on 20 December 2021). The authors do not have permission to share the data.

Acknowledgments

This study is part of the PhD thesis research of Sinem Cetinkaya.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

In our study focused on AS modeling in the Engelberger Aa, Meienreuss, and Göschenerreuss catchments, we provide comprehensive statistical summaries of key environmental and topographical factors across three descriptive statistics tables (Table A1, Table A2 and Table A3). These tables delineate the variations in factors related to avalanche (1) and non-avalanche (0) occurrences within each specific catchment area. Each row in the table represents a distinct factor, offering insights into its mean, standard deviation, minimum, first quartile (0.25), median (0.50), third quartile (0.75), and maximum values across both categories.
Table A1. Descriptive statistics of Engelberger Aa factors based on avalanche inventory.
Table A1. Descriptive statistics of Engelberger Aa factors based on avalanche inventory.
FactorsInventoryMeanStd DevMin0.250.500.75Max
Altitude (m)01593.24588.45458.391150.011572.942035.393233.93
Altitude (m)11911.27350.30846.601668.411924.142171.012897.65
Aspect (°)0201.05109.28−1.00104.52220.52299.49360.00
Aspect (°)1170.6087.720.00116.92159.34224.30359.99
CI00.075.89−96.81−1.970.042.0496.76
CI1−1.174.30−88.14−2.82−0.761.0163.09
DAH0−0.030.35−0.97−0.30−0.030.230.97
DAH10.100.36−0.95−0.170.150.390.95
DTS0135.55155.860.0030.0080.62183.581124.50
DTS161.98116.850.0010.0022.3658.31842.14
LS-Factor034.7239.330.0016.3428.0341.902605.34
LS-Factor150.2250.250.0027.6538.3454.881580.63
MSP00.540.300.000.290.560.811.00
MSP10.540.290.000.300.570.801.00
Plan Curv.00.000.01−0.170.000.000.000.30
Plan Curv.10.000.01−0.14−0.010.000.000.13
Profile Curv.00.000.01−0.410.000.000.000.35
Profile Curv.10.000.01−0.250.000.000.000.24
Slope (°)029.9615.240.0019.4730.2138.4187.56
Slope (°)133.9213.210.0925.6633.5140.2986.09
TPI00.4012.67−124.38−4.95−0.444.41284.12
TPI1−4.2011.93−100.18−8.31−3.170.66134.30
TRI04.554.340.002.403.865.24191.15
TRI15.144.050.013.184.375.66124.74
TWI05.952.14−0.654.535.656.9523.64
TWI16.261.93−0.024.926.127.3718.44
VD0118.74106.56−332.1732.2587.27181.83509.81
VD1152.48116.11−23.5252.58125.83236.44471.73
VRM00.010.020.000.000.000.010.57
VRM10.010.020.000.000.000.010.46
WEI01.000.090.770.951.001.061.34
WEI11.010.070.780.961.011.051.33
Table A2. Descriptive statistics of Meienreuss factors based on avalanche inventory.
Table A2. Descriptive statistics of Meienreuss factors based on avalanche inventory.
FactorsInventoryMeanStd DevMin0.250.500.75Max
Altitude (m)02166.36466.11819.961826.982205.812517.943410.88
Altitude (m)12256.97382.401073.602013.042304.162556.632983.17
Aspect (°)0159.51101.57−1.0066.47163.80226.03360.00
Aspect (°)1136.7369.27−1.0086.04131.60178.82359.98
CI00.125.09−88.31−1.93−0.031.8989.33
CI1−1.664.16−70.98−3.52−1.280.6351.92
DAH0−0.010.43−0.95−0.400.000.380.96
DAH10.060.35−0.91−0.210.080.330.93
DTS0617.98445.850.00260.00537.12881.422304.10
DTS1597.44440.600.00199.25518.65991.821765.11
LS-Factor041.6553.500.0023.2334.2248.494021.48
LS-Factor151.8740.750.0028.9841.2060.531233.13
MSP00.520.290.000.260.520.771.00
MSP10.520.300.000.250.510.801.00
Plan Curv.00.000.01−0.150.000.000.000.16
Plan Curv.10.000.01−0.14−0.010.000.000.08
Profile Curv.00.000.01−0.140.000.000.000.18
Profile Curv.10.000.01−0.13−0.010.000.000.06
Slope (°)034.6813.460.0025.8334.2343.0183.71
Slope (°)130.7212.420.0021.6830.5138.0877.89
TPI00.6612.02−65.43−5.79−0.835.03146.03
TPI1−5.348.78−47.42−9.79−4.58−0.5383.74
TRI05.183.220.003.234.496.2675.05
TRI14.322.570.002.633.895.2138.02
TWI05.731.970.054.385.616.8121.00
TWI16.872.011.215.526.758.0918.78
VD0138.90127.06−164.3735.1899.55218.08792.84
VD1165.87115.90−14.0983.89141.40207.34485.38
VRM00.010.020.000.000.000.010.66
VRM10.010.020.000.000.000.010.53
WEI01.000.080.760.961.001.051.34
WEI10.980.060.780.950.991.021.32
Table A3. Descriptive statistics of Göschenerreuss factors based on avalanche inventory.
Table A3. Descriptive statistics of Göschenerreuss factors based on avalanche inventory.
FactorsInventoryMeanStd DevMin0.250.500.75Max
Altitude (m)02372.25502.280.002009.942414.892755.653628.03
Altitude (m)12370.60370.321171.302122.572392.382631.753214.11
Aspect (°)0160.10105.27−1.0071.91150.96226.27360.00
Aspect (°)1166.6265.730.03116.26176.04210.56359.92
CI00.075.32−89.97−1.93−0.061.7993.95
CI1−1.374.15−52.58−3.10−0.871.0334.15
DAH0−0.040.41−0.95−0.39−0.080.330.94
DAH10.220.33−0.85−0.030.280.470.94
DTS0790.18554.850.00339.41694.621157.673035.34
DTS1714.37509.530.00272.03643.271114.142308.68
LS-Factor042.1739.420.0022.9834.9650.943612.33
LS-Factor154.7151.880.0026.9341.1363.961138.44
MSP00.520.300.000.260.530.781.00
MSP10.550.310.000.270.590.831.00
Plan Curv.00.000.01−0.170.000.000.000.21
Plan Curv.10.000.01−0.15−0.010.000.000.09
Profile Curv.00.000.01−0.160.000.000.000.19
Profile Curv.10.000.01−0.19−0.010.000.000.06
Slope (°)033.6414.490.0024.3132.8842.3184.51
Slope (°)130.6613.570.1020.9929.9637.8481.42
TPI00.5012.47−99.56−5.53−0.684.53137.40
TPI1−4.5610.93−96.50−8.83−3.430.7658.42
TRI05.093.540.003.024.276.1169.97
TRI14.473.230.152.563.815.1652.46
TWI06.042.280.084.545.887.1922.93
TWI16.911.970.615.516.848.1417.24
VD0141.79143.02−111.3728.4886.56223.07710.84
VD1182.72145.79−25.1270.43127.31300.43563.13
VRM00.010.030.000.000.000.010.60
VRM10.010.020.000.000.000.010.51
WEI01.000.080.760.961.011.051.34
WEI10.980.060.800.940.991.021.23

Appendix B

The results obtained from the SBS algorithm implemented with the CatBoost model in three alpine catchments (Engelberger Aa, Meienreuss, and Göschenerreuss) are presented in Table A4, Table A5 and Table A6, which illustrate the evolution of the classification accuracy as features are systematically reduced, illustrating the effectiveness of the combined SBS-CatBoost approach in enhancing the predictive accuracy of AS models.
Table A4. Selected features and classification accuracy for AS models in Engelberger Aa.
Table A4. Selected features and classification accuracy for AS models in Engelberger Aa.
Selected Features of Engelberger AaAccuracy
16Altitude, Aspect, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Forest, Grassland, Settlement, Water Bodies0.93
15Altitude, Aspect, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Forest, Grassland, Water Bodies0.94
14Altitude, Aspect, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Grassland, Water Bodies0.93
13Altitude, Aspect, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Grassland0.93
12Altitude, Aspect, DAH, DTS, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Grassland0.93
11Altitude, Aspect, DTS, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Grassland0.94 *
10Altitude, Aspect, DTS, MSP, TPI, TRI, TWI, VD, WEI, Grassland0.93
9Altitude, Aspect, DTS, MSP, TPI, TRI, VD, WEI, Grassland0.93
8Altitude, Aspect, DTS, TPI, TRI, VD, WEI, Grassland0.93
7Altitude, Aspect, DTS, TRI, VD, WEI, Grassland0.92
6Altitude, Aspect, DTS, TRI, VD, WEI0.92
5Altitude, Aspect, DTS, VD, WEI0.90
4Altitude, Aspect, DTS, VD0.87
3Altitude, Aspect, DTS0.82
2Altitude, DTS0.76
* The best performance of the model.
Table A5. Selected features and classification accuracy for AS models in Meienreuss.
Table A5. Selected features and classification accuracy for AS models in Meienreuss.
Selected Features of MeienreussAccuracy
16Altitude, Aspect, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, VRM, WEI, Forest, Grassland, Settlement, Water Bodies0.96
15Altitude, Aspect, DAH, DTS, MSP, TPI, TRI, TWI, VD, VRM, WEI, Forest, Grassland, Settlement, Water Bodies0.96
14Altitude, Aspect, DAH, DTS, MSP, TPI, TRI, TWI, VD, WEI, Forest, Grassland, Settlement, Water Bodies0.96
13Altitude, Aspect, DTS, MSP, TPI, TRI, TWI, VD, WEI, Forest, Grassland, Settlement, Water Bodies0.96
12Altitude, Aspect, DTS, MSP, TPI, TRI, TWI, VD, WEI, Forest, Grassland, Settlement0.96
11Altitude, Aspect, DTS, MSP, TPI, TRI, TWI, VD, WEI, Grassland, Settlement0.96
10Altitude, Aspect, DTS, MSP, TPI, TRI, TWI, VD, WEI, Grassland0.96
9Altitude, Aspect, DTS, MSP, TPI, TWI, VD, WEI, Grassland0.96
8Altitude, Aspect, DTS, MSP, TPI, TWI, VD, WEI0.96
7Altitude, Aspect, DTS, MSP, TWI, VD, WEI0.96 *
6Altitude, Aspect, DTS, MSP, VD, WEI0.95
5Altitude, Aspect, DTS, VD, WEI0.95
4Altitude, Aspect, DTS, VD0.94
3Altitude, DTS, VD0.89
2Altitude, VD0.75
* The best performance of the model.
Table A6. Selected features and classification accuracy for AS models in Göschenerreuss.
Table A6. Selected features and classification accuracy for AS models in Göschenerreuss.
Selected Features of GöschenerreussAccuracy
16Altitude, Aspect, CI, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Forest, Grassland, Settlement0.96
15Altitude, Aspect, CI, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Bareland, Grassland, Settlement0.97
14Altitude, Aspect, CI, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Grassland, Settlement0.96
13Altitude, Aspect, CI, DAH, DTS, LS-Factor, MSP, TPI, TRI, TWI, VD, WEI, Grassland0.97
12Altitude, Aspect, CI, DAH, DTS, LS-Factor, MSP, TPI, TRI, VD, WEI, Grassland0.96
11Altitude, Aspect, DAH, DTS, LS-Factor, MSP, TPI, TRI, VD, WEI, Grassland0.96
10Altitude, Aspect, DTS, LS-Factor, MSP, TPI, TRI, VD, WEI, Grassland0.97
9Altitude, Aspect, DTS, LS-Factor, MSP, TPI, VD, WEI, Grassland0.97 *
8Altitude, Aspect, DTS, MSP, TPI, VD, WEI, Grassland0.96
7Altitude, Aspect, DTS, MSP, VD, WEI, Grassland0.96
6Altitude, Aspect, DTS, MSP, VD, WEI0.96
5Altitude, Aspect, DTS, VD, WEI0.96
4Altitude, Aspect, DTS, VD0.94
3Altitude, DTS, VD0.90
2Altitude, DTS0.76
* The best performance of the model.

Appendix C

Here, the AS maps for the Engelberger Aa, Meienreuss, and Göschenerreuss catchments are presented to demonstrate the impact of feature set reduction on the spatial predictions of avalanche occurrences.
Figure A1. The AS maps for Engelberger Aa, Meienreuss, and Göschenerreuss catchments, based on models with varying numbers of features (16, 15, 14, 13, and 12).
Figure A1. The AS maps for Engelberger Aa, Meienreuss, and Göschenerreuss catchments, based on models with varying numbers of features (16, 15, 14, 13, and 12).
Ijgi 13 00312 g0a1
Figure A2. The AS maps for Engelberger Aa, Meienreuss, and Göschenerreuss catchments, based on models with varying numbers of features (11, 10, 9, 8, and 7).
Figure A2. The AS maps for Engelberger Aa, Meienreuss, and Göschenerreuss catchments, based on models with varying numbers of features (11, 10, 9, 8, and 7).
Ijgi 13 00312 g0a2
Figure A3. The AS maps for Engelberger Aa, Meienreuss, and Göschenerreuss catchments, based on models with varying numbers of features (6, 5, 4, 3, and 2).
Figure A3. The AS maps for Engelberger Aa, Meienreuss, and Göschenerreuss catchments, based on models with varying numbers of features (6, 5, 4, 3, and 2).
Ijgi 13 00312 g0a3

References

  1. Bergua, S.B.; Piedrabuena, M.P.; Alfonso, J.L.M. Snow avalanche susceptibility in the eastern hillside of the Aramo Range (Asturian Central Massif, Cantabrian Mountains, NW Spain). J. Maps 2018, 14, 373–381. [Google Scholar] [CrossRef]
  2. Liu, Y.; Chen, X.; Yang, J.; Li, L.; Wang, T. Snow avalanche susceptibility mapping from tree-based machine learning approaches in ungauged or poorly-gauged regions. Catena 2023, 224, 106997. [Google Scholar] [CrossRef]
  3. Yariyan, P.; Omidvar, E.; Karami, M.; Cerdà, A.; Pham, Q.B.; Tiefenbacher, J.P. Evaluating novel hybrid models based on GIS for snow avalanche susceptibility mapping: A comparative study. Cold Reg. Sci. Technol. 2022, 194, 103453. [Google Scholar] [CrossRef]
  4. Varol, N. Avalanche susceptibility mapping with the use of frequency ratio, fuzzy and classical analytical hierarchy process for Uzungol area, Turkey. Cold Reg. Sci. Technol. 2022, 194, 103439. [Google Scholar] [CrossRef]
  5. Akbar, M.; Bhat, M.S.; Chanda, A.; Lone, F.A.; Thoker, I.A. Integrating Traditional Knowledge with GIS for Snow Avalanche Susceptibility Mapping in Kargil-Ladakh Region of Trans-Himalayan India. Spat. Inf. Res. 2022, 30, 773–789. [Google Scholar] [CrossRef]
  6. Durlević, U.; Valjarević, A.; Novković, I.; Ćurčić, N.B.; Smiljić, M.; Morar, C.; Stoica, A.; Barišić, D.; Lukić, T. GIS-Based Spatial Modeling of Snow Avalanches Using Analytic Hierarchy Process. A Case Study of the Šar Mountains, Serbia. Atmosphere 2022, 13, 1229. [Google Scholar] [CrossRef]
  7. Kumar, S.; Srivastava, P.K.; Snehmani Bhatiya, S. Geospatial probabilistic modelling for release area mapping of snow avalanches. Cold Reg. Sci. Technol. 2019, 165, 102813. [Google Scholar] [CrossRef]
  8. Choubin, B.; Borji, M.; Mosavi, A.; Sajedi-Hosseini, F.; Singh, V.P.; Shamshirband, S. Snow avalanche hazard prediction using machine learning methods. J. Hydrol. 2019, 577, 123929. [Google Scholar] [CrossRef]
  9. Rahmati, O.; Ghorbanzadeh, O.; Teimurian, T.; Mohammadi, F.; Tiefenbacher, J.P.; Falah, F.; Pirasteh, S.; Ngo, P.-T.T.; Bui, D.T. Spatial Modeling of Snow Avalanche Using Machine Learning Models and Geo-Environmental Factors: Comparison of Effectiveness in Two Mountain Regions. Remote Sens. 2019, 11, 2995. [Google Scholar] [CrossRef]
  10. Wen, H.; Wu, X.; Liao, X.; Wang, D.; Huang, K.; Wünnemann, B. Application of machine learning methods for snow avalanche susceptibility mapping in the Parlung Tsangpo catchment, southeastern Qinghai-Tibet Plateau. Cold Reg. Sci. Technol. 2022, 198, 103535. [Google Scholar] [CrossRef]
  11. Iban, M.C.; Bilgilioglu, S.S. Snow avalanche susceptibility mapping using novel tree-based machine learning algorithms (XGBoost, NGBoost, and LightGBM) with eXplainable Artificial Intelligence (XAI) approach. Stoch. Environ. Res. Risk Assess. 2023, 37, 2243–2270. [Google Scholar] [CrossRef]
  12. Cetinkaya, S.; Kocaman, S. Snow Avalanche Susceptibility Mapping for Davos, Switzerland. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 2022, XLIII-B3-2022, 1083–1090. [Google Scholar] [CrossRef]
  13. Costache, R.; Arabameri, A.; Costache, I.; Crăciun, A.; Islam, A.R.M.T.; Abba, S.; Sahana, M.; Pham, B.T. Flood susceptibility evaluation through deep learning optimizer ensembles and GIS techniques. J. Environ. Manag. 2022, 316, 115316. [Google Scholar] [CrossRef] [PubMed]
  14. Pham, B.T.; Van Dao, D.; Acharya, T.D.; Van Phong, T.; Costache, R.; Van Le, H.; Nguyen, H.B.T.; Prakash, I. Performance assessment of artificial neural network using chi-square and backward elimination feature selection methods for landslide susceptibility analysis. Environ. Earth Sci. 2021, 80, 686. [Google Scholar] [CrossRef]
  15. Tiwari, A.; Arun, G.; Vishwakarma, B.D. Parameter importance assessment improves efficacy of machine learning methods for predicting snow avalanche sites in Leh-Manali Highway, India. Sci. Total Environ. 2021, 794, 148738. [Google Scholar] [CrossRef]
  16. Guyon, I.; Elisseeff, A. An Introduction to Variable and Feature Selection. J. Mach. Learn. Res. 2003, 3, 1157–1182. [Google Scholar] [CrossRef]
  17. Bolón-Canedo, V.; Sánchez-Maroño, N.; Alonso-Betanzos, A. Recent advances and emerging challenges of feature selection in the context of big data. Knowl. Based Syst. 2015, 86, 33–45. [Google Scholar] [CrossRef]
  18. Kuhn, M.; Johnson, K. Applied Predictive Modeling; Springer Science Business Media: New York, NY, USA, 2013; pp. 27–59. [Google Scholar] [CrossRef]
  19. Hu, S.; Liu, H.; Zhao, W.; Shi, T.; Hu, Z.; Li, Q.; Wu, G. Comparison of Machine Learning Techniques in Inferring Phytoplankton Size Classes. Remote Sens. 2018, 10, 191. [Google Scholar] [CrossRef]
  20. Kohavi, R.; John, G.H. Wrappers for feature subset selection. Artif. Intell. 1997, 97, 273–324. [Google Scholar] [CrossRef]
  21. Ghinoi, A.; Chung, C.J. STARTER: A statistical GIS-based model for the prediction of snow avalanche susceptibility using terrain features—Application to Alta Val Badia, Italian Dolomites. Geomorphology 2005, 66, 305–325. [Google Scholar] [CrossRef]
  22. Hafner, E.; Bühler, Y. SPOT6 Avalanche Outlines 24 January 2018; EnviDat: Zurich, Switzerland, 2019. [Google Scholar] [CrossRef]
  23. Hafner, E.; Leinss, S.; Techel, F.; Bühler, Y. Satellite Avalanche Mapping Validation Data; EnviDat: Zurich, Switzerland, 2021. [Google Scholar] [CrossRef]
  24. Bühler, Y.; Hafner, E.D.; Zweifel, B.; Zesiger, M.; Heisig, H. Where are the avalanches? Rapid SPOT6 satellite data acquisition to map an extreme avalanche period over the Swiss Alps. Cryosphere 2019, 13, 3225–3238. [Google Scholar] [CrossRef]
  25. Hafner, E.D.; Techel, F.; Leinss, S.; Bühler, Y. Mapping avalanches with satellites—Evaluation of performance and completeness. Cryosphere 2021, 15, 983–1004. [Google Scholar] [CrossRef]
  26. Cetinkaya, S.; Kocaman, S. Impact of Learning Set and Sampling for Snow Avalanche Susceptibility Mapping with Random Forest. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2023, XLVIII-M-1, 57–64. [Google Scholar] [CrossRef]
  27. Lundberg, S.; Lee, S. A Unified Approach to Interpreting Model Predictions. In NIPS’17 Proceedings of the 31st International Conference on Neural Information Processing Systems; ACM Press: New York, NY, USA, 2017; Volume 1705, pp. 4765–4774. [Google Scholar]
  28. Lundberg, S.M.; Erion, G.; Chen, H.; DeGrave, A.; Prutkin, J.M.; Nair, B.; Katz, R.; Himmelfarb, J.; Bansal, N.; Lee, S.I. From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2020, 2, 56–67. [Google Scholar] [CrossRef]
  29. Scikit Learn: GridSearchCV. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.GridSearchCV.html (accessed on 13 May 2024).
  30. Can, R.; Kocaman, S.; Gokceoglu, C. A Comprehensive Assessment of XGBoost Algorithm for Landslide Susceptibility Mapping in the Upper Basin of Ataturk Dam, Turkey. Appl. Sci. 2021, 11, 4993. [Google Scholar] [CrossRef]
  31. Yao, Z.; Chen, M.; Zhan, J.; Zhuang, J.; Sun, Y.; Yu, Q.; Yu, Z. Refined Landslide Susceptibility Mapping by Integrating the SHAP-CatBoost Model and InSAR Observations: A Case Study of Lishui, Southern China. Appl. Sci. 2023, 13, 12817. [Google Scholar] [CrossRef]
  32. swissALTI3D. Available online: https://www.swisstopo.admin.ch/en/height-model-swissalti3d (accessed on 20 January 2024).
  33. Conrad, O.; Bechtel, B.; Bock, M.; Dietrich, H.; Fischer, E.; Gerlitz, L.; Wehberg, J.; Wichmann, V.; Böhner, J. System for Automated Geoscientific Analyses (SAGA) v. 2.1.4. Geosci. Model Dev. 2015, 8, 1991–2007. [Google Scholar] [CrossRef]
  34. McClung, D.; Schaerer, P. The Avalanche Handbook; The Mountaineers Books: Seattle, WA, USA, 2006. [Google Scholar]
  35. Schweizer, J.; Jamieson, J.B. Snowpack properties for snow profile analysis. Cold Reg. Sci. Technol. 2003, 37, 233–241. [Google Scholar] [CrossRef]
  36. Akay, H. Towards Linking the Sustainable Development Goals and a Novel-Proposed Snow Avalanche Susceptibility Mapping. Water Resour. Manag. 2022, 36, 6205–6222. [Google Scholar] [CrossRef]
  37. Riley, S.J.; De Gloria, S.D.; Elliot, R. A Terrain Ruggedness that Quantifies Topographic Heterogeneity. Intermt. J. Sci. 1999, 5, 23–27. [Google Scholar]
  38. Revuelto, J.; Billecocq, P.; Tuzet, F.; Cluzet, B.; Lamare, M.; Larue, F.; Dumont, M. Random forests as a tool to understand the snow depth distribution and its evolution in mountain areas. Hydrol. Process. 2020, 34, 5384–5401. [Google Scholar] [CrossRef]
  39. Böhner, J.; Antonić, O. Chapter 8 Land-Surface Parameters Specific to Topo-Climatology. Dev. Soil Sci. 2009, 33, 195–226. [Google Scholar] [CrossRef]
  40. Chen, Y.; Chen, W.; Rahmati, O.; Falah, F.; Kulakowski, D.; Lee, S.; Rezaie, F.; Panahi, M.; Bahmani, A.; Darabi, H.; et al. Toward the development of deep learning analyses for snow avalanche releases in mountain regions. Geocarto Int. 2021, 37, 7855–7880. [Google Scholar] [CrossRef]
  41. Liu, Y.; Chen, X.; Qiu, Y.; Hao, J.; Yang, J.; Li, L. Mapping snow avalanche debris by object-based classification in mountainous regions from Sentinel-1 images and causative indices. Catena 2021, 206, 105559. [Google Scholar] [CrossRef]
  42. Panahi, M.; Sadhasivam, N.; Pourghasemi, H.R.; Rezaie, F.; Lee, S. Spatial prediction of groundwater potential mapping based on convolutional neural network (CNN) and support vector regression (SVR). J. Hydrol. 2020, 588, 125033. [Google Scholar] [CrossRef]
  43. Mosavi, A.; Shirzadi, A.; Choubin, B.; Taromideh, F.; Hosseini, F.S.; Borji, M.; Shahabi, H.; Salvati, A.; Dineva, A.A. Towards an Ensemble Machine Learning Model of Random Subspace Based Functional Tree Classifier for Snow Avalanche Susceptibility Mapping. IEEE Access 2020, 8, 145968–145983. [Google Scholar] [CrossRef]
  44. Choubin, B.; Borji, M.; Hosseini, F.S.; Mosavi, A.; Dineva, A.A. Mass wasting susceptibility assessment of snow avalanches using machine learning models. Sci. Rep. 2020, 10, 18363. [Google Scholar] [CrossRef] [PubMed]
  45. Dietrich, H.; Böhner, J. Cold air production and flow in a low mountain range landscape in Hessia (Germany). Hambg. Beiträge Phys. Geogr. Landschaftsökologie 2008, 19, 37–48. [Google Scholar]
  46. De Reu, J.; Bourgeois, J.; Bats, M.; Zwertvaegher, A.; Gelorini, V.; De Smedt, P.; Chu, W.; Antrop, M.; De Maeyer, P.; Finke, P.; et al. Application of the topographic position index to heterogeneous landscapes. Geomorphology 2013, 186, 39–49. [Google Scholar] [CrossRef]
  47. Dorogush, A.V.; Ershov, V.; Gulin, A. CatBoost: Gradient boosting with categorical features support. arXiv 2018, arXiv:1810.11363. [Google Scholar]
  48. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  49. Hafner, E.D.; Techel, F.; Daudt, R.C.; Wegner, J.D.; Schindler, K.; Bühler, Y. Avalanche size estimation and avalanche outline determination by experts: Reliability and implications for practice. Nat. Hazards Earth Syst. Sci. 2023, 23, 2895–2914. [Google Scholar] [CrossRef]
Figure 1. A schematic overview of the proposed framework.
Figure 1. A schematic overview of the proposed framework.
Ijgi 13 00312 g001
Figure 2. Engelberger Aa, Meienreuss, and Göschenerreuss catchments (sub-catchments of the Reuss River Basin).
Figure 2. Engelberger Aa, Meienreuss, and Göschenerreuss catchments (sub-catchments of the Reuss River Basin).
Ijgi 13 00312 g002
Figure 3. Altitude maps of Engelberger Aa, Meienreuss, and Göschenerreuss catchments.
Figure 3. Altitude maps of Engelberger Aa, Meienreuss, and Göschenerreuss catchments.
Ijgi 13 00312 g003
Figure 4. LULC classification maps for Engelberger Aa, Meienreuss, and Göschenenreuss.
Figure 4. LULC classification maps for Engelberger Aa, Meienreuss, and Göschenenreuss.
Ijgi 13 00312 g004
Figure 5. Flowchart of iterative feature elimination using CatBoost with GridSearchCV.
Figure 5. Flowchart of iterative feature elimination using CatBoost with GridSearchCV.
Ijgi 13 00312 g005
Figure 6. (a) The AS map of the Engelberger Aa catchment using the optimal feature set and (b) SHAP summary plot.
Figure 6. (a) The AS map of the Engelberger Aa catchment using the optimal feature set and (b) SHAP summary plot.
Ijgi 13 00312 g006
Figure 7. (a) The AS map of the Meienreuss catchment using the optimal feature set and (b) SHAP summary plot.
Figure 7. (a) The AS map of the Meienreuss catchment using the optimal feature set and (b) SHAP summary plot.
Ijgi 13 00312 g007
Figure 8. (a) The AS map of the Göschenerreuss catchment using the optimal feature set and (b) SHAP summary plot.
Figure 8. (a) The AS map of the Göschenerreuss catchment using the optimal feature set and (b) SHAP summary plot.
Ijgi 13 00312 g008
Table 1. Brief summary of the ML methods and the features used for AS mapping in the recent literature.
Table 1. Brief summary of the ML methods and the features used for AS mapping in the recent literature.
ReferenceYearMethodLocationFeaturesNo. of Features
Choubin et al. [8]2019SVM, MDAIndian HimalayasPrecipitation, Temperature, Elevation, Slope, Aspect, Curvature, Drainage Density, Topographic Wetness Index, Topographic Position Index, Vector Ruggedness Measure, Distance to Stream, Distance to Fault, Land Use, Lithology14
Rahmati et al. [9]2019SVM, RF, NB, GAMDarvan and Zarrinehroud Watersheds, IranElevation, Topographic Position Index, Terrain Ruggedness Index, Topographic Wetness Index, Vector Ruggedness Measure, Weighted Elevation Index, LS Factor, Relative Slope Position, Slope, Aspect, Profile Curvature, Distance from Stream, Lithology, Land Use14
Tiwari et al. [15]2021SVM (with Linear, Polynomial, Sigmoid, RBF Kernels)Leh-Manali Highway, IndiaElevation, Slope, Aspect, Plan Curvature, Roughness, Topographic Wetness Index, Precipitation, Temperature, Wind Speed, Normalized Difference Vegetation Index, Soil Wetness Index11
Varol [4]2022FR, AHP, Fuzzy AHPUzungol, Trabzon, TurkeyElevation, Slope, Curvature, Aspect, Vegetation5
Akbar et al. [5]2022AHPKargil-Ladakh Region, Trans-HimalayasElevation, Slope, Profile Curvature, Land Cover, Aspect, Distance from Lineaments6
Durlević et al. [6]2022AHPŠar Mountains, SerbiaElevation, Slope, Aspect, Profile Curvature, Terrain Ruggedness Index, Topographic Wetness Index, LS Factor, Air Temperature, Normalized Difference Snow Index, Weighted Elevation Index, Normalized Difference Vegetation Index, Bare Soil Index, Distance from Stream, Lithology14
Wen et al. [10]2022SVM, KNN, CART, MLPParlung Tsangpo Catchment, Southeastern TibetElevation, Slope, Aspect, Surface Roughness, Curvature, Relief Amplitude, Earth’s Surface Incision, Variance Coefficient in Elevation, Average Annual Snowfall, Average Annual Snowfall Days, Average Temperature of January, Maximum Snow Depth, Distance to Rivers, Distance to Faults, Normalized Difference Vegetation Index, Land Use16
Cetinkaya and Kocaman [12]2022LR, RFDavos, SwitzerlandElevation, Slope, Plan Curvature, Profile Curvature, Aspect, Topographic Position Index, Terrain Ruggedness Index, Topographic Wetness Index, Land Use and Land Cover, Lithology, Distance to Road, Distance to River12
Liu et al. [2]2023CatBoost, LightGBM, RF, XGBoostTianshan Mountains, ChinaAspect, Slope, Elevation, Precipitation, Average Temperature, Slope Length, Drainage Density, Distance to River, Profile Curvature, Plan Curvature, Average Wind Speed, Maximum Snow Depth, Relative Slope Position, Topographic Wetness Index, Topographic Position Index, Terrain Ruggedness Index, Terrain Surface Convexity, Terrain Surface Texture, Vector Ruggedness Measure, Relief Degree of Land Surface20
Iban and Bilgilioglu [11]2023XGBoost, LightGBM, NGBoost, AdaBoost, RF, GBProvince of Sondrio, ItalyElevation, Slope, Aspect, Plan Curvature, Profile Curvature, Topographic Wetness Index, Terrain Ruggedness Index, Topographic Position Index, Proximity to Road, Proximity to Stream, Land Use, Precipitation, Maximum Temperature, Minimum Temperature, Wind Speed, Solar Radiation, Lithology17
Table 2. The performance measures used in the study.
Table 2. The performance measures used in the study.
MetricFormulaEquation
Precision T P T P + F P (7)
Recall T P T P + F N (8)
F1-score 2 × p r e c i s i o n × r e c a l l p r e c i s i o n + r e c a l l (9)
Specificity T N T N + F P (10)
Negative Predictive Value T N T N + F N (11)
Accuracy T P + T N T P + T N + F P + F N (12)
Table 3. The results of multicollinearity analysis.
Table 3. The results of multicollinearity analysis.
Engelberger AaMeienreussGöschenerreuss
VIFTOLVIFTOLVIFTOL
Altitude2.6060.3842.7160.3683.3770.296
Aspect1.0940.9141.3040.7671.2340.810
CI2.0630.4852.6530.3772.4600.406
DAH1.1340.8821.3140.7611.2810.781
DTS1.2700.7871.6990.5891.9650.509
LS-Factor2.4610.4062.2710.4402.5910.386
MSP1.2380.8081.2970.7711.3230.756
Plan Curv.2.2850.4382.7900.3582.7010.370
Profile Curv.1.8940.5281.7090.5851.8760.533
Slope6.3540.15710.8160.09210.4090.096
TPI3.0220.3313.2490.3083.1490.318
TRI3.5890.2797.9720.1257.3400.136
TWI4.2040.2384.8570.2065.0770.197
VD2.0050.4992.5610.3912.8550.350
VRM1.3380.7471.4100.7091.3960.716
WEI3.9320.2545.0300.1994.4770.223
Table 4. Performance measures for the Engelberger Aa, Meienreuss, and Göschenerreuss catchments expressed in precision, recall, F1-score, specificity, NPV, and accuracy.
Table 4. Performance measures for the Engelberger Aa, Meienreuss, and Göschenerreuss catchments expressed in precision, recall, F1-score, specificity, NPV, and accuracy.
MetricsEngelberger Aa
(11 Features)
Meienreuss
(7 Features)
Göschenerreuss
(9 Features)
Precision0.910.950.94
Recall0.960.980.97
F1-score0.940.970.96
Specificity0.960.980.97
Negative Predictive Value0.910.950.94
Accuracy0.940.960.97
5-fold Mean CV Score0.9310.9580.954
Confidence Intervals
[Lower Bound, Upper Bound]
[0.929, 0.934][0.956, 0.960][0.953, 0.955]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Cetinkaya, S.; Kocaman, S. Integrating Sequential Backward Selection (SBS) and CatBoost for Snow Avalanche Susceptibility Mapping at Catchment Scale. ISPRS Int. J. Geo-Inf. 2024, 13, 312. https://doi.org/10.3390/ijgi13090312

AMA Style

Cetinkaya S, Kocaman S. Integrating Sequential Backward Selection (SBS) and CatBoost for Snow Avalanche Susceptibility Mapping at Catchment Scale. ISPRS International Journal of Geo-Information. 2024; 13(9):312. https://doi.org/10.3390/ijgi13090312

Chicago/Turabian Style

Cetinkaya, Sinem, and Sultan Kocaman. 2024. "Integrating Sequential Backward Selection (SBS) and CatBoost for Snow Avalanche Susceptibility Mapping at Catchment Scale" ISPRS International Journal of Geo-Information 13, no. 9: 312. https://doi.org/10.3390/ijgi13090312

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop