1. Introduction
In recent years, the sustainability has attracted a significant attention [
1,
2,
3]. Sustainability information is used more and more in different stakeholders’ decisions [
4]. Companies are advised to voluntarily disclose matters regarding their sustainability. The disclosure improves the accountability and transparency of companies’ operations and make the investors’ valuation proper [
5]. More and more companies have begun to pay attention to their sustainability information disclosure [
6,
7,
8,
9,
10,
11]. For heavily polluting industries, its environmental impact, employees’ occupational health plans, and product safety issues are part of sustainability information. Therefore, the quality of sustainability information disclosure in heavily polluting industries are more concerned.
Since the disclosure of sustainability information is not compulsive, the quality of disclosed sustainability information is various [
12,
13,
14]. High quality disclosure indicates that enterprises are willing to shoulder social responsibilities and establish a good corporate image. It will help attract investment, improve risk management ability, and enhance enterprise management performance [
6]. The quality of the disclosure of sustainability information needs to be evaluated. Using the evaluation results, the stakeholder can comprehensively and directly understand the sustainability of the company. Meanwhile, it is also the valuable reference for the improvement of disclosure of sustainability information.
Researches have been put on the quality of sustainability information disclosure. Most focus on the impact of company or industry characteristics on the quality of sustainability information disclosure. For example, Brammer and Pavelin studied the impact of the nature of business activities, the environmental performance, firm size, company ownership etc. on the quality of corporate environmental information disclosure [
6]; Orazalin and Mahmood used the largest oil and gas company in Russia as a sample to study the potential impacts of sustainability information quality [
7]; Martínez-Ferrero et al., reveals the effect of financial reporting quality on sustainability information disclosure [
9]. Michelon & Parbonetti examine the relationship of board composition, leadership and structure on sustainability disclosure [
10]. Cuadrado-Ballesteros et al. study the relationship between the media pressure and the disclosure of sustainability information [
11]. Dilling studies the characteristics of corporations that impact the quality of sustainability reports [
15].
The research on the evaluation of quality of disclosures is relatively few. For example, Romolini et al., used inductive methods to measure the quality of disclosures in sustainability reports by assessing current disclosures of Global Reporting Initiative (GRI) indicators [
13]; Manes-Rossi et al., selected 50 European companies to assess their disclosure levels by studying compliance with their annual reports and comprehensive reports on EUG [
14]. The evaluations in these researches are based on the compliance of case companies to relevant indicators. It only evaluates from the integrity and standardization aspects, which are not complete. In fact, there are many other indicators to be paid attention to. For example, the accordance with relevant indicators can only reflects whether corresponding contents are disclosed. The degree of detail of the disclosure cannot be reflected. Obviously, different level of detail of the disclosure will lead to significant differences in the quality of the disclosure of sustainability information. But the in previous methods, it cannot be reflected. Moreover, the evaluation is performed by one or two persons [
13,
14]. As very few people participated in the evaluation, there is probably bias in the judgement due to limited levels of expertise. Aggregating the opinions of multiple experts will ease the bias of a single person to the greatest extent and make the evaluation more objective.
In order to resolve the problem, this paper proposed the approach to evaluating the quality of sustainability information disclosure. With the proposed method, the quality of the disclosure can be evaluated directly and more comprehensively.
Firstly, aspects of the evaluation are determined, which guides the construction of the indicator system. It focuses more on the quality of information disclosure. Then the corresponding indicators tied to sustainability for the evaluation of quality of sustainability information disclosure is derived. It is fully considered that the contents of the evaluation are sustainability information. With the analysis and extension of the existing literatures [
8,
16,
17,
18], the derived six aspects are completeness [
16], adequacy [
8], relevance [
17], reliability [
17], normativeness [
18] and clarity [
17]. Completeness refers to the breadth of the report disclosure [
16]. Adequacy reflects the depth of disclosure of the report. Relevance shows the usefulness of the report disclosure to the reader [
8]. Reliability is the trustworthiness of the reader to the content of the report [
17]. Normativeness describes the compliance of the report with the G3.1 indicator disclosure requirement [
18]. Clarity indicates the reader’s ability to comprehend the sustainability reporting [
17].
Afterwards, the novel evaluation method is proposed to deal with the evaluation information, which not only considers the weight of experts but also subject and object weights of indicators. In the method, a group of experts are invited to give the evaluation information. Since the linguistic terms are preferred in the evaluation, the intuitionistic fuzzy sets are used to model the linguistic ratings. Not only the membership and nonmembership but also the hesitation is used to characterize the vagueness and uncertainty [
19,
20,
21,
22]. The evaluation information can be modeled more comprehensively. Different expertise and knowledge lead to different level on the accuracy of opinions. The weights of experts are calculated based on entropy [
23]. Moreover, indicators play different roles in the discrimination of candidates. The subject weight representing the importance and the object weight representing the discrimination capability are often integrated as the weight of indicators [
24,
25]. However, in intuitionistic fuzzy setting, they are treated separately in current researches [
23,
26]. In the study, the two kinds of weights are integrated based on entropy. Finally, the opinions of multiple experts are integrated as the final evaluation results with the weight of experts and indicators.
Finally, the seven representative companies are selected as the case company to verify the proposed approach. Meanwhile, the evaluation results are analyzed and suggestions are given for further improvement.
The rest of this paper is organized as follows.
Section 2 introduces the entropy and intuitionistic fuzzy sets.
Section 3 builds evaluation indicator system from six aspects.
Section 4 proposes the evaluation method.
Section 5 is the application of the proposed approach. The conclusion along with future research are given in
Section 6.
3. Construction of Indicator System
Sustainability information disclosure essentially belongs information disclosure related to sustainability. Therefore, there needs to determine the aspects of information disclosure firstly. Based on the literatures [
8,
16,
17,
18], the six aspects including completeness [
16], adequacy [
8], relevance [
17], reliability [
17], normativeness [
18] and clarity [
17] are determined. In the work [
16], the completeness is used to measure the environmental information disclosure. The adequacy is used in the work [
8] to evaluate the environmental performance information disclosure. Relevance, reliability and clarity are used for the evaluation of quality of social responsibility information disclosure [
17]. Normativeness is derived from the work [
18], which is used to assess the quality of sustainability reporting.
Based on the above aspects and the information tied to sustainability, the sustainability information disclosure quality evaluation indicator system is built, which is directly related to sustainability information disclosure. For example, sustainability information usually includes social, economic and environmental aspects. Therefore, in the aspect of completeness, there are the degree of disclosure of economic information and social information. The environmental information is subdivided into dye emissions, total emission reduction. It can be seen that the indicators are closely related to sustainability information.
The quality evaluation indicator system for sustainability information disclosure is shown in
Table 1 and the detailed illustration are as follows.
- (1)
Completeness refers to the breadth of the report disclosure. Sustainability reports generally cover social, economic and environmental aspects [
12]. For the heavily polluting industry, the most important is its environmental information. In the “Guidelines for Environmental Information Disclosure of Listed Companies” (Draft for Comment) issued by the Ministry of Environmental Protection of China in 2010 [
51], the 16 heavily polluting industries identified by their classification must disclose the degree of disclosure of pollutant discharge compliance, the degree of disclosure of the completion of the total emission reduction task, the degree of disclosure of the implementation of the “three simultaneous” system etc [
16].
- (2)
Adequacy refers to the depth of disclosure of the report. For heavily polluting enterprises, the part that should be substantially disclosed is the environmental part. Generally speaking, the larger the proportion of environmental information, the more adequate the information disclosure. In addition, the way information is disclosed also determines the adequacy of information disclosure to a certain extent. At present, there are three main ways of environmental information disclosure, including consolidated reports, supplementary reports and independent reports [
16]. Compared with consolidated reports and supplementary reports, corporate disclosures using independent reports will be more fully disclosed.
- (3)
Relevance is the usefulness of the report disclosure to the reader, which generally includes three aspects: timeliness [
17], predictability and importance [
52]. For matters happening in the enterprise, timely disclosure should be made. The more timely the disclosure, the higher the quality of the report [
17]. The content of the report should be predictive. For heavily polluting industries, the predictability is mainly reflected in whether the expected environmental risks are disclosed. In addition, issues of concern to stakeholders should be substantively disclosed in accordance with the principle of importance.
- (4)
Reliability is the trustworthiness of the reader to the content of the report. Mainly depends on the neutrality, verifiability and authenticity of the report [
17]. In addition, whether the company passes the ISO (International Organization for Standardization) environmental system certification [
54] and reports whether it is audited by an independent third party will also affect the reliability of the report. For heavily polluting enterprises, environmental problems are the most important problems they face, and the ISO environmental system certification can prove that the organization has reached an international level in environmental management, which can enhance readers’ conviction on reports. And if the report is audited by an independent third party, it can also enhance the reliability of the report and improve the quality of the report.
- (5)
Currently, there are no uniform disclosure standards for sustainability reports. Different companies have different disclosure standards, guidelines, and specifications. In addition, the reporting language also has problems such as normativeness and rigor. In recent years, as GRI guidelines have become more widely used, more and more companies are providing GRI indicator index in their report appendix [
8]. This index describes the compliance of the report with the G3.1 indicator disclosure requirements, which to some extent enhances the normative nature of the report and improves the quality of the report.
- (6)
Clarity is the reader’s comprehensibility of sustainability reporting. When preparing a sustainability report, it is necessary to give practical consideration to the reader’s ability to understand [
17,
54]. If the disclosed report is difficult to understand, it loses its meaning. Therefore, it is necessary to use an easy-to-understand language when disclosing, and to make necessary explanations for unavoidable technical terms and abbreviations. In addition, the sustainability report should not be limited to a fixed form. Personalized disclosure should be encouraged to avoid the same content that is disclosed each year, so that readers can have a deeper understanding of the sustainable development of the company through reading reports [
17].
4. Evaluation Method
The indicators in
Table 1 are qualitative. It is difficult to get exact numerical judgements. Instead, linguistic assessments are preferred. Because the ratings are in linguistic form, intuitionistic fuzzy sets are applied to model the linguistic ratings comprehensively. The intuitionistic fuzzy entropy is used to discriminate the experts and indicators. Since expertise level and familiarity degree are probably not identical, experts need to be discriminated [
23]. The stronger consistency of opinions indicates the expert is more reliable [
23]. The corresponding expert will be given a higher weight. The two kinds of expert weights are derived by the ratings of enterprise and indicators respectively based on intuitionistic fuzzy entropy [
23]. Moreover, the weights of indicators are also not same [
24]. The weight of indicators should include the importance and the discrimination [
24]. The importance named as subject weight is often rated by experts. The discrimination capability named as object weight is often derived by calculating the discrimination capability of the indicator. In intuitionistic fuzzy settings, these two kinds of weight are used separately in current researches [
23,
26]. In order to get a more comprehensive weight of indicators, in the study, the object weight [
41] and subject weight [
23,
56] are derived with intuitionistic fuzzy entropy and integrated as the weight of indicators. Firstly, the weight of experts and the corresponding weighted score and weighted importance of the indicator are derived [
23]. The object weight of the indicator is calculated [
41]. Then the weighted importance and object weight of the indicator are integrated as the weights of the indicator [
25]. Finally, the evaluation results are derived by aggregating ratings. The detailed steps are given as follows.
Let be the set of evaluators, be the set of alternatives, and be the set of indicators. Assume that the weight vector for the score with respect to indicator of m alternatives can be expressed in , where and , and the score for importance of indicator of enterprise can be expressed in , where . The K evaluators are invited to evaluate the score with respect to indicator of enterprise and the score for importance of indicator of enterprise separately. Then obtain the intuitionistic fuzzy decision matrix and by evaluator , where the intuitionistic fuzzy set can be expressed in IFS (intuitionistic fuzzy sets) . And , , respectively express the satisfaction, dissatisfaction and hesitancy degree of evaluator under the indicators of the enterprise , , , , .
Step 1. Assume that the scoring with respect to indicator
of enterprise
given by the evaluator
can be expressed in IFS
, the scoring for importance of indicator
given by the evaluator
can be expressed in IFS
. Therefore, the corresponding intuitionistic fuzzy decision matrix
and
can be shown concisely in matrix in the following form.
where
,
.
Step 2. Obtain intuitionistic fuzzy entropy of the scoring of enterprise. According to the evaluator evaluation results of the scoring with respect to indicator
of alternative
, calculate the intuitionistic fuzzy entropy
and then obtain the entropy weight of
indicators [
56] as the weight of evaluator
on the enterprise score by the following formula.
Step 3. Calculate the weighted evaluation value for the scoring of enterprise. Based on the weight of
evaluator on the enterprise score
and the enterprise scoring information, with Equation (3), calculate the weighted evaluation value of indicators
of enterprise
on the enterprise scoring
.
where
.
Step 4. Obtain the entropy weight on the enterprise scoring. Based on the weighted evaluation value
, with Equations (6) and (7), calculate the entropy weight
with respect to indicators
of all
enterprises on the enterprise scoring by using the following formula [
41].
Step 5. Obtain intuitionistic fuzzy entropy of the scoring for importance of indicators. According to the evaluator evaluation results of the scoring for importance of indicator
of enterprise
, calculate the intuitionistic fuzzy entropy
and then obtain the entropy weight of
indicators [
56] as the weight of evaluator
on the scoring for importance of indicator by the following formula.
Step 6. Calculate the weighted evaluation value for the scoring for importance of indicators. Based on the weight of
evaluator on the enterprise score
and the importance of indicator scoring of enterprise
information, with Equation (3), calculate the weighted evaluation value
of indicators
on the scoring for importance of indicator as the weight of indicators.
where
.
Step 7. Obtain the weight of indicators. Based on the entropy weight of the enterprise scoring and the weighted evaluation value for the scoring for importance of indicators, with Equation (3), obtain the weight of indicators .
Step 8. Calculate the weight of indicators. According to the weight of indicators , with Equation (8), calculate the corresponding score value.
Step 9. Obtain the final evaluation results. Based on the weight of enterprise scoring and the weight of indicators , with Equation (2), obtain the final evaluation results by using the following formula.
Step 10. Calculate the final evaluation score of enterprise . According to the final evaluation results , with Equation (8), calculate the final evaluation score of enterprise by using the score function as follows.