Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Next Article in Journal
Sustainable Performance Evaluation: Evidence from Listed Chinese Mining Corporations
Next Article in Special Issue
Porcelain Insulator Crack Location and Surface States Pattern Recognition Based on Hyperspectral Technology
Previous Article in Journal
Tracking an Auto-Regressive Process with Limited Communication per Unit Time
Previous Article in Special Issue
Fault Diagnosis of Permanent Magnet Synchronous Motor Based on Stacked Denoising Autoencoder
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Maximum Entropy Approach to Reliability of Multi-Component Systems with Non-Repairable or Repairable Components

1
Graduate School of China Academy of Engineering Physics, Beijing 100193, China
2
Beijing Computational Science Research Center, Beijing 100193, China
*
Authors to whom correspondence should be addressed.
Entropy 2021, 23(3), 348; https://doi.org/10.3390/e23030348
Submission received: 14 February 2021 / Revised: 10 March 2021 / Accepted: 10 March 2021 / Published: 15 March 2021
(This article belongs to the Special Issue Reliability of Modern Electro-Mechanical Systems)

Abstract

:
The degradation and recovery processes are multi-scale phenomena in many physical, engineering, biological, and social systems, and determine the aging of the entire system. Therefore, understanding the interplay between the two processes at the component level is the key to evaluate the reliability of the system. Based on the principle of maximum entropy, an approach is proposed to model and infer the processes at the component level, and is applied to repairable and non-repairable systems. By incorporating the reliability block diagram, this approach allows for integrating the information of network connectivity and statistical moments to infer the hazard or recovery rates of the degradation or recovery processes. The overall approach is demonstrated with numerical examples.

1. Introduction

Degradation processes are ubiquitous in many physical, engineering, biological, and social systems. Modeling the degradation is crucial for lifetime prediction and has drawn increasing attention in the field of reliability and risk analysis [1]. Reliable and accurate lifetime prediction remains a great challenge due to the time-varying and stochastic nature of degradation processes.
In reliability theory, the hazard rate function characterizes the failure probability in the degradation processes, and determines the probability distribution of the lifetime. To estimate the hazard rate function, the lifetime distribution is usually presumed in a certain form, and is fitted with the lifetime testing data. Alternatively, with a large number of lifetime data, an empirical curve can be directly established by interpolation. Both methods require sufficient samples of data to assure the accuracy and reliability of the results. For high reliability-demanding systems or parts, the sample size is usually small. To alleviate the difficulty, the previous study [2] proposed a method based on the maximum entropy principle (MaxEnt) [3,4,5] to estimate the hazard rate function and the lifetime distribution with limited lifetime testing data of the whole system.
However, the forecast of an on-going aging process of a multi-component system is still challenging. For most complex multi-component systems, it is difficult to obtain enough system-level lifetime data due to the restriction on the trial cost, the limitation of the observation, the very low degradation rate, and so on. An alternative method is to estimate degradation at the component level, leveraging the fact that the component-level degradation is closely associated with the aging of the whole system. The association is defined by the structural function [6], which can be represented by the reliability block diagram [7]. Existing studies, including but not limited to [6,7], neglect the correlations between the components. However, the failure of an individual component usually leads to a load redistribution to other normal components in a complex system, influencing the degradation among components. Therefore, ignoring the correlation may cause unknown risk. There are no formal rules to deal with the interaction of the degradations among connected components [8].
The network approach is widely used to model the spreading dynamics of epidemics and information in society [9,10,11,12,13], and such spreading dynamics resemble the degradation propagation in a complex system. The network approach has demonstrated its advantage in modeling the systems with multiple correlated components [14,15] such as, an electrical circuit with multiple electronic components, a mechanical system involving multiple parts, a living consisting of multiple organs [16,17,18,19,20,21,22,23], and many other.
By combining the network approach, this study develops a MaxEnt-based reliability method for general multi-component systems. The basic idea is to represent the entropy of the system as a function of the hazard rate functions of the participating components. The connectivity of the components in the network can subsequently be recast to an equivalent reliability block diagram of the system. In particular, non-repairable and repairable models are focused to motivate the development of the proposed method. The former one represents a network with multiple inter-connected components where the components only undergo degradation process. The latter one allows for the recovery or replacement of failed components, by which the forecast of an on-going aging-recovering process is demonstrated. To study the degradation propagation, the failure of one component alters the hazard rate function of neighboring components in both models. By incorporating the reliability block diagram, the components are hierarchically organized in a parallel-series diagram. The statistical moments are used in the macroscopic model to reduce the inherent noise in early-stage data. Furthermore, under the assumption of a homogeneous hazard rate, the one-shot type of data can be transformed to equivalent moment data with the reliability block diagram.
This paper is organized as follows. In Section 2, the multi-component system is briefly reviewed. In Section 3, the microscopic model for the non-repairable system is developed. The MaxEnt is used to infer the (inhomogeneous and homogeneous) hazard rates of the components with the different topologies of the network. In Section 4, the reliability block diagram is employed as a tool to aggregate different types of information. In Section 5, the microscopic model for repairable systems is discussed in detail. The repairable-component model of the Watts–Strogatz small world [24] is adopted to demonstrate the proposed method. Different limitations of accessible information, such as the local observation and the one-shot observation, are taken into account.

2. Modeling the Degradation and the Recovery Processes

In this paper, the multi-component systems are modeled by the networks, where nodes denote the components. Each component has two possible states, namely, the normal state and failed state.
The propagation of degradation is driven by one or more failed components in the system. The degradation process of a component is triggered by a failed neighboring component with the transition rate x ( t ) , where t is the duration that the component connects with at least one failed component. Its remaining lifetime T is a random variable with a probability Prob ( T > t ) = F ( t ) . For a normal component connected to more than one failed component, the transition rate is assumed to be the same. The transition rate function is defined by:
x ( t ) = d ln F ( t ) d t ,
which is also called the hazard rate function in reliability theory. With the degradation process defined for an individual component, the joint distributions of all the components’ lifetimes are directly constructed by the hazard functions.
The repairable-component model is built by adding the recovery process. Similar to the degradation process, the recovery time T ˜ is assumed to be a random variable with the cumulative distribution Prob ( T ˜ > t ) = R ( t ) . The recovery rate function is defined by:
y ( t ) = d ln R ( t ) d t .
Recovered components are assumed to undergo further degradation.

3. The Non-Repairable System

The standard MaxEnt provides a method to construct the most probable distribution with linear constraints, e.g., moment constraints, or convex constraints [25]. In practice, the small number of constraints may lead to an imprecise inference. For example, for a two-dimensional distribution, if the constraints are the first moments of the two random variables, the standard MaxEnt only provides an uncorrelated distribution, since the first moments do not contain information of correlations. The construction of correlated distributions requires more constraints, which raises a higher requirement of observation.
To reduce the requirement of available information, an alternative way is proposed by combining the MaxEnt with the degradation model, which is regarded as prior knowledge and constrains the probability distribution. Namely, the variation is done in a physical subset of the probability distribution functional space. In this section, the variational probability distributions rely on the network structures and the model. A standard MaxEnt with moment constraints is equivalent to the maximum likelihood estimation, while the MaxEnt based on degradation model here is different from the maximum likelihood estimation.
To begin with, the double-component systems as presented in Figure 1a,b, are studied to present the inference of the components’ hazard rates via MaxEnt. The two components are labeled by C 1 and C 2 with lifetimes t 1 and t 2 . The joint probability distribution of lifetimes p ( t 1 , t 2 ) is associated with the hazard rates x i with i = 1 , 2 . The system may degrade in two different possible ways: C 1 degrades first and C 2 follows, and the opposite. The joint distribution of the lifetimes is written as:
p ( t 1 , t 2 ) p 12 ( t 1 , t 2 ) θ ( t 2 t 1 ) + p 21 ( t 1 , t 2 ) θ ( t 1 t 2 ) ,
where θ denotes the step function. p 12 , p 21 are the functions depending on the structure of the graph, which will be explicitly defined in different cases. The structure-dependent joint distribution implies the physical subset in which the variation is done.
In the following, the inference of the life time distribution p ( t 1 , t 2 ) given a different type of information is developed based on the MaxEnt principle. Both the degradation sequence and the lifetimes are considered in the joint distribution (3). The Shannon entropy [26] of the joint distribution is written as:
S [ p ] = p ( t 1 , t 2 ) ln p ( t 1 , t 2 ) d t 1 d t 2 .
The linear constraints are:
C [ p ] = k ξ k f k ( t 1 , t 2 ) p ( t 1 , t 2 ) d t 1 d t 2 ,
where ξ k s are the Lagrange multipliers corresponding to the averages of f k with k = 1 , 2 , , and the averages are either the moments or the correlations of the components’ lifetimes. These constraints are the same with that considered in the standard MaxEnt.
The most probable probability distribution is obtained through maximizing the entropy with the constraints:
δ ( S + C ) δ p = 0 ,
which also gives the most probable hazard rate.

3.1. MaxEnt for Double-Component Non-Repairable Model: Independent Degradation

Figure 1a shows independent degradations of the two components. The joint probability distribution of lifetimes p ( t 1 , t 2 ) = p 1 ( t 1 ) p 2 ( t 2 ) is determined by:
p ( t 1 , t 2 ) = p 1 ( t 1 ) p 2 ( t 2 ) x 1 ( t 1 ) x 2 ( t 2 ) exp [ X 1 ( t 1 ) X 2 ( t 2 ) ] ;
with the hazard rate function x i of each component and X i ( t ) = 0 t x i ( t ) d t , i = 1 , 2 . In this case, p 12 is same with p 21 , i.e., p 12 = p 21 = x 1 ( t 1 ) x 2 ( t 2 ) exp [ X 1 ( t 1 ) X 2 ( t 2 ) ] . The hazard rate function is directly used here, because in general a one-dimensional distribution p i ( t ) (defined with t [ 0 , ) ) can be expressed as p i ( t ) = x i ( t ) exp [ X i ( t ) ] .
By defining a function L ( x 1 , X 1 , x 2 , X 2 , t ) = p ln p k ξ k f k ( t 1 , t 2 ) p , Equation (6) is rewritten as S + C = L d t 1 d t 2 . With Euler–Lagrange equations, it follows from Equation (6) that:
x ˙ i x i 2 + x i k ξ k 0 t h i ( k ) x i ¯ ( t i ¯ ) exp [ X i ¯ ( t i ¯ ) ] d t i ¯ = 0 ,
where i , i ¯ = 1 , 2 , i i ¯ , and h i ( k ) = t i f k ( t 1 , t 2 ) | t i = t .
If taking the average lifetimes t ¯ 1 , t ¯ 2 as the constraints, i.e., f 1 = t 1 , f 2 = t 2 , then the solutions become x 1 = 1 / t ¯ 1 , x 2 = 1 / t ¯ 2 for Equation (8).
Note that not all the correlations and the moments can be fused by Equation (8). For example, one considers f 1 = t 1 , f 2 = t 2 , f 3 = t 1 t 2 and determines the Lagrange multipliers by these observed values t ¯ 1 , t ¯ 2 , and t 1 t 2 ¯ . No solution exists for the Lagrange multipliers ξ k in Equation (8) when t ¯ 1 t ¯ 2 t 1 t 2 ¯ , because the distribution in Equation (7) implies t 1 is independent with t 2 which is conflicted with the available information. To remove such conflict, one could modify the degradation model (i.e., modify the physical subset) or select other constraints, for example, f 1 = t 1 , f 2 = t 2 , f 3 = ( t 1 t 2 ) 2 , and the solution to Equation (6) becomes:
p ( t 1 , t 2 ) = 1 Z exp [ ξ ˜ 1 t 1 ξ ˜ 2 t 2 ξ 3 ( t 1 2 + t 2 2 ) ] ,
where Z is the partition function and ln Z / ξ ˜ 1 = t ¯ 1 , ln Z / ξ ˜ 2 = t ¯ 2 , ln Z / ξ 3 = ( t 1 t 2 ) 2 ¯ + t ¯ 1 t ¯ 2 with ξ ˜ 1 = ξ 1 2 ξ 3 t ¯ 2 , ξ ˜ 2 = ξ 2 2 ξ 3 t ¯ 1 .

3.2. MaxEnt for Double-Component Non-Repairable Model: Correlated Degradation Case

In Figure 1b, the degradation processes of the two components are correlated. The joint probability distribution of lifetimes is p ( t 1 , t 2 ) = p 12 θ ( t 2 t 1 ) . Combining the degradation-propagation rule with the network structure, C 1 degrades due to connection with the degradation source and the degradation of C 2 follows. As the result, p 12 becomes:
p 12 = p 1 ( t 1 ) p 2 | 1 ( t 2 | t 1 )
where p 1 = x 1 ( t 1 ) exp [ X ( t 1 ) ] is marginal probability distribution, and p 2 | 1 ( t 2 | t 1 ) = x 2 ( t 2 t 1 ) exp [ X 2 ( t 2 t 1 ) ] θ ( t 2 t 1 ) is the conditional probability distribution. p ( t 1 , t 2 ) is normalized if exp [ X i ( 0 ) ] = 1 , exp [ X i ( + ) ] = 0 , i = 1 , 2 . The time-dependent hazard rate function implies a non-Markovian degradation process for the correlated systems. The difference between the distribution by Equations (7) and (9) is caused by different network structures.
Equation (6) becomes:
x ˙ i x i 2 + x i k ξ k 0 t g i ( k ) x i ¯ ( t ) exp [ X i ¯ ( t ) ] d t = 0 ,
with i = 1 , 2 , i ¯ i and g 1 ( k ) = t f k ( t , t + t ) , g 2 ( k ) = t f k ( t , t + t ) .
Equation (9) implies that the random variables t 1 and t 2 t 1 are statistically independent. With observing the average lifetimes t ¯ 1 , t ¯ 2 , the hazard rates are inferred as x 1 = 1 / t ¯ 1 , x 2 = 1 / ( t ¯ 2 t ¯ 1 ) . In the above two cases, the entropy functions depend on the structure of the graphs, which leads to different dynamics of degradation processes.

4. System Hierarchy by Reliability Block Diagram

In this section, the information constraints to the MaxEnt are considered. The lifetime of one component is the summation of the two intervals. One is the shortest lifetime of the neighbor components. The other is the remaining lifetime of the component. The former relates to the path information, and the single-component information for the latter. The reliability block diagram is introduced to classify different types of information constraints.

4.1. System-Level Observation and Coarse-Grained Information

The system-level observation is defined in the following way. For an n-component system, a failure of system occurs if more than k of n components degrade. In the reliability theory, such a system is called the ‘ k / n system’ [7]. The lifetime of the entire system is the coarse grain of the component-level information. For the models considered in this paper, the lifetimes of k / n systems depend on the degrading path, and the path information is also the coarse-grain information.
Specifically, the 1 / n ( n / n ) system is called the series (parallel) system, the reliability block diagram of which is shown in Figure 2. In the diagrams, the blocks stand for the components. The diagrams illustrate the relationship between the system-level data and the component-level data.
The reliability block diagram explicitly presents the observed data. As follows, it shows that the reliability block diagram can be reduced according to the degradation rule and the network structure in some particular cases.

4.2. Tree-Type Networks

Consider a semi-infinite chain with n components, as shown in Figure 1c. From the left side to the right side, the components are labeled by C 1 , C 2 , , C n . The filled circle stands for a source of degradation. The degradation starts with C 1 and ends with C n . The joint probability distribution of lifetimes is:
p ( t 1 , t 2 , , t n ) = p 1 ( t 1 ) i = 2 n p i ( t i t i 1 ) θ ( t i t i 1 ) .
For a parallel system, the average lifetime of C n is observed, which gives the constraint C = p ( t 1 , t 2 , , t n ) max ( t 1 , t 2 , , t n ) i = 1 n d t i . According to MaxEnt, the most probable distribution becomes:
p ( t 1 , t 2 , , t n ) = ξ n exp ( ξ t n ) i = 2 n θ ( t i t i 1 ) ,
The lifetime distribution of parallel system follows:
p ( t ) = ξ n t n 1 ( n 1 ) ! exp ( ξ t ) .
The gamma distribution is retained by MaxEnt with the system-level information.
In the chain-type network, the lifetime of C n can be decomposed into the remaining lifetime of each component as t n = ( t n t n 1 ) + ( t n 1 t n 2 ) + + t 1 . Each interval in the summation is associated with the hazard rate of the corresponding component. This implies that if the n components are on one path, the further reduction of the parallel type diagram can be done according to Figure 3. Since the path is unique for any tree graphs, the path information is further reduced to lots of single-component information.

4.3. Homogeneous Hazard Assumption

For the degradation propagated on more complex networks, it is difficult to apply the above approach to infer hazard rates of all components, since required information, such as lifetime moments of specific components and subsystems, increases rapidly with the increasing number of components. This information can only be obtained from the observation to system ensemble. However, it is difficult to obtain the ensemble data for a complex system in practice. In particular, it is impossible to make a precise component-dependent inference based on the one-shot degradation data. If the components could be sorted into several classes according to their degrees or other characteristics with negligible difference in the same class, a class-dependent inference is possible to achieve. For example, in the epidemic models, it is usually assumed that all individuals obey the same infection and recovery rates. In this way, it is feasible to infer a homogeneous hazard rate with the one-shot degradation data by MaxEnt.
Under the homogeneous hazard assumption, the variational joint probability distribution of the system in Figure 1c is:
p ( t 1 , t 2 , t 3 , , n ) = i = 1 n p h ( t i t i 1 ) θ ( t i t i 1 ) ,
where p h is the identical remaining lifetime distribution of all the components.
The constraints are the first and the second moment of t n : t ¯ n , t ¯ n 2 .
C = p ( t 1 , t 2 , t 3 , , t n ) ( ξ 1 t n + ξ 2 t n 2 ) i = 1 n d t i ,
where ξ 1 ( 2 ) are the Lagrange multipliers. With p h = x h exp ( X h ) , the MaxEnt by Equation (6) leads to the Euler–Lagrange equation of the hazard rate as:
x ˙ h x h 2 + x h ( ξ ˜ 1 + 2 ξ ˜ 2 t ) = 0 .
The above equation has solution:
p h = 1 Z exp ( ξ ˜ 1 t ξ 2 t 2 ) ,
where Z is normalization constant, ξ ˜ 1 = ξ 1 + ( n 1 ) ξ ˜ 2 t ¯ n / n . The parameters are determined by:
ln Z ξ ˜ 1 = t ¯ n n ln Z ξ 2 = t n 2 ¯ n ( n 1 ) n 2 t ¯ n 2 .
These results are reduced to the single-component case [2], which coincides with the reduction of the reliability block diagram in Figure 3.
For one-shot observation, it is difficult to infer the component-dependent hazard rate due to the lack of moment information. The homogeneous hazard assumption provides an alternative way to rebuild the joint distribution with the one-shot data.

4.4. Loop Networks and Parallel-Series Type Diagram

With a loop structure in a network, the degradation path is not unique, which leads to a parallel-series type diagram. The diagram could not be reduced to single blocks. Consequently, the constraints for the MaxEnt is no longer linear. Assume there are m paths from the target component to the source, and the lengths of the paths are denoted by d i , i = 1 , 2 , , m . The reliability block diagram is presented in Figure 4.
Take the network in Figure 1d as an example, the components are labeled by C 1 , C 2 , and C 3 . The joint distribution of the lifetime is:
p ( t 1 , t 2 , t 3 ) = p 1 ( t 1 ) p 2 ( t 2 ) [ p 3 ( t 3 t 1 ) θ ( t 3 t 1 ) θ ( t 2 t 1 ) + p 3 ( t 3 t 2 ) θ ( t 3 t 2 ) θ ( t 1 t 2 ) ] ,
where p i ( t ) = p h ( t ) is the lifetime distributions of component C i .
The constraints, for example, are the first-order moments for each individual component, namely:
C = 3 i = 1 3 ξ i p ( t 1 , t 2 , t 3 ) t i d t 1 d t 2 d t 3 = 3 ξ F h d t 3 ξ 3 F h 2 d t
where F h = t p h ( t ) d t is the survival probability of the homogeneous distribution p h , and ξ 1 = ξ 2 , ξ 3 are the Lagrange multipliers with ξ = ξ 1 + ξ 3 . The factor 3 in Equation (20) is added to simplify the following calculation and note that it does not affect the distribution determined by the MaxEnt. The first term in Equation (20) is the single-component moment, and the second term is the moment for the series structure of two components. These constraints are directly obtained with the reliability block diagram presented in Figure 5.
To see the non-linearity of the constraint in Equation (20), rewrite the entropy explicitly,
S = p ( t 1 , t 2 , t 3 ) ln p ( t 1 , t 2 , t 3 ) d t 1 d t 2 d t 3 = 0 d t 1 t 1 d t 2 0 d τ p h ( t 1 ) p h 2 ( t 2 ) p h ( τ ) [ ln p h ( t 1 ) + ln p h ( t 2 ) + ln p h ( τ ) ] 0 d t 1 0 t 1 d t 2 0 d τ p h ( t 1 ) p h 2 ( t 2 ) p h ( τ ) [ ln p h ( t 1 ) + ln p h ( t 2 ) + ln p h ( τ ) ] = 3 p h ln p h d t ,
which shows that the entropy of the three-dimensional distribution Equation (19) is proportional to that of the one-dimensional distribution p h . It follows from Equation (20) that:
S + C = 3 p h ln p h d t ξ F h d t ξ 3 F h 2 d t ,
where the constraint is nonlinear in p h , although still linear in p. The degradation model converts the linear constraint in high-dimensional distributions to the non-linear constraint in low-dimensional distributions.
From the structure-dependent joint probability distribution by Equation (19) and the constraints by Equation (20), the hazard rate for each component is inferred as:
u ¨ + ξ 3 u ˙ u = 0 ,
with u = F h + ξ / ξ 3 . The solution is:
F h = ξ ξ tanh ( ξ t / 2 ) ξ + ( ξ 3 + ξ ) tanh ( ξ t / 2 ) .
The above discussion presents the reduction of the reliability block diagram. It is worth mentioning that the reduction depends on the network structure and the rule of degradation propagation.

5. The Repairable System

This section motivates to demonstrate the MaxEnt-based reliability theory for the repairable systems. A failed component can return to a normal component through the recovery process. The recovery processes of the components are assumed to be statistically independent of each other. The degradation is similar to that of the non-repairable model.

5.1. Double-Component Model

Consider a simple example as presented in Figure 1b. The component C i fails at time t i and recovers at time τ i (the recovery time is τ i t i ) with i = 1 , 2 . Before the first recovery of C 1 , the component C 2 may fail at least once or not, which are labeled by ( 1 ; 1 ) and ( 0 ; 1 ) , respectively. Here the notation ( n ; k ) means k leaves of the hub with n leaves failed at least once.
The joint distributions for two situations are written as:
p ( 1 ; 1 ) ( t 2 t 1 , τ 1 t 1 ) = x ( t 2 t 1 ) exp [ X ( t 2 t 1 ) ] y 1 ( τ 1 t 1 ) exp [ Y ( τ 1 t 1 ) ] θ ( t 2 t 1 ) θ ( τ 1 t 2 ) , p ( 0 ; 1 ) ( τ 1 t 1 ) = y ( τ 1 t 1 ) exp [ Y ( τ 1 t 1 ) ] θ ( τ 1 t 1 ) ,
where the hazard (recovery) rate is x(y). The corresponding probabilities are obtained as:
P ( 1 ; 1 ) = 0 exp ( Y ) x exp ( X ) d t , P ( 0 ; 1 ) = 0 y exp ( Y ) exp ( X ) d t = 1 P ( 1 ; 1 ) .
Different number of variables in Equation (25) for the two distributions leads to divergent entropy of the joint distribution. In this situation, one could estimate the most probable distributions through maximizing the entropies of the following distributions:
q ( t ) = y exp ( Y ) , p ( t ) = exp ( Y ) x exp ( X ) / P ( 1 ; 1 ) x ˜ exp ( X ˜ ) ,
where p is the distribution of the series interval from C 1 to C 2 , and x ˜ is the effective hazard rate.
Based on the average recovery time and series interval obtained from the moments of one-shot data, the hazard and recovery rates are directly inferred from
δ [ q ( t ) ln q ( t ) d t p ( t ) ln p ( t ) d t k [ ξ k q ( t ) t k d t + ξ ˜ k p ( t ) t k d t ] ] = 0 .
Particularly for constraints of first and second moments, MaxEnt gives the most probable distribution as:
q ( t ) = 1 Z exp ( ξ 1 t ξ 2 t 2 ) , p ( t ) = 1 Z ˜ exp ( ξ ˜ 1 t ξ ˜ 2 t 2 ) ,
where Z , Z ˜ are normalization constants.
The bare hazard rate and the ratio of degradation are determined:
p ( 1 ; 1 ) = 1 p ( t ) exp ( Y ) d t x exp ( X ) = p ( 1 ; 1 ) x ˜ exp ( X ˜ + Y ) .
The ratio of degradation is associated with the recovery duration and the series interval.

5.2. Degradation Propagation on Star Graph and Complex Networks

Since in the early stage of a degradation process on a low-clustering-coefficient network, the sub-graph consisting of the failed nodes is usually in a star type, namely most nodes fail due to the connection to one single failed node. As follows, the degradation on a star graph is studied.
A graph is called a star graph if there is one specific node (called ‘hub’) links with all other nodes (called ‘leaves’) and there are no links between the leaves. Consider a star graph with the hub labeled by 0 and the leaves 1 , 2 , , k . Without loss of generality assuming t 0 = 0 , the detailed joint probability density function p ( n ; k ) ( τ 0 , t 1 , t 2 , , t n ) that n of k failed is explicitly written as:
p ( n ; k ) = y ( τ 0 ) exp [ ( k n ) X ( τ 0 ) Y ( τ 0 ) ] × i = 1 n x ( t i ) exp [ X ( t i ) ] n ! ( k n ) ! n ! ,
with the corresponding probability:
P ( n ; k ) = p ( n ; k ) d τ 0 i = 1 n d t i = n ! ( k n ) ! n ! 0 ( 1 e X ) n e ( k n ) X q d t .
It is easy to verify the normalized condition n = 0 k P ( n ; k ) = 1 , and the expected number of the components failed at least once:
n = 0 k n P ( n ; k ) = k P ( 1 ; 1 ) .
The moments of the series interval follow from Equation (31) as:
0 + p ( t ) t m d t t 1 m ( 1 | 1 ) 1 ( 1 | 1 ) = n = 1 k t 1 m + t 2 m + + t n m ( n ; k ) / n n = 1 k t 1 0 + t 2 0 + + t n 0 ( n | k ) / n ,
where the average denotes ( n | k ) = p ( n ; k ) d τ 0 i = 1 n d t i . Equation (34) does not depend on the leave number k, and gives a reliable estimation of moments based on the data of the sampling nodes. The dynamical parameter estimation and network structure estimation, thus, become separated in this way.

5.3. Illustration of the Method

The performance of the approach is presented with the simulation of the repairable model on 10,000-node Watts–Strogatz small world [24] with the reconnected probability p = 0.05 and the degree K = 12 . The sub-graph of the generated Watts–Strogatz small world is presented in Figure 6 for illustration. To clearly demonstrate the connection 14 nodes are shown.
The hazard rate and the recovery rate are set to be exponential distributions:
x sim exp ( X sim ) exp ( α s t β s t 2 ) , y sim exp ( Y sim ) exp ( α r t β r t 2 ) ,
with t > 0 In the simulation, the parameters are chosen as α s = 2 , β s = 1 / 3 , α r = 1 / 4 . Here for simplicity, the constant recovery rate is chosen with β r = 0 .
The constraints are the first and second moments of the series interval and the first moment of recovery time. With the reliability block diagram, the observed component is chosen to ensure that only single-component data is obtained. The results are presented in Figure 7.
For the system-level models, the reliable estimation of the model parameters depends on sufficient system-level survey data. For example, in the epidemics [27], the numbers of susceptible, infected, and recovered individuals are needed at different time points to estimate the model parameters. The counts are noisy due to the false alarm, test capacity, and latency [28]. It is different with the approach in [27] that the proposed approach can deal with the component-level data.

6. Conclusions and Discussion

In this work, a novel MaxEnt-based approach of multi-component systems was proposed to assess the reliability of non-repairable and repairable systems. The developed approach provides a rational way to estimate hazard rates of a system consisting of correlated degrading components. Combined with the reliability block diagram, the one-shot type of data can be used for the estimation. The case study shows that the developed approach can yield reliable results with limited and noisy data at the early stage.
The application of the approach involves the following steps in general as presented in Figure 8. (1) Form a network with nodes representing the multi-component system, (2) build the variational joint distribution based on the network, (3) collect the observed lifetime (recovery duration) data of the components as testable information, (4) process the observed data according to the reliability block diagram and calculate the moments, and (5) maximize the entropy of the variational joint distribution with the moment constraints. For many artificial systems, the network structure is usually known, and the network can be constructed accordingly among the components. For the systems with an unknown structure, the inference of network structure is also needed. Such inference is not the subject of this paper. Relevant discussions can be found in [29,30] for network modeling. Combination the inference of network and dynamics will be studied in future work.

Author Contributions

Conceptualization, Y.-M.D., X.G. and C.P.S.; Formal analysis, Y.-M.D.; Funding acquisition, X.G. and C.P.S.; Writing—original draft, Y.-M.D.; Writing—review & editing, J.-F.C., X.G. and C.P.S. All authors have read and agreed to the published version of the manuscript.

Funding

The work in this study was supported by the National Science Foundation of China, Nos. 12088101, 11534002, U1930402, 1930403, 51975546, 11872088, the National Basic Program of China, No. 2016YFA0301201, and CX20200035.The APC was funded by CX20200035.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The work in this study was supported by the National Science Foundation of China, Nos. 12088101, 11534002, U1930402, 1930403, 51975546, 11872088, the National Basic Program of China, No. 2016YFA0301201, and CX20200035. The support is gratefully acknowledged. Authors would like to thank the anonymous reviewers for their constructive comments.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gnedenko, B.; Belyayev, Y.; Solovyev, A. Mathematical Methods of Reliability Theory; Academic Press: Cambridge, MA, USA, 2014. [Google Scholar]
  2. Du, Y.-M.; Ma, Y.-H.; Wei, Y.-F.; Guan, X.; Sun, C. Maximum entropy approach to reliability. Phys. Rev. E 2020, 101, 012106. [Google Scholar] [CrossRef] [PubMed]
  3. Jaynes, E.T. Information theory and statistical mechanics. Phys. Rev. 1957, 106, 620. [Google Scholar] [CrossRef]
  4. Jaynes, E.T. Information theory and statistical mechanics. II. Phys. Rev. 1957, 108, 171. [Google Scholar] [CrossRef]
  5. Jaynes, E.T. On the rationale of maximum-entropy methods. Proc. IEEE 1982, 70, 939. [Google Scholar] [CrossRef]
  6. Birnbaum, Z.W.; Esary, J.D.; Saunders, S.C. Multi-component systems and structures and their reliability. Technometrics 1961, 3, 55. [Google Scholar] [CrossRef]
  7. Rausand, M.; Barros, A.; Hoyland, A. System Reliability Theory: Models, Statistical Methods, and Applications; John Wiley & Sons: Hoboken, NJ, USA, 2020. [Google Scholar]
  8. Chang, L.; Wu, Z. Performance and reliability of electrical power grids under cascading failures. Int. J. Electr. Power Energy Syst. 2011, 33, 1410. [Google Scholar] [CrossRef]
  9. Mieghem, P.V. Performance Analysis of Communications Networks and Systems; Cambridge University Press: Cambridge, UK, 2006. [Google Scholar]
  10. Dorogovtsev, S.N.; Goltsev, A.V.; Mendes, J.F.F. Critical phenomena in complex networks. Rev. Mod. Phys. 2008, 80, 1275. [Google Scholar] [CrossRef] [Green Version]
  11. Castellano, C.; Fortunato, S.; Loreto, V. Statistical physics of social dynamics. Rev. Mod. Phys. 2009, 81, 591. [Google Scholar] [CrossRef] [Green Version]
  12. Barrat, A.; Barthelemy, M.; Vespignani, A. Dynamical Processes on Complex Networks; Cambridge University Press: Cambridge, UK, 2012. [Google Scholar]
  13. Pastor-Satorras, R.; Castellano, C.; Mieghem, P.V.; Vespignani, A. Epidemic processes in complex networks. Rev. Mod. Phys. 2015, 87, 925. [Google Scholar] [CrossRef] [Green Version]
  14. Albert, R.; Barabási, A. Statistical Mechanics of Complex Networks. Rev. Mod. Phys. 2002, 74, 47. [Google Scholar] [CrossRef] [Green Version]
  15. Boccaletti, S.; Latora, V.; Moreno, Y.; Chavez, M.; Hwang, D.-U. Complex networks: Structure and dynamics. Phys. Rep. 2006, 424, 175. [Google Scholar] [CrossRef]
  16. Cancho, R.F.; Janssen, C.; Solé, R.V. Topology of technology graphs: Small world patterns in electronic circuits. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 2001, 64, 046119. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Yin, X.; Mo, Y.; Dong, C.; Zhang, Y. Identification of the influential parts in a complex mechanical product from a reliability perspective using complex network theory. Qual. Reliab. Eng. Int. 2020, 36, 604. [Google Scholar] [CrossRef]
  18. Farrell, S.G.; Mitnitski, A.B.; Rockwood, K.; Rutenberg, A.D. Network model of human aging: Frailty limits and information measures. Phys. Rev. E 2016, 94, 052409. [Google Scholar] [CrossRef] [Green Version]
  19. Liu, Y.-M.; Shi, Y.-M.; Bai, X.-C.; Zhan, P. Reliability estimation of a N-M-cold-standby redundancy system in a multicomponent stress-strength model with generalized half-logistic distribution. Physics A 2017, 490, 231. [Google Scholar] [CrossRef]
  20. Peng, H.; Kan, Z.; Zhao, D.-D.; Han, J.-M.; Lu, J.-F.; Hu, Z.-L. Reliability analysis in interdependent smart grid systems. Physics A 2018, 500, 50. [Google Scholar] [CrossRef]
  21. Limiao, Z.; Daqinga, L.; Pengju, Q.; Bowena, F.; Yinan, J.; Zio, E.; Rui, K. Reliability analysis of interdependent lattices. Physics A 2016, 452, 120. [Google Scholar] [CrossRef]
  22. Rutenberg, A.D.; Mitnitski, A.B.; Farrell, S.G.; Rockwood, K. Unifying aging and frailty through complex dynamical networks. Exp. Gerontol. 2018, 107, 126. [Google Scholar] [CrossRef]
  23. Peng, H.; Liu, C.; Zhao, D.; Han, J. Reliability analysis of CPS systems under different edge repairing strategies. Physics A 2019, 532, 121865. [Google Scholar] [CrossRef]
  24. Watts, D.J.; Strogatz, S.H. Collective dynamics of small-world networks. Nature 1998, 393, 440. [Google Scholar] [CrossRef]
  25. Shore, J.; Johnson, R. Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. Inf. Theory 1980, 26, 26. [Google Scholar] [CrossRef] [Green Version]
  26. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379. [Google Scholar] [CrossRef] [Green Version]
  27. White, L.F.; Pagano, M. A likelihood-based method for real-time estimation of the serial interval and reproductive number of an epidemic. Stat. Med. 2008, 27, 2999. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Kucharski, A.J.; Russell, T.W.; Diamond, C.; Liu, Y.; Edmunds, J.; Funk, S.; Eggo, R.M.; Sun, F.; Jit, M.; Munday, J.D.; et al. Early dynamics of transmission and control of COVID-19: A mathematical modelling study. Lancet Infect. Dis. 2020. [Google Scholar] [CrossRef] [Green Version]
  29. Lü, L.; Zhou, T. Link prediction in complex networks: A survey. Phys. A Stat. Mech. Appl. 2011, 390, 1150. [Google Scholar] [CrossRef] [Green Version]
  30. Ren, Z.-M.; Zeng, A.; Zhang, Y.-C. Structure-oriented prediction in complex networks. Phys. Rep. 2018, 750, 1. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The illustrations of the system networks. (a) the double-component model of independent degradation, (b) the double-component model of correlated degradation (c) the chain-type graph model (d) the graph model contains loop. The filled and the numbered circles represent the degradation source and normal components, respectively.
Figure 1. The illustrations of the system networks. (a) the double-component model of independent degradation, (b) the double-component model of correlated degradation (c) the chain-type graph model (d) the graph model contains loop. The filled and the numbered circles represent the degradation source and normal components, respectively.
Entropy 23 00348 g001
Figure 2. The reliability block diagram of parallel system (left) and series system (right).
Figure 2. The reliability block diagram of parallel system (left) and series system (right).
Entropy 23 00348 g002
Figure 3. The reduction of the reliability block diagram. The right arrow means that if the n components are on one path, the parallel type diagram can be further reduced for tree graphs.
Figure 3. The reduction of the reliability block diagram. The right arrow means that if the n components are on one path, the parallel type diagram can be further reduced for tree graphs.
Entropy 23 00348 g003
Figure 4. The reliability diagram for parallel-series system.
Figure 4. The reliability diagram for parallel-series system.
Entropy 23 00348 g004
Figure 5. The reliability block diagram and its reduction for a parallel-series structure.
Figure 5. The reliability block diagram and its reduction for a parallel-series structure.
Entropy 23 00348 g005
Figure 6. The sub-graph of the generated Watts-Strogatz small world where 14 nodes are shown for illustration purposes.
Figure 6. The sub-graph of the generated Watts-Strogatz small world where 14 nodes are shown for illustration purposes.
Entropy 23 00348 g006
Figure 7. The performance of the MaxEnt method. (a) The inference of the bare hazard rate. (b) The forecast of the number of normal and failed components by MaxEnt. The parameters of simulation are α s = 2 , β s = 1 / 3 , α r = 1 / 4 , β r = 0 . The simulation result shows that the total spreading last about T = 15 ( α r 1 ) , the data with an initial 1.5 ( α r 1 ) . The data of 27 single-component samples are used to estimate the moments.
Figure 7. The performance of the MaxEnt method. (a) The inference of the bare hazard rate. (b) The forecast of the number of normal and failed components by MaxEnt. The parameters of simulation are α s = 2 , β s = 1 / 3 , α r = 1 / 4 , β r = 0 . The simulation result shows that the total spreading last about T = 15 ( α r 1 ) , the data with an initial 1.5 ( α r 1 ) . The data of 27 single-component samples are used to estimate the moments.
Entropy 23 00348 g007
Figure 8. The block diagram of proposed method.
Figure 8. The block diagram of proposed method.
Entropy 23 00348 g008
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Du, Y.-M.; Chen, J.-F.; Guan, X.; Sun, C.P. Maximum Entropy Approach to Reliability of Multi-Component Systems with Non-Repairable or Repairable Components. Entropy 2021, 23, 348. https://doi.org/10.3390/e23030348

AMA Style

Du Y-M, Chen J-F, Guan X, Sun CP. Maximum Entropy Approach to Reliability of Multi-Component Systems with Non-Repairable or Repairable Components. Entropy. 2021; 23(3):348. https://doi.org/10.3390/e23030348

Chicago/Turabian Style

Du, Yi-Mu, Jin-Fu Chen, Xuefei Guan, and C. P. Sun. 2021. "Maximum Entropy Approach to Reliability of Multi-Component Systems with Non-Repairable or Repairable Components" Entropy 23, no. 3: 348. https://doi.org/10.3390/e23030348

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop