Document Type : Original Research

Authors

1 PhD, Assistant Professor, Department of Math and Computer Science, Allameh Tabataba’i University, Tehran, Iran

2 PhD, Visiting Fellow, School of Computing, Eng and Math, Western Sydney University, Sydney, Australia

3 PhD, Assistant Professor, Department of Biomedical Engineering, Research Center of Technology and Engineering, Standard Research Institiute, Karaj, Iran

4 MSc, Department of Math and Computer Science, Allameh Tabataba’i University, Tehran, Iran

10.31661/jbpe.v0i0.1133

Abstract

Background: A medical device is any instrument, apparatus, implement, machine, appliance, software, material, which is intended material, to be utilized, either alone or in combination, for medical purpose. These devices should work precisely and the maintenance program of them has also a key role to achieve this goal. Many of the maintenance programs have not considered important functional parameters such as equipment type, risk factors, and expert opinion.
Objective: The purpose of this study is to present a novel fuzzy method for medical device risk assessment. The obtained values for risk could be used to prioritize maintenance operations by considering allocation budget.
Material and Methods: This experimental study aims to make a new application of Ordered-Weighted Average operator in aggregation of different parameters for calculating Risk Priority Number. This model is a fuzzy multi-criteria decision making approach based on risk maintenance framework for medical device prioritization.
Results: A limited budget is one of the barrier in medical centers. The suggested framework presents a simple and reliable method to choose the best maintenance strategy for each kind of medical device by considering budget limitation. Based on obtained results from numerical model, defibrillators and surgical suction have respectively the highest and the lowest priority in mentioned example.
Conclusion: Risk prioritization of medical devices is valuable because the medical centers can prioritize maintenance operations and thereby to establish preference of maintenance strategy. Implementation of our proposed maintenance program has many effective results in medical center budgets.

Keywords

Introduction

Having medical devices with correct performance and without any health hazards is critical for healthcare centers in the world. A medical device is any instrument, apparatus, implement, machine, appliance, implant, reagent for in vitro use, software, material or other similar or related article, intended to be utilized, either alone or in combination, for medical purposes to evaluate, recognize and treat diseases or prevent of them. These devices should work precisely according to reliability standards of healthcare services. Maintenance programs of medical devices are unacceptable and inefficient based on periodic visits, device age, professional liability and the main mission of medical centers and regardless of environmental conditions. The prioritization of medical devices was a fund project for health maintenance system (HMS) base on risk score of risk-based management programs. Clinical engineering departments of medical centers and hospitals have been developing maintenance programs such as medical equipment management program (MEMP) to reduce risks related to medical devices and increase their safety for patients and medical staff members. Calculating Risk Priority Number (RPN) is the first step in maintenance program for medical devices.

The Joint Commission on Accreditation of Healthcare Organizations (JCAHOs) have presented a series of medical equipment standards and have forced medical centers and hospitals to use their own risk management instruments to determine equipment implied in the MEMP in US [ 1 ]. Fennigkoh and Smith suggested a device classification plan based on three criteria, including maintenance requirements, physical harm/risk and equipment function [ 2 ]. Moreover, they calculated equipment management number and classified medical devices based on calculating scores to the three specified criteria. In 2004, JCAHO introduced the standard EC6.10 and confirmed the Fennigkoh and Smith procedure [ 3 ]. This procedure was used in many medical centers and hospitals widespread. Although this procedure, which is not dependent on parameters of risk factor, calculated an arithmetic average based on three factors, it is not appropriate for risk management. As Tawfik et al. has shown in their study, these shortcomings could investigate some critical equipment, such as steam sterilizers, hematology analyzers for low scores based on equipment function and physical harm to be considered as low risk [ 4 ].

Material and Methods

In this experimental study, American Society for Healthcare Engineering (ASHE) in 1996, presented a method to calculate the RPN of medical devices according to the five criteria as follows: clinical application (A), equipment function (E), environmental use (U), preventive maintenance requirements (P), probability of equipment failure (F), and a total score (T) which is calculated for each component using the equation (1) [ 5 ].

T=E+A+(P+F+U)/3 (1)

Although all these methods consider some important factors and points, they have some drawbacks as follows:

  1. 1- All of the factors have the same weight but the relative importance has been overlooked.
  2. 2- Evaluations have not carried out between different experts.
  3. 3- Cost and profitability factors have not been mentioned.

In this study, a fuzzy logic approach for calculation RPN is introduced to overcome the traditional FMEA weakness due to investigation of uncertainties obtained from experts’ different opinions, which relate linguistic variables to RPN factors. In addition, particular weights have been assigned not only to experts’ different opinions but also to RPN factors.

Ordered Weighted Average Operator (OWA)

In 1988, Yager presented the ordered weighted averaging (OWA) operator [ 6 ]. In a classic definition, an OWA operator of dimension n is a mapping as the equation (2), (3), (4).

F:RnR (2)

Which has an associated n vector W as follows:

W=[W1,W2,...,Wn,]T (3)

Such that Wi ϵ[0,1],

Wi=1 i=1,2...n (4)

Where bj is the j-th element of largest set of fused objects, a1,a2,…,an. The value of F(a1,a2, ,an) can determine the aggregated value of objects a1,a2, ,an. Particularly, a weight wi is associated with an ordered position i of the elements. One of the well-known characteristics of the OWA operators is including operators for the appropriate selection of the vector W, such as (5):

  1. 1. W= [0, 0,..,1]T, F(a1, a2,…,an)=Min(ai)
  2. 2. W=[1,0,…,0]T, F(a1, a2,…,an)= Max(ai) (5)
  3. 3. W=[1/n, 1/n,…,1/n]T, F(a1, a2,…,an)=Mean(ai)

Yager showed that OWA operators satisfied the commutativity, monotonicity and idem potency properties and were bound by the Max and Min operators,

Min(ai)≤F(a1,a2,…,an) ≤Max(ai) (6)

Since this operator (OWA) was bounded by the Max (or) and the Min (and), Yager introduced the orness measure of the aggregation to characterize the type of aggregation performed for a particular value of the weighting vector, which is defined as (7):

Orness (W)=(∑(n-i)×wi)/(n-1) (7)

The orness measure reflects the and-like or or-like aggregation result of an OWA operator, which is very important both in theory and applications.

Orness ([0,0,…,1]T)=0 (8)

Orness ([1,0,…,0]T)=1 (9)

Orness ([1/n, 1/n,…,1/n]T)= 1/2 (10)

Another measure introduced by Yager was the entropy associated with a weighting vector, used to calculate the amount of used information in arguments during an aggregation based on the vector W. This approach is based on the process of maximization of Dispersion, (11), has profit the most usage information theory.

Disp (W) = ∑ Wi ln(Wi) i=1,..,n (11)

Although OWA operator and the weighted mean are both a linear combination of the values, there is a meaningful difference between them due to assigning weight vector. In weighted mean, the i-th data is specified to the i-th weight but in OWA operator weight is specified to the position not to the value.

The Proposed Model

In this study, the product of three factors, including Severity, Probability, and Detection are considered to calculate RPN as the proposed model by Jamshidi and Wang [ 7 , 8 ] is given as:

RPN= Severity × Detection × Probability (12)

Where detection (D) is the probability of a failure detection potential before occurring, probability (P) is the frequency of failure(s) or risk(s) occurrence for a defined device, and severity (S) is the impact of failure on patient’s safety, maintenance resources and mean time to repair.

Despite of simplicity of approach, results have some deficiency as following:

  1. • Difference between experts’ opinions is ignored.
  2. • Different collections of P, S and D can generate a similar RPN.
  3. • The relative importance between P, S and D is ignored.

In order to overcome these deficits, we applied a modified version of RPN calculation, with considering different experts’ opinions and aggregating them using OWA operator. Besides, some linguistic variables are assigned to RPN factors. All of the criteria and subdivision are defined in follow. Table 1 represents an evaluation sheet. Now, we have a multi expert-multi criteria decision making (ME-MCDM) problem. The ranking system following comes with a two-stage system. In the first step, experts are asked to provide evaluation sheet lonely as shown in Table (1). This evaluation consists of a rating on each of the criteria and the ratings are chosen from the scale {1, 2, 3, 4, 5}, where 5, 4, 3, 2 and 1 stand for very high, high, moderate, low and rare, respectively The next step is to find a general evaluation by a given expert for an alternative. Finally we need to fuse the opinions of experts.

Risk Priority Index Very High High Medium Low Rare
Detectability
Probability of non-detection (D1)
Method of failure detection (D2)
Probability
Mean time between failures (P1)
Repeatability (P2)
Visibility (P3)
Failure’s Severity
Patient safety (S1)
Potential risk for operator and maintenance staff (S2)
Mean time to repair (S3)
Table 1.Evaluation sheet

Detectability (D)

This factor refers to the probability of failure detection before occurring. In this study, detectability includes two following subdivision as follows:

  1. • Probability of detection (D1)
  2. • Failure detection method (D2)

Fuzzy rating and leveling of detectability criteria are demonstrated in Table (2).

Level D1 D2
Rare No scheduled inspection No inspection process, the device failures even with a complete inspection can hardly detected
Low Scheduled inspection No inspection process, the failure has been allowed to occur
Moderate Detection after an inspection Manual inspection for some component
High Detection via automatic diagnostic aids Complete manual inspection
Very High Full visibility detection assessment 100% automatic inspection process
Table 2.Fuzzy rating and leveling of detectability sub-criteria.

Probability

This factor refers to the frequency of potential failure (s) or risk (s) occurrence probability for an obtained device. In this study, probability includes three following sub-criteria as following:

  1. • Mean time between failures (P1)
  2. • Repeatability (P2)
  3. • Visibility (P3)

Fuzzy rating and leveling of probability criteria are demonstrated in Table (3).

Level P1 P2 P3
Very High Failure is almost inevitable (3 month) Same failure in 3 months It is not visible at all
High Repeated failure (3-6 month) Same failure in 3-6 months Visible while using the device
Moderate Occasional failure (6 month to 24 months) Same failure in 6-24 months Visible between two inspection intervals
Low Relatively few failure (2-5 year) Same failure in 2-5 years Visible while inspecting
Rare Failure is ulikely (5 year) Failure is ulikely (5 year) Visible before an inspection
Table 3.Fuzzy rating and leveling of Probability sub-criteria.

Failure’s severity (S)

This factor refers to the impact of failure severity and probability of risk on the patient and maintenance personnel’s safety. In this study, failure’s severity includes three following sub-criteria.

  1. • Patient safety (S1)
  2. • Potential risk for operator and maintenance staff (S2)
  3. • Mean time to repair (S3)

Fuzzy rating and leveling of failure’s severity criteria are demonstrated in Table (4).

Level S1 & S2 S3
Very High Death Order a new device
High Debilitating long-term injury External intervention for repairs
Moderate Moderate injury 1 day MTTR 4 days
Low Minor injury 1 h MTTR 1 day
Rare Less no effect MTTR 1 h
MTTR: Mean time to return
Table 4.Fuzzy rating and leveling of failure’s severity occurrence sub-criteria.

Therefore, we have a multi expert-multi criteria decision making (ME-MCDM) problem. The ranking system is a two-step process as explained in the following. In the first step, individual experts are asked to provide an evaluation of the selected character. This assessment includes a ratio for each variable at any scale, and the ratios for each scale are {1, 2, 3} that 3, 2 and 1 show excellent, average and weak performance, respectively. Each expert provides a 6-tuple (a1, a2, a3, a4, a5, a6) for each applicant, where ai ϵ {1, 2, 3}, i= 1, 2, 3, 4, 5, 6. The next step is finding the overall evaluation for each expert on selected character. Aggregation of experts’ opinion for different medical devices on all sub-criteria is shown in Table (5).

Medical Device Risk Priority Index
Detectability Probability Severity
L M U L M U L M U
XX
YY
Lower=L, Medium=M, Upper=U
Table 5.Aggregation of experts’ opinion for all sub-criteria.

Results

This section provides a numerical example of proposed model. Table (6) shows multiple experts’ opinion on all sub-criteria for four chosen medical devices; Defibrillator, Infusion Pump, Surgical Light and Surgical Suction; based on the evaluation sheet is drawn in Table (1). The ratings and leveling indexes are chosen from the scale {5, 4, 3, 2, 1}, where 5, 4, 3, 2 and 1are for very high, high, moderate, low and rare, respectively. Each expert scores sub-criteria (D1, D2, O1, O2, O3, S1, S2, S3) for each medical device. Considering an Orness value reflect optimistic value, we calculate the RPN value based on each expert’s point of view. Considering 0.9 for orness, we find the value of RPN, which is shown in Table (6).

Medical Device Expert Fuzzy Risk Priority Level
Detectability Probability Severity
D1 D2 P1 P2 P3 S1 S2 S3
Defibrillator Expert 1 5 5 4 4 4 4 5 4
Expert 2 4 4 3 2 2 3 4 4
Expert 3 4 5 4 3 4 4 4 3
Expert 4 5 5 3 3 3 4 5 3
Expert 5 4 5 3 3 4 3 5 4
Infusion Pump Expert 1 4 4 3 3 4 4 3 3
Expert 2 4 3 3 3 3 4 3 3
Expert 3 3 3 3 2 2 3 3 3
Expert 4 4 5 3 2 3 3 3 2
Expert 5 4 3 4 2 3 4 4 3
Surgical Light Expert 1 3 3 3 3 2 3 4 4
Expert 2 3 3 2 3 2 2 3 3
Expert 3 2 3 3 2 2 2 3 3
Expert 4 3 3 2 2 2 2 3 3
Expert 5 3 3 2 2 3 3 3 3
Surgical Suction Expert 1 3 3 2 3 2 3 4 3
Expert 2 4 4 3 3 3 3 3 2
Expert 3 3 3 3 2 2 3 2 2
Expert 4 3 4 3 2 2 3 2 2
Expert 5 4 3 3 2 3 4 3 3
Low=2 Moderate=3 High=4 Very High=5
Table 6.Opinion of expert

The next step is finding the overall evaluation for an alternative based on OWA operator derived from an appropriate linguistic quantifier. The results of expert opinion fusion for four selected medical devices are shown in Table (7).

Medical Device Defibrillator Infusion Pump Surgical Light Surgical Suction
RPN 4.04 3.99 3.21 3.08
RPN: Risk Priority Number
Table 7.Final Risk Priority Number (RPN) based on fusion of expert opinion.

Discussion

Calculation of RPN is vital in maintenance program of medical device. Limited budget is more important in medical centers. In this study, we have introduced the application of OWA operator for aggregation of different parameters for calculating of RPN. This framework presents a simple, precise and reliable method to choose the best maintenance policy for each medical device based on its importance. Based on the obtained results from numerical model, defibrillator and surgical suction have the highest and the lowest ranking between other chosen medical devices as shown in Table 3.

Conclusion

The study aims to propose and develop a risk assessment method and maintenance strategy for medical devices of medical centers and hospitals. For healthcare organizations, prioritization of medical devices based on risk is valuable because our future work is the development of a risk-based maintenance software based on this framework for implementing in healthcare center.

Conflict of Interest

None

References

  1. Dyro JF. Clinical Engineering Handbook. Elsevier: Amsterdam; 2003.
  2. Fennigkoh L, Smith B. Clinical equipment management. JCAHO PTSM Series. 1989; 2:5-14.
  3. Joint Commission on Accreditation of Healthcare Organizations. Hospital accreditation standards, Oakbrook Terrace, IL. JACAHO; 2004.
  4. Tawfik B, Ouda BK, El Samad YMA. A fuzzy logic model for medical equipment risk classification. J Clin Eng. 2013; 38:185-90. DOI
  5. American Society for Healthcare Engineering of the American Hospital Association. Clinical Equipment Risk Classification. ASHE/AHA: USA; 1996.
  6. Yager RR. On ordered weighted averaging aggregation operators in multicriteria decisionmaking. IEEE Transactions on Systems, Man, and Cybernetics. 1988; 18:183-90. DOI
  7. Jamshidi A, Rahimi SA, Ait-Kadi D, Ruiz A. A comprehensive fuzzy risk-based maintenance framework for prioritization of medical devices. Applied Soft Computing. 2015; 32:322-34. DOI
  8. Wang Y-M, Chin K-S, Poon GKK, Yang J-B. Risk evaluation in failure mode and effects analysis using fuzzy weighted geometric mean. Expert Systems with Applications. 2009; 36:1195-207. DOI