Contributions towards the improvement of the IMS-MM©: A Delphi method study

Purpose– This paper aims at reporting the results collected throughout a research study focused on the assessment of the relative importance of potential indicators/metrics that may be suitable to evaluate the efficiency of Integrated Management Systems (IMSs) by further incorporating them into the existing back-office component of the IMS-MM©. In addition, this novel semi-quantitative approach will hopefully overcome one of the shortcomings ascribed to the first version of the Integrated Management Systems- Maturity Model (IMSMM ©).
Design/methodology/approach– Potential indicators/metrics suitable for adoption to monitor the performance of IMSs were identified and selected based on a thorough and extensive revision of literature and on two case studies conducted in industries. These indicators/metrics were assessed (rated according a 5-point importance Likert scale) by a Delphi panel (encompassing 30 academic, industry and business experts) throughout 3 rounds (iterations). Supported on the statistical summarized results collected throughout the 3 rounds they were subsequently organized and prioritized (1st: Importance degree- Median; 2nd: Round at which the consensus criterion was fulfilled; 3rd: Evolution of the Median score throughout the three iterations; 4th: Evolution of the opinions of the experts (throughout the three rounds) according to its potential importance to assess the performance of IMSs.
Findings– At the end of the last round all of the proposed indicators/metrics fulfilled the consensus criterion previously established (Interquartile range (IQR)<1). The indicators/metrics can be clustered throughout 11 levels. On one hand, it should be highlighted that indicators/metrics such as the “Existence of integrated policy”, “Existence ofintegrated indicators”, “Existence of integrated objectives” and “Existence of integrated procedures” were rated as the most important. Conversely, the indicator “Number of guidelines, frameworks or standards adopted to integrate the management subsystems” was ranked at the 11th cluster.
Research limitations/ implications– The research limitations of the current study relate with those inherent to the research method adopted (Delphi study), i.e., reliability issues and dropouts of experts throughout the successive rounds (iterations).
Practical implications– These results will be adopted to develop a second version, i.e., an improved, more reliable, less biased and semi-quantitative version of the IMS-MM©. This work will impact both on academia (the proposal of a novel framework to assess IMSs) and on companies (the assessment of their own IMSs).
Originality/value– As of today scarce are the instruments/tools that enable the overall assessment of IMSs (effectiveness and efficiency). The reported results will support the development of an updated version of the IMS-MM© that, ultimately, will point out to companies an optimized path in order to reach a higher maturity level.

See paper

See paper

Integrated Management Systems, Delphi Panel, efficiency, Maturity, Performance Indicators/metrics