Research Papers

Development of a Key Performance Indicator Assessment Methodology and Software Tool for Product-Service System Evaluation and Decision-Making Support

[+] Author and Article Information
Dimitris Mourtzis

Department of Mechanical Engineering
and Aeronautics,
University of Patras,
Patras 26504, Greece
e-mail: mourtzis@lms.mech.upatras.gr

Anna-Maria Papatheodorou

Department of Mechanical Engineering
and Aeronautics,
University of Patras,
Patras 26504, Greece
e-mail: papatheodorou@lms.mech.upatras.gr

Sophia Fotia

Department of Mechanical Engineering and
University of Patras,
Patras 26504, Greece
e-mail: fotia@lms.mech.upatras.gr

1Corresponding author.

Contributed by the Computers and Information Division of ASME for publication in the JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING. Manuscript received December 22, 2017; final manuscript received May 15, 2018; published online July 3, 2018. Assoc. Editor: Kristina Wärmefjord.

J. Comput. Inf. Sci. Eng 18(4), 041005 (Jul 03, 2018) (13 pages) Paper No: JCISE-17-1307; doi: 10.1115/1.4040340 History: Received December 22, 2017; Revised May 15, 2018

During the last decade, as a result of their constant urge to retain sustainability, companies have shifted to the product-service system (PSS) business model, in an effort to gain competitive advantages. PSS providers have realized the importance of offering highly perceived solutions; thus, the necessity of monitoring the performance of PSSs and evaluating them has intensified. However, not much work has been conducted toward that direction, especially focusing on its practical application. In the current work, a holistic approach for PSS evaluation using key performance indicators (KPIs) is proposed, extending to all its lifecycle phases and covering aspects from both provider's and customer's perspectives. A software tool was developed to assist the decision maker in the selection of appropriate KPIs to monitor for PSS evaluation and additionally, to offer KPIs data collection, storage, processing, and visualization capabilities. The proposed methodology was applied in a real industrial case of the mold making area to validate its results.

Copyright © 2018 by ASME
Your Session has timed out. Please sign back in to continue.


Mourtzis, D. , and Doukas, M. , 2014, “ The Evolution of Manufacturing Systems: From Craftsmanship to the Era of Customisation,” Handbook of Research on Design and Management of Lean Production Systems, IGI Global, Hershey, PA, Chap. 1. [CrossRef]
Ren, G. , and Gregory, M. J. , 2007, “ Servitization in Manufacturing Companies: A Conceptualization, Critical Review, and Research Agenda,” Frontiers in Service Conference, San Francisco, CA, Oct. 4–7.
Kjaer, L. L. , Pagoropoulos, A. , Schmidt, J. H. , and McAloone, T. C. , 2016, “ Challenges When Evaluating Product/Service-Systems Through Life Cycle Assessment,” J. Cleaner Prod., 120, pp. 95–104. [CrossRef]
Aguinis, H. , 2005, Performance Management, Edinburgh Business School, Heriot-Watt University, Edinburgh, UK.
Marr, B., 2012, Global Survey Analysis: Full Report2 20 Years of Measuring and Managing Business Performance Analytics and Big Data, Advanced Performance Institute, Mateo, CA.
Parmenter, D. , 2015, Key Performance Indicators: Developing, Implementing, and Using Winning KPIs, 3rd ed., Wiley, Hoboken, NJ.
Annarelli, A. , Battistella, C. , and Nonino, F. , 2016, “ Product Servie System: A Conceptual Framework From a Systematic Review,” J. Cleaner Prod., 139, pp. 1011–1032. [CrossRef]
Adrodegari, F. , Saccani, N. , and Kowalkowski, C. , 2016, “ A Framework for PSS Business Models: Formalization and Application,” Procedia CIRP, 47, pp. 519–524. [CrossRef]
Pourabdollahian, G. , and Copani, G. , 2015, “ Development of a PSS-Oriented Business Model From Customized Production in Healthcare,” Procedia CIRP, 30, pp. 492–497. [CrossRef]
Carlucci, D. , 2010, “ Evaluating and Selecting Key Performance Indicators: An ANP-Based Model,” Meas. Bus. Excellence, 14(2), pp. 66–76. [CrossRef]
Strickler, N. , Pfeiffer, A. , Moser, E. , Kadar, B. , and Lanza, G. , 2016, “ Performance Measurement in Flow Lines—Key to Performance Improvement,” CIRP Ann.-Manuf. Technol., 65(1), pp. 463–466. [CrossRef]
Kibira, D. , Brundage, M. P. , Feng, S. , and Morris, K. C. , 2017, “ Procedure for Selecting Key Performance Indicators for Sustainable Manufacturing,” ASME J. Manuf. Sci. Eng., 140(1), p. 011005.
Bingol, B. N. , and Polat, G. , 2017, “ Measuring Managerial Capability of Subcontractors Using a KPI Model,” Procedia Eng., 196, pp. 68–75. [CrossRef]
Li, Y. , O'Donnell, J. , Garcia-Castro, R. , and Vega-Sanchez, S. , 2017, “ Identifying Stakeholders and Key Performance Indicators for District and Building Energy Performance Analysis,” Energy Build., 155, pp. 1–15. [CrossRef]
Mate, A. , Trujillo, J. , and Mylopoulos, J. , 2017, “ Specification and Derivation of Key Performance Indicators for Business Analytics: A Semantic Approach,” Data Knowl. Eng., 108, pp. 30–49. [CrossRef]
Tsai, Y.-C. , and Cheng, Y.-T. , 2012, “ Analyzing Key Performance Indicators (KPIs) for E-Commerce and Internet Marketing of Elderly Products: A Review,” Arch. Gerontol. Geriatr., 55(1), pp. 126–132. [CrossRef] [PubMed]
Kaganski, S. , Majak, J. , Karjust, K. , and Toompalu, S. , 2017, “ Implementation of Key Performance Indicators Selection Model as Part of the Enterprise Analysis Model,” Procedia CIRP, 63, pp. 283–288. [CrossRef]
Alwaer, H. , and Clemens-Croome, D. J. , 2010, “ Key Performance Indicators (KPIs) and Priority Setting in Using the Multi-Attribute Approach for Assessing Sustainable Intelligent Buildings,” Build. Environ., 45(4), pp. 799–807. [CrossRef]
Ugwu, O. O. , Kumaraswamy, M. M. , Wong, A. , and Ng, S. T. , 2006, “ Sustainability Appraisal in Infrastructure Projects (SUSAIP)—Part 1: Development of Indicators and Computational Methods,” Autom. Constr., 15(2), pp. 239–251. [CrossRef]
Podgorski, D. , 2015, “ Measuring Operational Performance of Osh Management System—A Demonstration of AHP-Based Selection of Leading Key Performance Indicators,” Saf. Sci., 73, pp. 146–166. [CrossRef]
Khalil, N. , Kamaruzzaman, S. N. , and Baharum, M. R. , 2016, “ Ranking the Indicators of Building Performance and the Users' Risk Via Analytical Hierarchy Process (AHP): Case of Malaysia,” Ecol. Indic., 71, pp. 567–576. [CrossRef]
Cabral, I. , Grilo, A. , and Cruz-Machado, V. , 2012, “ A Decision-Making Model for Lean, Agile, Resilient and Green Supply Chain Management,” Int. J. Prod. Res., 50(17), pp. 4830–4845. [CrossRef]
Vujanovic, D. , Momcilovic, V. , Bojovic, N. , and Papuc, V. , 2012, “ Evaluation of Vehicle Fleet Maintenance Management Indicators by Application of DEMATEL and ANP,” Expert Syst. Appl., 39(12), pp. 10552–10563. [CrossRef]
Goncalves, C. D. F. , Dias, J. A. M. , and Cruz-Machado, V. A. , 2014, “ Decision Methodology for Maintenance KPI Selection: Based on ELECTRE,” Eighth International Conference on Management Science and Engineering Management, Lisbon, Portugal, July 25–27, pp. 1001–1012.
Rodriguez, R. R. , Saiz, J. J. A. , and Bas, A. O. , 2009, “ Quantitative Relationships Between Key Performance Indicators for Supporting Decision-Making Processes,” Comput. Ind., 60(2), pp. 104–113. [CrossRef]
Stricker, N. , Micali, M. , Dornfeld, D. , and Lanza, G. , 2017, “ Considering Interdependencies of KPIs—Possible Resource Efficiency and Effectiveness Improvements,” Procedia Manuf., 8, pp. 300–307. [CrossRef]
Vasantha, G. V. A. , Roy, R. , Lelah, A. , and Brissaud, D. , 2012, “ A Review of Product–Service Systems Design Methodologies,” J. Eng. Des., 23(9), pp. 635–659. [CrossRef]
Deng, X. , and Zeng, Y. , 2014, “ A Novel Framework for Product/Service Systems Using Environment-Based Design Methodology,” ASME Paper No. DETC2014-34302.
Kim, Y. S. , Lee, S. W. , Maeng, J. W. , and Cho, C. K. , 2010, “ Product-Service Systems Design Process Based on Activities and Functions,” ASME Paper No. DETC2010-29025.
Geng, X. , Chu, X. , Xue, D. , and Zhang, Z. , 2010, “ Prioritizing Engineering Characteristics of Product-Service System Using Analytic Network Process and Data Envelopment Analysis,” ASME Paper No. DETC2010-28382.
Mourtzis, D. , Doukas, M. , and Fotia, S. , 2016, “ Classification and Mapping of PSS Evaluation Approaches,” IFAC-Papers OnLine, 49(12), pp. 1555–1560. [CrossRef]
Mourtzis, D. , Fotia, S. , and Doukas, M. , 2015, “ Performance Indicators for the Evaluation of Product-Service Systems Design: A Review,” Advances in Production Management Systems: Innovative Production Management Towards Sustainable Growth (IFIP Advances in Information and Communication Technology, Vol. 460), Springer, Cham, Switzerland, pp. 592–601.
Mourtzis, D. , Fotia, S. , Vlachou, E. , and Koutoupes, A. , 2017, “ A Lean PSS Design and Evaluation Framework Supported by KPI Monitoring and Context Sensitivity Tools,” Int. J. Adv. Manuf. Technol., 94(5–8), pp. 1–15.
Kim, K.-J. , Lim, C.-H. , Heo, J.-Y. , Lee, D.-H. , Hong, Y.-S. , and Park, K. , 2013, “ An Evaluation Scheme for Product-Service System Models With a Lifecycle Consideration From Customer's Perspective,” Re-Engineering Manufacturing for Sustainability, 20th CIRP International Conference on Life Cycle Engineering, (LCE), Singapore, Apr. 17–19, pp. 69–74.
Abramovici, M. , Aidi, Y. , Quezada, A. , and Schindler, T. , 2014, “ PSS Sustainability Assessment and Monitoring Framework (PSS-SAM)—Case Study of a Multi-Module PSS Solution,” Procedia CIRP, 16, pp. 140–145. [CrossRef]
Mert, G. , and Aurich, J. C. , 2015, “ A Software Demonstrator for Measuring the Quality of PSS,” Procedia CIRP, 30, pp. 209–214. [CrossRef]
Trieu, V.-H. , 2017, “ Getting Value From Business Intelligence Systems: A Review and Research Agenda,” Decis. Support Syst., 93, pp. 111–124. [CrossRef]
Dedić, N. , and Stanier, C. , 2016, “ Measuring the Success of Changes to Existing Business Intelligence Solutions to Improve Business Intelligence Reporting,” Research and Practical Issues of Enterprise Information Systems, CONFENIS 2016 (Lecture Notes in Business Information Processing, Vol. 268), Springer, Cham, Switzerland, pp. 225–236.
Wiesner, S. , Freitag, M. , Westphal, I. , and Thoben, K.-D. , 2015, “ Interactions Between Service and Product Lifecycle Management,” Procedia CIRP, 30, pp. 36–41. [CrossRef]
Meyers, T. J. , and Hester, P. , 2011, “ Toward the What and How of Measuring R&D System Effectiveness,” Seventh European Conference on Management, Leadership and Governance: SKEMA Business School, Sophia-Antipolis, France, Oct. 6–7.
Dombrowski, U. , Schmidtchen, K. , and Ebentreich, D. , 2013, “ Balanced Key Performance Indicators in Product Development,” Int. J. Mater. Mech. Manuf., 1(1), pp. 27–31. http://ijmmm.org/papers/006-E019.pdf
Popova, V. , and Sharpanskykh, A. , 2010, “ Modeling Organizational Performance Indicators,” Inf. Syst., 35(4), pp. 505–527. [CrossRef]
Chryssolouris, G. , 2006, Manufacturing Systems: Theory and Practice, 2nd ed., Springer-Verlag, New York.
Ishitaka, A. , and Nemery, P. , 2013, Multi-Criteria Decision Analysis: Methods and Software, 1st ed., Wiley, Chichester, UK. [CrossRef]
Jacquet-Lagreze, E. , and Siskos, J. , 1982, “ Assessing a Set of Additive Utility Functions for Multicriteria Decision-Making, the UTA Method,” Eur. J. Oper. Res., 10(2), pp. 151–164. [CrossRef]
von Nitzsch, R. , and Weber, M. , 1993, “ The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements,” Manage. Sci., 39(8), pp. 937–943. [CrossRef]
Wilberg, J. , Hollauer, C. , and Omer, M. , 2015, “ Supporting the Performance Assessment of Product-Service Systems During the Use Phase,” Procedia CIRP, 30, pp. 203–208. [CrossRef]
Oracle, 2007, “ Java SE Application Design With MVC,” Oracle Corporation, Redwood City, CA, accessed date June 2, 2018, http://www.oracle.com/technetwork/articles/javase/index-142890.html
Hibernate, 2012, “ Relational Persistence for Java and .NET,” Hibernate Framework, accessed June 2, 2018, http://www.hibernate.org


Grahic Jump Location
Fig. 1

Frequency of tools used for performance management [4]

Grahic Jump Location
Fig. 2

Steps of proposed KPI selection methodology

Grahic Jump Location
Fig. 3

Goal categories for PSS evaluation

Grahic Jump Location
Fig. 4

Conceptual design of KPI assessment tool for PSS

Grahic Jump Location
Fig. 5

System architecture of developed software

Grahic Jump Location
Fig. 6

Enhanced entity relationship diagram of the KPI assessment tool

Grahic Jump Location
Fig. 7

Screenshot sequence of the KPI assessment tool's sub-module of KPIs management: (1) KPIs library, (2) PI definition dialog, (3) PIs-for-assessment pool, and (4) UT criteria weights setting

Grahic Jump Location
Fig. 8

Objective tree of mold maintenance company

Grahic Jump Location
Fig. 9

Screenshot of the KPI assessment tool's submodule of KPIs monitoring (my dashboard), displaying selected KPIs in the dashboard for mold industry



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In