Document Server@UHasselt >
Research >
Research publications >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/25149

Title: A comparative study of existing quality measures for process discovery
Authors: Janssenswillen, Gert
Donders, Niels
Jouck, Toon
Depaire, Benoît
Issue Date: 2017
Citation: INFORMATION SYSTEMS, 71, p. 1-15
Abstract: Evaluating the quality of discovered process models is an important task in many process mining analyses. Currently, several metrics measuring the fitness, precision and generalization of a discovered model are implemented. However, there is little empirical evidence how these metrics relate to each other, both within and across these different quality dimensions. In order to better understand these relationships, a large-scale comparative experiment was conducted. The statistical analysis of the results shows that, although fitness and precision metrics behave very similar within their dimension, some are more pessimistic while others are more optimistic. Furthermore, it was found that there is no agreement between generalization metrics. The results of the study can be used to inform decisions on which quality metrics to use in practice. Moreover, they highlight issues which give rise to new directions for future research in the area of quality measurement.
Notes: Janssenswillen, G (reprint author), UHasselt Hasselt Univ, Fac Business Econ, Agoralaan, B-3590 Diepenbeek, Belgium. gert.janssenswillen@uhasselt.be; ndonders93@gmail.com; toon.jouck@uhasselt.be; benoit.depaire@uhasselt.be
URI: http://hdl.handle.net/1942/25149
DOI: 10.1016/j.is.2017.06.002
ISI #: 000413385200001
ISSN: 0306-4379
Category: A1
Type: Journal Contribution
Appears in Collections: Research publications

Files in This Item:

Description SizeFormat
Published version3.18 MBAdobe PDF
Peer-reviewed author version2.25 MBAdobe PDF

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.