ISOIECQualityStandards.PDFVIP

Process Engine Benchmarking with Betsy in the Context of ISO/IEC Quality Standards Matthias Geiger, Simon Harrer, and J?rg Lenhard Distributed Systems Group, University of Bamberg, Germany {matthias.geiger,simon.harrer,joerg.lenhard}@uni-bamberg.de Abstract Business process management and automation has been the focus of intense research for a long time. Today, a plethora of process languages for specifying and im- plementing process models have evolved. Examples for such languages are established international stan- dards, such as BPEL 2.0 or, more recently, BPMN 2.0. Implementations of these standards which are able to execute models, so called process engines, differ in their quality of service, e.g., in performance or usability, but also in the degree to which they actually implement a given standard. Selecting the “best” engine for a par- ticular use case is hard, as none of the existing process standards features an objective certification process to assess the quality of its implementations. To fill this gap, we present the current achievements in process engine benchmarking and point out future directions. Keywords: business process management, process engine, BPEL, BPMN, benchmarking 1 Introduction The field of business process management (BPM) forms an umbrella for a variety of research areas, ranging from managerial challenges to application engineering [23]. Among these fields are the modeling and automation of processes using process-aware technologies specifically dedicated to this task. This has led to the development of a multiplicity of process languages and standards [19] that can be used for specifying process models. A sub- set of these languages allow to specify models that are intended for execution in specific runtime environments, called process engines. Typically, multiple alternative engines are available for a given process language. The user of the language can implement process models as defined in the language specification and has to s