Waller, Jan and Hasselbring, Wilhelm (2013) A Benchmark Engineering Methodology to Measure the Overhead of Application-Level Monitoring [Paper] In: Symposium on Software Performance: Joint Kieker/Palladio Days 2013 (KPDAYS 2013), November 27-29, 2013, Karlsruhe, Germany.
Monitoring_Overhead_Benchmark_KPDays2013_preprint.pdf - Accepted Version
Download (423Kb) | Preview
presentation.pdf - Presentation
Download (1038Kb) | Preview
Application-level monitoring frameworks, such as Kieker, provide insight into the inner workings and the dynamic behavior of software systems. However, depending on the number of monitoring probes used, these frameworks may introduce significant runtime overhead. Consequently, planning the instrumentation of continuously operating software systems requires detailed knowledge of the performance impact of each monitoring probe.
In this paper, we present our benchmark engineering approach to quantify the monitoring overhead caused by each probe under controlled and repeatable conditions. Our developed MooBench benchmark provides a basis for performance evaluations and comparisons of application-level monitoring frameworks. To evaluate its capabilities, we employ our benchmark to conduct a performance comparison of all available Kieker releases from version 0.91 to the current release 1.8.
|Document Type:||Conference or Workshop Item (Paper)|
|Research affiliation:||Kiel University > Faculty of Engineering > Department of Computer Science > Software Engineering|
|Date Deposited:||31 Oct 2013 11:02|
|Last Modified:||25 Jun 2014 09:32|
Actions (login required)