Increasing the Throughput of Pipe-and-Filter Architectures by Integrating the Task Farm Parallelization Pattern

Wulf, Christian, Wiechmann, Christian Claus and Hasselbring, Wilhelm (2016) Increasing the Throughput of Pipe-and-Filter Architectures by Integrating the Task Farm Parallelization Pattern [Paper] In: 18th International ACM SIGSOFT Symposium on Component-Based Software Engineering, 5-8 April 2016, Venice, Italy.

CBSE2016.pdf - Published Version

Download (502Kb) | Preview
CBSE2016slides.pdf - Presentation

Download (1589Kb) | Preview


The Pipe-and-Filter style represents a well-known family of component-based architectures. By executing each filter on a dedicated processing unit, it is also possible to leverage contemporary distributed systems and multi-core systems for a high throughput.

However, this simple parallelization approach is not very effective when (1) the workload is uneven distributed over all filters and when (2) the number of available processing units exceeds the number of filters. In the first case, parallelizing all filters can lead to a waste of resources since only the slowest filter is responsible for the overall throughput. In the second case, some processing units remain unused.

In this paper, we present an automatic parallelization approach providing high throughput and utilizing the available processing units. Our main idea is to provide a composite filter that is wrapped around an existing filter to increase its throughput.
We call this composite filter the Task Farm Filter since it implements the Task Farm parallelization pattern. It creates and executes multiple instances of the underlying filter in parallel. Moreover, we present a modular, self-adaptive mechanism that automatically adapts the number of instances at runtime to achieve the highest possible throughput. Finally, we present an extensive experimental evaluation of our self-adaptive task farm filter by employing a CPU-intensive, an I/O-intensive, and a hybrid scenario. The evaluation shows that our task farm automatically parallelizes the underlying filter and thus increases the overall throughput. Furthermore, the evaluation shows that our task farm scales well with the workload of the executed Pipe-and-Filter architecture.

Document Type: Conference or Workshop Item (Paper)
Keywords: Pipe-and-Filter Architectures task farm self-adaptation teetime
Research affiliation: Kiel University > Software Engineering
Kiel University > Kiel Marine Science
OceanRep > The Future Ocean - Cluster of Excellence
Projects: TeeTime
Date Deposited: 03 May 2016 06:48
Last Modified: 05 Sep 2018 15:38

Actions (login required)

View Item View Item

Document Downloads

More statistics for this item...