Hybrid Synchronization Based Distributed Thread Pool

摘要

Distributed applications have been frequently developed with distributed thread pools (DTP) for performance boost. An important design aspect of thread pool system (TPS) is the use of one of two synchronization mechanisms called mutex and spinlock that controls access to producer-consumer shared queue (PCSQ). When to use which one depends upon several factors including computer architecture and application behavior. Each one has its own pros and cons. In our previous work, we have proposed a distributed frequency based thread pool (DFBTP), where PCSQ was implemented by mutex. Mutex causes context switches due to sleeping and waking of threads, hence degrades system performance. In this paper we are presenting a new distributed thread pool named Hybrid Synchronization Based Distributed Thread Pool (HSBDTP) that implements a combined synchronization approach of both spinlock and mutex in order to gain advantages of both synchronization primitives. The evaluation results have proved that HSBDTP outperformed old approach by sustaining maximum performance in terms of response time and wait times.