Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Clojure High Performance Programming, Second Edition

You're reading from   Clojure High Performance Programming, Second Edition Become an expert at writing fast and high performant code in Clojure 1.7.0

Arrow left icon
Product type Paperback
Published in Sep 2015
Publisher
ISBN-13 9781785283642
Length 198 pages
Edition 2nd Edition
Languages
Arrow right icon
Author (1):
Arrow left icon
Shantanu Kumar Shantanu Kumar
Author Profile Icon Shantanu Kumar
Shantanu Kumar
Arrow right icon
View More author details
Toc

Table of Contents (10) Chapters Close

Preface 1. Performance by Design FREE CHAPTER 2. Clojure Abstractions 3. Leaning on Java 4. Host Performance 5. Concurrency 6. Measuring Performance 7. Performance Optimization 8. Application Performance Index

Concurrent pipelines


Imagine a situation where we have to carry out jobs at a certain throughput, such that each job includes the same sequence of differently sized I/O task (task A), a memory-bound task (task B) and, again, an I/O task (task C). A naïve approach would be to create a thread pool and run each job off it, but soon we realize that this is not optimum because we cannot ascertain the utilization of each I/O resource due to unpredictability of the threads being scheduled by the OS. We also observe that even though several concurrent jobs have similar I/O tasks, we are unable to batch them in our first approach.

As the next iteration, we split each job in stages (A, B, C), such that each stage corresponds to one task. Since the tasks are well known, we create one thread pool (of appropriate size) per stage and execute tasks in them. The result of task A is required by task B, and B's result is required by task C—we enable this communication via queues. Now, we can tune the thread...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $19.99/month. Cancel anytime