Search icon CANCEL
Subscription
0
Cart icon
Cart
Close icon
You have no products in your basket yet
Save more on your purchases!
Savings automatically calculated. No voucher code required
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Scala for Machine Learning, Second Edition - Second Edition

You're reading from  Scala for Machine Learning, Second Edition - Second Edition

Product type Book
Published in Sep 2017
Publisher Packt
ISBN-13 9781787122383
Pages 740 pages
Edition 2nd Edition
Languages
Toc

Table of Contents (27) Chapters close

Scala for Machine Learning Second Edition
Credits
About the Author
About the Reviewers
www.PacktPub.com
Customer Feedback
Preface
1. Getting Started 2. Data Pipelines 3. Data Preprocessing 4. Unsupervised Learning 5. Dimension Reduction 6. Naïve Bayes Classifiers 7. Sequential Data Models 8. Monte Carlo Inference 9. Regression and Regularization 10. Multilayer Perceptron 11. Deep Learning 12. Kernel Models and SVM 13. Evolutionary Computing 14. Multiarmed Bandits 15. Reinforcement Learning 16. Parallelism in Scala and Akka 17. Apache Spark MLlib Basic Concepts References Index

Performance evaluation


There are numerous configuration parameters that can be set to optimize the execution of Spark jobs. The topic of tuning and the resolution of performance bottlenecks on Spark clusters deserves at the minimum, a dedicated chapter.

This section does not address Mesos-and Yarn-specific configurations as they are not related to machine learning and are beyond the scope of this book [7:11].

Tuning parameters

The performance of a Spark application depends greatly on the configuration parameters. Selecting the appropriate value for those configuration parameters in Spark can be overwhelming—there are more than 60 configuration parameters as of the last count. Fortunately, the majority of those parameters have relevant default values.

However, there are a few parameters that deserve your attention, including:

  • Number of cores available to execute transformation and actions on RDDs: config.cores.max.

  • Memory available for the execution of the transformation and actions spark. executor...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €14.99/month. Cancel anytime