An Overview of Regularization

Let’s embark on a journey into the world of regularization in machine learning. I hope you will learn a lot and find as much joy in reading this book as I did in writing it.

Regularization is important for any individual willing to deploy robust machine learning (ML) models.

This chapter will introduce some context and key concepts about regularization before diving deeper into it in the next chapters. At this point, you may have many questions about this book and about regularization in general. What is regularization? Why do we need regularization for production-grade ML models? How do we diagnose the need for regularization? What are the limits of regularization? What are the approaches to regularization?

All the foundational knowledge about regularization will be provided in this chapter in the hope of answering all these questions. Not only will this give you a high-level understanding of what regularization is but it will also allow...