Search icon CANCEL
Subscription
0
Cart icon
Cart
Close icon
You have no products in your basket yet
Save more on your purchases!
Savings automatically calculated. No voucher code required
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Advanced Deep Learning with Python

You're reading from  Advanced Deep Learning with Python

Product type Book
Published in Dec 2019
Publisher Packt
ISBN-13 9781789956177
Pages 468 pages
Edition 1st Edition
Languages
Author (1):
Ivan Vasilev Ivan Vasilev
Profile icon Ivan Vasilev
Toc

Table of Contents (17) Chapters close

Preface 1. Section 1: Core Concepts
2. The Nuts and Bolts of Neural Networks 3. Section 2: Computer Vision
4. Understanding Convolutional Networks 5. Advanced Convolutional Networks 6. Object Detection and Image Segmentation 7. Generative Models 8. Section 3: Natural Language and Sequence Processing
9. Language Modeling 10. Understanding Recurrent Networks 11. Sequence-to-Sequence Models and Attention 12. Section 4: A Look to the Future
13. Emerging Neural Network Designs 14. Meta Learning 15. Deep Learning for Autonomous Vehicles 16. Other Books You May Enjoy

Optimization-based learning

So far, we have discussed metric-based learning, which uses a special similarity measure (which is hard to overfit) to adapt the representational power of NNs with the ability to learn from datasets with few training samples. Alternatively, model-based approaches rely on improved network architectures (for example, memory augmented networks) to solve the same issue. In this section, we'll discuss optimization-based approaches, which adjust the training framework to adapt to the few-shot learning requirements. More specifically, we'll focus on a particular algorithm called model-agnostic meta learning (MAML; Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks, https://arxiv.org/abs/1703.03400). As the name suggests, MAML can be applied over any learning problem and model that is trained with gradient descent.

To quote the original...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime