Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Advanced Deep Learning with Python

You're reading from   Advanced Deep Learning with Python Design and implement advanced next-generation AI solutions using TensorFlow and PyTorch

Arrow left icon
Product type Paperback
Published in Dec 2019
Publisher Packt
ISBN-13 9781789956177
Length 468 pages
Edition 1st Edition
Languages
Tools
Arrow right icon
Author (1):
Arrow left icon
Ivan Vasilev Ivan Vasilev
Author Profile Icon Ivan Vasilev
Ivan Vasilev
Arrow right icon
View More author details
Toc

Table of Contents (17) Chapters Close

Preface 1. Section 1: Core Concepts
2. The Nuts and Bolts of Neural Networks FREE CHAPTER 3. Section 2: Computer Vision
4. Understanding Convolutional Networks 5. Advanced Convolutional Networks 6. Object Detection and Image Segmentation 7. Generative Models 8. Section 3: Natural Language and Sequence Processing
9. Language Modeling 10. Understanding Recurrent Networks 11. Sequence-to-Sequence Models and Attention 12. Section 4: A Look to the Future
13. Emerging Neural Network Designs 14. Meta Learning 15. Deep Learning for Autonomous Vehicles 16. Other Books You May Enjoy

Optimization-based learning

So far, we have discussed metric-based learning, which uses a special similarity measure (which is hard to overfit) to adapt the representational power of NNs with the ability to learn from datasets with few training samples. Alternatively, model-based approaches rely on improved network architectures (for example, memory augmented networks) to solve the same issue. In this section, we'll discuss optimization-based approaches, which adjust the training framework to adapt to the few-shot learning requirements. More specifically, we'll focus on a particular algorithm called model-agnostic meta learning (MAML; Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks, https://arxiv.org/abs/1703.03400). As the name suggests, MAML can be applied over any learning problem and model that is trained with gradient descent.

To quote the original...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €18.99/month. Cancel anytime