Advanced Deep Learning with TensorFlow 2 and Keras: Apply DL, GANs, VAEs, deep RL, unsupervised learning, object detection and segmentation, and more , Second Edition

Rowel Atienza

€32.99

4.4 (11 Ratings)

Paperback Feb 2020 512 pages 2nd Edition

Rowel Atienza

€32.99

4.4 (11 Ratings)

Paperback Feb 2020 512 pages 2nd Edition

What do you get with Print?

Instant access to your digital eBook copy whilst your Print order is Shipped

Paperback book shipped to your preferred address

Download this book in EPUB and PDF formats

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

AI Assistant (beta) to help accelerate your learning

View table of contents

Preview Book

Advanced Deep Learning with TensorFlow 2 and Keras

Deep Neural Networks

In this chapter, we'll be examining deep neural networks. These networks have shown excellent performance in terms of the accuracy of their classification on more challenging datasets like ImageNet, CIFAR10 (https://www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf), and CIFAR100. For conciseness, we'll only be focusing on two networks: ResNet [2][4] and DenseNet [5]. While we will go into much more detail, it's important to take a minute to introduce these networks.

ResNet introduced the concept of residual learning, which enabled it to build very deep networks by addressing the vanishing gradient problem (discussed in section 2) in deep convolutional networks.

DenseNet improved ResNet further by allowing every convolution to have direct access to inputs, and lower layer feature maps. It's also managed to keep the number of parameters low in deep networks by utilizing both the Bottleneck and Transition layers...

3. ResNet v2

The improvements for ResNet v2 are mainly found in the arrangement of layers in the residual block as shown in Figure 2.3.1.

The prominent changes in ResNet v2 are:

The use of a stack of 1 x 1 – 3 x 3 – 1 × 1 BN-ReLU-Conv2D
Batch normalization and ReLU activation come before two dimensional convolution

Figure 2.3.1: A comparison of residual blocks between ResNet v1 and ResNet v2

ResNet v2 is also implemented in the same code as resnet-cifar10-2.2.1.py, as can be seen in Listing 2.2.1:

Listing 2.2.1: resnet-cifar10-2.2.1.py

def resnet_v2(input_shape, depth, num_classes=10):
    """ResNet Version 2 Model builder [b]

    Stacks of (1 x 1)-(3 x 3)-(1 x 1) BN-ReLU-Conv2D or 
    also known as bottleneck layer.
    First shortcut connection per layer is 1 x 1 Conv2D.
    Second and onwards shortcut connection is identity.
    At the beginning of each stage, 
    the feature map size...

Download Code

Key benefits

Explore the most advanced deep learning techniques that drive modern AI results
New coverage of unsupervised deep learning using mutual information, object detection, and semantic segmentation
Completely updated for TensorFlow 2.x

Description

Advanced Deep Learning with TensorFlow 2 and Keras, Second Edition is a completely updated edition of the bestselling guide to the advanced deep learning techniques available today. Revised for TensorFlow 2.x, this edition introduces you to the practical side of deep learning with new chapters on unsupervised learning using mutual information, object detection (SSD), and semantic segmentation (FCN and PSPNet), further allowing you to create your own cutting-edge AI projects. Using Keras as an open-source deep learning library, the book features hands-on projects that show you how to create more effective AI with the most up-to-date techniques. Starting with an overview of multi-layer perceptrons (MLPs), convolutional neural networks (CNNs), and recurrent neural networks (RNNs), the book then introduces more cutting-edge techniques as you explore deep neural network architectures, including ResNet and DenseNet, and how to create autoencoders. You will then learn about GANs, and how they can unlock new levels of AI performance. Next, you’ll discover how a variational autoencoder (VAE) is implemented, and how GANs and VAEs have the generative power to synthesize data that can be extremely convincing to humans. You'll also learn to implement DRL such as Deep Q-Learning and Policy Gradient Methods, which are critical to many modern results in AI.

Who is this book for?

This is not an introductory book, so fluency with Python is required. The reader should also be familiar with some machine learning approaches, and practical experience with DL will also be helpful. Knowledge of Keras or TensorFlow 2.0 is not required but is recommended.

What you will learn

Use mutual information maximization techniques to perform unsupervised learning
Use segmentation to identify the pixel-wise class of each object in an image
Identify both the bounding box and class of objects in an image using object detection
Learn the building blocks for advanced techniques - MLPss, CNN, and RNNs
Understand deep neural networks - including ResNet and DenseNet
Understand and build autoregressive models – autoencoders, VAEs, and GANs
Discover and implement deep reinforcement learning methods

Estimated delivery fee Deliver to France

Premium delivery 7 - 10 business days

€10.95

(Includes tracking information)

What do you get with Print?

Instant access to your digital eBook copy whilst your Print order is Shipped

Paperback book shipped to your preferred address

Download this book in EPUB and PDF formats

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

AI Assistant (beta) to help accelerate your learning

Frequently bought together

Deep Learning with TensorFlow 2 and Keras

€32.99

€32.99

Total € 98.97

FAQs

What is the delivery time and cost of print book?

Shipping Details

USA:

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.

Unfortunately, due to several restrictions, we are unable to ship to the following countries:

Afghanistan
American Samoa
Belarus
Brunei Darussalam
Central African Republic
The Democratic Republic of Congo
Eritrea
Guinea-bissau
Iran
Lebanon
Libiya Arab Jamahriya
Somalia
Sudan
Russian Federation
Syrian Arab Republic
Ukraine
Venezuela

What is custom duty/charge?

Customs duty are charges levied on goods when they cross international borders. It is a tax that is imposed on imported goods. These duties are charged by special authorities and bodies created by local governments and are meant to protect local industries, economies, and businesses.

Do I have to pay customs charges for the print book order?

The orders shipped to the countries that are listed under EU27 will not bear custom charges. They are paid by Packt as part of the order.

List of EU27 countries: www.gov.uk/eu-eea:

A custom duty or localized taxes may be applicable on the shipment and would be charged by the recipient country outside of the EU27 which should be paid by the customer and these duties are not included in the shipping charges been charged on the order.

How do I know my custom duty charges?

The amount of duty payable varies greatly depending on the imported goods, the country of origin and several other factors like the total invoice amount or dimensions like weight, and other such criteria applicable in your country.

For example:

If you live in Mexico, and the declared value of your ordered items is over $ 50, for you to receive a package, you will have to pay additional import tax of 19% which will be $ 9.50 to the courier service.
Whereas if you live in Turkey, and the declared value of your ordered items is over € 22, for you to receive a package, you will have to pay additional import tax of 18% which will be € 3.96 to the courier service.

How can I cancel my order?

Cancellation Policy for Published Printed Books:

You can cancel any order within 1 hour of placing the order. Simply contact customercare@packt.com with your order details or payment transaction id. If your order has already started the shipment process, we will do our best to stop it. However, if it is already on the way to you then when you receive it, you can contact us at customercare@packt.com using the returns and refund process.

Please understand that Packt Publishing cannot provide refunds or cancel any order except for the cases described in our Return Policy (i.e. Packt Publishing agrees to replace your printed book because it arrives damaged or material defect in book), Packt Publishing will not accept returns.

What is your returns and refunds policy?

Return Policy:

We want you to be happy with your purchase from Packtpub.com. We will not hassle you with returning print books to us. If the print book you receive from us is incorrect, damaged, doesn't work or is unacceptably late, please contact Customer Relations Team on customercare@packt.com with the order number and issue details as explained below:

If you ordered (eBook, Video or Print Book) incorrectly or accidentally, please contact Customer Relations Team on customercare@packt.com within one hour of placing the order and we will replace/refund you the item cost.
Sadly, if your eBook or Video file is faulty or a fault occurs during the eBook or Video being made available to you, i.e. during download then you should contact Customer Relations Team within 14 days of purchase on customercare@packt.com who will be able to resolve this issue for you.
You will have a choice of replacement or refund of the problem items.(damaged, defective or incorrect)
Once Customer Care Team confirms that you will be refunded, you should receive the refund within 10 to 12 working days.
If you are only requesting a refund of one book from a multiple order, then we will refund you the appropriate single item.
Where the items were shipped under a free shipping offer, there will be no shipping costs to refund.

On the off chance your printed book arrives damaged, with book material defect, contact our Customer Relation Team on customercare@packt.com within 14 days of receipt of the book with appropriate evidence of damage and we will work with you to secure a replacement copy, if necessary. Please note that each printed book you order from us is individually made by Packt's professional book-printing partner which is on a print-on-demand basis.

What tax is charged?

Currently, no tax is charged on the purchase of any print book (subject to change based on the laws and regulations). A localized VAT fee is charged only to our European and UK customers on eBooks, Video and subscriptions that they buy. GST is charged to Indian customers for eBooks and video purchases.

What payment methods can I use?

You can pay with the following card types:

Visa Debit
Visa Credit
MasterCard
PayPal

What is the delivery time and cost of print books?

Shipping Details

USA:

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Unfortunately, due to several restrictions, we are unable to ship to the following countries:

Afghanistan
American Samoa
Belarus
Brunei Darussalam
Central African Republic
The Democratic Republic of Congo
Eritrea
Guinea-bissau
Iran
Lebanon
Libiya Arab Jamahriya
Somalia
Sudan
Russian Federation
Syrian Arab Republic
Ukraine
Venezuela

Filter reviews by

All

Amazon verified reviews

WU. Mar 20, 2020

Unlike other authors that release new editions yearly with few revisions, Atienza has packed more than 40% worth of content versus the 1st edition. This is a first for me.The 1st edition is just about identical to the 2nd up to chapter 10, save for some stylistic changes, but half of chapter 10, as well as chapters 11, 12, 13, are brand new.Everything that made the 1st edition great is till here: great exposition of the fundamentals, the math for those that'd like to dig a bit deeper, the great references, as well as clean, understandable, working code.This book is highly recommended as a reference for those looking to move into deeper waters in the production of ML models for use cases that would strain conventional Neural Networks.If I could, however, make a suggestion to all authors of ML books, it would be to PLEASE move away from MNIST, and the CIFAR datasets. I know these are the standard benchmarks in the field but you could just as easily cite this in your repositories and use the real estate in your books to explore other use cases such as anomaly detection in categorical data, time series, etc. This would make your books much more valuable in the hands of industry practitioners not looking to work strictly with images. So let's stop beating those horses yes?Highly Recommended!

Amazon Verified review

Matthew Emerick Apr 14, 2020

Disclaimer: The publisher and asked me to review this book and gave me a review copy. I promise to be 100% honest in how I feel about this book, both the good and the less so.Overview:This book is for the advanced student or experienced practitioner of artificial intelligence. It assumes you have a general level of knowledge of implementing various neural network architectures, or at least a good understanding. One caveat I would very much like to point out is that the Preface states that most of the code requires use of a GPU, which is not mentioned in the book's description. Thankfully, there are free options which mitigate this requirement, which can be found through a simple web search.What I Like:The introductory chapter gives enough information on Keras to allow even a novice AI developer to work through the book and get a lot out of it. As someone in the middle of beginner and expert, I appreciate things like that, as they can the reader a refresher of the material in case they haven't used it in a while. In this case, the author thoughtfully runs through examples using common neural network architectures, such as the multilayer perceptron, recurrent neural network, and convolutional neural network. Each section of the review also gives a refresher of the math at just the right level to get the reader ready for the advanced material later in the book. A final reason to appreciate the first chapter is that is gives clear and concise definitions of common terms used by AI practitioners.The overall organization is also well done. I appreciate a book that flows well, as it greatly adds to the understanding when learning from it as well as lends to finding information easier when using it as a reference. Each chapter adds to the complexity of the reader's understanding, but gradually enough to aid with comprehension.What I Don't LikeThis is a difficult section to write. It's not that there is too much to write about, bu the opposite. This book is well written, both by structure and by prose. It's a balanced book to learn from and to refer to. It's a practitioner's book in that it focuses on code over math, but covers both. The topics covered are useful, interesting, and wide ranging. I did mention at the beginning the GPU requirement, but that's all I'm seeing right now.What I Would Like to SeeThis is a great book overall. I would like to see more, either by expanding the book or writing another one. At 512 pages and the number of topics that could have been covered in addition to what is already on there, I would have been fine with the book being longer.Overall, I give this book a 4.9 out of 5 stars. The author did an excellent job writing this book. I can find little fault.

Prayson Daniel Apr 21, 2020

Advanced Deep Learning with TensorFlow 2 and Keras is a high-level introduction to Multilayer Perceptron (MLP), Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN). This book is a powerful tool for AI practitioners that already have knowledge of Deep Learning but wish to understand MLP, CNN, and RNN in a technical sense, namely building and training such models.The first chapters introduce basic of Python library Keras via TensorFlow API as a tool for building models architectures. Concepts of such as regularisation, regularisation, performance evaluation, model structures are presented in a way that both novice and a Deep Learning practitioners would find valuable.There is a clear flow of ideas as the author moves from basics to advance models building. This book could have been longer. Natural Language Processing and Audio Processing are topics that are not covered. Nevertheless, what is covered is covered very well.

Alessandro Apr 27, 2021

That's really what I needed. A very well written book an advanced deep learning techniques. I have mostly focused my attention on autoencoders and Gans, but the other chapters sound interesting either.

Ryan Zurrin Apr 21, 2022

Great reference for anyone looking to get into deep learning and working with tensorflow

Advanced Deep Learning with TensorFlow 2 and Keras: Apply DL, GANs, VAEs, deep RL, unsupervised learning, object detection and segmentation, and more , Second Edition

What do you get with Print?

Advanced Deep Learning with TensorFlow 2 and Keras

Deep Neural Networks

1. Functional API

2. Deep Residual Network (ResNet)

3. ResNet v2

4. Densely Connected Convolutional Network (DenseNet)

5. Conclusion

6. References

Page 1 of 7

Key benefits

Description

Who is this book for?

What you will learn

Product Details

What do you get with Print?

Product Details

Frequently bought together

Table of Contents

Recommendations for you

Customer reviews

Filter reviews by

People who bought this also bought

About the author

FAQs

Advanced Deep Learning with TensorFlow 2 and Keras: Apply DL, GANs, VAEs, deep RL, unsupervised learning, object detection and segmentation, and more , Second Edition

What do you get with Print?

Key benefits

Description

Who is this book for?

What you will learn

Product Details

What do you get with Print?

Product Details

Packt Subscriptions

Frequently bought together

Table of Contents

Recommendations for you

Customer reviews

Filter reviews by

People who bought this also bought

About the author

FAQs