Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Advanced Deep Learning with R

You're reading from   Advanced Deep Learning with R Become an expert at designing, building, and improving advanced neural network models using R

Arrow left icon
Product type Paperback
Published in Dec 2019
Publisher Packt
ISBN-13 9781789538779
Length 352 pages
Edition 1st Edition
Languages
Tools
Arrow right icon
Author (1):
Arrow left icon
Bharatendra Rai Bharatendra Rai
Author Profile Icon Bharatendra Rai
Bharatendra Rai
Arrow right icon
View More author details
Toc

Table of Contents (20) Chapters Close

Preface 1. Section 1: Revisiting Deep Learning Basics
2. Revisiting Deep Learning Architecture and Techniques FREE CHAPTER 3. Section 2: Deep Learning for Prediction and Classification
4. Deep Neural Networks for Multi-Class Classification 5. Deep Neural Networks for Regression 6. Section 3: Deep Learning for Computer Vision
7. Image Classification and Recognition 8. Image Classification Using Convolutional Neural Networks 9. Applying Autoencoder Neural Networks Using Keras 10. Image Classification for Small Data Using Transfer Learning 11. Creating New Images Using Generative Adversarial Networks 12. Section 4: Deep Learning for Natural Language Processing
13. Deep Networks for Text Classification 14. Text Classification Using Recurrent Neural Networks 15. Text classification Using Long Short-Term Memory Network 16. Text Classification Using Convolutional Recurrent Neural Networks 17. Section 5: The Road Ahead
18. Tips, Tricks, and the Road Ahead 19. Other Books You May Enjoy

Developing the model architecture

In this section, we will make use of convolutional and LSTM layers in the same network. The convolutional recurrent network architecture can be captured in the form of a simple flowchart:

Here, we can see that the flowchart contains embedding, convolutional 1D, maximum pooling, LSTM, and dense layers. Note that the embedding layer is always the first layer in the network and is commonly used for applications involving text data. The main purpose of the embedding layer is to find a mapping of each unique word, which in our example is 500, and turn it into a vector that is smaller in size, which we will specify using output_dim. In the convolutional layer, we will use the relu activation function. Similarly, the activation functions that will be used for the LSTM and dense layers will be tanh and softmax, respectively.

We can use the following...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €18.99/month. Cancel anytime