Neural network architectures

We can categorize DL architectures into four groups:

• Deep neural networks (DNNs)
• Convolutional neural networks (CNNs)
• Recurrent neural networks (RNNs)
• Emergent architectures (EAs)

However, DNNs, CNNs, and RNNs have many improved variants. Although most of the variants are proposed or developed for solving domain-specific research problems, the basic working principles still follow the original DNN, CNN, and RNN architectures. The following subsections will give you a brief introduction to these architectures.

DNNs

DNNs are neural networks that have a complex and deeper architecture with a large number of neurons in each layer, and many connections between them. Although DNN refers to a very deep...