Building the Pong gaming bot

In this section, we will be looking at how we can build a gaming bot that can learn the game of Pong. Before we start, we will look at the approach and concepts that we will be using for building the Pong gaming bot.

Understanding the key concepts

In this section, we will be covering some aspects of building the Pong game bot, which are as follows:

• Architecture of the gaming bot

• Approach for the gaming bot

Architecture of the gaming bot

In order to develop the Pong gaming bot, we are choosing a neural-network-based approach. The architecture of our neural network is crucial. Let's look at the architectural components step by step:

1. We take the gaming screen as the input and preprocess it as per the DQN algorithm.

2. We pass this preprocessed screen to an neural network (NN.)

3. We use a gradient descent to update the weights of the NN.

4. Weight [1]: This matrix holds the weights of pixels passing into the hidden layer. The dimension will be [200 x 80 x 80] – [200 x 6400].

5. Weight...