Questions

1. What is the difference between an extensional and an intensional definition?
2. Define the concept of feedforward in a neural network.
3. Explain what role the weights play in a neural network. How is an input value propagated through the network?
4. Briefly describe gradient descent.
5. Briefly describe backpropagation.
6. Describe the difference between a policy agent and a value agent.
7. What is the difference between a tensor and an array? What benefit do we get from using tensors?
8. What is a placeholder tensor?
9. How does a Q-network update its internal approximation of the Q-values of a state-action function?
10. What types of architectures qualify as deep Q-networks?
11. Briefly describe the difference between a neural network that implements a Q-learning algorithm and a deep Q-network.