Please refer to the following links:
- David Silver's model-free prediction presentation: http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching_files/MC-TD.pdf
- David Silver's model-free control presentation: http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching_files/control.pdf