Appendix A. Mathematical Foundations and Advanced TensorFlow

Here we will discuss some of the concepts that will be useful to understand details provided in the chapters. First we will discuss several mathematical data structures found throughout the book, followed by a description about various operations performed on those data structures. Next, we will discuss the concept of probabilities. Probabilities play a vital role in machine learning, as they usually give insights to how uncertain a model is about its prediction. Thereafter, we discuss a high-level library known as Keras in TensorFlow, as well as how to implement a neural machine translator with the seq2seq sublibrary in TensorFlow. Finally we conclude this section with a guide on how to use the TensorBoard as a visualization tool for word embeddings.