Let's get acquainted with some basic terminologies and concepts of data science. We will get into some theory and then move on to understand some complex terms such as entropy and dimensionality.
The fundamentals of data science
Information theory
Before a deeper dive into various network architectures and some hands-on examples, it would be a pity if we did not elaborate a little on the pivotal notion of gaining information through processing real-world signals. We speak of the science of quantifying the amount of information present in a signal, also referred to as information theory. While we don't wish to provide a deep mathematical overview on this notion, it is useful to know some background on learning from...
