Deep learning and TabTransformers
We now look at an approach to solving tabular-based data problems using deep learning. Deep learning has gained immense popularity in recent years due to the performance of deep-learning-based models. Deep-learning-based techniques such as AlphaZero, Stable Diffusion, and the GPT series of language models have achieved human or superhuman performance in gameplay, art generation, and language-based reasoning.
What is deep learning?
Deep learning is a subfield of the broader machine learning field of artificial neural networks. Artificial neural networks are mathematical mimics of the human brain and consist of interconnected layers of nodes (or “neurons” in biological parlance) that process and transmit information.
Simple artificial neural networks consist of only a few layers. The term “deep” in deep learning refers to using neural networks of many more layers, each with potentially thousands of neurons. These...