Running downstream tasks
In this section, we will just jump into some transformer cars and drive them around a bit to see what they do. There are many models and tasks. We will run a few of them in this section. Once you understand the process of running a few tasks, you will quickly understand all of them. After all, the human baseline of all of these tasks is us!
A downstream task is a fine-tuned transformer task that inherited the model and parameters from a pretrained transformer model.
A downstream task is thus the perspective of a pretrained model running fine-tuned tasks. That means, depending on the model, a task is downstream if it wasn't used to fully pretrain the model. In this section, we will consider all of the tasks as downstream since we did not pretrain them.
Models will evolve, as will databases, benchmark methods, accuracy measurement methods, and leaderboard criteria. But the structure of human thought reflected through the downstream tasks in...
