Technical requirements

For the implementation in the rest of the sections, we may illustrate it in BERT or GPT models. We will use the Stanford Question Answering Dataset (SQuAD 2.0) as our dataset. We will also use PyTorch for illustration. The main library dependencies for our code are as follows:

• torch>=1.7.1
• transformers>=4.10.3
• cuda>=11.0
• NVIDIA driver>=450.119.03

It is mandatory to have the preceding libraries pre-installed with their correct versions.

Dataset Citation

SQuAD: 100,000+ Questions for Machine Comprehension of Text, Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang, arXiv preprint arXiv:1606.05250 (2016): https://rajpurkar.github.io/SQuAD-explorer/.