Index

Symbols

1-gram precision 354

A

Adam optimizer 13

additive attention layer

reference link 344

Amazon Web Services (AWS)

URL 21

Anaconda

download link 18

installation link 18

installing 18

Application Programming Interface (API) 24

attention patterns

visualizing 355, 357, 360

AutoGraph 26

Automatic Language Processing Advisory Committee (ALPAC) 314

average pooling 157

B

backpropagation (BP) 197

avoiding, for RNNs 199

working 197, 198

Backpropagation Through Time (BPTT) 197, 256

limitations 201, 202

RNNs, training 200

bag-of-words 6, 8

batch normalization 376

Bayes' rule 461, 462

beam 260

beam length 260

beam search 260, 301, 302

implementing 302, 304

text, generating with 304, 305

used, for improving LSTMs 260, 261

bell curve 459

Bidirectional Encoder Representation from Transformers (BERT) 377, 378

answering questions, with 399,...