You're reading from Mastering Transformers The Journey from BERT to Large Language Models and Stable Diffusion

Product type Paperback

Published in Jun 2024

Publisher Packt

ISBN-13 9781837633784

Length 462 pages

Edition 2nd Edition

Languages

Python

Tools

BERT

Concepts

GPT/LLMs

Authors (2):

Savaş Yıldırım

Meysam Asgari- Chenaghlu

View More author details

Table of Contents (25) Chapters

Preface

1. Part 1: Recent Developments in the Field, Installations, and Hello World Applications

2. Chapter 1: From Bag-of-Words to the Transformers FREE CHAPTER

3. Chapter 2: A Hands-On Introduction to the Subject

4. Part 2: Transformer Models: From Autoencoders to Autoregressive Models

5. Chapter 3: Autoencoding Language Models

6. Chapter 4: From Generative Models to Large Language Models

7. Chapter 5: Fine-Tuning Language Models for Text Classification

8. Chapter 6: Fine-Tuning Language Models for Token Classification

9. Chapter 7: Text Representation

10. Chapter 8: Boosting Model Performance

11. Chapter 9: Parameter Efficient Fine-Tuning

12. Part 3: Advanced Topics

13. Chapter 10: Large Language Models

14. Chapter 11: Explainable AI (XAI) in NLP

15. Chapter 12: Working with Efficient Transformers

16. Chapter 13: Cross-Lingual and Multilingual Language Modeling

17. Chapter 14: Serving Transformer Models

18. Chapter 15: Model Tracking and Monitoring

19. Part 4: Transformers beyond NLP

20. Chapter 16: Vision Transformers

21. Chapter 17: Multimodal Generative Transformers

22. Chapter 18: Revisiting Transformers Architecture for Time Series

23. Index

Why subscribe?

24. Other Books You May Enjoy

Index

As this ebook edition doesn't have fixed pagination, the page numbers below are hyperlinked for reference only, based on the printed edition of this book.

AdapterFusion 234

adapter tuning

used, for fine-tuning BERT checkpoint 237-241

adaptive learning

benefits 227, 228

additive methods 235

A Lite BERT (ALBERT) 81-84

Amazon Polarity 200

Amazon SageMaker

reference link 372

Anaconda 30

installing, on Linux 31

installing, on macOS 34

installing, on Windows 32-34

transformer, installing with 30

Anaconda for Linux

download link 31

Anaconda for macOS

download link 34

Anaconda for Windows

download link 32

anaphoric relations 282

application programming interfaces (APIs) 359

dockerizing 364

used, for accessing datasets 47-50

AR models

used, for NLG 120-122

artificial intelligence (AI) 3, 39, 403

attention heads

interpreting 272, 273

visualizing, with exBERT 273-278...

The rest of the chapter is locked

You're reading from Mastering Transformers The Journey from BERT to Large Language Models and Stable Diffusion

Table of Contents (25) Chapters

Index

Unlock this book and the full library FREE for 7 days

Authors (2)

Personalised recommendations for you