You're reading from Transformers for Natural Language Processing and Computer Vision Explore Generative AI and Large Language Models with Hugging Face, ChatGPT, GPT-4V, and DALL-E 3

Product type Paperback

Published in Feb 2024

Publisher Packt

ISBN-13 9781805128724

Length 730 pages

Edition 3rd Edition

Languages

Processing

Tools

Processing

Concepts

Computer Vision

Author (1):

Denis Rothman

View More author details

Table of Contents (24) Chapters

Preface

1. What Are Transformers?

2. Getting Started with the Architecture of the Transformer Model FREE CHAPTER

3. Emergent vs Downstream Tasks: The Unseen Depths of Transformers

4. Advancements in Translations with Google Trax, Google Translate, and Gemini

5. Diving into Fine-Tuning through BERT

6. Pretraining a Transformer from Scratch through RoBERTa

7. The Generative AI Revolution with ChatGPT

8. Fine-Tuning OpenAI GPT Models

9. Shattering the Black Box with Interpretable Tools

10. Investigating the Role of Tokenizers in Shaping Transformer Models

11. Leveraging LLM Embeddings as an Alternative to Fine-Tuning

12. Toward Syntax-Free Semantic Role Labeling with ChatGPT and GPT-4

13. Summarization with T5 and ChatGPT

14. Exploring Cutting-Edge LLMs with Vertex AI and PaLM 2

15. Guarding the Giants: Mitigating Risks in Large Language Models

16. Beyond Text: Vision Transformers in the Dawn of Revolutionary AI

17. Transcending the Image-Text Boundary with Stable Diffusion

18. Hugging Face AutoTrain: Training Vision Models without Coding

19. On the Road to Functional AGI with HuggingGPT and its Peers

20. Beyond Human-Designed Prompts with Generative Ideation

21. Index

Appendix A: Revolutionizing AI: The Power of Optimized Time Complexity in Transformer Models

1. Appendix B: Answers to the Questions

References

OpenAI and GPT-3 engines: https://beta.openai.com/docs/engines/engines
BertViz GitHub Repository by Jesse Vig: https://github.com/jessevig/bertviz
OpenAI's supercomputer: https://blogs.microsoft.com/ai/openai-azure-supercomputer/
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, 2018, Improving Language Understanding by Generative Pre-Training: https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019, Language Models are Unsupervised Multi-task Learners: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
Common Crawl data: https://commoncrawl.org/big-picture/

GPT-4 Technical Report, OpenAI 2023, https://arxiv.org/pdf/2303.08774.pdf

The rest of the chapter is locked

You're reading from Transformers for Natural Language Processing and Computer Vision Explore Generative AI and Large Language Models with Hugging Face, ChatGPT, GPT-4V, and DALL-E 3

Table of Contents (24) Chapters

References

Authors (1)

Personalised recommendations for you

You're reading from Transformers for Natural Language Processing and Computer Vision Explore Generative AI and Large Language Models with Hugging Face, ChatGPT, GPT-4V, and DALL-E 3

Table of Contents (24) Chapters Close

References

Unlock this book and the full library FREE for 7 days

Authors (1)

Personalised recommendations for you

Table of Contents (24) Chapters