0

Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Getting Started with Google BERT

You're reading from Getting Started with Google BERT Build and train state-of-the-art natural language processing models using BERT

Product type Paperback

Published in Jan 2021

Publisher Packt

ISBN-13 9781838821593

Length 352 pages

Edition 1st Edition

Languages

Python

Tools

BERT

Concepts

Mobile Application Development

Author (1):

Sudharsan Ravichandiran

View More author details

Table of Contents (15) Chapters

Preface

1. Section 1 - Starting Off with BERT

2. A Primer on Transformers FREE CHAPTER

3. Understanding the BERT Model

4. Getting Hands-On with BERT

5. Section 2 - Exploring BERT Variants

6. BERT Variants I - ALBERT, RoBERTa, ELECTRA, and SpanBERT

7. BERT Variants II - Based on Knowledge Distillation

8. Section 3 - Applications of BERT

9. Exploring BERTSUM for Text Summarization

10. Applying BERT to Other Languages

11. Exploring Sentence and Domain-Specific BERT

12. Working with VideoBERT, BART, and More

13. Assessments

14. Other Books You May Enjoy

Leave a review - let other readers know what you think

Further reading

To learn more, check out the following resources:

Attention Is All You Need by Ashish Vaswani, Noam Shazeer, and Niki Parmar, available at https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf
The Illustrated Transformer blog by Jay Alammar, at http://jalammar.github.io/illustrated-transformer

You have been reading a chapter from

Getting Started with Google BERT

Published in: Jan 2021

Publisher: Packt

ISBN-13: 9781838821593

© 2021 Packt Publishing Limited All Rights Reserved

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at R$50/month. Cancel anytime

Authors (1)

Sudharsan Ravichandiran

Sudharsan Ravichandiran

Sudharsan Ravichandiran is a data scientist and artificial intelligence enthusiast. He holds a Bachelors in Information Technology from Anna University. His area of research focuses on practical implementations of deep learning and reinforcement learning including natural language processing and computer vision. He is an open-source contributor and loves answering questions on Stack Overflow.

See other products by Sudharsan Ravichandiran

Other recommended products

Related to this chapter

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Transformers for Natural Language Processing

Transformers for Natural Language Processing

Being the first book in the market to dive deep into the Transformers, it is a step-by-step guide for data and AI practitioners to help enhance the performance of language understanding and gain expertise with hands-on implementation of transformers using PyTorch, TensorFlow, Hugging Face, Trax, and AllenNLP.

Jan 2021 12h 48m

Transformers for Natural Language Processing

Transformers for Natural Language Processing

Being the first book in the market to dive deep into the Transformers, it is a step-by-step guide for data and AI practitioners to help enhance the performance of language understanding and gain expertise with hands-on implementation of transformers using PyTorch, TensorFlow, Hugging Face, Trax, and AllenNLP.

Jan 2021 12h 48m

Transformers for Natural Language Processing

Transformers for Natural Language Processing

Being the first book in the market to dive deep into the Transformers, it is a step-by-step guide for data and AI practitioners to help enhance the performance of language understanding and gain expertise with hands-on implementation of transformers using PyTorch, TensorFlow, Hugging Face, Trax, and AllenNLP.

Jan 2021 12h 48m