Building and deploying GenAI applications with Vertex AI

Now, let’s see how you can use Vertex AI GenAI features programmatically and integrate them with your apps.

Use case 1 – using GenAI models to extract key entities from scanned documents

We will use a publicly available patent document from the US Patents and Trademark Office as a sample document and extract the following information from the document:

• Inventor name
• Location of the inventor
• Patent number

Refer to the notebook at https://github.com/PacktPublishing/The-Definitive-Guide-to-Google-Vertex-AI/blob/main/Chapter12/Chapter12_Vertex_GenAI_Entity_Extraction.ipynb

In this notebook, you will perform the following steps to extract the required information:

1. Extract the text from the document by using the Document AI Optical Character Recognition (OCR) tool.
2. Feed the text to the GenAI model (text-bison) along with a detailed prompt about the entities we need to extract...