All Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Enterprise GENERATIVE AI Well-Architected Framework & Patterns

You're reading from Enterprise GENERATIVE AI Well-Architected Framework & Patterns

Product type Book

Published in Apr 2024

Publisher Packt

ISBN-13 9781836202912

Pages 113 pages

Edition 1st Edition

Languages

Concepts

Artificial Intelligence

Author (1):

Suvoraj Biswas

Table of Contents (43) Chapters

1. What is Generative AI?

2. What is the background of GenAI - Well Architected Framework?

3. Why do we need a Well Architected Framework for GenAI based Enterprise Use Case?

4. What are the pillars of the Well Architected Framework?

5. What are the building blocks for each pillar?

Operational Excellence:

6. What is a Large Language Model?

7. What is a Foundation Model?

8. When should we be using the Foundation Model?

9. Introduction to Content Moderation building block:

10. What is AI Guardrails and How to integrate it?

11. Introduction to the Compliance Pillar:

12. Benefits of having an Archival for Compliance building block:

13. What are some solutions for Archiving AI & Human interactions for Regulatory Compliance?

14. The FM or LLM observability Building Block:

15. What are some LLM Observability Solutions?

16. Introduction

17. What are some best practices to optimize Cost during Architecting?

18. Prompt Engineering

19. Why Prompt Engineering plays a crucial role in the GenAI apps?

20. Some Best Practices for Effective Prompts:

21. Embedding & Vector Database

22. What are Embeddings and why are they so important?

23. What are OpenAI's Offerings on Embeddings?

24. What is a Vector Database & How do they really work?

25. Options of Vector Databases for Solutioning

26. The Orchestrator Building Block

27. Some Orchestrator Application framework for AI development:

28. Introduction

29. What is Retrieval-augmented generation (RAG) Pattern for GenAI?

30. Demo Time - a GenAI based QnA python app using RAG pattern (LangChain, PineCone & Open AI api)

31. What is Fine tuning?

32. Why do we need fine tuning? Can’t we use RAG for domain specific use cases?

33. Are Fine Tuning & Pre-Training referring to the similar process?

34. Foundation Model or Large Language Model fine-tuning techniques:

35. Parameter Efficient Fine Tuning:

36. What are some Enterprise Use cases where SFT/RLHF or PEFT can be used?

37. What is LoRA (Low Rank Adaptation Model) technique?

38. What are the advantages of the LoRA method in fine tuning LLM?

39. What is QLoRA (Quantized Low Rank Adaptation Model) ?

40. Vector Database & Semantic Search capabilities

41. How to run PostGreSQL with pgVector extension in EC2 ?

42. Overview of AWS Sagemaker and AWS Bedrock

43. Example Generative AI based Enterprise Product Search Architecture in AWS

Why Prompt Engineering plays a crucial role in the GenAI apps?

The success of our AI product relies on the effectiveness of the prompts used with the Large Language Model. If we fail to carefully design the prompts for the instructions or queries sent to the LLM, it may result in an unsatisfactory user experience. Therefore, when developing a Generative AI-based product, it is crucial to involve Prompt Engineers or Natural Language Analysts who can thoroughly analyze and select the most effective prompts for interacting with the LLM model. Even if the product generates dynamic prompts, it is important to follow clear guidelines and principles to ensure accurate results for the users.

In the following sections, I will guide you through various examples of prompt techniques and responses from the LLM. These examples aim to illustrate the usage and significance of prompt engineering as a crucial...

The rest of the chapter is locked

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $15.99/month. Cancel anytime}

Authors (1)

Suvoraj Biswas

Suvoraj Biswas is a Subject Matter Expert and thought leader in the Enterprise GENERATIVE AI and it's Architecture & Governance. Professionally, he works as a Solution Architect at a prominent Fortune 500 financial corporation. With an extensive Enterprise IT background spanning over 19+ years in countries like India, United States and Canada, he has held architectural positions & DevOps/DevSecOps Consultant at renowned companies like Thomson Reuters, IBM and Global Relay. Throughout his professional journey, he has amassed considerable expertise across diverse IT domains, specializing in the design of secure and scalable Enterprise systems, facilitating multi-Cloud adoption and migration, and driving digital transformation initiatives. He has overseen end-to-end solution development and the execution of large-scale Enterprise projects, leveraging advanced and specialized technologies including SAAS platform engineering, AWS cloud migration, Generative AI adoption & implementation and building smart IoT based platform.

See other products by Suvoraj Biswas

Personalised recommendations for you

Based on your interests and search pattern

Ever wonder why speech recognition systems don't understand the Scottish accent, or what would happen if an astronaut only ate mac 'n' cheese, or other spurious reflections you'd have at a bar? We did, then collated those deliberations into absurd research articles with fake figures and methodologies inspired by even more fictionally absurd studies.

Aug 2023 7 hours 40 minutes

Generative AI with LangChain

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

Dec 2023 12 hours 0 minutes

Generative AI with LangChain

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

Dec 2023 12 hours 0 minutes

Generative AI with LangChain

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

Dec 2023 12 hours 0 minutes

Generative AI with LangChain

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

Dec 2023 12 hours 0 minutes

Mastering Tableau 2023

Mastering Tableau 2023

This book is a comprehensive resource to mastering your Tableau skills and becoming a BI expert. As you progress, you will learn how to build advanced dashboards and improve your storytelling to derive key business insight, as well as make you well-versed with advanced functionalities of Tableau in the business intelligence domain.

Aug 2023 22 hours 48 minutes

Building AI Applications with ChatGPT APIs

Building AI Applications with ChatGPT APIs

This guide covers all ChatGPT API features for effortless creation of robust AI powered apps. With its help, you’ll be able to leverage ChatGPT’s cutting-edge NLP models to take your app development skills to the next level. You’ll also work on ten exciting projects that will give you the practical know-how that you can apply to your existing applications.

Sep 2023 8 hours 36 minutes

Building AI Applications with ChatGPT APIs

Building AI Applications with ChatGPT APIs

This guide covers all ChatGPT API features for effortless creation of robust AI powered apps. With its help, you’ll be able to leverage ChatGPT’s cutting-edge NLP models to take your app development skills to the next level. You’ll also work on ten exciting projects that will give you the practical know-how that you can apply to your existing applications.

Sep 2023 8 hours 36 minutes

Data Engineering with AWS

Data Engineering with AWS

Embark on a journey to master data engineering pipelines on AWS! Our book offers a hands-on experience of AWS services for ingesting, transforming, and consuming data. Whether you're an absolute beginner or someone with basic data engineering experience, this guide is an indispensable resource.

Oct 2023 21 hours 12 minutes

Modern Data Architecture on AWS

Modern Data Architecture on AWS

Every organization wants an agile, performant, and cost-effective data platform that meets all their current and future business needs. Purpose-built AWS analytics services and their features play a big part in building such a modern data platform. This book brings to you all the design and architectural patterns that’ll help you achieve this goal.

Aug 2023 14 hours 0 minutes

Practical Guide to Applied Conformal Prediction in Python

Practical Guide to Applied Conformal Prediction in Python

Discover the power of Conformal Prediction with the "Practical Guide to Applied Conformal Prediction in Python." Master the latest techniques to quantify uncertainty in machine learning and computer vision models, and seamlessly apply them to your industry applications.

Dec 2023 8 hours 0 minutes

TinyML Cookbook

TinyML Cookbook

With over 70 project-based recipes, the TinyML Cookbook is a practical guide that will help you to get the most out of your microcontrollers. It provides a comprehensive understanding of the theoretical foundations while giving you hands-on experience training ML models for deployment on Arduino Nano 33 BLE Sense, Raspberry Pi Pico, and SparkFun RedBoard Artemis Nano microcontrollers.

Nov 2023 22 hours 8 minutes