Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Harnessing Open Source LLMs and ChatGPT with Minimal Code
Harnessing Open Source LLMs and ChatGPT with Minimal Code

Harnessing Open Source LLMs and ChatGPT with Minimal Code: Explore Large Language Models with Open Source Innovations like LLama3 and ChatGPT

Video
€59.99
Subscription
Free Trial
Renews at €18.99p/m

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want

Key benefits

  • No-code solutions for running open-source models
  • Advanced Python techniques for streaming responses and function calling
  • Insights into using llama3 model with a web interface

Description

Welcome to the captivating world of Large Language Models (LLMs)! This course is designed to guide you through the fascinating landscape of LLMs, encompassing both no-code and low-code solutions powered by Python. We begin by equipping you with the necessary software to operate these models locally, enabling you to explore various open-source models, including Google’s Gemma:7b and Llama3, without the need for an internet connection. In the advanced section, you will delve into using Python for streaming responses from open-source LLMs and integrating with the official OpenAI API. The course covers low code solutions for streaming ChatGPT responses and introduces function calling within ChatGPT models. You'll also learn about the llama3 model and how to interface it with Python for web applications. Throughout the course, you'll gain experience fetching responses in both batch and streaming modes, and we will jointly develop a small web frontend using Streamlit for our streaming LLM API. By the end of the course, you'll be equipped to run open-source LLMs locally and leverage their capabilities to the fullest.

Who is this book for?

This course is ideal for individuals interested in running open-source LLMs locally and privately, as well as those looking to utilize these models completely free of charge. It's perfect for beginners eager to start with low-code API endpoints using minimal Python and anyone interested in operating no-code LLMs locally. Python knowledge is beneficial for the low-code sections but not mandatory. To follow along with the OpenAI ChatGPT portion, a sign-up and a $5 credit payment (credit card) are required. All other open-source models and software are entirely free.

What you will learn

  • Configure and run local LLMs
  • Use local server API endpoints for open-source models
  • Integrate and utilize OpenAI API with Python
  • Implement low-code solutions for streaming ChatGPT responses
  • Operate the llama3 model using Python web interfaces
  • Develop a small web frontend for streaming LLM APIs using Streamlit
  • Experiment with various open-source models, understanding their capabilities and limitations

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Jul 24, 2024
Length: 1hr 59mins
Edition : 1st
Language : English
ISBN-13 : 9781836642534
Category :
Languages :
Tools :

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want

Product Details

Publication date : Jul 24, 2024
Length: 1hr 59mins
Edition : 1st
Language : English
ISBN-13 : 9781836642534
Category :
Languages :
Tools :

Packt Subscriptions

See our plans and pricing
Modal Close icon
€18.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
€189.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts
€264.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total 127.97
Harnessing Open Source LLMs and ChatGPT with Minimal Code
€59.99
Applying Math with Python
€37.99
Causal Inference and Discovery in Python
€29.99
Total 127.97 Stars icon

Table of Contents

2 Chapters
Setting Up and Exploring Local LLMs Chevron down icon Chevron up icon
Advanced Usage and API Integrations Chevron down icon Chevron up icon

Customer reviews

Rating distribution
Full star icon Full star icon Full star icon Full star icon Half star icon 4.4
(5 Ratings)
5 star 60%
4 star 20%
3 star 20%
2 star 0%
1 star 0%
Gianni Aug 03, 2024
Full star icon Full star icon Full star icon Full star icon Full star icon 5
A really good course to be able to work quickly with llms. I'd like to see an example with vector stores.
Subscriber review Packt
Olawole Sep 10, 2024
Full star icon Full star icon Full star icon Full star icon Full star icon 5
Subscriber review Packt
Raghuvardhan Rao Nov 12, 2024
Full star icon Full star icon Full star icon Full star icon Full star icon 5
Good for understanding basics of LLM. Easy to follow
Subscriber review Packt
Hugo Aug 10, 2024
Full star icon Full star icon Full star icon Full star icon Empty star icon 4
Nice introductory course into LLMs. A bit short but usefull
Subscriber review Packt
Mark Aug 06, 2024
Full star icon Full star icon Full star icon Empty star icon Empty star icon 3
Brilliant course, BUT - i'm running an i9 mac, LM Studio will not run and work, so it's very difficult to follow the code snippets, i'm having to pause the video write things down, then type them in :( - Not everyon has the latest MAC M series chips.
Subscriber review Packt
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

How can I download a video package for offline viewing? Chevron down icon Chevron up icon
  1. Login to your account at Packtpub.com.
  2. Click on "My Account" and then click on the "My Videos" tab to access your videos.
  3. Click on the "Download Now" link to start your video download.
How can I extract my video file? Chevron down icon Chevron up icon

All modern operating systems ship with ZIP file extraction built in. If you'd prefer to use a dedicated compression application, we've tested WinRAR / 7-Zip for Windows, Zipeg / iZip / UnRarX for Mac and 7-Zip / PeaZip for Linux. These applications support all extension files.

How can I get help and support around my video package? Chevron down icon Chevron up icon

If your video course doesn't give you what you were expecting, either because of functionality problems or because the content isn't up to scratch, please mail customercare@packt.com with details of the problem. In addition, so that we can best provide the support you need, please include the following information for our support team.

  1. Video
  2. Format watched (HTML, MP4, streaming)
  3. Chapter or section that issue relates to (if relevant)
  4. System being played on
  5. Browser used (if relevant)
  6. Details of support
Why can’t I download my video package? Chevron down icon Chevron up icon

In the even that you are having issues downloading your video package then please follow these instructions:

  1. Disable all your browser plugins and extensions: Some security and download manager extensions can cause issues during the download.
  2. Download the video course using a different browser: We've tested downloads operate correctly in current versions of Chrome, Firefox, Internet Explorer, and Safari.