Search icon CANCEL
Subscription
0
Cart icon
Cart
Close icon
You have no products in your basket yet
Save more on your purchases!
Savings automatically calculated. No voucher code required
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Mobile Deep Learning with TensorFlow Lite, ML Kit and Flutter
Mobile Deep Learning with TensorFlow Lite, ML Kit and Flutter

Mobile Deep Learning with TensorFlow Lite, ML Kit and Flutter: Build scalable real-world projects to implement end-to-end neural networks on Android and iOS

By Anubhav Singh , Rimjhim Bhadani
$15.99 per month
Book Apr 2020 380 pages 1st Edition
eBook
$29.99
Print
$43.99
Subscription
$15.99 Monthly
eBook
$29.99
Print
$43.99
Subscription
$15.99 Monthly

What do you get with a Packt Subscription?

Free for first 7 days. $15.99 p/m after that. Cancel any time!
Product feature icon Unlimited ad-free access to the largest independent learning library in tech. Access this title and thousands more!
Product feature icon 50+ new titles added per month, including many first-to-market concepts and exclusive early access to books as they are being written.
Product feature icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Product feature icon Thousands of reference materials covering every tech concept you need to stay up to date.
Subscribe now
View plans & pricing
Table of content icon View table of contents Preview book icon Preview Book

Mobile Deep Learning with TensorFlow Lite, ML Kit and Flutter

Mobile Vision - Face Detection Using On-Device Models

In this chapter, we will build a Flutter application that is capable of detecting faces from media uploaded from the gallery of a device or directly from the camera using the ML Kit's Firebase Vision Face Detection API. The API leverages the power of pre-trained models hosted on Firebase and provides the application, the ability to identify the key features of a face, detect the expression, and get the contours of the detected faces. As the face detection is performed in real time by the API, it can also be used to track faces in a video sequence, in a video chat, or in games that respond to the user's expression. The application, coded in Dart, will work efficiently on Android and iOS devices.

In this chapter, we will be covering the following topics:

  • Introduction to image processing
  • Developing a...

Technical requirements

Introduction to image processing

In this chapter, we shall be detecting faces in images. In the context of artificial intelligence, the action of processing an image for the purpose of extracting information about the visual content of that image is called image processing.

Image processing is an emerging field, thanks to the surge in the number of better AI-powered cameras, medical imagery-based machine learning, self-driving vehicles, analysis of people's emotions from images, and many other applications.

Consider the use of image processing by a self-driving vehicle. The vehicle needs to make decisions in as close to real time as possible to ensure the best possible accident-free driving. A delay in the response of the AI model running the car could lead to catastrophic consequences. Several techniques and algorithms have been developed for fast and accurate...

Developing a face detection application using Flutter

With the basic understanding of how a CNN works from Chapter 1Introduction to Deep Learning for Mobile, and how image processing is done at the most basic level, we are ready to proceed with using the pre-trained models from Firebase ML Kit to detect faces from the given images.

We will be using the Firebase ML Kit Face Detection API to detect the faces in an image. The key features of the Firebase Vision Face Detection API are as follows:

  • Recognize and return the coordinates of facial features such as the eyes, ears, cheeks, nose, and mouth of every face detected.
  • Get the contours of detected faces and facial features.
  • Detect facial expressions, such as whether a person is smiling or has one eye closed.
  • Get an identifier for each individual face detected in a video frame. This identifier is consistent across invocations...

Summary

In this chapter, we examined the concept behind image processing and how we can integrate it with our Android- or iOS-based application made using Flutter to perform face detection. The chapter started with adding relevant dependencies to support the functionalities of Firebase ML Kit and the image_picker library. The required UI components with the necessary functionalities were added. The implementation mainly covered image file selection using the Flutter plugin and how images can be processed once they are selected. An example of on-device Face Detector model usage was presented, along with an in-depth discussion of the method by which the implementation was carried out. 

In the next chapter, we will be discussing how you can create your own AI-powered chatbot that can double-up as a virtual assistant using the Actions on Google platform.&...

Left arrow icon Right arrow icon
Download code icon Download Code

Key benefits

  • Work through projects covering mobile vision, style transfer, speech processing, and multimedia processing
  • Cover interesting deep learning solutions for mobile
  • Build your confidence in training models, performance tuning, memory optimization, and neural network deployment through every project

Description

Deep learning is rapidly becoming the most popular topic in the mobile app industry. This book introduces trending deep learning concepts and their use cases with an industrial and application-focused approach. You will cover a range of projects covering tasks such as mobile vision, facial recognition, smart artificial intelligence assistant, augmented reality, and more. With the help of eight projects, you will learn how to integrate deep learning processes into mobile platforms, iOS, and Android. This will help you to transform deep learning features into robust mobile apps efficiently. You’ll get hands-on experience of selecting the right deep learning architectures and optimizing mobile deep learning models while following an application oriented-approach to deep learning on native mobile apps. We will later cover various pre-trained and custom-built deep learning model-based APIs such as machine learning (ML) Kit through Firebase. Further on, the book will take you through examples of creating custom deep learning models with TensorFlow Lite. Each project will demonstrate how to integrate deep learning libraries into your mobile apps, right from preparing the model through to deployment. By the end of this book, you’ll have mastered the skills to build and deploy deep learning mobile applications on both iOS and Android.

What you will learn

Create your own customized chatbot by extending the functionality of Google Assistant Improve learning accuracy with the help of features available on mobile devices Perform visual recognition tasks using image processing Use augmented reality to generate captions for a camera feed Authenticate users and create a mechanism to identify rare and suspicious user interactions Develop a chess engine based on deep reinforcement learning Explore the concepts and methods involved in rolling out production-ready deep learning iOS and Android applications

Product Details

Country selected

Publication date : Apr 6, 2020
Length 380 pages
Edition : 1st Edition
Language : English
ISBN-13 : 9781789611212
Category :
Concepts :

What do you get with a Packt Subscription?

Free for first 7 days. $15.99 p/m after that. Cancel any time!
Product feature icon Unlimited ad-free access to the largest independent learning library in tech. Access this title and thousands more!
Product feature icon 50+ new titles added per month, including many first-to-market concepts and exclusive early access to books as they are being written.
Product feature icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Product feature icon Thousands of reference materials covering every tech concept you need to stay up to date.
Subscribe now
View plans & pricing

Product Details


Publication date : Apr 6, 2020
Length 380 pages
Edition : 1st Edition
Language : English
ISBN-13 : 9781789611212
Category :
Concepts :

Table of Contents

13 Chapters
Preface Chevron down icon Chevron up icon
1. Introduction to Deep Learning for Mobile Chevron down icon Chevron up icon
2. Mobile Vision - Face Detection Using On-Device Models Chevron down icon Chevron up icon
3. Chatbot Using Actions on Google Chevron down icon Chevron up icon
4. Recognizing Plant Species Chevron down icon Chevron up icon
5. Generating Live Captions from a Camera Feed Chevron down icon Chevron up icon
6. Building an Artificial Intelligence Authentication System Chevron down icon Chevron up icon
7. Speech/Multimedia Processing - Generating Music Using AI Chevron down icon Chevron up icon
8. Reinforced Neural Network-Based Chess Engine Chevron down icon Chevron up icon
9. Building an Image Super-Resolution Application Chevron down icon Chevron up icon
10. Road Ahead Chevron down icon Chevron up icon
11. Other Books You May Enjoy Chevron down icon Chevron up icon
Appendix Chevron down icon Chevron up icon

Customer reviews

Top Reviews
Rating distribution
Empty star icon Empty star icon Empty star icon Empty star icon Empty star icon 0
(0 Ratings)
5 star 0%
4 star 0%
3 star 0%
2 star 0%
1 star 0%
Top Reviews
No reviews found
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

What is included in a Packt subscription? Chevron down icon Chevron up icon

A subscription provides you with full access to view all Packt and licnesed content online, this includes exclusive access to Early Access titles. Depending on the tier chosen you can also earn credits and discounts to use for owning content

How can I cancel my subscription? Chevron down icon Chevron up icon

To cancel your subscription with us simply go to the account page - found in the top right of the page or at https://subscription.packtpub.com/my-account/subscription - From here you will see the ‘cancel subscription’ button in the grey box with your subscription information in.

What are credits? Chevron down icon Chevron up icon

Credits can be earned from reading 40 section of any title within the payment cycle - a month starting from the day of subscription payment. You also earn a Credit every month if you subscribe to our annual or 18 month plans. Credits can be used to buy books DRM free, the same way that you would pay for a book. Your credits can be found in the subscription homepage - subscription.packtpub.com - clicking on ‘the my’ library dropdown and selecting ‘credits’.

What happens if an Early Access Course is cancelled? Chevron down icon Chevron up icon

Projects are rarely cancelled, but sometimes it's unavoidable. If an Early Access course is cancelled or excessively delayed, you can exchange your purchase for another course. For further details, please contact us here.

Where can I send feedback about an Early Access title? Chevron down icon Chevron up icon

If you have any feedback about the product you're reading, or Early Access in general, then please fill out a contact form here and we'll make sure the feedback gets to the right team. 

Can I download the code files for Early Access titles? Chevron down icon Chevron up icon

We try to ensure that all books in Early Access have code available to use, download, and fork on GitHub. This helps us be more agile in the development of the book, and helps keep the often changing code base of new versions and new technologies as up to date as possible. Unfortunately, however, there will be rare cases when it is not possible for us to have downloadable code samples available until publication.

When we publish the book, the code files will also be available to download from the Packt website.

How accurate is the publication date? Chevron down icon Chevron up icon

The publication date is as accurate as we can be at any point in the project. Unfortunately, delays can happen. Often those delays are out of our control, such as changes to the technology code base or delays in the tech release. We do our best to give you an accurate estimate of the publication date at any given time, and as more chapters are delivered, the more accurate the delivery date will become.

How will I know when new chapters are ready? Chevron down icon Chevron up icon

We'll let you know every time there has been an update to a course that you've bought in Early Access. You'll get an email to let you know there has been a new chapter, or a change to a previous chapter. The new chapters are automatically added to your account, so you can also check back there any time you're ready and download or read them online.

I am a Packt subscriber, do I get Early Access? Chevron down icon Chevron up icon

Yes, all Early Access content is fully available through your subscription. You will need to have a paid for or active trial subscription in order to access all titles.

How is Early Access delivered? Chevron down icon Chevron up icon

Early Access is currently only available as a PDF or through our online reader. As we make changes or add new chapters, the files in your Packt account will be updated so you can download them again or view them online immediately.

How do I buy Early Access content? Chevron down icon Chevron up icon

Early Access is a way of us getting our content to you quicker, but the method of buying the Early Access course is still the same. Just find the course you want to buy, go through the check-out steps, and you’ll get a confirmation email from us with information and a link to the relevant Early Access courses.

What is Early Access? Chevron down icon Chevron up icon

Keeping up to date with the latest technology is difficult; new versions, new frameworks, new techniques. This feature gives you a head-start to our content, as it's being created. With Early Access you'll receive each chapter as it's written, and get regular updates throughout the product's development, as well as the final course as soon as it's ready.We created Early Access as a means of giving you the information you need, as soon as it's available. As we go through the process of developing a course, 99% of it can be ready but we can't publish until that last 1% falls in to place. Early Access helps to unlock the potential of our content early, to help you start your learning when you need it most. You not only get access to every chapter as it's delivered, edited, and updated, but you'll also get the finalized, DRM-free product to download in any format you want when it's published. As a member of Packt, you'll also be eligible for our exclusive offers, including a free course every day, and discounts on new and popular titles.