Adding AI Builder image recognition to Power Automate

Now, let’s learn how we can use Power Automate and an image recognition model to update our inventory via email.

Our scenario is as follows: A warehouse worker will send a weekly picture of a box with oranges in an email. This email will be processed using Power Automate, and AI Builder will count how many oranges are in the box and update the inventory amount in Dynamics 365 F&O.

To do this, I trained an object detection model with images of oranges, oranges and pineapples, oranges and bananas, and images that contain no oranges. I want to insist on the quality of the data we use to train our models: our model is only as good as the data we use to create it.

If we just provide images of oranges, the model will identify all round objects as oranges and you could end up with a bad model (see Figure 9.7):

Figure 9.7 – Incorrect identification

In Figure 9.7, round fruits are...