Value metrics – evaluating performance across verticals and peer groups
No matter what domain, vertical, or peer group your AI product is in, you’re going to need to establish some way of communicating the success of your product through a combination of value (business) metrics, key performance indicators (KPIs), and objectives and key results (OKRs), along with a number of technical metrics that might be required when you’re communicating about the efficacy and success of your product to a technical audience. As with anything, if we can’t establish a baseline and see how we’ve grown from that baseline, we won’t know whether our performance is improving (and if it is, by how much) unless we track it.
In the following section, we will be looking at the various types of metrics we will start to collect on our products’ efficacy. For AI products, deciding on which metrics you will track, how you will talk about them, and what kinds...