Analyzing results

After collecting the data for all the metrics, we should analyze the results. Analysis of these results mainly involves comparing the actual result with the expected target. The outcome must be examined for each metric individually and frequently. Initially, the trends must be observed daily and thoroughly analyzed weekly. Product managers should do this analysis with support from others, such as technical leads and customer support.

Analyzing the deviation in the result and finding the root cause is an essential part of this step. Sometimes, the root cause of the variation could be straightforward, for example, the number of new consumers was low in a particular week because many people were on holiday due to extended weekends. But sometimes, it can be complex and tricky.

For example, the number of transactions at a particular time on a certain day went down significantly due to latency in response from a major credit card provider. This might not be very...