Centralized logging solution

In order to address the earlier stated challenges, traditional logging solutions require serious rethinking. The new logging solution, in addition to addressing the preceding challenges, is also expected to support the capabilities summarized here:

• Ability to collect all log messages and run analytics on top of the log messages
• Ability to correlate and track transactions end-to-end
• Ability to keep log information for longer time periods for trending and forecasting
• Ability to eliminate dependency on the local disk system
• Ability to aggregate log information coming from multiple sources, such as network devices, operating system, microservices, and so on

The solution to these problems is to centrally store and analyze all log messages, irrespective of the source of the log. The fundamental principle employed in the new logging solution is to detach log storage and processes from the service execution environments. Big data solutions are better suited for storing and...