A centralized logging solution
In order to address the challenges stated earlier, traditional logging solutions require serious rethinking. The new logging solution, in addition to addressing the preceding challenges, is also expected to support the capabilities summarized here:
The ability to collect all log messages and run analytics on top of the log messages
The ability to correlate and track transactions end to end
The ability to keep log information for longer time periods for trending and forecasting
The ability to eliminate dependency on the local disk system
The ability to aggregate log information coming from multiple sources such as network devices, operating system, microservices, and so on
The solution to these problems is to centrally store and analyze all log messages, irrespective of the source of log. The fundamental principle employed in the new logging solution is to detach log storage and processing from service execution environments. Big data solutions are better suited to...