Splunk visualization - deeper into the logs

We spoke about TurboIntegrator earlier in this chapter. TurboIntegrator is the Cognos TM1 ETL scripting language used to (among other things) load data from external data sources into a TM1 server. These TI scripts can read directly from most data sources and can also easily load data from text or CSV files. Most organizations create multiple TI scripts, test and then schedule them to execute on a routine schedule, to keep the information within TM1 up to date.

In a mature organization (or one that follows proven-practice methodologies), ETL scripts should generate load or processing statistics. These stats can then be used for many things such as determining the success of the executed process (records read = records loaded), performance trending (using the duration time of the processes, are they beginning to run slower over time?), and so on.

In our example, our organizations load process scripts and write statistics upon conclusion or successful...