Getting the metadata of the data sources
The fuel for the data application is the data itself. The data sources that are used in the application have to be correctly identified in the logs. If an issue occurs at a data source and you need to perform deeper analyses, you would expect information that will help you retrieve the data. In this section, we will see how a data source can be identified.
Data source
To identify the data that’s used by an application, we need to define the metadata of the data source. The metadata represents the data on the data.
The metadata of the data source is all the elements that will allow you to recognize the data source. Let’s explore them:
- The file’s location: This gives you the address of the data source and helps you retrieve the data in case you need it. The file location can be the path on your local filesystem or the filesystem of the company. It can also be a connection string if the data is in a table located...