Calculating Columns Using Complex Algorithms: Distances

The data ingestion phase allows you to gather all the information you need for your analysis from any data source. Once the various datasets have been imported, some of this information may not be useful in describing a phenomenon from an analytical point of view. After the data ingestion phase, it’s not uncommon to find that some of the raw information doesn’t directly contribute to analytical insights as is. Recognizing this, it is essential to refine and enhance the dataset with additional computations that can provide new perspectives and answers to our questions. This often involves the creation of calculated columns that provide measures that are more aligned with our analytical goals. For example, in the context of our exploration, the calculation of the distance between two geographic points or the dissimilarity between two strings can transform seemingly abstract or unrelated data into powerful tools for...