With big data solutions, sometimes the data needs to be transformed and processed into smaller chunks due to its sheer size. In order to deal with this problem, Microsoft have introduced some functionality to help. This section will cover the features that are designed to assist with big data issues.
Enriching data for analysis
rxDataSteps
The rxDataStep function can be used to process data in chunks. It is one of the important data transformation functions in Microsoft ML Services.
The rxDataStep function can be used to create and transform subsets of data. The rxDataStep function processes data one chunk at a time, reading from one data source and writing to another. rxDataStep allows you to modify existing columns or add...