As already mentioned, regression itself is a process to analyze a relationship between one variable and another variable, but there are some terms used in machine learning to describe these variables along with various types of regression and processes associated with regression:
- Response or dependent variable: These terms will be used interchangeably for the variable that we are trying to predict based on one or more other variables. This variable is often labeled y.
- Explanatory variables, independent variables, features, attributes, or regressors: These terms will be used interchangeably for the variables that we are using to predict the response. These variables are often labeled x or x1, x2, and so on.
- Linear regression: This type of regression assumes that the dependent variable depends on the independent variable linearly (that is,...
