Machine learning algorithms

In this section, we review algorithms that are needed for machine learning, and introduce machine learning libraries including Spark's MLlib and IBM's SystemML, then we discuss their integration with Apache Spark.

After reading this section, readers will become familiar with various machine learning libraries including Spark's MLlib, and know how to make them ready for machine learning.

To complete a Machine Learning project, data scientists often employ some classification or regression algorithms to develop and evaluate predictive models, which are readily available in some Machine Learning tools like R or MatLab. To complete a machine learning project, besides data sets and computing platforms, these machine learning libraries, as collections of machine learning algorithms, are necessary.

For example, the strength and depth of the popular R mainly comes from the various algorithms that are readily provided for the use of Machine Learning professionals. The total number of R packages is over 1000. Data scientists do not need all of them, but do need some packages to:

• Load data, with packages like RODBC or RMySQL
• Manipulate data, with packages like stringr or lubridate
• Visualize data, with packages like ggplot2 or leaflet
• Model data, with packages like Random Forest or survival
• Report results, with packages like shiny or markdown

According to a recent ComputerWorld survey, the most downloaded R packages are:

PACKAGE	# of DOWNLOADS
Rcpp	162778
ggplot2	146008
plyr	123889
stringr	120387
colorspace	118798
digest	113899
reshape2	109869
RColorBrewer	100623
scales	92448
manipulate	88664

Note

For more info, please visit http://www.computerworld.com/article/2920117/business-intelligence/most-downloaded-r-packages-last-month.html