Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
MySQL 8 for Big Data

You're reading from   MySQL 8 for Big Data Effective data processing with MySQL 8, Hadoop, NoSQL APIs, and other Big Data tools

Arrow left icon
Product type Paperback
Published in Oct 2017
Publisher Packt
ISBN-13 9781788397186
Length 296 pages
Edition 1st Edition
Languages
Tools
Concepts
Arrow right icon
Authors (4):
Arrow left icon
Chintan Mehta Chintan Mehta
Author Profile Icon Chintan Mehta
Chintan Mehta
Shabbir Challawala Shabbir Challawala
Author Profile Icon Shabbir Challawala
Shabbir Challawala
Jaydip Lakhatariya Jaydip Lakhatariya
Author Profile Icon Jaydip Lakhatariya
Jaydip Lakhatariya
Kandarp Patel Kandarp Patel
Author Profile Icon Kandarp Patel
Kandarp Patel
Arrow right icon
View More author details
Toc

Table of Contents (11) Chapters Close

Preface 1. Introduction to Big Data and MySQL 8 FREE CHAPTER 2. Data Query Techniques in MySQL 8 3. Indexing your data for High-Performing Queries 4. Using Memcached with MySQL 8 5. Partitioning High Volume Data 6. Replication for building highly available solutions 7. MySQL 8 Best Practices 8. NoSQL API for Integrating with Big Data Solutions 9. Case study: Part I - Apache Sqoop for exchanging data between MySQL and Hadoop 10. Case study: Part II - Real time event processing using MySQL applier

Real-time integration with MySQL Applier


There are many MySQL applier packages available on GitHub. We can use any of them which provides framework for replication and an example of real-time replication:

  • Flipkart/MySQL-replication-listener
  • SponsorPay/MySQL-replication-listener
  • bullsoft/MySQL-replication-listener

For our configuration, let's use Flipkart/MySQL-replication-listener. You can clone the Git library using the following command:

$ git clone https://github.com/Flipkart/MySQL-replication-listener.git

Here are some environment variables required by the package. Make sure that all are set properly.

  • HADOOP_HOME: The Hadoop root directory path
  • CMAKE_MODULE_PATH: The path of the root directory where FindHDFS.cmake and FindJNI.cmake files are located in HDFS
  • HDFS_LIB_PATHS: The path of the libhdfs.so file available in HADOOP
  • JAVA_HOME: You need to set the Java home path for this variable

Now build and compile all the libraries using the following command:

$ cd src
$ cmake . -DCMAKE_MODULE_PATH:String...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €18.99/month. Cancel anytime