Time for action – installing and configuring Flume

Let's get Flume downloaded and installed.

1. Retrieve the most recent Flume NG binary from http://flume.apache.org/ and download and save it to the local filesystem.

2. Move the file to the desired location and uncompress it:

   $ mv apache-flume-1.2.0-bin.tar.gz /opt
   $ tar -xzf /opt/apache-flume-1.2.0-bin.tar.gz
   

3. Create a symlink to the installation:

   $ ln -s /opt/apache-flume-1.2.0 /opt/flume
   

4. Define the FLUME_HOME environment variable:

   Export FLUME_HOME=/opt/flume
   

5. Add the Flume bin directory to your path:

   Export PATH=${FLUME_HOME}/bin:${PATH}
   

6. Verify that JAVA_HOME is set:

   Echo ${JAVA_HOME}
   

7. Verify that the Hadoop libraries are in the classpath:

   $ echo ${CLASSPATH}
   

8. Create the directory that will act as the Flume conf directory:

   $ mkdir /home/hadoop/flume/conf
   

9. Copy the needed files into the conf directory:

   $ cp /opt/flume/conf/log4j.properties /home/hadoop/flume/conf
   $ cp /opt/flume/conf/flume-env.sh.sample /home/hadoop/flume/conf/flume-env.sh
   

10. Edit...