Other flume components

In addition to main components in Flume, there are other very important components. These components will be discussed in some detail in this section. The following figure shows all of these components working together:

Figure 19: Other Flume components working together

The following subsection gets deep into working and responsibility of each of the components in the preceding figure (Figure 19). Let's get started and understand how these components will help you in designing the right Flume component arrangement to execute your use case successfully.

Channel processor

As shown in Figure 19 the source sends the events to the channel processor. Every source has its own channel processor and for persisting the event in the channel, the source delegates the work to the channel processor, which actually does the job of persisting according to the channel type.

Interceptor

As seen in the preceding figure, the channel processor then passes the events to the interceptor. Channel...