Requirements

To understand the requirements of a big data processing architecture, let’s consider an example. Let’s say there’s a situation where a consumer goods company wants to understand its customers’ preferences and behavior to optimize its product placement, inventory management, and targeted marketing. To achieve this, the company will have to collect data from the following sources:

• Sales transactions: These are transactions that are made either at the physical store or through online website purchases.
• Online behavior: Tracking which products are frequently viewed and searched as customers browse the company website.
• Customer feedback: Customers are often offered to provide feedback through surveys, reviews, and feedback forms. This data needs to be collected and processed to improve business performance.
• Social media interactions: Consumers react to company products and their experiences by adding comments and posts on social...