Celery
Celery is the most popular task queue created in Python. It allows us to create new tasks easily and can handle the creation of the events that trigger new tasks.
Celery requires to work to set up a broker, which will be used as a queue to handle the messages.
In Celery parlance, the broker is the message queue, while the backend is reserved for interacting with a storage system to return information.
The code that creates the message will add it to the broker, and the broker will pass it to one of the connected workers. When everything happens with Python code, where the celery
package can be installed, it's simple to operate. We'll see later how to operate it in other cases.
Celery can use multiple systems as brokers. The most popular are Redis and RabbitMQ.
In our examples, we will use Redis as it can be used for the broker and the backend, and it's widely available in cloud systems. It's also quite scalable and...