Job execution: Celery Worker(s)
A Celery worker runs jobs in Nautobot. You can run as many workers as you need but they must all have access to the Nautobot database and Redis servers. By default, the Celery worker will run at most n concurrent tasks and reserve an additional 4n tasks, where n is the number of CPU cores on the system. You can change this behavior by sending the following arguments to the nautobot-server celery
worker
command:
nautobot-server celery worker --concurrency <n> Number of concurrent tasks to process nautobot-server celery worker --prefetch-multiplier <n> Number of tasks to prefetch for each concurrent process (default 4)
Since Nautobot jobs spend a lot of their time waiting for responses from network devices or remote APIs, it’s usually safe to increase the number of concurrent processes as long as your server has the memory capacity. Nautobot uses fork-based multiprocessing, which makes...