Running the topology – the Redis case
We have a few more small things to address before we run the topology:
Copy the
logconfig.ini
file from the second example in Chapter 3, Introducing Petrel, to this topology's directory.Create a file called
setup.sh
. Petrel will package this script with the topology and run it at startup. This script installs the third-party Python libraries used by the topology. The file looks like this:pip install -U pip pip install nltk==3.0.1 oauthlib==0.7.2 tweepy==3.2.0
Create a file called
manifest.txt
with these two lines:logconfig.ini setup.sh
Install the Redis server on a well-known node. All workers will store state here:
sudo apt-get install redis-server
Install the Python Redis client on all Storm worker machines:
sudo apt-get install python-redis
Before running the topology, let's review the list of files that we've created. Make sure you have created these files correctly:
topology.yaml
twitterstream.py
splitsentence.py
rollingcount.py
totalrankings...