The dynamic routing algorithm
As mentioned earlier, it is necessary for the capsule in the lower layer to decide how to send its output to the higher-level capsules. This is achieved through the novel concept of the dynamic routing algorithm, which was introduced in the paper (https://arxiv.org/pdf/1710.09829.pdf). The key idea behind this algorithm is that the lower layer capsule will send their output to the higher-level capsules that match the input.
This is achieved through the weights (cij) mentioned in the last section. These weights multiply the outputs from the lower layer capsule i before pushing them as the input to the higher level capsule j. Some of the properties of these weights are as follows:
- cijs are non-negative in nature and are determined by the dynamic-routing algorithm
- The number of weights in the lower layer capsule is equal to the number of higher-level capsules
- The sum of the weights of each lower layer capsule i amounts to 1
Implement the iterative routing algorithm...
