Memory-augmented neural networks (MANN)
Now we will see an interesting variant of NTM, called MANN. It is extensively used for one-shot learning tasks. MANN is designed to make NTM perform better at one-shot learning tasks. We know that NTM can either use content-based addressing or location-based addressing. But in MANN, we use only content-based addressing.
MANN uses a new addressing scheme called least recently used access. As the name suggests, it writes to the least recently used memory location. Wait. What? We just learned that MANN is not location-based, so why are we writing to the least recently used location? This is because the least recently used memory location is determined by the read operation and the read operation is performed by content-based addressing. So, we basically perform content-based addressing for reading and write to the location that was least recently used.
Read and write operations
Now we will see how to perform read and write operations in MANN and how they...
