Chapter 15 - Combining Computer Vision and NLP Techniques

1. Why are CNN and RNN combined in image captioning?
   CNN is needed for capturing image features, whereas, RNN is needed for creating the language output.
2. Why are start and end tokens provided in image captioning but not in handwritten transcription?
   CTC loss does not need such tokens, and moreover, in OCR, we generate tokens in all time-steps in one shot.
3. Why is the CTC loss function leveraged in handwriting transcription?
   We cannot delineate timesteps in the image. CTC takes care of aligning key image features with timesteps.
4. How do transformers help in object detection?
   By treating anchor boxes as embedding inputs for transformer decoders DETR learns dynamic anchor boxes thereby helping object detection.