Chapter 6, Extending the Preprocessor

1. Most of the time tokens are harvested from the provided source code, but in some cases, tokens might be generated dynamically inside the Preprocessor. For example, the __LINE__ built-in macro is expanded to the current line number, and the __DATE__ macro is expanded to the current calendar date. How does Clang put that generated textual content into the SourceManager's source code buffer? How does Clang assign SourceLocation to these tokens?
   • Developers can leverage the clang::ScratchBuffer class to insert dynamic Token instances.
2. When we were talking about implementing a custom PragmaHandler, we were using Preprocessor::Lex to fetch tokens followed after the pragma name, until we hit the eod token type. Can we keep lexing beyond the eod token? What interesting thing will you do if you can consume arbitrary tokens follow after the #pragma directive?
   • Yes, we can keep lexing beyond the eod token. It simply consumes the contents following...