Chapter 9: Scraping tools

Back in Chapter 1, Getting started with Puppeteer, we talked about the different uses for web automation. Of all those use cases, web scraping is the one that excites developers the most. When I give talks about automation, I know that I will get the crowd's full attention when I start talking about task automation, but even more when I get into the topic of web scraping.

Don't get me wrong, I think that UI testing is important. As we saw in the previous chapters, it's not just about running automation tests but also about taking care of your customers. But web scraping has that fun spark, a hacker feeling, and I didn't want to leave this topic out of the book.

A few months ago, I read a book about web scraping that included a chapter about UI testing at the end of the book. We are going to do the same, but the other way around. This is a UI testing book with a scraping chapter at the end.

We will begin this chapter by defining...