Summary
Although this is not a scraping book, we covered a lot of ground here. I hope the first section gave you a good idea of what scraping is, as well as covering what you can do and what you shouldn't do. We also learned how to create our own scrapers. We created a crawler in less than 100 lines. We added two new tools to our toolbox: puppeteer-cluster
and puppeteer-extra
. We closed this chapter learning a little bit about authentication and authorization, giving you almost everything you need to get started in the scraping world.
If you weren't that excited about scraping before this chapter, I hope it is the spark that will make you start creating your own scrapers. If you knew about scraping, I hope this chapter gave you more tools to scrape as a professional.
Our next and final chapter will be about performance and how we can measure it using Puppeteer.