Search code examples
web-scrapingpuppeteerserver-side-renderingcheerio

Programatically detect client rendered sites


I'm building a web scrapper and currently I'm using puppeteer to extract the content. But the problem with puppeteer is that it takes a lot of ram and sometimes my server runs out of memory when I scrap 15+ pages simultaneously.

So, I'm thinking about using cheerio for server rendered sites. I'm hoping it will be a lot faster and less expensive to user cheerio.

Is there any way to tell if a website is client rendered or not?


Solution

  • As mentioned by @ggorlen there's no way to determine whether a site is using ssr or csr and the best option is to use puppeteer.