Crawling big websites - RAM usage

Modified on Tue, 11 Jun at 3:42 PM

This is undoubtedly a logical question, especially in cases where scanning large websites is necessary. That's why we have prepared a table that provides a clear overview of maximal RAM consumption during scanning different quantities of URLs. The website is scanned using default settings.

Additionally, it provides insights into scanning duration, the number of threads and JS-rendering (enabled or disabled).

The table should certainly help you to understand if your device is "strong" enough for scanning your website.

Please note that if you increase the number of threads, RAM usage will increase as well.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article