Bad user agent scan

Bad User Agents

What It Checks

This scanner checks if bad User Agents can visit your website. Bad User Agents are bots that provide no value to the website. They include scrapers, spambots, email harvesters and more bots that you don't want on your site.

Why It Matters

Bad User Agents are bots that provide no value to the website. They include scrapers, spambots, email harvesters and more bots that you don't want on your site. Those bots that are crawling with a malicious purpose, have no desire to follow any robots.txt or meta tag.

What You'll See

Good Status:

• You are currently blocking bad User Agents.
• Protection activated

Bad Status:

• Your website should block HTTP requests for bad User Agents.

Warning:

• Unable to determine if your homepage is accessible by bad User Agents. But you can activate the Block bad User Agents protection from the Firewall module.

How to Fix

Activate the option "Block Bad User Agents" in the Firewall module. This will prevent malicious bots and scrapers from accessing your site, reducing server load and protecting your content.