Block this user agent

Hello @earl_d ,

Our Security plugin is designed to filter traffic based on Blacklists of IP addresses, not by User-Agent strings.

In our global database, this specific bot (Meta-Webindexer) currently has a “Trusted” status. This means it is recognized as a legitimate crawler and is allowed through the Security Firewall by default to prevent blocking useful social media indexing.

Unfortunately, there is no single, static list of IP addresses for this bot, as they can change frequently. For this reason, we cannot provide a specific range for you to add to your Personal Lists unless you have identified specific IPs from your own server logs.

I noticed that you have already started adding several IP addresses to your Personal Blacklists after reviewing your logs. This is exactly the right approach if you wish to restrict this bot’s access manually.

Since this is a known bot, it should respect the rules in your robots.txt file. You can add the following lines to your file to request the bot to stop indexing your site:

User-agent: meta-webindexer
Disallow: /

Please let us know if you have any further questions