Етикет на разширения: crawlers

Robots.txt rewrite

(2 общо оценки)

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Eugen Bobrowski 2 000+ активни инсталации Тествано до 4.7.29
Block AI Crawlers

(3 общо оценки)

Tells AI (Artificial Intelligence) companies not to scrap your site for their AI products.

lastsplash (a11n) 600+ активни инсталации Тествано до 6.7.2
Dark Visitors

(5 общо оценки)

Get realtime analytics on the AI agents, crawlers, scrapers, and other bots visiting your website. Generate a robots.txt to opt out of AI training.

gavindarkvisitors 400+ активни инсталации Тествано до 6.7.2
Robots Meta Whiz

(0 общо оценки)

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

Marat Nepomnyashy 100+ активни инсталации Тествано до 4.7.29
MetaRobots by SEO-Sign

(1 общо оценки)

The easiest way to manage meta robots tag.

Artem Pilipets 100+ активни инсталации Тествано до 4.1.41
Seo Crawlytics Data Export & Delete

(0 общо оценки)

Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

apasionados 30+ активни инсталации Тествано до 6.3.5
Log-Hero.com Plugin

(1 общо оценки)

Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.

Log Hero 20+ активни инсталации Тествано до 4.9.26
LJPL Armored robots.txt

(0 общо оценки)

Add some directives to your robots.txt file to keep your site safer

Lukasz Jasinski 20+ активни инсталации Тествано до 3.4.2
AI Rights Protection by SimpleFeed

(0 общо оценки)

Protect your rights by reviewing and blocking AI bots from using your content without compensation.

Alex Khomichenko По-малко от 10 активни инсталации Тествано до 6.7.2