Sumada Kaabaha: crawlers

Robots.txt rewrite

(2 wadarta qiimeynta)

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Eugen Bobrowski 2,000+ rakibaad firfircoon Lagu tijaabiyey 4.7.29
Block AI Crawlers

(3 wadarta qiimeynta)

Tells AI (Artificial Intelligence) companies not to scrap your site for their AI products.

lastsplash (a11n) 600+ rakibaad firfircoon Lagu tijaabiyey 6.7.2
Dark Visitors

(5 wadarta qiimeynta)

Get realtime analytics on the AI agents, crawlers, scrapers, and other bots visiting your website. Generate a robots.txt to opt out of AI training.

gavindarkvisitors 400+ rakibaad firfircoon Lagu tijaabiyey 6.7.2
Robots Meta Whiz

(0 wadarta qiimeynta)

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

Marat Nepomnyashy 100+ rakibaad firfircoon Lagu tijaabiyey 4.7.29
MetaRobots by SEO-Sign

(1 wadarta qiimeynta)

The easiest way to manage meta robots tag.

Artem Pilipets 100+ rakibaad firfircoon Lagu tijaabiyey 4.1.41
Seo Crawlytics Data Export & Delete

(0 wadarta qiimeynta)

Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

apasionados 30+ rakibaad firfircoon Lagu tijaabiyey 6.3.5
Log-Hero.com Plugin

(1 wadarta qiimeynta)

Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.

Log Hero 20+ rakibaad firfircoon Lagu tijaabiyey 4.9.26
LJPL Armored robots.txt

(0 wadarta qiimeynta)

Add some directives to your robots.txt file to keep your site safer

Lukasz Jasinski 20+ rakibaad firfircoon Lagu tijaabiyey 3.4.2
AI Rights Protection by SimpleFeed

(0 wadarta qiimeynta)

Protect your rights by reviewing and blocking AI bots from using your content without compensation.

Alex Khomichenko In ka yar 10 rakibaad firfircoon Lagu tijaabiyey 6.7.2