Conflict/issue with Yoast

Hi Venutius,

Thank you for downloading our plugin and taking the time to let us know about this. We are continuously developing this plugin and adding new features, so we truly value your feedback.

We have been analysing recent AI traffic patterns and found that many providers are changing how they identify themselves (switching between background “crawlers” and “live” user agents). To account for this, we have just released an update that broadens our detection logic. This ensures we capture the full spectrum of AI activity, including the newer “live” agents that other tools might be counting differently.

We have also optimised how the plugin serves the llms.txt file to prevent external services from serving “stale” or cached versions. This ensures that every time a bot requests your file, it hits your server directly and is correctly logged in your analytics.

For the best results, please check the following:

1. Update The Plugin: We have released a new update which should help address this issue. Please update the plugin.
2. Clear Your Cache: After updating, we recommend clearing your website cache (and CDN if you use one). Since AI bots can access cached versions of files, clearing this ensures they are forced to fetch the new, trackable version of your file.
3. Enable ‘Virtual Mode’: Please ensure you are using Virtual Mode in the plugin settings and click ‘Regenerate Now‘ in the ‘Tools‘ tab to fully clear the physical file. This mode is specifically designed for our advanced analytics features.
4. AI Crawl Schedules: While “Live” agents visit instantly when a user asks a question, the background crawlers (which build the AI’s memory) do not visit every day. Depending on your site’s size, they may only stop by every few days or weeks.

Please let us know if the analytics data improve for you after trying these steps.

Below are some screenshots of the AI Analytics tab logging AI visits for today.
We’ve done tests to manually trigger visits from different AIs. You can also check this yourself if you visit ChatGPT (for example) and ask it to fetch your llms.txt file. You’ll just need to give it your full llms.txt URL in the prompt.