WordPress.org
Get WordPress

Plugin Directory

Changeset 3383930


Ignore:
Timestamp:
10/24/2025 10:11:37 AM (4 months ago)
Author:
samsonovteamwork
Message:

Updated to ver 8.2.3

Location:
website-llms-txt/trunk
Files:
3 edited

Legend:

Unmodified
Added
Removed

  • website-llms-txt/trunk/README.txt

    r3383256 r3383930  
    11=== Website LLMs.txt ===
    22Contributors: ryhowa, samsonovteamwork
    3 Tags: llm, ai, seo, rankmath, yoast
     3Tags: llm, ai, seo, rankmath, yoast, seopress, aioseo
    44Requires at least: 5.8
    5 Tested up to: 6.8
     5Tested up to: 6.8.3
    66Requires PHP: 7.2
    7 Stable tag: 8.2.2
     7Stable tag: 8.2.3
    88License: GPLv2 or later
    99License URI: http://www.gnu.org/licenses/gpl-2.0.html
    1010
    11 Automatically generate and manage LLMS.txt files for LLM/AI content understanding, with full Yoast SEO and RankMath integration.
     11Automatically generate and manage LLMS.txt files for LLM/AI content understanding, with full Yoast SEO, Rank Math, SEOPress, and AIOSEO integration.
    1212
    1313== Description ==
    1414
    15 This plugin automatically generates an LLMs.txt file — a simple, structured list of important public URLs from your site — designed specifically for Large Language Models (LLMs) like ChatGPT, Perplexity, Claude, and other AI systems.
    16 It works much like a traditional XML sitemap, but is optimized for the way AI agents read and learn from the web.
    17 
    18 The plugin integrates seamlessly with popular SEO tools like Yoast SEO, Rank Math, and now AIOSEO, automatically excluding content marked as noindex or nofollow.
    19 
    20 ✅ Future-proof your site for AI discovery
    21 ✅ Lightweight, automatic, and customizable
    22 ✅ No need for manual configuration
    23 
    24 New: llms.txt AI crawler detection
    25 We now track whether major AI bots like GPTBot, ClaudeBot, and PerplexityBot are reading `llms.txt` files.
    26 
    27 <a href="https://www.ryanhoward.dev/p/are-ai-search-bots-actually-looking-at-llms-txt-files" target="_blank">About crawler detection</a>
    28 <a href="https://www.ryanhoward.dev/p/everything-we-know-about-llms-txt-573e">Everything we know about llms.txt</a>
    29 
    30 Features:
    31 
    32 * Automatic LLMS.txt generation
    33 * Custom post type selection and ordering
    34 * SEO plugin integration (Yoast SEO, RankMath)
    35 * Sitemap integration
    36 * Cache management
    37 * Configurable update frequency
     15**Website LLMs.txt** generates and manages an `llms.txt` file, a structured, AI-ready index that helps large language models like ChatGPT, Claude, and Perplexity understand your site’s most important content.
     16
     17### How llms.txt works
     18Traditional sitemaps and robots files guide search engines. But as AI-driven systems such as ChatGPT, Claude, and Perplexity increasingly ingest web content, they benefit from a clear, structured list of a site’s most important URLs.
     19`llms.txt` offers that: a plain-text or Markdown list of essential public URLs, optionally annotated with titles, descriptions, and grouping, designed for AI consumption rather than general web crawling.
     20
     21### Key benefits
     22✅ **AI discovery readiness** — future-proof your site for AI indexing and content retrieval.
     23✅ **Fully automatic** — the plugin builds and updates your `llms.txt` file on its own schedule.
     24✅ **SEO plugin integration** — works seamlessly with Yoast SEO, Rank Math, SEOPress, and AIOSEO, automatically excluding content marked as *noindex* or *nofollow*.
     25✅ **Advanced controls** — choose post types, customize file titles or descriptions, attach optional Markdown files, and trigger manual regeneration.
     26✅ **Developer-friendly** — includes filters such as `llms_generator_get_post_meta_description` for description logic, performance tuning, and custom indexing behavior.
     27✅ **AI crawler detection** — opt in to track whether GPTBot, ClaudeBot, or PerplexityBot are actually reading your site’s `llms.txt`.
     28✅ **WooCommerce & multisite ready** — respects product visibility rules and scales easily across large or networked sites.
     29✅ **Privacy-first experiment** — anonymous, encrypted telemetry helps reveal which bots are accessing `llms.txt` files across the web.
     30
     31### Activation & setup
     321. Activate the plugin.
     332. Visit *Settings → LLMs.txt* to configure post types, update frequency (immediate, daily, or weekly), and optional crawler logging.
     343. The plugin generates `llms.txt` (and optionally `llms-full.txt`) and serves it from your site root.
     354. Content updates trigger automatic regeneration. All noindex/nofollow rules from your SEO plugin are respected.
     365. If you enable AI crawler logging, local and global logs record each visit from known AI bots — viewable right inside your WordPress dashboard.
     37
     38### Use cases for llms.txt
     39- Publishers, SaaS companies, developers, and documentation sites that want to make their content easier for AI systems to interpret.
     40- SEO-driven websites teting AI engine optimization tactics.
     41- Agencies and site owners preparing for the next phase of AI search and retrieval.
     42
     43### The llms.txt experiment & further reading
     44- [Are AI bots actually reading llms.txt files?](https://completeseo.com/are-ai-bots-actually-reading-llms-txt-files/)
     45- [Everything we know about llms.txt](https://completeseo.com/everything-we-know-about-llms-txt/)
     46
    3847
    3948== Installation ==
    4049
    41501. Upload the plugin files to `/wp-content/plugins/website-llms-txt`
    42 2. Activate the plugin through the 'Plugins' screen in WordPress
    43 3. Use the Settings->LLMS.txt screen to configure the plugin
     512. Activate the plugin through the *Plugins* screen in WordPress
     523. Go to *Settings → LLMs.txt* to configure options and generate your file
     53
    4454
    4555== Frequently Asked Questions ==
    4656
    47 = What is LLMS.txt? =
    48 
    49 LLMS.txt is a standardized file that helps AI language models better understand your website content structure and hierarchy.
    50 
    51 = Does this work with Yoast SEO and RankMath? =
    52 
    53 Yes, the plugin integrates with both Yoast SEO and RankMath for sitemap generation and cache management.
    54 
    55 = How often is the LLMS.txt file updated? =
    56 
    57 You can choose between immediate, daily, or weekly updates in the plugin settings.
    58 
    59 == Screenshots ==
    60 
    61 1. Main settings page
    62 2. Content configuration
    63 3. Cache management
    64 4. Manual file upload interface
     57= What is llms.txt? =
     58`llms.txt` is a plain-text or Markdown file placed at the root of your domain (for example `https://example.com/llms.txt`) that lists your site’s most important public URLs. It helps large language models (LLMs) like ChatGPT, Claude, and Perplexity better understand your site’s structure and priority content.
     59
     60= How does the Website LLMs.txt plugin work? =
     61The plugin automatically generates and maintains your `llms.txt` file based on published content. It pulls titles and descriptions from your site, respects SEO plugin settings (Yoast SEO, Rank Math, SEOPress, and AIOSEO), and excludes anything marked as *noindex* or *nofollow*. The file is then served from your site root, ready for AI crawlers to read.
     62
     63= How often is llms.txt updated? =
     64You can set the update frequency in the plugin settings — immediate, daily, or weekly. You can also click “Generate Now” in the admin panel to rebuild the file at any time.
     65
     66= Does this guarantee visibility in ChatGPT, Claude, or Perplexity? =
     67No. There’s no guarantee that any AI model will immediately use `llms.txt`, but it’s clear that several systems — including GPTBot, ClaudeBot, and PerplexityBot — are already crawling these files. Using `llms.txt` positions your site ahead of the curve as AI indexing becomes more structured.
     68
     69= What’s the difference between llms.txt and llms-full.txt? =
     70`llms.txt` is a concise, curated list of key URLs.
     71`llms-full.txt` is an optional extended file generated by the plugin that includes a more comprehensive export of your site’s content. It’s useful for documentation sites, developer platforms, or large content hubs that want to expose additional structure to AI systems.
     72
     73= What if my host doesn’t allow writing to the root directory? =
     74The plugin includes fallback logic for environments such as WordPress VIP or read-only hosting. In those cases, it serves `llms.txt` virtually through WordPress rewrite rules, so the file is still accessible at `https://example.com/llms.txt`.
     75
     76= Does it work with SEO plugins like Yoast or Rank Math? =
     77Yes. It automatically integrates with Yoast SEO, Rank Math, SEOPress, and AIOSEO. Pages marked as *noindex* or *nofollow* in any of those plugins will be excluded from your `llms.txt` file automatically.
     78
     79= Can I track which AI bots visit my llms.txt file? =
     80Yes. When crawler logging is enabled, visits from AI crawlers such as GPTBot, ClaudeBot, and PerplexityBot are recorded. You can view these visits in your WordPress dashboard. If you opt into the global experiment, your data is anonymized and encrypted before contributing to a shared dataset that tracks AI bot behavior across thousands of sites.
     81
     82= Will it conflict with sitemap.xml or robots.txt? =
     83No. `llms.txt` complements your sitemap and robots file. Sitemaps tell search engines what to crawl; `llms.txt` helps AI systems understand what’s most valuable. They work together without overlap or conflict.
     84
     85= Can I customize what appears in llms.txt? =
     86Yes. You can include or exclude specific post types, add a custom title or description, and even attach Markdown (`.md`) files to individual posts or pages. The plugin provides a straightforward settings panel and per-page controls for fine-tuning output.
     87
     88= I’m a developer. Are there filters or hooks available? =
     89Yes. Filters such as `llms_generator_get_post_meta_description` and others allow you to modify how descriptions are generated or extend what metadata appears in the file. Developers can also adjust caching behavior, database queries, and output formatting.
     90
     91= Is any personal data shared when I enable crawler logging? =
     92No. All telemetry is privacy-first. Local logs remain on your site. If you opt into the public experiment, only anonymized data (bot name, timestamp, and a hashed version of your domain) is shared. No content, user, or identifiable data is ever transmitted.
     93
    6594
    6695== Changelog ==
     96
     97= 8.2.3 =
     98
     99📝 Update: README.txt improvements
     100• Updated the link for “All websites counter & experiment details” to the new, correct URL.
     101• Minor text adjustments for clarity and consistency within the documentation.
    67102
    68103= 8.2.2 =

  • website-llms-txt/trunk/admin/admin-page.php

    r3383256 r3383930  
    368368                    </p>
    369369                    <p>
    370                         <a href="https://www.ryanhoward.dev/p/are-ai-search-bots-actually-looking-at-llms-txt-files" target="_blank"><?php _e('Experiment details','website-llms-txt') ?></a> |
    371                         <a href="https://completeseo.com/are-ai-bots-actually-reading-llms-txt-files/" target="_blank"><?php esc_html_e('All websites data counter','website-llms-txt') ?></a>
     370                        <a href="https://completeseo.com/are-ai-bots-actually-reading-llms-txt-files/" target="_blank"><?php _e('All websites counter & experiment details','website-llms-txt') ?></a>
    372371                    </p>
    373372                    <?php if(!empty($settings)): ?>

  • website-llms-txt/trunk/website-llms-txt.php

    r3383256 r3383930  
    22/**
    33 * Plugin Name: Website LLMs.txt
    4  * Description: Manages and automatically generates LLMS.txt files for LLM/AI consumption and integrates with SEO plugins (Yoast SEO, RankMath)
    5  * Version: 8.2.2
    6  * Author: Website LLM
    7  * Author URI: https://wordpress.org/plugins/website-llms-txt/
     4 * Description: Generates and manages an llms.txt file, a structured, AI-ready index that helps large language models like ChatGPT, Claude, and Perplexity understand your site's most important content.
     5 * Version: 8.2.3
     6 * Author: Ryan Howard
     7 * Author URI: https://completeseo.com/author/ryan-howard/
    88 * Text Domain: website-llms-txt
    99 * Domain Path: /languages
    … …  
    1919
    2020// Define plugin constants
    21 define('LLMS_VERSION', '8.2.2');
     21define('LLMS_VERSION', '8.2.3');
    2222define('LLMS_PLUGIN_FILE', __FILE__);
    2323define('LLMS_PLUGIN_DIR', plugin_dir_path(__FILE__));
Note: See TracChangeset for help on using the changeset viewer.