Ruban KT

LLMs Txt Generator

LLMs.txt File Generator

Create a configuration file to control how Large Language Models access your content.

Your LLMs.txt File

Installation Instructions

  1. Copy the generated content above
  2. Create a new file named llms.txt in your website's root directory
  3. Paste the content and save the file
  4. Verify it's accessible at yourdomain.com/llms.txt

Step 1: Configure Your Preferences

A. Block Specific AI Crawlers

  • ☑ Block OpenAI’s GPTBot
    (Checked by default) – Prevents OpenAI’s crawler from accessing your content.

  • ☑ Block Common Crawl’s CCBot
    (Checked by default) – Stops Common Crawl’s bot from scraping your site.

  • ☑ Block Anthropic’s Claude
    (Checked by default) – Blocks Claude-Web from accessing your content.

B. Add Custom Paths to Block (Optional)

  • In the “Additional paths to block” text area, enter any specific directories you want to restrict (one per line).

Step 2: Generate Your LLMs.txt File

  • The tool automatically updates the preview box below with the correct llms.txt format.

  • Review the generated content to ensure it matches your preferences.


Step 3: Copy or Download the File

Option A: Copy to Clipboard

  1. Click the “Copy to Clipboard” button.

  2. A confirmation (“Copied!”) will appear briefly.

  3. The content is now in your clipboard and ready to paste.

Option B: Download the File

  1. Click the “Download File” button.

  2. A file named llms.txt will be saved to your computer.


Step 4: Upload LLMs.txt to Your Website

Method 1: Manual Upload via FTP/cPanel

  1. Connect to your website’s root directory (where wp-config.php is located) via FTP or File Manager in cPanel.

  2. Upload the llms.txt file directly.

  3. Verify it’s live by visiting:
    https://yourwebsite.com/llms.txt

Scroll to Top