Login Buy Now Build My Website Free

Home
/
Tools
/
Robots.txt Generator

Free Robots.txt Generator

Control which search engines and AI crawlers can access your website. Generate and download your robots.txt instantly.

General Access

Allow all crawlersBlock all crawlers

WordPress

Block wp-admin from crawlersBlock wp-includes from crawlersBlock internal search pages (?s=)Block tag and author archive pagesBlock RSS/Atom feeds

AI Crawlers

Toggle individual AI crawlers to block them from training on your content.

Block all AI crawlers

GPTBot(OpenAI)ClaudeBot(Anthropic)Google-Extended(Google AI)CCBot(Common Crawl)FacebookBot(Meta AI)Amazonbot(Amazon Alexa)

Sitemap

← Back to all tools

60Web60

Ireland's AI Website Builder

Describe your business. AI builds your WordPress website. Live in 60 seconds. €60 a year.

A SmartHost Product

Product

Features
Pricing
How It Works
Technology
Demo
Get Started

Company

About
Blog
Support
Contact Us

Resources

Knowledge Base
Website Builder Guide

Legal

Terms of Service
Privacy Policy
Cookie Policy
Refund Policy

© 2026 Web60 — A trading name of SmartHost Web Services Limited. Reg. No. 679347 · VAT IE3711022EH · ISO/IEC 27001:2022 Certified.

Block B, Maynooth Business Campus, Straffan Rd, Maynooth, Co. Kildare, W23 W5X7 · 01 901 9700 · ISO 27001 Certified

hello@web60.ieStaff login