# robots.txt for search engines User-agent: * Disallow: /wp-admin/ Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?et_blog Disallow: /*?limit= Disallow: /*?order= Disallow: /cgi-bin/ Allow: /wp-admin/admin-ajax.php Sitemap:https://www.allinlocksmithllc.com/sitemap.xml # AI-Specific Rules (to save resources) User-agent: GPTBot # OpenAI/ChatGPT training crawler Allow: /llms.txt User-agent: ChatGPT-User # OpenAI real-time user queries Allow: /llms.txt User-agent: OAI-SearchBot # OpenAI search crawler Allow: /llms.txt User-agent: ClaudeBot # Anthropic/Claude Allow: /llms.txt User-agent: Claude-User # Anthropic real-time Allow: /llms.txt User-agent: Google-Extended # Google AI (e.g., Gemini) Allow: /llms.txt