User-agent: OAI-SearchBot/1.0; +https://openai.com/searchbot Allow: / User-agent: * Disallow: /404-page$ Disallow: