Скачать или смотреть Should you BLOCK OpenAI from Crawling your Website?

OpenAI's instructions about how to block ChatGPT from crawling your website: https://platform.openai.com/docs/bots

There are three different disallow statements you can add to the Robots.txt file of your website:
1. OAI-SearchBot -- Blocks your website from showing up in ChatGPT's search results. Your website will not be included in OpenAI's search index.
2. ChatGPT-User -- Blocks AI agents from using your website or taking action on it.
3. GPTBot -- This is the one that tells OpenAI not to scrape your data or use the text, images, or videos there for training its models.

However, you may want to consider allowing ChatGPT to index your website. Doing so will give you influence over the language that is used in your domain and enable you to have more thought leadership in your space. We've seen several examples of this at my company, Kapwing, when discussing new topics, emerging trends, and providing guidance to customers.

Plus, I'm dubious that including the robots.txt disallow will actually work to block OpenAI's crawlers.

Follow my account for more tips on GEO, or how to optimize your videos for