When OpenAI launched their chatbot ChatGPT, they also revealed their web crawler called the GPTBot. Their crawler works the same way as a Google bot, and website owners can block these crawlers from accessing their websites in robots.txt. OpenAI also gave access for blocking their bot. It is said that around 48% of websites have
