OpenAI's GPTbot, a web crawler designed to collect data to improve AI models, has been blocked by 15% of the top 100 websites in the world, including Amazon and Quora. The tool works by identifying potential data sources, extracting information from websites, and storing it in a database for training AI models. OpenAI created GPTbot to address lawsuits related to unauthorized content usage. This comes after Elon Musk, then CEO of Twitter, blocked OpenAI from scraping data from the platform a few months ago.
World's most popular websites are blocking OpenAI from collecting data for ChatGPT
August 25, 2023
0
OpenAI's GPTbot, a web crawler designed to collect data to improve AI models, has been blocked by 15% of the top 100 websites in the world, including Amazon and Quora. The tool works by identifying potential data sources, extracting information from websites, and storing it in a database for training AI models. OpenAI created GPTbot to address lawsuits related to unauthorized content usage. This comes after Elon Musk, then CEO of Twitter, blocked OpenAI from scraping data from the platform a few months ago.