5 billion. It had been also experienced on lots much more info. But teaching on textual content taken from the web brings new difficulties. GPT-three soaked up Considerably with the disinformation and prejudice it found on the internet and reproduced it on need. As OpenAI acknowledged: “Net-experienced products have World-wide-web-scale biases.�