Looks like OpenAI’s AI led language algorithm GPT-3 may soon have competition. A new project called ” Eleuther” is an open-source one that aims to match GPT-3 in writing coherent articles in English when given a text prompt.
First spotted by wired.com, EleutherAI is still some way from matching the full capabilities of GPT-3, but last week the researchers released a new version of their model, called GPT-Neo, which is about as powerful as the least sophisticated version of GPT-3. Generative Pre-trained Transformer 3 or GPT-3 for short, is an autoregressive language model that uses deep learning to produce human-like text.
The Guthub notes state that once developers have a trained model, or downloaded one of the pre-trained models, generating text is as simple as running the main.py script with the --predict flag on.
GPT-Neo is the name of the codebase for transformer-based language models loosely styled around the GPT architecture. The team at Eleuther says one of its goals is to use GPT-Neo to replicate a GPT-3 sized model & open source it to the public, for free.
For more details on EleutherAI, click here.
Image credit: EleutherAI
