The report highlights the vast costs of training a model.
“Based on variables released by Google et al., you’re paying circa $1 per 1,000 parameters. This means OpenAI’s 175B parameter GPT-3 could have cost tens of millions to train. Experts suggest the likely budget was $10M.”
The report features PolyAI’s ConveRT model as a prime example of how data-efficient models can outperform large models in specific dialogue use cases, offering an affordable, pre-trained solution to enterprise clients.
Check out what our CTO, Shawn Wen, has to say about PolyAI’s contributions in this video:
Strictly Necessary Cookies
Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.
If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.