Since the rollout of ChatGPT, companies in most every industry are looking to leverage the text generation and retrieval capabilities made possible by large language models. Well known LLMs like GPT, Bard and LLaMA have been trained on a massive corpus of data, where data sets are internet scale and made up of publicly available data, and with parameters that number in the billions.
At such scale, it’s not surprising that today’s LLMs are energy intensive and expensive to run, but they don’t have to be. According to research from the expert.ai R&D team, lightweight models can obtain the high performance levels that companies expect, but at significantly lower costs.
BlogEnglish