On the topic of (large) LLMs – a trend which is growing quite substantially is to go from large to small language models. Not only do they run on much cheaper hardware, but they can also be tailored more easily to an organization’s specific data and needs, and they also produce less surface area for vulnerabilities.
The slowing pace of improvement at the bleeding edge of generative AI is one sign that LLMs are not living up to their hype. Arguably a more important indication is the rise of smaller, nimbler alternatives, which are finding favour in the corporate world. […] As David Cox, head of research on AI models at IBM, a tech company, puts it: “Your HR chatbot doesn’t need to know advanced physics.”
