In the blog post, "The Shift from Models to Compound AI Systems", a group of Berkeley AI researchers notes the difference between using Large Language Models (LLMs) as monolithic standalone systems versus using them as components in larger, compound systems that include both LLMs and other technology. They list the following reasons to use Compound AI Systems instead of relying solely on an LLM:
Building on the concept of Compound AI systems, artificial intelligence (AI), particularly LLMs, is providing an approach for the research that will be demonstrated in this presentation.