Video / Short
The One Word That Sums Up AI's Biggest Trend
Pete Cooper names context as the one word that sums up the AI trend of the last few years. He explains what context means in practice and how different LLMs handle it.
Video summary
Pete Cooper picks context as the key word for the trend he has seen in AI. He says LLMs have massively expanded the context they can handle over the last four or five years.
By context he means the full story behind a question: why you are asking, which project it relates to, which part of your workflow it touches and what else you are pushing forward. He says some LLMs already do this quite well by bringing in historical chat information, while others isolate the context so you have to supply it in the prompt. In his view they are all heading the same way, building up better context so they can give better answers.
Video transcript
Read the spoken content without loading the YouTube player.
Is one key word that I think sums up the trend that we have seen in AI and that is context. We have seen the ability for LLMs to increase their context and context has been massively expanded over the last four or five years. And what do I mean by context? Well, it's understanding the full story behind why you're asking a question, what project it relates to, what part of your work flows does it relate to, what other aspects are you driving forward? Now, some of the LLMs are doing it quite well. They're bringing in a lot of historical chat information.
Others, they isolate the context, so you have to prompt it with that, but they're all moving in the same direction and that is to build up better context so that they can effectively give you better answers to the prompts that you give them.