Foundation models

…And then now, today, what we're doing is we're moving to something called foundation models.…

…peaker B: Because the foundation models out there, they're converging.…

…And so some of the things that we're doing around foundation models, for example, like you're both trying to do domain specific foundation model beyond just the language or, you know, internet data that it was trained on, right?…

…all this technology at our fingertips, right? You can provision, you know, essentially limitless cloud uh resources in the cloud just from your browser now, uh and uh access to all these massive foundation models that have been pre-trained with you know petabytes of of uh of data, both public and maybe not so public.…

…You made an interesting point about foundation models because a lot of our initial ideas about assurance are, you know, you build some machine learning solution for an application and we're gonna test it for bias or for accuracy or whatever else.…

…What do I do? And even though these, you know, foundation models have gotten, uh, more and more powerful.…

…One thing that we think constantly about is where do we have a right to play? We are not training our own foundation models.…

…They've got a whole bunch of public information and it's this information that the foundation models from Anthropic or Google or uh, OpenAI are trained on M.…

…and you also have to think how much performance do 211 00:11:29,679 - > 00:11:32,720 you need? How much parameters are really necessary? If you 212 00:11:32,799 - > 00:11:35,480 look at the biggest foundation models in the market and 213 00:11:35,600 - > 00:11:38,080 you see the parameters, I would say in OPO's four 214 00:11:38,120 - > 00:11:41,159 point zero is not necessary for ninety nine percent of 215 00:11:41,240 - >…

…And this was also when the field had pivoted towards foundation models which were substantially larger than the earlier generation of small machine learning models.…

…Sometimes people use the term foundation models.…

…And I think the kind of the foundational software layer is the models, the foundation models and of course a ton of probably the most famous well known AI, uh, companies are at this layer like OpenAI and Anthropic.…

…It is essentially a combination of yes, LMS, but also foundation models that are trained on chemistry.…

…This podcast is presented by NXAI, your partner for time series foundation models and physical AI.…

…And so, um, that summer I was forming this thesis about, oh, well, foundation models are great, but they're really lacking the personal context.…

…peaker B: Because the foundation models out there, they're converging.…

…Um, and that's, that's largely a function because there's so many external dependencies that are changing quickly, eg, foundation models, uh, moving in step.…

…In fact, we're already seeing this with the foundation models in many ways.…

…But today, foundation models are allowing robots to learn from data, to learn from experience.…

…So it operates on foundation models like Chi GPT4 that can be tuned to diverse tasks across workflows.…

…And what resonates is that the things you talk back at work in today's world, it's agent ecommerce, it's foundation models, it's embedded in finance.…

…Physical AI changes that equation because for the first time advances in foundation models, multimodal AI and agentic systems are giving machines something new The ability to perceive reason plan adapt and act In other words we are beginning to see the emergence of embodied intelligence Intelligence that does…

…And so we have this geometric mean aggregation of these questions and we look at the top foundation models out there and, and assess them about how they do in regards to even flourishing.…

…Once you leave the laptop and the internet and you go out into the real world and you're trying to foundation models, it is so much harder.…