red teaming

…Kevin: What exactly are those technical capabilities? You, you mentioned red teaming before, but, but give us a little bit more detail about what that means in practice.…

…In the modern world that is called red teaming, we do algorithmically red teaming.…

…A big part of the certification in the case of Agenack AI is red teaming, so we go in and test the actual AI agent systems, not just to see that the policies they have are in place and work well, but that the agents actually work and are robust under pressure, and the companies that then…

…And so when you think about red teaming, and if you're not familiar with the concepts of blue teaming and green teaming, definitely get your arms around that.…

…3 00:00:05,030 - > 00:00:08,240 Jim has been doing red teaming since before it became a term 4 00:00:08,300 - > 00:00:10,849 and pen testing back when pen tests were basically red team 5 00:00:10,849 - > 00:00:11,599 operations.…

…We describe in what the military developed techniques have called red teaming, which is the ability for us to challenge plans and behaviors and things we see in a way that helps us improve.…

…And that was one the things we were talking about red teaming within that how do you how do you try and get agents to do things they shouldn't do but also you know, what is the barriers you want for that and then using evaluations to run that on a continuous basis, look at it from…

…we put into place a full vulnerability management program with scanning and patching and reporting and metrics for success and then that eventually evolved into red teaming so okay we know where all the vulnerabilities are and we're paying a lot of money to manage all the pen tests that was another aspect of the vulnerability management program i got to engage with all of our pen testers…

…Pre deployment testing, including red teaming and benchmark evaluations remains crucial but cannot capture all real world usage patterns and emergent risks.…