Microsoft’s new safety system can catch hallucinations in its customers’ AI apps

Mar 28 2024 by The Verge

 
Illustration: The Verge

Sarah Bird, Microsoft’s chief product officer of responsible AI, tells The Verge in an interview that her team has designed several new safety features that will be easy to use for Azure customers who aren’t hiring groups of red teamers to test the AI services they built. Microsoft says these LLM-powered tools can detect potential vulnerabilities, monitor for hallucinations “that are plausible yet unsupported,” and block malicious prompts in real time...

Continue Reading Microsoft’s new safety system can catch hallucinations in its customers’ AI apps