Generative AI Safety Monitor Startup CalypsoAI Raises $23M

Generative AI security startup CalypsoAI has raised $23 million in a Series A funding round led by Paladin Capital Group. CalypsoAI’s technology is designed to test and monitor software leveraging large language models (LLMs), including ChatGPT and other well-known generative AI tools, as well as any models built in-house by its clients.

ChatGPT Safety

CalypsoAI embeds its software in its clients’ infrastructure, allowing it to watch and rate how ChatGPT and other generative AI products perform. The dashboard measures the quality of the response, flags potential issues, and keeps an eye on how it performs in engaging with users. The idea is to stop a company from sharing any private data or saying anything that would reflect badly on its brand, as well as spotting any malicious attack from generative AI technology.

CalypsoAI claims to free up human employees from the tedium of editing every LLM-generated text while making the whole process more efficient. CalypsoAI aims its products at organizations that have sensitive information and need public trust. The startup’s new CalypsoAI Moderator platform is pitched at the enterprise market, while its VESPR Validate service is designed for government organizations. The new funding more than doubles CalypsoAI’s total raised to about $38.2 million. Both services fall under what the startup refers to as “AISec,” which encompasses any AI tools, not just those using LLMs.

“Many organizations may think banning the use of LLMs or setting up written guidelines are the right approaches to mitigating risk. Not only are these the wrong approaches, but it also sets them up to become digital laggards as their competitors successfully deploy the technology to scale innovation,” CalypsoAI CEO Neil Serebryany said. “By adopting CalypsoAI’s solutions, every enterprise or government organization should be able to enable the benefits AI solutions deliver while having confidence that they are trusted, resilient, and secure. With support from some of the top investors and a drive to put LLMs in every worker’s hands, CalypsoAI is bringing the AI and cybersecurity markets together in a way that’s never been done before.”

OpenAI Will Award $1M for Generative AI Cybersecurity Programs

OpenAI CEO Sam Altman Urges Congress to Create AI Regulation at Senate Hearing

Salesforce Ups Generative AI Fund to $500M, Launches AI Cloud