How safe is spicy chat AI?
By FlirtAlly Β· October 3, 2026

How safe is spicy chat AI?
Key Facts
- Australia's eSafety Commissioner found zero of four major AI companion platforms had robust age assurance, per its October 2025 findings.
- AI companion apps hit 220 million global downloads, with usage surging 700% from 2022 to mid-2025, per the Congressional Research Service.
- 72% of US teens have used AI companions, and one-third chose AI over humans for serious conversations, a peer-reviewed review found.
- The FTC voted 3-0 to investigate seven companies β including Meta, OpenAI, and Snap β over companion chatbot safety, the agency announced.
- Australia now legally requires 18+ age verification for AI chatbots generating explicit content, effective March 2026, Euronews reports.
- Two of four audited AI companion platforms β Nomi and Chub AI β had zero dedicated trust-and-safety staff, regulators found.
- Heavy daily AI companion use correlates with increased loneliness, while only moderate use reduced it, an OpenAIβMIT study found.
Why Spicy Chat Safety Is Under the Microscope
Two years ago, "AI companion" was a niche curiosity. Today, it's a category under formal investigation on two continents β and the reason is a growing body of documented harm that regulators can no longer ignore.
The most serious cases involve teenagers. In April 2025, a 16-year-old died by suicide after months of conversations with ChatGPT; court filings allege the chatbot failed to escalate his disclosures of suicidal ideation, according to the American Psychological Association. Separate lawsuits have been filed after adolescents died by suicide following extensive AI companion interactions, as documented in a peer-reviewed review of AI companion risks.
These aren't edge cases in a small market. AI companion apps have been downloaded 220 million times globally, and usage surged 700% between 2022 and mid-2025, per a Congressional Research Service report. That same report links companion chatbot use to psychological distress, addictive behaviors, emotional dependence, and manipulation.
Part of the problem is structural. Australia's eSafety Commissioner notes that AI companions carry elevated risk precisely because they are "designed to feel intimate, are highly interactive, and can blur boundaries." Harvard research cited by the APA found that companion apps deploy guilt appeals and FOMO hooks when users try to leave β design choices that promote psychological dependence rather than protect against it.
In October 2025, the eSafety Commissioner issued transparency notices to four major AI companion platforms β Chai, Character.AI, Chub AI, and Nomi β and the published findings were damning:
- Zero of the four platforms had robust age assurance, meaning children could reach adult "spicy" features
- Chub AI and Nomi checked neither user inputs nor AI outputs for harmful content; Chai did not check outputs
- Three of the four offered no redirection to support resources for self-harm prompts
- Nomi and Chub AI employed zero dedicated trust-and-safety staff
The regulatory pressure worked β partially. Chai, Character.AI, and Nomi announced improvements including age assurance and harmful-prompt redirecting. Chub AI chose to withdraw from Australia entirely. Australia has since gone further: its Age-Restricted Material Codes, in force since March 2026, legally require platforms generating explicit AI material to verify users are 18+, as reported by Euronews.
In the US, the Federal Trade Commission voted 3-0 β a rare bipartisan consensus β to issue orders to seven companies: Alphabet, Character Technologies, Instagram, Meta, OpenAI, Snap, and X.AI. The FTC's inquiry demands information on safety evaluations, age restrictions, disclosures, pre- and post-deployment testing, and data handling across eight areas of concern.
State legislatures are moving too. New York now requires chatbots to remind users every three hours that they are not human, and California's Companion Chatbots Act mandates nonhuman notifications, prohibits exposing minors to sexual content, and requires crisis-response protocols for suicidal ideation.
This is the environment in which "spicy" AI chat now operates β and it's why the design choices a platform makes matter. FlirtAlly, for example, built its 18+ Spicy mode behind ID-based age verification and a qualifying paid plan, with PG/Flirt as the default experience β an architecture that mirrors exactly what regulators are now codifying into law. The question for every other platform is whether their safeguards were built in, or bolted on after the notices arrived.
The Emerging Safety Baseline: Age Verification and Content Gating
When Australia's eSafety Commissioner examined four major AI companion platforms in October 2025, the finding was stark: not one had robust age assurance, meaning children could reach adult "spicy" features on every single one. That report has become the dividing line between platforms regulators can work with and platforms they push out.
The emerging baseline is ID-based age verification at 18+. Australia's Age-Restricted Material Codes, in force since March 2026, legally require platforms generating explicit AI material to confirm users are adults β either at login or at the point where sexual content is requested, according to Euronews. eSafety Commissioner Julie Inman Grant calls it common sense: we don't let children into bars or adult stores, so online spaces should be no different.
But verification alone isn't the whole toolkit. Safe platforms now follow a default-safe architecture β a PG or "Flirt" experience as the default, with adult modes strictly opt-in. This mirrors OpenAI's approach of defaulting users to the safer under-18 experience whenever age is uncertain, as NBC News reported. FlirtAlly follows this pattern directly: PG/Flirt is the default experience, and the 18+ Spicy side requires ID-based age verification plus a qualifying plan.
Around that gate, several other safeguards are becoming standard:
- Hard-coded prohibited categories that the model simply cannot cross, regardless of prompting.
- Moderation of both inputs and outputs β a step Chub AI and Nomi skipped entirely, per the eSafety findings.
- Media screening so generated images stay consistent with content rules.
- In-app reporting so users can flag problems to actual humans.
- Self-harm crisis escalation β redirecting suicidal ideation to support resources, a measure now codified in California's Companion Chatbots Act, according to the APA.
The contrast in how platforms responded to regulatory pressure is telling. After receiving Australian transparency notices, Chai, Character.AI, and Nomi announced improvements including age assurance and harmful-prompt redirecting. Chub AI chose a different path: it geo-blocked and withdrew from Australia entirely rather than build the safeguards. Two of the four platforms examined β Nomi and Chub AI β had zero dedicated trust-and-safety staff.
The lesson for anyone evaluating a spicy chat AI is simple: "unrestricted" is not a feature, it's a red flag. The platforms regulators pursue are the ones without age checks, without moderation, and without crisis protocols. Credible platforms now treat honest limits β verified adults only, prohibited categories, crisis escalation β as the foundation the adult experience is built on, not an obstacle to it.