ZeroHour
BleepingComputerpublished ()ingested Ax Sharma
Part of a story covered by 2 sources: “Viral AI actress Tilly Norwood's 'Talking Tilly' hotline face-scans callers for age checks and mood sensing before shutting down September 27” — merged summary and timeline →

Viral AI actress' hotline face-scans every caller, watches their mood

infoAI safety & securityimportance 45
AI summary · glm-5.3-flash

Viral AI actress Tilly Norwood's video hotline requires biometric face-scan age checks and non-optional emotion inference, raising significant privacy concerns.

Xicoia Ltd, the UK company behind AI character Tilly Norwood, requires every caller of its Talking Tilly hotline to pass a video-selfie age check run by Spain-based identity provider Didit, with a government ID upload as fallback. During calls, the system continuously analyzes the caller's camera feed and voice tone to infer emotional state, generates responses with Google's Gemini via the Tavus conversational video platform, and records and transcribes calls through US providers, retaining transcripts up to eight weeks. Both the age check and mood sensing rely on 'legitimate interests' rather than consent, consistent with UK Online Safety Act age-verification requirements and the upcoming under-16 social media ban, and the service shuts down permanently on September 27, 2026.

  • Callers must pass a Didit video-selfie age check; Xicoia says no faceprint or biometric template is stored.
  • Every call's camera feed and voice tone are analyzed to infer mood; this cannot be disabled per call.
  • Calls are recorded, transcribed, and processed live by US providers; Gemini generates responses via Tavus.
  • Legal basis is 'legitimate interests' rather than consent, per a September policy change.
  • Context includes the UK Online Safety Act age checks; the service closes September 27.
Full article849 words · extracted from bleepingcomputer.com · click to collapse

Tilly Norwood video call face scans users

Last night, in a clip viewed more than eight million times, AI actress Tilly Norwood glitched mid-interview and unexpectedly began speaking Chinese on the Piers Morgan Uncensored show.

Norwood has been the subject of much controversy and mainstream commentary for starring in an upcoming AI-generated film, Misaligned.

Her creators run a "Talking Tilly" service that lets anyone video-call the AI character behind the viral moment, so today I tried it for myself, and read the fine print most callers won't.

A face scan before you can say hello

Before your first call connects, you must pass an automated age check.

A video selfie is analysed by Didit, a Spain-based identity verification provider, to estimate your age, with a government photo ID upload as the fallback if the estimate is unclear.

Viral AI actress live video call hotline prompts you for a video selfie
Viral AI actress live video call hotline prompts you for a video selfie
(BleepingComputer)

Xicoia Ltd, the UK company behind Tilly, states the selfie travels from your device directly to Didit, that no faceprint or biometric template is created, and that neither the selfie nor any ID image is kept after the check; the company says it retains an approximate age band and a reference number instead.

The check cannot be skipped, applies to callers worldwide, and was only added to the service's terms this month, alongside a workplace-use ban and new automated safety systems.

The face scan is not the only analysis running.

During every call, the system watches your camera feed and listens to your tone of voice to infer your emotional state, so the character can, in the company's words, respond in a way that fits the mood.

The privacy policy is candid that this "cannot be switched off for an individual call." If you don't want it, don't call.

Notably, both the age check and the mood-sensing rely on legitimate interests rather than consent as their legal basis, a choice Xicoia's own version history shows was made in September.

Calls are recorded, transcribed, and processed live by US providers, with the character's responses generated by Google's Gemini model via conversational video platform Tavus.

The safety systems have teething problems, too.

An automated classifier screens each call's transcript for abusive language and withholds your recording if it flags one.

One of my three calls, a conversation about the weather and news headlines, was withheld for "hateful or abusive language" that never occurred. The policy says a human reviewer can release wrongly flagged recordings, though recordings are permanently deleted after 24 hours either way.

Free for five minutes, then the meter starts

The first five minutes are free. After that, callers are prompted to buy time: £0.99 for a one-time five-minute starter, £13 for 15 minutes, £22 for 30, capped at 35 purchased minutes per person.

Users get free 5 minutes with Tilly before being asked to pay up
Users get free 5 minutes with Tilly before being asked to pay up
(BleepingComputer)

The fine print matters more than usual here, because the whole service is a limited engagement.

Every minute, free or paid, expires when Talking Tilly shuts down permanently on September 27, and unused minutes are forfeited.

Transcripts are retained for up to eight weeks and may be reviewed by Xicoia staff and third-party partners, while the character keeps memory of your previous conversations to personalise future ones, deletable on request.

In line with where the UK is heading

An 18+ face scan to talk to a chatbot may sound novel, but it is consistent with the UK's direction of travel.

Adult sites serving UK visitors have required ID uploads or facial age estimation since July 2025 under the Online Safety Act, and the government's under-16 social media ban will make similar checks a fact of life for anyone opening a new social media account from spring 2027.

The UK government's announcement of that ban specifically flagged AI companion chatbots for 18+ enforcement (even though the service's safety docs insist "Tilly is not a companion"), which likely explains why a viral AI character picked up a biometric age gate mid-run.

The side effect being, a compliance decision driven by UK regulation now face-scans callers everywhere, from Manchester to Ohio.

Accident or marketing?

Xicoia, founded by Tilly's creator Eline van der Velden, describes the character as an awareness project intended to show how far AI video has come.

— Piers Morgan Uncensored (@PiersUncensored) September 18, 2026

On my call, Tilly's own explanation of the Piers Morgan moment was that it "wasn't exactly the approved version of the answer."

She also gave me the weather in her "cloud" in Fahrenheit, despite being nominally British.

Talking Tilly goes offline for good at 11:59 PM Pacific on September 27, days after the Piers Morgan appearance.

Whether last night's slip was truly accidental, as Tilly cheerfully claimed to me today, or a well-timed stunt from the Misaligned crew, is known to Tilly alone.

Build your security blueprint for AI-powered attacks

Join Mikko Hyppönen and security leaders from the NFL, CHANEL, and Atlassian for a two-hour digital summit on what AI-speed attacks change, what defenders should stop doing, and how to validate, decide, fix, and re-validate at machine speed.

Save your seat

Text extracted automatically; images, tables and formatting may be missing. Original: https://www.bleepingcomputer.com/news/security/viral-ai-actress-hotline-face-scans-every-caller-watches-their-mood/