Humans are reviewing Copilot users’ bizarre and abusive image-editing requests
Contractors reviewing Microsoft Copilot image-editing requests see uncensored private photos, including sexual and abusive content, with no safety-flagging role.
A 404 Media report describes third-party contractors reviewing Microsoft Copilot users' original photos, editing requests, and AI-generated results, rating technical quality rather than flagging inappropriate content. Reviewers reported sexual requests, some involving children, nonconsensual edits, and identifiable uncensored faces. Microsoft said the updated consumer Copilot app (August 18) does not use prompts or uploaded files to train foundation models, but it is unclear whether users can opt out of human image reviews; OpenAI runs similar contractor reviews under Project Lily.
35