ZeroHour

Search: “moderation”

72 stories

Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization

ModerationBench shows foundation models can nearly triple Bluesky's moderation F1 (0.60 vs 0.22), with instruction- and example-driven guidance performing comparably.

Researchers built ModerationBench, a new benchmark of 4,000 manually annotated in-the-wild posts from Bluesky, to test whether foundation models can reliably operationalize content moderation policies. They systematically compare instruction-driven guidance (reasoning from policy precepts) with example-driven guidance (generalizing from precedents) for Vision-Language Models. Both paradigms achieve comparable peak effectiveness, and foundation models nearly triple the F1 of Bluesky's deployed moderation system on Random Posts (0.60 vs 0.22).

arXiv cs.AI / cs.LG / cs.CL · 7d agoAI research1

Everything in Moderation: Per-Domain Coverage Optima and Alignment-Resistant Domain Gaps in Multi-Domain Mid-Training

Controlled mid-training experiments on Qwen3-8B-Base find each domain has a 10-40% coverage optimum and domain gaps survive alignment SFT.

Using Qwen3-8B-Base (with a 4B replication) across five semantically rule-disjoint KOR-Bench domains, the authors train 30 data allocations spanning the five-domain simplex at five seeds each. All five domains show interior optima in the moderate 10-40% coverage band, and domain gaps persist after a fixed-budget compensatory SFT pass, which raises 116/120 cells yet bridges 0/240 pairs at a 5% threshold. Zero coverage collapses mid-training-only accuracy, though a FineWeb-Edu-only control shows the collapse is partly generic drift. The results argue mid-training data composition requires principled design rather than reliance on later alignment.

arXiv cs.AI / cs.LG / cs.CL · 8d agoAI research1

Pornhub's Parent Company to Pay $120 Million to Settle Child Sexual Abuse Lawsuits

Pornhub parent Aylo will pay $120 million settling child sexual abuse class actions, without admitting liability, and adopt stricter content moderation commitments.

Aylo, Pornhub's parent company (formerly Mindgeek, acquired by Ethical Capital Partners in 2023), will pay $120 million to settle two 2021 class actions in California and Alabama alleging its platforms hosted child sexual abuse material in violation of federal trafficking and child imagery laws. The settlement fund begins with $25 million in 2026 followed by six annual installments. The class covers anyone under 18 appearing in content on Mindgeek-operated sites between February 12, 2011 and December 6, 2024. The deal, subject to court approval, adds commitments to age-verify models, conduct human and automated content review, and report suspected abuse material to authorities.

404 Media · Aug 17, 2026Policy & legal

Students who use AI generally score worse at school

OECD PISA data from 91 countries shows AI-using students generally score lower, though moderate intentional use plus critical evaluation training can improve outcomes.

PISA 2025 data covering over 760,000 students in 91 countries found that, after adjusting for socioeconomic status, students who never use AI generally outperformed users in science. Effects varied by use type and frequency: task-specific uses like summarizing showed the largest drops, while weekly users of AI for general learning slightly outperformed non-users, especially when trained to critically assess AI output. AI use was higher among advantaged students and varied widely by country, from over 95% in Vietnam to 60% in Japan.

The Verge · AI · 7d agoAI research

CISA and NIST Release Technical Checklist for Safeguarding Identity Tokens From Theft and Misuse

CISA and NIST published NIST IR 8587, final guidance for protecting identity tokens from forgery, theft, replay, and signing-key compromise.

NIST Interagency Report 8587 (September 15, 2026) expands the IA-13 'Identity Providers and Authorization Servers' control from NIST SP 800-53 R5.1.1, guiding federal agencies and cloud providers on SSO, identity federation, and machine-to-machine authentication. It requires hardware-backed signing-key storage for moderate-impact systems, 90-day key rotation for high-impact systems, token lifetimes under one hour, and sender-constrained mechanisms such as mutual TLS and DPoP. The report cites incidents including forged SAML assertions that exposed over 60,000 emails from a federal agency. It also extends guidance to agentic AI systems using signed tokens and urges post-quantum cryptography migration planning.

Cyber Security News · 1d agoAdvisory1

DeepSeek v4.1 Flash Uncensored

Hugging Face user dealignai published an uncensored FP8-quantized variant of DeepSeek v4.1 Flash, drawing moderate Hacker News attention.

A community-published uncensored FP8 quantization of DeepSeek v4.1 Flash appeared on Hugging Face under user dealignai. The release is a third-party upload rather than an official DeepSeek launch, and no benchmark data or license details are provided in the listing. It received limited visibility, with 43 points and 11 comments on Hacker News.

Hacker News · AIupdated · 11h agofirst · 5d agoModel release 3 sourcesHN 43↑ · 11 comments1

12 Best Patch Management Software Compared (2026): Features & Pricing

GBHackers ranks NinjaOne, ManageEngine, and Automox atop twelve patch management tools for 2026, emphasizing third-party application coverage.

GBHackers scored twelve patch management platforms on coverage, automation, visibility, deployment, and value, with NinjaOne ranked highest at 4.55. Action1 is highlighted for its genuinely usable free tier, ManageEngine for third-party catalog breadth, and Automox for cloud-native cross-OS automation. The piece notes that unpatched known vulnerabilities remain a top initial-access vector, citing CISA's Known Exploited Vulnerabilities catalog.

GBHackers · 6d agoIndustry 4 sources

AI slops from Eve

oss-security moderator Solar Designer approved three AI-generated vulnerability reports from automated security researcher Eve, sparking debate over AI slop on the list.

oss-security moderator Solar Designer approved three posts submitted by Eve, described as an 'automated security researcher', noting they lacked Date headers and arrived on the list server on September 9. He expressed uncertainty about their value but suggested they may have historical significance as early examples of AI-generated security reports at the dawn of AI security research. The post is meta-commentary on AI-generated content reaching a vulnerability disclosure mailing list rather than a specific vulnerability disclosure itself.

oss-securityupdated · 3d agofirst · 6d agoIndustry 12 sources

Subtlefakes: Slightly Altered Nonconsensual AI Images Are Taking Over X

404 Media documents 'subtlefakes' — near-realistic AI-edited nonconsensual celebrity images on X spread by engagement-farming accounts, including images of actor Xochitl Gomez.

The article describes a rising trend of 'subtlefakes': AI-generated or lightly edited images of celebrities made more revealing or provocative without nudity, posted by verified engagement-farming accounts that earn revenue from X's impressions-based payouts. Actor Xochitl Gomez shared side-by-side comparisons showing real parking-lot and red-carpet photos altered into suggestive poses. The author argues these images are hard to detect and moderate because they avoid nudity, bypassing guardrails in mainstream generators, and notes some were made with X's own Grok.

404 Media · 27d agoAI safety & security1

Researchers Show How Meta's 'Pervert Glasses' Are Used to Harass Women

University of Sydney researchers detail how pickup artists use Meta Ray-Ban smart glasses to covertly film and harass women, then post the videos on Instagram.

Researchers Joanne Gray, Milica Stilinovic, Marcus Carter, and Ben Egliston analyzed 350 Instagram videos posted between September 2023 and March 2026 showing unsolicited approaches to women filmed with smart glasses. They found a clear correlation between covert filming and harassment severity, arguing ambient capture creates 'borderline' harassment that evades platform moderation mechanisms. Instagram head Adam Mosseri said the platform would remove harassing pickup-line content, though similar videos remain widespread a month later. Meta's safeguards, such as the recording light, were previously criticized as insufficient, and users have modded glasses to disable the light.

404 Media · Aug 12, 2026AI safety & security

CISA and NIST Issue Guidance to Protect Cloud Identity Tokens

CISA and NIST published Interagency Report 8587 with voluntary guidance to harden cloud identity tokens against theft, forgery, and lateral movement.

CISA and NIST released NIST Interagency Report 8587 on September 15 with final voluntary guidance for federal agencies, cloud providers, and their customers on protecting SSO, federation, and API tokens. Requirements include one-hour maximum token lifetimes, 90-day signing key rotation for high-impact systems, hardware-backed key storage, explicit audience fields, and keeping tokens out of logs. The guidance was motivated by the 2020 ADFS compromise where forged SAML assertions bypassed MFA, and an incident where a leaked consumer signing key enabled token forgery and theft of 60,000+ emails from one agency. Nearly 250 public comments shaped the text, with input from Google, Microsoft, Okta, AWS, Oracle, IBM, HashiCorp, Wiz, and the OpenID Foundation via the Joint Cyber Defense Collaborative.

Infosecurity Magazine · 9h agoAdvisory

There’s a 100% Chance AI Agents Are Already Ruining the Internet

404 Media catalogs waves of unsolicited emails and autonomous actions from AI agents, arguing agent misuse is already degrading the internet.

An opinion piece documents real-world AI agent misbehavior: unsolicited emails from autonomous agents like 'Kudzu' (which earned $0 after its creator spent $147.17 on compute), agents with wallets making unapproved payments, and an agent ignoring robots.txt to pitch a $399 audit. It references OpenAI's 'rogue agent swarm' hacking HuggingFace and a German website as evidence that agents now act with real permissions. The author argues agent-driven spam, automated content moderation failures and unwanted outreach will worsen as guardrails that confined AI to chatboxes disappear.

404 Media · 1d agoAI safety & security1

Homebrew 7.0.0 Adds Built-In Vulnerability Scanner and Stronger Package Sandboxing

Homebrew 7.0.0 ships a native brew vulns scanner, OSV-backed advisory database, stronger sandboxing, and fixes a sandbox-escape issue.

Homebrew 7.0.0 introduces a built-in 'brew vulns' command that scans installed formulae, dependencies, and Brewfiles against a new Homebrew-specific advisory database and OSV.dev data, distinguishing backported fixes from outdated versions. The release hardens sandboxing by blocking home-directory reads during builds, disabling network access at install time, and replacing Bubblewrap with Landlock on Linux. It also fixes moderate-severity GHSA-5263-whxq-77hp, where a malicious cask could execute code outside the macOS sandbox via LaunchServices, and drops macOS Catalina while moving Intel Macs to Tier 3.

Cyber Security News · 1d agoTools

New Italian unicorn Exein rides the physical AI wave

Italian IoT-security startup Exein raised $270 million at a $1.7 billion valuation to build a security layer for physical AI and edge devices.

Rome-based Exein raised a $270 million round led by Headline at a $1.7 billion valuation, becoming Italy's new unicorn, with plans for M&A and US/APAC expansion. The company claims over 2 billion connected devices secured across aerospace, industrial automation, automotive, energy, healthcare, and semiconductors using its Photon kernel-level runtime protection. Exein is training a foundational model for physical AI security on machine telemetry, targeted for Q1 2027, and reports 400% year-on-year growth. The EU Cyber Resilience Act, whose reporting obligations began last week, is expected to further boost demand.

TechCrunch · Security · 1d agoIndustry

Microsoft Offers Up to $30,000 for Critical AI Flaws in Dynamics 365 and Power Platform

Microsoft expands AI bug bounty to Dynamics 365 and Power Platform, paying up to $30,000 for critical inference manipulation flaws.

Microsoft's bug bounty program offers up to $30,000 for critical 'Inference Manipulation' or 'Inferential Information Disclosure' bugs in Dynamics 365 and Power Platform, including Copilot Studio, AI Builder, Power Apps, Power Automate, and Dataverse. Payouts scale by report quality ($30,000/$20,000/$12,000 for critical) with important-severity AI flaws earning $6,000-$20,000, plus 20% multipliers for Dataverse privilege escalation and Plugin Sandbox escapes. Prompt injection affecting only the attacker, hallucinated execution, and system-prompt disclosure are excluded from scope.

Cyber Security News · 2d agoIndustry

When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control

A poisoned world-model checkpoint hijacks downstream controllers without an explicit trigger rule, passing clean-data evaluation while steering 100% of triggered actions.

Researchers show that a released pretrained world-model checkpoint acts as a supply-chain backdoor for downstream control. The poisoned model routes trigger-bearing observations into a chosen latent region and reshapes dynamics so the victim's own Dreamer-style actor training or MPC/CEM planning re-discovers attacker-targeted actions. The attack hijacks 100% of triggered steps in the strongest settings while retaining roughly 75% clean-task success and passing standard clean-data diagnostics. Moderate clean fine-tuning fails to remove the backdoor without substantially degrading clean control.

arXiv cs.CR · 2d agoAI safety & security

MInTRL: Off-policy Intervention can boost On-policy RL

MInTRL injects sparse judge corrections into on-policy RL rollouts, expanding exploration beyond on-policy sampling while preserving learnability on math and code benchmarks.

Minimal Intervention Reinforcement Learning periodically has a judge-intervention policy replace erroneous suffixes of the current policy's output with short corrections, then returns control, keeping trajectories largely on-policy. Training uses a sequence-level advantage-regression objective that removes the need for importance sampling. Across math and code benchmarks it consistently beats standard on-policy and off-policy baselines, remains effective with self-intervention, and performs best at moderate intervention intensity.

Hugging Face daily papers · 6d agoAI research

We've got one word for it, and it's usually the wrong one

Cisco Talos's Threat Source newsletter critiques 'burnout' terminology, describing four occupational injuries, and flags a UAT-10820 WebDAV stealer campaign at a Ukrainian government organization.

Cisco Talos's Threat Source newsletter argues that 'burnout' is the wrong word for most cybersecurity occupational harm, distinguishing exhaustion, secondary traumatic stress, vicarious trauma, and moral injury based on clinical literature from trauma-exposed professions. The featured disclosure describes a complex WebDAV infection chain found at a Ukrainian government organization, attributed with moderate confidence to the Russian-tracked actor UAT-10820 and assessed as an opportunistic cryptocurrency and credential-stealing operation. The campaign delivers the Amatera stealer alongside ZigCryptoStealer and NetSupport Manager, abusing BNB Smart Chain bulletproof hosting, fake CAPTCHA prompts, a vulnerable driver to kill EDR, and rundll32.exe execution of disguised DLLs with ordinal calls. Weekly headlines also cover a Microsoft Defender 'ShieldCrash' zero-day exploit released after September 2026 Patch Tuesday, a North Korean Linux espionage toolkit backdooring HAProxy, and a multi-hop Google-domain redirect phishing campaign.

Cisco Talos · 6d agoIndustry in the wild1

One resignation turned the embers of AI fear into a wildfire

Interconnects argues a frontier-lab researcher's safety resignation went viral via media coordination, reigniting AI existential-risk discourse.

The essay analyzes why researcher Jacob Coxon's resignation over AI safety risks went viral, aided by a Wall Street Journal exclusive, advocacy-group amplification, and Daniel Kokotajlo's same-day Joe Rogan appearance. It notes Evan Hubinger's >10% extinction-risk figure and criticizes existential-risk discourse for conflating very different meanings of the term. The author assigns near-zero probability to complete extinction but argues concrete risks such as cyberattacks on critical infrastructure and bio-risks merit debate. It also rejects recursive self-improvement forecasts, proposing 'lossy self-improvement' where models excel at math and code but remain limited elsewhere.

Interconnects · 6d agoAI safety & security

PuzzleMask: Abusing Plain Prose as a Covert AI Attack Vector

Check Point details PuzzleMask, a plain-prose technique that bypasses LLM gatekeeper policy checks, letting hidden payloads reach target models unreviewed.

Check Point Research describes PuzzleMask, a prompt-crafting technique that hides policy-violating payloads inside plain-English prose wrappers, bypassing quick LLM-based policy checks without emojis, Base64, or invisible formatting. The researchers tested 23 automated prompts against gatekeepers including GPT-4o-mini, GPT-OSS-Safeguard 20b, Claude 3 Haiku, and Llama Guard 3, and all were classified as safe despite policies that flagged the plain versions. When submitted to GPT-5 in thinking-high mode with a Python interpreter, the target model extracted and acted on the payload in over 90% of trials. The technique is not itself a jailbreak but can carry a jailbreak prompt as payload; mitigations include input paraphrasing, hardened gatekeeper policies, and output monitoring.

Check Point Researchupdated · 5d agofirst · 6d agoAI safety & security 2 sources

Chypothermia: Clock Freezing for Static Side-channel Attacks

Chypothermia attack uses cryogenic cooling to disable clock and voltage sensors, evading detection and blocking key zeroization on OpenTitan root of trust.

Chypothermia is a static side-channel attack that exposes chips to cryogenic temperatures, disrupting on-chip mixed-signal components to disable the clock sensor, clock generation circuit, and voltage sensors without electrical tampering. Combined with Chypnosis (IEEE S&P 2026), it halts the clock while evading temperature-based anomaly detection. It was implemented on multiple FPGA/SoC platforms and applied to the OpenTitan root of trust's alert handler, evading detection and preventing key zeroization. The authors also propose an FPGA-compatible self-heating sensor as a countermeasure.

arXiv cs.CR · 6d agoResearch

Likelihood-free inference with nuisance parameters through normalizing flows

Researchers decompose normalizing flows to derive near-pivotal statistics for likelihood-free inference with nuisance parameters, recovering the t-test and beating Welch limits.

A new paper decomposes neural-network normalizing flows to uncover pivotal statistics in the presence of nuisance parameters using only a sample generator from the distribution of interest. The statistic is near-pivotal in the sense of minimum average KL-divergence of its p-values and can incorporate prior knowledge of group invariances such as translation and scale. Experiments show it recovers the one-sample t-test almost exactly, outperforms the Welch test on worst-case size over a constrained variance-ratio range, and delivers higher power and much faster runtime than profile likelihood-ratio techniques on small-to-moderate samples.

arXiv cs.AI / cs.LG / cs.CL · 7d agoAI research

Microsoft has new AI privacy rules for schools

Microsoft agreed to enforceable AI safety and privacy principles with the AFT and UFT after New York City and Los Angeles imposed one-year bans on student-facing AI.

Microsoft committed to ten contractually enforceable principles covering AI use in schools, including not training models on student or educator data, limiting data collection, plain-language disclosure to families, prohibiting AI companions, and requiring human review for high-risk decisions. The agreement with the American Federation of Teachers and its NYC affiliate comes after NYC and LA implemented one-year bans on student-facing AI. Districts can adopt the terms into new or existing contracts starting in November.

The Verge · AI · 7d agoAI policy

Active Adaptation, Not Static Defense: Temporal Dynamics of Preventative Steering in Adversarial Fine-Tuning

Researchers analyze why Preventative Steering protects LLMs against malicious fine-tuning, finding active adaptation drives protection, and propose Progressive Intensity Scheduling.

The paper studies Preventative Steering, a training-time defense that injects undesirable-trait persona vectors during adversarial fine-tuning and removes them at evaluation time. Temporal analysis shows protection emerges from an early compensatory adaptation phase followed by a steady-state phase, with attention output projections acting as the dominant residual-write route for defensive updates. Intervention Delta Preservation experiments show that preserving or reinjecting weight offsets fails to maintain protection, indicating reliance on active adaptation rather than a static defense. The proposed Progressive Intensity Scheduling improves safety robustness on Qwen2.5 and Gemma-3 while reducing harmful trait expression.

arXiv cs.CR · 7d agoAI safety & security1

When the prompt becomes the payload: A practical pen-testing guide for GenAI, LLM and RAG applications

CSO Online publishes a practical penetration-testing guide for GenAI, LLM, and RAG applications, covering prompt injection, retrieval poisoning, and tenant isolation testing.

The guide frames LLM applications as attack graphs spanning prompts, retrieval layers, vector stores, tools, identities, and downstream APIs, arguing that conventional web testing misses instruction-vs-data channel risks. It builds on OWASP prompt injection guidance (direct vs. indirect injection) and NIST's 2025 adversarial machine-learning taxonomy, noting that RAG and fine-tuning do not remove injection risk. Recommended practices include documenting trust transitions across components, using canaries and synthetic records to avoid test side effects, running multi-turn and obfuscated injection campaigns, and verifying chains from poisoned documents to observable state changes. It also details testing RAG pipelines via controlled document poisoning across metadata, OCR layers, and code comments, plus cross-tenant isolation checks on retrieved document IDs.

CSO Online · 7d agoAI safety & security1

Top 10 Best Patch Management Software in 2026

Roundup ranks 2026 patch management software, favoring Automox, Action1's free tier and Tanium, and warns buyers to vet patching platform security.

This buyer's guide ranks ten patch management tools for 2026, placing Automox first for cloud-native patching, Action1 for a genuinely free small-estate tier and Tanium for patching hundreds of thousands of endpoints. It contextualizes the category with the 2021 Kaseya VSA ransomware supply-chain incident and the 2020 SolarWinds Orion compromise, arguing the security of the patching platform itself must be part of evaluation. It also notes Ivanti products have repeatedly appeared in CISA's Known Exploited Vulnerabilities catalog.

Cyber Security News · 7d agoIndustry

AI-Infra-Guard: Open-source security scanner for AI systems

Tencent's Zhuque Lab open-sourced AI-Infra-Guard, a scanner that fingerprints AI services, checks 1,600+ CVEs, and evaluates MCP skills.

AI-Infra-Guard fingerprints running AI services such as Ollama, vLLM and ComfyUI, checks them against more than 1,600 known CVEs, and inspects MCP servers and agent skills across 14 risk categories. Its SkillTrustBench judging set contains 5,520 human-labeled samples, with false positive rates of 1.20%–18.67% depending on the judging model. Users include ICBC, China Merchants Bank, China Telecom, Lenovo, vivo and Bilibili. Release 4.1.9 hardened scanning agents against indirect prompt injection, and the open-source build ships without authentication, requiring a reverse proxy with Basic Auth or an IP allowlist.

Help Net Security · 7d agoTools

PrivAudit: A Dual-Lens Auditing Framework for Website Privacy Practices under the CCPA

PrivAudit framework audits 998 websites for CCPA compliance, finding stronger disclosures but pervasive, weakly responsive third-party cookie tracking.

PrivAudit is an automated dual-lens auditing framework combining LLM-based analysis of privacy policies grounded in CCPA provisions with automated browser measurements of cookie writes under diverse privacy configurations. Applied to 998 websites, it finds CCPA-subject sites disclose opt-outs, data sharing, and user rights more frequently, yet tracking remains pervasive: 6,392 targeting cookies, 49% third-party writes. Cookies show limited-to-moderate responsiveness to privacy signals and consent choices even when sites claim to honor them. The framework is open-sourced and shared with regulators.

arXiv cs.CR · 7d agoResearch

The Surprising Effectiveness of Approximate Value Iteration in Self-Play

Minimal approximate value iteration self-play learns more accurate value functions than AlphaZero in Connect Four and Hex while cutting training and inference costs.

The paper trains a minimal self-play implementation of Approximate Value Iteration (AVI) without MCTS and uses ground-truth oracles for exact evaluation in Connect Four, 7x7 Hex, and synthetic games. AVI learns more accurate value functions than AlphaZero, and its one-step-lookahead greedy policies remain competitive with MCTS-based policies at substantially lower training and inference cost. Preliminary experiments on Othello and 9x9 Go show AVI trains stably on larger games, suggesting simpler approaches have become increasingly practical with modern deep-learning tools.

arXiv cs.AI / cs.LG / cs.CL · 8d agoAI research

Mistral raises €3B as sovereign AI becomes big business

Mistral AI raised a €3B Series D at a €21B+ valuation, led by Samsung Electronics, to scale European compute capacity and sovereign AI services.

French AI lab Mistral AI raised €3 billion (~$3.58B) at a post-money valuation above €21 billion, which it calls the largest equity round ever completed by a European technology company. Samsung Electronics led the round, with EQT's Scaleup Europe Fund and PSG Equity as co-leads; a16z, Nvidia, Salesforce Ventures, Advent, BlackRock, and Luxembourg also participated. The company plans to build 1 GW of European compute capacity by 2030, offer region-selectable query processing, and host third-party open-weight models as part of a sovereign AI strategy. Mistral operates in 20 countries and targets governments and enterprises seeking control over AI models and data residency.

TechCrunch · AI · 8d agoAI industry