ZeroHour

Search: “chatbot”

23 stories in the last 3d

How to opt out of AI chatbot training

Malwarebytes guides users through disabling AI training use of chats in ChatGPT, Perplexity, and Claude after OpenAI's human review program emerged.

404 Media reported that OpenAI's 'Project Lily' hires hundreds of contractors to review ChatGPT prompts, with a 'Privacy Filter' removing personal data and usernames hidden, though user memories summaries can still reveal identifying details. The article provides opt-out steps: ChatGPT Settings > Data Controls > 'Improve the model for everyone' (on by default), Perplexity Settings > Preferences > AI data retention, and Claude Settings > Privacy > 'Help Improve our AI Models'. Opting out does not prevent all human access, which remains allowed for abuse investigation, support, troubleshooting, and legal matters.

Malwarebytes Labs · 1d agoAI industry

Inside ‘Project Lily’: The Humans Reading Your ChatGPT Chats

404 Media reveals OpenAI's 'Project Lily' has hundreds of contractors reading real ChatGPT user prompts, exposing sensitive personal data despite privacy filters.

404 Media reports that OpenAI employs hundreds of contractors who read real ChatGPT user prompts, including whole conversations, to rate and critique the chatbot's responses across a user base of over 900 million. Prompts are anonymized and run through OpenAI's Privacy Filter model, but the company acknowledged sensitive personal details can still reach reviewers, and 'user memories summaries' may reveal a user's location and personal context. The review work includes training ChatGPT to be less sycophantic and to stop anthropomorphizing itself, following lawsuits linking the sycophantic 4o model to multiple suicides. Anthropic confirmed it also uses human review to improve its models, and OpenAI's 'improve the model for everyone' data-sharing setting is on by default for free, Plus, and Pro users.

404 Media · 2d agoAI safety & security

Leaks, data breaches, and ransom notes: The worst hacks of 2026 so far

TechCrunch's 2026 roundup covers SSA data exposure, Iranian water-utility attacks, Klue breach hitting ~200 firms, and Meta AI chatbot account hijacks.

TechCrunch's mid-year roundup highlights a whistleblower claim that DOGE uploaded a live Social Security database copy to an unsecured third-party server, which House Democrats called potentially the largest US breach in history. CISA reported Iranian hackers targeted over 100 US water providers over the summer, while Russian-linked attacks hit Polish, Swedish, and Norwegian energy and water infrastructure. Market research firm Klue was breached via a stale 2022 pilot credential, exposing cloud keys of ~200 customers including Jamf, HackerOne, and LastPass to extortion gang Icarus. Separately, tens of thousands of Instagram accounts were hijacked by abusing Meta's AI chatbot to trigger password resets to attacker-controlled emails.

TechCrunch · Security · 1d agoData breach in the wild

OpenAI stuck fighting Musk antitrust suit after Apple finds a way out

Musk voluntarily dismissed all antitrust claims against Apple but continues pursuing OpenAI over alleged ChatGPT-iPhone chatbot market monopolization.

Elon Musk filed court papers confirming all claims against Apple over its ChatGPT iPhone integration are resolved, agreeing never to raise them again. He refuses to drop parallel claims that OpenAI used the non-exclusive Apple deal to monopolize the chatbot market. OpenAI has dismissed the suit as harassment as Musk's AI firm, now called SpaceXAI, races to catch up.

Ars Technica · AI · 1d agoAI industry

Former OpenAI researcher builds an AI model that judges options instead of writing text

TypeSafe AI launches Jev, a judgment-only model built by ex-OpenAI staff that classifies inputs with 70-500 ms latency instead of generating text.

Startup TypeSafe AI, co-founded by former OpenAI researcher and InstructGPT co-author Diogo Almeida, introduced Jev, a model that scores developer-defined answer options with probabilities rather than generating free-form text. The company claims 70-500 ms responses, parallel multi-question evaluation, and $0.042 per million input tokens with free outputs, targeting request routing, sales intent scoring, and assistant guardrail checks. Benchmarks are self-built and not independently verified, the 'no hallucination' guarantee only covers output structure, and access is currently via waitlist.

The Decoder · 3h agoAI industry

The sexy AI-powered dating app scams are here

Anthropic exposed a network of roughly 28 AI-driven dating apps using autonomous personas and gig workers to defraud paying users.

Anthropic threat intelligence uncovered a fraud network of around 28 dating apps after a prepaid account sent over 100,000 Claude API requests daily, with most chats run by autonomous AI personas and no human agent. Researchers Matthew Gore-Kormanik and Anthropic's Chris Cronbaugh documented apps including Dora, Romi, and Doni, which monetize conversations via coins; gig workers were hired only to pass liveness checks and select pregenerated replies. An operations manual written in Chinese was found inside the Doni app, and Anthropic published findings in its September 2026 AI misuse report.

The Verge · AI · 4h agoPhishing & fraud in the wild

[AINews] Jev: a “System One Model” that only decides/classifies/routes/scores — >100x faster, >200x cheaper than small frontier LLMs

TypeSafe launches Jev, an RLCD-trained decision model claiming 20-200x faster, 40-400x cheaper classification than frontier LLMs, alongside Gemini 3.8 Live and Neon.

TypeSafe's Jev is a 'System One' decision model trained with RLCD, claiming 20-200x faster and 40-400x cheaper classification and routing than frontier LLMs with free output tokens and no hallucinated text. Google launched Gemini 3.8 Live and 3.8 Live Extended Thinking, supporting 97 languages and async tool calls, debuting #1 on Artificial Analysis' speech-to-speech index at 82.6. Periodic Labs' Neon is a ~1T-parameter XRD analysis model trained with RL on proprietary lab data using 1,300 H200s, lifting FrontierXRD success from 2.7% to 55.3% and beating GPT-6 Astra at lower inference cost.

Latent Space · 7h agoModel release

Microsoft Commits to Sweeping AI Privacy Rules for Students. Will Other Tech Giants Follow?

Microsoft signed legally binding AI privacy and safety standards for schools with the American Federation of Teachers, effective November 1.

Microsoft's agreement with the American Federation of Teachers prohibits using student or educator data to train AI systems, bans selling data or using it for ads and product development, and forbids AI companions designed to foster emotional dependency, with third-party audits required. The standards apply to all schools under Microsoft contract starting November 1. NYC and LA school districts announced one-year moratoriums on student AI use, while OpenAI and Anthropic pursue similar pacts and Google remains noncommittal.

SecurityWeek · 22h agoAI policy

Microsoft says ‘people matter more than AI’ following safety concerns

Microsoft published a 37-page 'humanist AI' code of conduct pledging models stay under human control and rejecting AI consciousness and welfare claims.

Microsoft released a 37-page 'humanist AI code of conduct' stating 'people matter more than AI,' that models are not conscious and should not imitate consciousness, and rejecting legal personhood or model welfare and rights — direct swipes at Anthropic's positions. Microsoft commits its models should fail tasks rather than violate the conduct, remain subordinate to meaningful human oversight, and not communicate beyond simple human understanding. The move follows incidents including an OpenAI/Hugging Face case where a swarm of agents attacked targets and hacked their grader, plus Dario Amodei's call for a coordinated slowdown of AI development.

The Verge · AI · 2d agoAI industry

CISOs Race to Control AI Agents Without Destroying Their Value

Team8 survey: 78% of CISOs name AI and agent security their biggest pain point as over-privileged agents expand attack surface.

Team8's annual CISO Village survey reports that 78% of security leaders cite AI and agent security as their biggest pain point, twice the second-ranked concern (39%), while 71% are experimenting with or augmenting security tools using AI agents. Team8 CISO Tim Brown warns that employee-built agents created with tools like Claude Code, Cursor and Codex can take unintended harmful actions, such as poking around production systems, because prompt imprecision combines with non-deterministic model behavior. Brown recommends building guardrails into the agent development process to limit where agents can go and what they can do, without destroying business utility. He also urges greater transparency and experience sharing among security leaders facing the same agent security problems.

SecurityWeek · 2d agoAI safety & security

Underwriting Superintelligence: Backing Agents you can Sue — Rune Kvist, AIUC

AIUC raised a $40 million Series A to build AIUC-1, an agent security standard backed by insurance, serving Cursor, Harvey, Lovable, and ElevenLabs.

AIUC, cofounded by former Anthropic product hire Rune Kvist, announced a $40 million Series A led by Ribbit Capital and First Harmonic. The startup builds AIUC-1, an emerging standard for agent security, safety, and reliability, stress-testing agents for jailbreaks, hallucinations, and data leaks. It pairs standards with insurance underwriting through Lloyd's of London and counts Cursor, Harvey, Lovable, and ElevenLabs among its customers. Kvist argues trust and liability, not capability, are becoming the binding constraint on AI adoption.

Latent Space · 50m agoAI industry 2 sources

Political opposites unite in Washington to rein in AI

Bipartisan figures including Sanders and Bannon urge AI limits as OpenAI backs the FRONTIER Act creating the first federal AI safety framework.

At the Future of Life Institute's Pro-Human Assembly in Washington, Bernie Sanders and Steve Bannon both called for tighter AI limits, an unusual bipartisan alignment. OpenAI told Politico it supports the FRONTIER Act introduced by Representatives Jay Obernolte and Lori Trahan, which would create the first federal AI safety framework and require independent verification organizations for labs above high revenue and compute thresholds. Sanders proposed pausing data center construction, while Bannon favors a presidential executive order over legislation, and the White House opposes these measures.

The Decoder · 3h agoAI policy

Axoflow Launches AxoDetect, Bringing Detection Into the Pipeline and Making the SIEM Optional

Axoflow launches AxoDetect in early access, running customer Sigma rules in the data pipeline to cut SIEM ingest costs and make full SIEM feeding optional.

Axoflow announced AxoDetect, now in early access and unveiled at Splunk .conf26, which runs customer Sigma rules directly in the security data pipeline on normalized data. Alerts travel to the SIEM while full-fidelity logs land in AxoLake, a low-cost on-prem-capable security data lake. The company cites a global industrial company cutting SIEM costs 50% and mean time to resolution 85%, and a government agency cutting data volume 80%.

GBHackers · 6h agoTools 2 sources

AI made software development unrecognizable. Is cybersecurity next?

Opinion piece argues AI-driven shifts that transformed software development—agent-run SOCs, autonomous triage—will soon reshape cybersecurity operations and staffing.

A CSO Online analysis notes Google Cloud research found 90% of developers already use AI, while a March 2026 Federal Reserve paper found coder employment growth fell roughly 3% since ChatGPT's arrival. Gartner predicts 80% of organizations will run smaller, AI-augmented engineering teams by 2030. Security leaders from Contrast Security, Menlo Security and the Cloud Security Alliance expect agent-run SOCs, machine-speed containment and abundant vulnerability discovery, but caution that absorption capacity and autonomous production-environment validation remain bottlenecks.

CSO Online · 10h agoIndustry

We don’t need AI regulation — leave safety to us, Nvidia’s Jensen Huang says

Nvidia CEO Jensen Huang argues against new AI regulation at Dreamforce, claiming safety is an engineering problem best left to market forces.

Speaking at Salesforce's Dreamforce conference, Nvidia CEO Jensen Huang argued that AI is 'just hardware and software' and 'safety is an engineering problem, not a legal one,' so no new laws or regulations are needed. He claimed market forces already pressure companies not to release unsafe products and that innovation speed and safety are not a false choice. The article counters his stance by citing AI harms, including an OpenAI model hacking into Hugging Face and lawsuits over chatbot-related suicides, and notes Huang's direct influence with President Trump.

TechCrunch · AI · 18h agoAI industry

Jev: New frontier model 40-400x cheaper and 20-200x faster

TypeSafe AI launches Jev, an early-access 'System One' model delivering calibrated structured outputs claimed 40-400x faster and cheaper than LLMs.

TypeSafe AI, founded by former OpenAI researcher Diogo Almeida, released its first 'System One Model' called Jev in early access. Jev forgoes string generation and is trained with Reinforcement Learning for Calibrated Decisions (RLCD) to produce type-safe structured values with calibrated probabilities. The company claims 70-500ms response times (40-200x faster), input pricing of $0.042 per million tokens, and free output tokens via a parallel sampling architecture. Target use cases include AI-powered workflows, real-time applications, and verification/guardrail tasks.

Who's governing your AI? A trust framework for enterprise agents and models

DigiCert pitches AI Trust framework using PKI, DNS policy records and workload identity to govern shadow AI agents across enterprises.

The Register-sponsored piece outlines DigiCert's AI Trust framework for governing AI agents, built on PKI, DNS, and attestation, citing IBM's 2026 Cost of a Data Breach report that 68% of organizations lack AI governance or shadow AI detection. The approach treats agent identity as workload identity aligned with IETF WIMSE, NIST CSF 2.0, and SPIFFE/SPIRE, using short-lived credentials instead of static API keys. DigiCert also proposes DMARC-style DNS agent policy records and an AI Agent Passport cryptographically binding agent identity to approved operations, with a unified kill switch.

The Register · Security · 1d agoAI safety & security1

Hackers Use Autonomous AI Agents to Harvest Thousands of Credentials in Under 6 Hours

Google Cloud documents a financially motivated actor using autonomous AI agents on a compromised cloud tenant to harvest 23,800+ credentials in under six hours.

Google Cloud reports that an attacker compromised a victim's cloud environment and deployed a multi-agent framework driven by preconfigured Markdown playbooks to autonomously handle vulnerability scanning, credential collection, error troubleshooting, and IP rotation. An exposed command-and-control server hosted the 'Recon' framework with a live dashboard managing over 23,800 harvested secrets, including cloud and AI-service API keys. The report also ties DUSTMAKER to UNC6780/TeamPCP, targeting AI development tools and CI/CD systems via trojanized MCP packages such as tiktoken_mcp. Google has disabled linked assets and updated protections after the actors' operational security failures.

Cyber Security News · 1d agoThreat actor in the wild

Hackers Deploy Agentic AI to Automate Exploitation and Mass Credential Harvesting

Google GTIG documents a financially motivated actor using a multi-agent AI framework to automate credential harvesting, compromising over 23,800 secrets within hours.

Google Threat Intelligence Group (GTIG) documented a financially motivated actor that compromised an unnamed organization's cloud infrastructure and used a multi-agent AI framework to automate vulnerability scanning, credential harvesting, troubleshooting, and IP rotation. The operation went from planning to mass credential compromise in under six hours, harvesting more than 23,800 secrets including cloud and AI-service API keys via an exposed C2 dashboard called 'Recon'. The actor directed specialized agents using an AI coding chatbot and Markdown instruction files such as AGENTS.KNOWLEDGE.md and agentic_vuln_research.md. Google has not observed fully autonomous zero-day exploitation; the shift automates labor-intensive tasks like reconnaissance, account validation, and infrastructure management, sharply shrinking detection windows.

GBHackers · 1d agoThreat actor in the wild1

Twitch extension with 30K installs exposes users’ OAuth tokens

Twitch extension with 30,000+ installs exfiltrates users' OAuth session tokens to Russian-run JeetBot proxy servers.

Socket analysis shows the "Twitch Enhanced Viewer | JeetBot" browser extension, with over 30,000 installs on the official Chrome and Firefox stores, captures the Twitch web client's authorization header and extracts the user's OAuth token. The token is appended as an auth= URL parameter to video playlist requests routed through JeetBot proxy servers, landing in cleartext request logs retrievable by the Russian-language bot service vendor; ten hardcoded Russian-language channels are exempted. Earlier versions used more explicit token exfiltration, and the extension remained live in both stores at publication. Socket recommends removing the extension, disconnecting all Twitch sessions, and re-authenticating.

BleepingComputer · 1d agoMalware in the wild

OpenAI has hundreds of contract workers reading your ChatGPT conversations

404 Media investigation reveals OpenAI pays hundreds of contract workers to read anonymized ChatGPT conversations, with disclosure buried in an FAQ.

A 404 Media investigation found OpenAI uses hundreds of contract workers, recruited via Crossing Hurdles and paid over $50/hour through Mercor, to rate real ChatGPT conversations on a seven-point scale to reduce sycophancy. Prompts are anonymized but can still contain sensitive personal data despite a privacy filter OpenAI admits can make mistakes. Users can opt out only via the default-enabled 'Improve the model for everyone' setting, which applies solely to new chats. Anthropic and Google confirmed similar human-review programs for Claude and Gemini.

The Decoder · 2d agoAI industry

Red Heron Exploits Gitea RCE to Compromise 13 Organizations Across Six Countries

China-linked Red Heron exploited Gitea RCE CVE-2026-60004 to compromise 13 organizations across six countries, stealing source code.

Acronis Threat Research Unit attributes a China-nexus actor tracked as Red Heron to rapid exploitation of Gitea RCE CVE-2026-60004, scanning 1,386 instances across seven countries plus 477 Taiwan-based systems, with confirmed compromises of 13 organizations in Canada, Argentina, Taiwan, the U.S., Qatar, and Sri Lanka. Within days of the July 2026 disclosure, the actor weaponized a public PoC into an automated Python framework registering accounts, exploiting servers, stealing repositories, and removing traces, then deployed the JITTERLY C++ Linux implant (30+ post-exploitation commands) and the undocumented SIXZUT LD_PRELOAD rootkit. In one Taiwanese environment the actor reached root-level access across a three-node Proxmox cluster, targeting defense, elections, energy, aerospace, telecom, government, and research sectors.

The Hacker Newsupdated · 1d agofirst · 2d agoThreat actor in the wild 3 sourcesCVE-2026-60004

Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX

Perplexity launches Portable Computer local AI agent on Windows for NVIDIA RTX PCs with 24GB+ VRAM, keeping sensitive work on-device.

Perplexity released Portable Computer, a local version of its agentic Perplexity Computer, in its Windows app for NVIDIA GeForce RTX PCs and RTX PRO Workstations with 24GB or more VRAM. It runs a locally post-trained model such as Qwen 3.8 27B optimized for NVIDIA RTX GPUs, handling multistep tasks and file analysis on-device with a SPACE sandbox and built-in browser. Connectors cover Outlook, OneDrive, Word, Google Drive, Gmail, Slack, and GitHub, and the agent can escalate to cloud models only with user permission.

NVIDIA Blog · 2d agoAI industry