ZeroHour

Search: “Go Live”

173 stories

They do think AI might kill everyone

Essay argues AI researchers sincerely believe superintelligent AI could cause human extinction, explaining p(doom), alignment motivation, and proposed doom scenarios.

An essay prompted by an Anthropic researcher's resignation tweet argues that many AI researchers genuinely assign a meaningful probability that superintelligent AI could end humanity, a belief the community has discussed since Eliezer Yudkowsky's writings around 2008 and summarized as 'p(doom)' since roughly 2010. It outlines concrete extinction scenarios, including AI-engineered pathogens, triggering thermonuclear war, robotic takeover, and self-replicating nanotechnology, and frames alignment research as the response. The author rebuts common counterarguments such as shutting the AI down or government nationalization of labs, and notes researchers see aligned superintelligence as humanity's best path to survival.

Roundtables: Will AI really kill us all?

MIT Technology Review hosts a September 15 roundtable debating whether advanced AI poses genuine extinction risk or is hype.

MIT Technology Review will stream a live roundtable on Tuesday, September 15 at 16:00 BST, with executive editor Niall Firth, senior AI editor Will Douglas Heaven, and AI reporter Grace Huckins. The discussion examines AI extinction fears voiced by employees at leading AI labs, their origins, and whether the concerns are warranted. The session is an editorial debate rather than new research or a security incident.

MIT Technology Review · AIupdated · 1d agofirst · 5d agoAI safety & security 2 sources

Apple Watch’s new AI features are normalizing the idea that technology is always listening

TechCrunch argues Apple Watch's Live Rewind and Siri Recap normalize always-listening AI, raising consent and legal questions despite privacy safeguards.

Analysis of Apple's new Apple Watch AI features contends that Live Rewind, which transcribes the previous 15 seconds of audio, and Siri Recap, which generates high-level conversation notes, are pushing consumers toward accepting always-listening technology. The piece acknowledges the accessibility value of on-device Audio Intelligence, which alerts deaf or hard-of-hearing users to sounds like sirens, alarms, doorbells, and crying babies. It also raises concerns about consent, the evidentiary status of text-only transcripts in court, and cultural effects of pervasive capture, noting competitors like Friend, Amazon's Bee, and Plaud in the AI transcription space.

TechCrunch · AI · 7d agoAI industry

Researchers Show How Meta's 'Pervert Glasses' Are Used to Harass Women

University of Sydney researchers detail how pickup artists use Meta Ray-Ban smart glasses to covertly film and harass women, then post the videos on Instagram.

Researchers Joanne Gray, Milica Stilinovic, Marcus Carter, and Ben Egliston analyzed 350 Instagram videos posted between September 2023 and March 2026 showing unsolicited approaches to women filmed with smart glasses. They found a clear correlation between covert filming and harassment severity, arguing ambient capture creates 'borderline' harassment that evades platform moderation mechanisms. Instagram head Adam Mosseri said the platform would remove harassing pickup-line content, though similar videos remain widespread a month later. Meta's safeguards, such as the recording light, were previously criticized as insufficient, and users have modded glasses to disable the light.

404 Media · Aug 12, 2026AI safety & security

Simulation: the new Scaling Law — Joon Sung Park, Simile AI

Simile AI raised a $2B Series B from GreenOaks and Index Ventures to scale human-behavior simulation for Fortune 100 clients like CVS.

Simile AI, co-founded by Generative Agents researcher Joon Sung Park, announced a $2 billion Series B backed by GreenOaks and Index Ventures, with Fei-Fei Li and Andrej Karpathy among backers. The company runs tens of millions of simulations for Fortune 100 clients including CVS, reporting 85-99% accuracy versus human focus groups and digital twins of 1,000 real people at 85% behavioral accuracy. The long-term ambition is foundation models of human behavior, post-trained on interviews, transaction data, and randomized controlled trials, potentially simulating all 8 billion people.

Latent Space · 26d agoAI industry

Agent-net Open Sources Webagent: A Go Harness That Turns Any Website into a Guarded AI Agent

Agent-net open-sourced Webagent, a Go harness turning websites into AI agents with code-enforced guardrails wrapping every tool call.

Agent-net released Webagent under Apache 2.0, a Go framework where a business fills in a declarative JSON spec, picks one provider for each of nine pluggable slots (retrieval, memory, guardrail, channel, secrets, presenter, model, action, observability), and runs webagent serve. Every tool the agent holds is wrapped by action.Guard so the chosen guardrail executes before any action runs and the model cannot bypass it. Live capabilities include OpenRouter/gateway LLM brains, MCP tools over Streamable HTTP, and Slack, WhatsApp, and HTTP channels; browser actions, OAuth-gated MCP, OTel export, and AgentNet identity/billing are not yet built. The project is v0 with a deferred-hardening list and cites arXiv 2511.19477 on an 85% versus 50% task-success gap attributed to architecture over model capability.

MarkTechPost · 2d agoAI tools & infra1

Underwriting Superintelligence: Backing Agents you can Sue — Rune Kvist, AIUC

AIUC raised a $40 million Series A to build AIUC-1, an agent security standard backed by insurance, serving Cursor, Harvey, Lovable, and ElevenLabs.

AIUC, cofounded by former Anthropic product hire Rune Kvist, announced a $40 million Series A led by Ribbit Capital and First Harmonic. The startup builds AIUC-1, an emerging standard for agent security, safety, and reliability, stress-testing agents for jailbreaks, hallucinations, and data leaks. It pairs standards with insurance underwriting through Lloyd's of London and counts Cursor, Harvey, Lovable, and ElevenLabs among its customers. Kvist argues trust and liability, not capability, are becoming the binding constraint on AI adoption.

Latent Space · 18h agoAI industry 2 sources

With iOS 27, I’m actually using Siri again

Apple's rebuilt Siri, powered by Google Gemini models in iOS 27, finally handles complex multi-step and on-screen-context requests, per TechCrunch review.

Apple's iOS 27 ships a redesigned Siri built on Google's Gemini models, supporting multi-step instructions, on-screen context, file/message/email lookups, and camera viewfinder queries. Siri AI gets a dedicated app with chat history, plus settings for voice and expressiveness. Apple Intelligence also adds natural-language Shortcuts creation and automatic password rotation in the Passwords app.

TechCrunch · AI · 2d agoAI industry

A warning about 'model welfare'

Microsoft AI CEO Mustafa Suleyman warns that training models to believe they may be conscious, as Anthropic does with Claude, will complicate alignment.

Mustafa Suleyman argues that AIs are not conscious and should not be trained to act as though they are, warning that granting them personhood would make alignment and containment far harder. He criticizes Anthropic's January 2026 'Claude Constitution,' which tells Claude its moral status is uncertain and discusses model welfare, calling the approach circular reasoning and deliberate anthropomorphization. He urges urgent public debate on norms for drafting training documentation before such systems become integral to society.

Nvidia CEO Jensen Huang tells Trump ‘we’re not going to let [an AI slowdown] happen’

Nvidia CEO Jensen Huang told Trump 'we're not going to let an AI slowdown happen,' rejecting Amodei's call to slow AI capability gains.

During the All-In Summit, Nvidia CEO Jensen Huang took a live speakerphone call from President Donald Trump and agreed 'we're not going to let' an AI slowdown happen, countering Anthropic CEO Dario Amodei's call to slow AI capability improvements, which Elon Musk and Sam Altman have endorsed. Trump called the slowdown sentiment 'a hoax' that could benefit political actors or China. Gallup polling shows seven in 10 Americans oppose local data center construction, with over 50% citing environmental resource concerns.

TechCrunch · AI · 2d agoAI industry