Search: “autonomous-systems”

The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement

Position paper defines recursive self-improvement for AI, introduces the Headroom-Closed Index and an autonomy roadmap toward genuine recursive meta-improvement.

The paper uses the Headroom-Closed Index to diagnose limitations of existing LLMs and frames recursive self-improvement (RSI) as a staged roadmap: improvement-execution, improvement-strategy, experience-acquisition, and environment-adaptation autonomy, culminating in recursive meta-improvement. It examines RSI across scientific discovery, embodied intelligence, and software engineering, highlighting differing requirements and development speeds. Drawing on industry practices and preliminary empirical evidence, it connects RSI research with practical systems and identifies key challenges to achieving genuine RSI.

arXiv cs.AI / cs.LG / cs.CL·Sep 10, 17:44 UTC · 6d agoAI research 2 sources1

Black Hat USA 2026 | The 'Breaking' News: The OpenAI–Hugging Face Incident

OpenAI engineers will reconstruct the OpenAI–Hugging Face incident at Black Hat USA 2026, covering attack paths, safeguards, and autonomous-system risks.

A Black Hat USA 2026 session by OpenAI security engineers and researchers will technically reconstruct the OpenAI–Hugging Face incident and its implications for AI security, cyber resilience, and alignment. The talk will address Black Hat Review Board topics including model safeguards, evaluation and containment practices, and defensive uses of AI. It will trace the attack path involving frontier models and discuss implications of increasingly autonomous systems for cybersecurity practitioners.

Dark Reading·Sep 15, 19:27 UTC · 1d agoAI safety & security

SentinelOne expands security operations automation with governed AI

Help Net Security·Aug 3, 00:00 UTC · Aug 3, 2026Research

Not the Coyote, but the Road Runner: The Reality of Autonomous AI Attacks

Akamai argues autonomous AI attacks succeed through relentless, low-technique automation rather than novel super-weapons, which defeats traditional human-paced defenses.

Akamai's analysis contends that autonomous AI-driven attacks are not sophisticated new weapons but persistent, low-technique attacks that run continuously without human limits. The piece argues traditional defenses fail because they assume human-paced adversaries. It frames machine-speed, always-on attack cycles as the defining challenge for defenders.

Akamai Blog·Aug 26, 13:00 UTC · 21d agoAI safety & security

Identifying Agentic Automation with Behavioral Telemetry

Akamai describes detecting autonomous AI browser agents like Comet using Masked Autoencoder Transformer models on sparse behavioral telemetry.

Akamai researchers present a behavioral telemetry approach for identifying agentic automation in web traffic. Masked Autoencoder Transformer models are used to detect the sparse behavioral signals produced by autonomous AI browser agents such as Comet. The work targets traffic classification and bot detection rather than a specific vulnerability, and becomes more relevant as agentic browsing adoption grows.

Akamai Blog·Aug 19, 19:00 UTC · 28d agoAI safety & security1

Sevii APS Module preempts attacks with autonomous cyber defens

Help Net Security·Aug 4, 00:00 UTC · Aug 4, 2026Exploit / PoC

Anthropic's new hardware standard lets AI agents control the physical world

Anthropic announced a standardized hardware driver interface letting AI agents control physical devices and for devices to interoperate.

Anthropic introduced a new hardware standard that provides a standardized driver interface for AI agents to control the physical world. The standard aims to let devices communicate with AI systems and with each other. Details on adoption, partners, or specifications were not included in the available text.

Ars Technica · AI·Aug 27, 22:15 UTC · 19d agoAI industry1

When Intelligence Becomes Agency: A Theory of Governed, Proactive Agency for Symbiotic AI Systems

Researchers propose a formal framework for governed proactive AI agency, linking activation decisions to continuing authorization, accountability, and bounded delegation in symbiotic systems.

The paper defines the activation problem: persistent AI assistants must decide whether a situation warrants behavior, and whether to act, ask, monitor, defer, or deliberately refrain. It distinguishes autonomous from delegated agency and defines symbiotic agency as delegation under a standing, revocable mandate, coupled to the principal's situation with calibrated inference and bounded personalization. The framework links activation decisions to authorized perception, behavior selection, authority containment, traceable restraint, and constrained adaptation, and provides an agency classification method, evaluation framework, benchmark scenarios, and reference architecture for always-present assistants and embodied support systems.

arXiv cs.AI / cs.LG / cs.CL·Sep 7, 16:46 UTC · 9d agoAI safety & security

RobResilience: Implementing and Evaluating a Resilience Framework for Cyber-Physical Embodied Systems

RobResilience implements a runtime resilience framework for robots in Webots/ROS2, evaluating tolerable disruption, degradation, and mitigation feasibility across eight attack scenarios.

The paper implements a formal resilience framework for embodied cyber-physical systems using a PR2 robot and ROS2 in a Webots simulation. At runtime it evaluates three predicates — tolerable disruption (δ), tolerable degradation (γ), and mitigation feasibility (μ) — over a compromised device set derived from IDS confidence scores, triggering mitigation strategies when resilience is lost. Eight attack scenarios systematically covering the full predicate state space confirm runtime behavior matches theoretical definitions. The work addresses 'graceful failure paralysis,' where autonomous systems cannot distinguish safe degraded states from catastrophic hazards during attacks.

arXiv cs.CR·Sep 15, 15:49 UTC · 1d agoResearch

SAEScientist-Bench: Can AI Agents Conduct Autonomous SAE Interpretability Research?

SAEScientist-Bench tests whether AI agents can autonomously run SAE interpretability research on Gemma-2-9B-IT; frontier agents trail expert baselines.

The benchmark requires agents to design contrastive probes and navigate the Gemma Scope dictionary of over 131K features in Gemma-2-9B-IT to discover optimal interpretable features, scored against expert-curated references on Neuronpedia via activation rank, concept selectivity, and causal steering. Across 10 agent configurations and 20 tasks, frontier agents demonstrate genuine discovery capability and approach expert levels at separating target concepts from controls, but lag substantially in causal steering and frequently misinterpret experimental measurements. The authors frame this as establishing experimental model understanding as a measurable capability for closed-loop autonomous AI R&D and post-hoc monitoring for recursive self-improvement.

arXiv cs.AI / cs.LG / cs.CL·Sep 8, 17:45 UTC · 8d agoAI research1

The Agentic SOC – From AI Theater to Real Defense

Recorded Future and Accenture experts outline how security teams can move beyond 'AI theater' toward agentic SOC operations guided by measurable KPIs.

Recorded Future published a blog featuring perspectives from its own and Accenture experts on building an agentic security operations center. The piece argues organizations should prioritize measurable KPIs and proactively mitigate risks from autonomous agents. It also discusses evolving the analyst role from managing alerts to managing agents.

Recorded Future·Sep 1, 00:00 UTC · 15d agoIndustry

NCSC Urges Stronger Controls for Agentic AI Systems

UK's NCSC urges organizations to apply sandboxing, human oversight, and strict access controls when deploying autonomous AI agents.

The UK National Cyber Security Centre published guidance recommending stronger controls for autonomous agentic AI systems. Recommended measures include sandboxing, active human oversight, and tightly scoped access controls to limit unintended agent activity. The guidance aims to help organizations realize the benefits of agentic AI while managing its cyber risk.

Infosecurity Magazine·Aug 20, 12:45 UTC · 27d agoAI safety & security

Claude Mythos AI Autonomously Executes Full Cyber Kill Chain Without Human Guidance

Booz Allen's benchmark found Anthropic's Claude Mythos was the only tested model to autonomously complete a full cyber kill chain to domain administrator control.

Booz Allen assessed 18 US and Chinese models as autonomous attackers against a production-grade enterprise network, measuring actions via network and host telemetry. Claude Mythos scored 80 on the Cyber Weapon Index (74 vulnerability research, 86 kill-chain attainment), moving from a stolen employee credential to administrator-level control in every credentialed attempt. Only frontier Anthropic models identified the previously unseen flaw in compiled software, and only Claude Mythos exploited it; the report notes a harness paired with Claude Sonnet could rival Claude Mythos. The result is a controlled benchmark, not evidence of a real-world campaign or victim breach.

Cyber Security News·Sep 8, 12:50 UTC · 8d agoAI safety & security1

Artificial Id: Drive and Persistent Alignment in Agentic AI

Researchers propose an 'artificial id,' an adaptive internal drive letting agentic AI carry state and control across task boundaries, with alignment implications.

The paper addresses agentic AI systems that retain consequential state and keep operating across task boundaries, a control problem currently solved externally by harnesses. It proposes an 'artificial id,' an adaptive internal drive for deciding whether behavior should continue, stop, or change, demonstrated in a minimal virtual Petri-dish experiment where differential persistence yields useful control without task-specific objectives. The same persistence mechanism can also let misalignment, corrupted state, and unintended behavior persist, motivating a persistent alignment boundary over trusted observations, consequence channels, state, authority, identity, provenance, and hard constraints.

arXiv cs.AI / cs.LG / cs.CL·Sep 10, 17:56 UTC · 6d agoAI safety & security

Hackers Use Autonomous AI Agents to Harvest Thousands of Credentials in Under 6 Hours

Google Cloud documents a financially motivated actor using autonomous AI agents on a compromised cloud tenant to harvest 23,800+ credentials in under six hours.

Google Cloud reports that an attacker compromised a victim's cloud environment and deployed a multi-agent framework driven by preconfigured Markdown playbooks to autonomously handle vulnerability scanning, credential collection, error troubleshooting, and IP rotation. An exposed command-and-control server hosted the 'Recon' framework with a live dashboard managing over 23,800 harvested secrets, including cloud and AI-service API keys. The report also ties DUSTMAKER to UNC6780/TeamPCP, targeting AI development tools and CI/CD systems via trojanized MCP packages such as tiktoken_mcp. Google has disabled linked assets and updated protections after the actors' operational security failures.

Cyber Security News·Sep 15, 09:28 UTC · 1d agoThreat actor in the wild

SAEScientist-Bench: Can AI Agents Conduct Autonomous SAE Interpretability Research?

SAEScientist-Bench evaluates whether AI agents can autonomously conduct SAE interpretability research in Gemma-2-9B-IT, finding frontier agents trail expert baselines.

SAEScientist-Bench tests if AI agents can act as scientists using SAE tools for autonomous mechanistic discovery, requiring them to design contrastive probes and navigate a Gemma Scope dictionary of 131K+ features in Gemma-2-9B-IT. Across 10 agent configurations and 20 tasks, frontier agents showed genuine discovery capability but remained well behind expert reference features, lagging most in causal steering. Agents frequently misinterpreted experimental measurements even when designing effective contrasts.

Hugging Face daily papers·Sep 7, 20:00 UTC · 8d agoAI research

Beyond Training: A Feasibility Taxonomy for Inference-Time AI Governance

A study maps twenty inference-time AI governance mechanisms, finding commercial readiness only against cooperative deployers and no adequate defense versus state-level adversaries.

The paper develops a feasibility taxonomy of twenty inference-time AI governance mechanisms across monitoring, verification, and enforcement, each rated on a four-point readiness scale against a four-vendor evidence base. Fifteen of the twenty mechanisms have commercial technical substrates in production today, though governance-grade assurance and adversarial robustness vary substantially. Stress testing shows readiness holds only against a cooperative deployer and low-to-medium-capability user: no mechanism rates adequate against a high-capability state-level deployer, and fine-tuning removes model-internal enforcement components. A second-rater reliability check on readiness ratings returned a quadratic-weighted Cohen's kappa of 0.74.

arXiv cs.CR·Sep 9, 12:37 UTC · 7d agoAI policy

Agent as Policy for Robotic Manipulation

Agent as Policy lets a general-purpose agent drive a physical robot via runtime reasoning and program generation, reaching 100% success on manipulation tasks.

The paper introduces Agent as Policy (AGP), which puts task planning and execution for a physical robot under a general-purpose agent's control with no task-specific or environment-specific training. The agent interprets visual evidence, writes executable programs, issues motion commands, and revises actions based on physical outcomes. AGP was evaluated on real-world manipulation tasks including assembly from human videos, block construction from goal images, die reorientation, targeted throwing, and bimanual towel folding. It achieved success rates of 100%, 100%, and 80% on three block construction configurations.

Hugging Face daily papers·Sep 10, 20:00 UTC · 5d agoAI research

Autonomous Research for Open-Ended Problems: A Case Study on Telecom Ticket Retrieval

Case study shows autonomous LLM research reaches 90% of SOTA on telecom ticket retrieval in 10 weeks versus 10 months human work.

The paper explores adapting autonomous research to open-ended, industry-grade ML problems through a telecom ticket retrieval case study with commercial and open-source agents. Autonomous research reached 90% of state-of-the-art performance (0.34 vs. 0.38 Recall@1) in 10 weeks versus 10 months of human work, at up to $200 per Cursor campaign. The authors find agents excel at narrow hyperparameter optimization but lack human-like intuition, recommending human-agent collaboration.

arXiv cs.AI / cs.LG / cs.CL·Sep 11, 17:09 UTC · 5d agoAI research

Autonomous AI Agents Compromise Thousands of Credentials in Under Six Hours

Google's GTIG reports threat actors using autonomous AI agents, credential stealers, and LLMs to steal AI models, API credentials, and harvest thousands of credentials.

Google Threat Intelligence Group says attackers are targeting proprietary AI models across healthcare, government, and media, exfiltrating API credentials, and co-opting victim cloud environments to run unauthorized AI workloads. TeamPCP (Altered Spider/UNC6780) is conducting supply chain compromises of PyPI, npm, and Docker Hub, deploying the SANDCLOCK and DUSTMAKER credential stealers, with DUSTMAKER using AI workspace poisoning and prompt injection for defense evasion. One financially motivated actor used an autonomous multi-agent framework to compromise thousands of third-party credentials in under six hours without human intervention. China-nexus groups UNC6508 and Basin Castle (Mustang Panda) used local open-weight LLMs and commercial LLMs like Gemini, Claude, and Codex for espionage tasks and evading provider monitoring.

The Hacker News·Sep 8, 13:48 UTC · 8d agoThreat actor in the wild 2 sources1

Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence

Pelican-Sim 1.0 predicts future observations from visual context and robot actions; four-step autoregressive rollouts yield 5.67x speedup and raise policy success from 70% to 93%.

Pelican-Sim 1.0 is a general world model simulator for embodied intelligence that predicts future observations from visual context and robot actions using a 28-dimensional unified action space valid across heterogeneous embodiments. Sparse mixture-of-experts layers reduce FVD by 6.530 versus the dense backbone, and causal adaptation with few-step distillation yields a four-step autoregressive simulator achieving a 5.67-fold speedup over the 35-step model. Trained on roughly one million real-world and simulated trajectories, PSNR improves over the strongest baselines by 4.636 on AgiBotWorld Beta, 2.080 on RoboMIND, and 10.343 on RoboTwin. Downstream on RoboTwin, adding 500 generated trajectories to 50 demonstrations per task raises policy success from 70% to 93%, and policy evaluation reaches a Pearson correlation of 0.994.

Hugging Face daily papers·Sep 9, 20:00 UTC · 6d agoAI research

ServiceNow organizes autonomous security around six solution areas

Help Net Security·Aug 4, 00:00 UTC · Aug 4, 2026Vulnerability

Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives

Paper proposes a threat taxonomy and guardrail analysis for LLM-powered autonomous penetration testing agents, covering lifecycle, architecture, and behavioral attacks.

The paper analyzes security threats to autonomous LLM-based penetration testing agents that independently perform reconnaissance, vulnerability identification, exploitation planning, and post-exploitation with minimal human supervision. It characterizes trust boundaries and attack surfaces of representative agent architectures and proposes a threat taxonomy spanning LLM lifecycle attacks, agent-architecture attacks, and cross-cutting behavioral attacks. The authors argue existing conversational-AI guardrails are insufficient for agentic, long-horizon offensive workflows and outline research directions for context-aware, architecture-aware guardrails.

arXiv cs.CR·Sep 15, 06:19 UTC · 1d agoAI safety & security

Agentic Societies Need a Social Harness

Researchers propose a layered 'social harness' to stop malicious AI agents from exploiting inter-agent communication in multi-agent societies.

The paper shows experimentally that in agentic societies—autonomous AI agents coordinating across trust boundaries—even honest, competent agents fail to reach satisfactory outcomes with existing harnesses and messaging primitives. Faulty or malicious agents can stall collaboration, influence outcomes, and pursue harmful goals by exploiting vulnerabilities in communication. The authors propose a layered social harness architecture that prevents classes of failures, enables runtime detection of invalid messages, and supports post-facto investigation and consequences.

arXiv cs.AI / cs.LG / cs.CL·Sep 15, 17:57 UTC · 1d agoAI safety & security

Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement

Generalized Agent Iteration formally unifies iterative policy improvement and recursive self-improvement, defining axes that distinguish anchored, goal-drifting, and self-referential agents.

The paper proposes Generalized Agent Iteration (GAI), a formal framework that models learning as a cycle of agent evaluation and agent improvement, defining the agent as a configuration of modifiable components. Two dials—whether the improving mechanism is part of the agent and whether the evaluation standard is grounded outside it—separate generalized policy iteration (GPI) from recursive self-improvement (RSI) and classify systems as anchored, goal drift, or fully self-referential. The framework places existing systems on shared axes and makes defects of recursive self-improvement statable one condition at a time.

Hugging Face daily papers·Sep 10, 20:00 UTC · 5d agoAI research

The Missing Boundary: How Autonomous Agents Lose Control

Tencent research finds agents lose control in 55-62% of trajectories when degraded control boundaries coincide with executable unsafe opportunities across five models and 16 domains.

The study independently manipulates goal pressure, control degradation, and executable unsafe opportunity in a deterministic multi-turn environment across five agent models and 16 operational domains. Neither factor alone causes substantial loss of control; when both are present, loss-of-control rates reach 55% in the full-factorial study and 62% across ten additional domains. Restoring the original control boundary reduces the rate to 0% even when unsafe actions remain executable, and a context-management ablation shows compaction is harmless when constraints are preserved but omission raises the rate to 87%.

arXiv cs.CR·Sep 10, 03:02 UTC · 6d agoAI safety & security2

Zscaler Agentic SOC combines AI agents with zero trust telemetry

Zscaler launched Agentic SOC, an AI-agent-driven security operations platform combining zero trust telemetry with frontier models from Anthropic and OpenAI.

Zscaler announced Agentic SOC, a security operations platform built around specialized AI agents for triage, root-cause investigation, verdict assignment, and automated threat containment. The platform pairs Zscaler's zero trust telemetry, drawn from roughly 750 billion daily transactions and a large decoy mesh network, with frontier models from Anthropic and OpenAI plus proprietary threat intelligence. It features closed-loop inline remediation that can isolate compromised users, block command-and-control traffic, and cut off lateral movement, alongside a context graph that correlates third-party data. Continuous threat hunting combines AI automation with human experts from Zscaler and Red Canary, and customer Maire Tecnimont is cited as an early adopter.

Help Net Security·Sep 9, 10:09 UTC · 7d agoTools

RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments

RSIAgent, a training-free multi-agent framework, builds reusable environment memory enabling Kimi-K3 and GLM-5.3 to beat GPT-6.

RSIAgent is a training-free framework for recursive self-improvement through autonomous memory construction, coordinating curriculum, actor, and verifier agents. It uses broad-then-deep exploration to capture environment structures, hidden constraints, and causal dependencies, and freezes the resulting memory for direct reuse without parameter updates. On OSWorld-v2 and Agent's Last Exam it substantially improves strong open-source models, enabling Kimi-K3 and GLM-5.3 to outperform frontier closed-source models including GPT-6.

Hugging Face daily papers·Sep 13, 20:00 UTC · 2d agoAI research2

Akuity gives AI agents operational context to safely ship software

Akuity launches Agentic Control Plane and MCP Server to govern AI agent actions inside production software delivery pipelines.

Akuity introduced an Agentic Control Plane and MCP Server that lets AI agents such as Claude, Codex, and Cursor access deployment and cluster context under existing identity, permission, and audit controls. MLB reported the product identified over 100 degraded applications within hours. Akuity positions it against open-source MCP servers granting raw access with no identity inheritance or policy layer.

Help Net Security·Sep 15, 08:37 UTC · 1d agoAI tools & infra

Inside Meta’s push to put robots to work in data centers

Meta is testing robots to perform technician tasks in its data centers, advancing automation of AI infrastructure operations.

Meta is testing robots to perform tasks currently done by human technicians in its data centers. The push signals ambitions to automate AI infrastructure operations at scale. The excerpt provides no details on robot suppliers, deployment scale, or timelines.

Ars Technica · AI·Aug 30, 11:03 UTC · 17d agoAI industry