Search: “evaluation framework”

12 stories in the last 24h

Horizon3.ai releases a scorecard for evaluating CTEM technologies on demonstrated exploitability and remediation evidence.

Horizon3.ai published a downloadable CTEM Technology Evaluation Scorecard for assessing security technologies across the six-stage Continuous Threat Exposure Management operating model, from discovering exposure through verifying risk removal. The scorecard uses a 0-3 scale based on repeatable evidence demonstrated in the evaluator's environment rather than stated feature claims, with emphasis on validating exploitability and verifying remediation. It is vendor marketing material aimed at security leaders and evaluation teams.

Horizon3.ai16:56 UTC · 1h agoIndustry 2 sources

Major Cyber Threat Detection Vendors Shift from MITRE to UK Testing Program

SE Labs launched PIVOT, a six-month vendor detection testing program backed by CrowdStrike, Fortinet, Palo Alto Networks and Sophos, as major vendors exit MITRE evaluations.

SE Labs unveiled PIVOT on September 15, a six-month testing program in which its ethical hackers replicate nation-state and criminal attack chains against participating vendor products, with results due January 2027. Broadcom (Symantec/Carbon Black), CrowdStrike, Fortinet, Palo Alto Networks and Sophos have confirmed participation, and Gartner and Forrester analysts will verify the underlying evidence before publication. The launch follows declining participation in MITRE Engenuity ATT&CK Evaluations: Enterprise, which fell from 30 vendors in 2023 to 11 in 2025 after public withdrawals by Microsoft, SentinelOne and Palo Alto Networks.

Infosecurity Magazineupdated 09:52 UTC · 8h agofirst 09:00 UTC · 9h agoIndustry 14 sources

CVE-2026-86089: Apache NiFi: Missing Process Group Authorization for Connector Migration

Apache NiFi 2.11.0 Connector Migration REST APIs authorize only against the target Connector, skipping Process Group access checks (CVE-2026-86089, Low).

Apache NiFi 2.11.0 supports migrating version-controlled Process Group contents into a Connector via REST API methods that list eligible migration sources and submit migration requests. Both methods were authorized only against the target Connector, without evaluating user access to the involved Process Groups. The flaw, tracked as CVE-2026-86089, is rated Low severity and affects the nifi-web-api component.

oss-security15:19 UTC · 2h agoVulnerability 3 sources CVE-2026-86089

What happens when AI agent governance is missing at scale

meshIQ engineering head Gourab Basu argues AI agent governance must inspect proposed tool calls in-flow, since prompts alone cannot control nondeterministic agents.

In a Help Net Security interview, Gourab Basu, Global Head of Engineering at meshIQ, argues that prompt instructions are an insufficient control boundary for nondeterministic AI agents. He advocates a framework-independent governance engine that inspects proposed tool calls and parameters before execution, citing an example of pausing refunds above $100 for human approval. He warns that scaling from ten to a thousand agents makes manual oversight and destination-side controls unworkable, so governance must sit inside the agent execution flow across frameworks such as FastMCP.

Help Net Security06:00 UTC · 12h agoAI safety & security

AIUC Raises $40 Million to Certify Enterprise AI Agents

AIUC raised $40 million in Series A funding led by Ribbit Capital to expand its AIUC-1 standard certifying enterprise AI agents against security risks.

AIUC's Series A, led by Ribbit Capital with participation from First Harmonic, brings the company's total funding to $55 million. Its AIUC-1 standard tests AI agents against roughly 5,000 adversarial scenarios covering jailbreaks, prompt injections, hallucinations, anomalous behavior, and data leaks, with quarterly audits. Certified agents include Cursor, ElevenLabs, Fin, Harvey, KPMG, Lovable, and UiPath; the funds will extend audits, standards, and insurance to frontier models.

SecurityWeek13:38 UTC · 4h agoAI industry

The DeepMind Institutenew

Google DeepMind launches the DeepMind Institute, publishing essays on AGI reasoning transparency, economic policy for AGI, and dynamic frontier AI capability testing.

Google DeepMind introduced the DeepMind Institute, an interdisciplinary initiative on the implications of approaching AGI, with contributors including Demis Hassabis, Shane Legg, James Manyika, Rohin Shah, and Anca Dragan. Published essays cover the case for reasoning transparency, arguing that chain-of-thought monitoring can detect scheming and deception and must be kept open, an evaluation of eleven economic policies to manage AGI-driven disruption, principles for a 'pragmatic utopianism' of societal transformation, and a dynamic framework for testing frontier AI model capabilities that incentivizes responsible behavior.

Hacker News · securityupdated 17:00 UTC · 1h agofirst 14:32 UTC · 3h agoAI safety & security 2 sources HN 27↑ · 4 comments

Big Tech’s AI safety rift signals disruption and disparity for enterprises

Diverging AI safety stances among major labs will make frontier model access less predictable, pushing enterprises toward routing layers and independent validation.

A public rift among leading AI labs over safety approaches - Meta's Zuckerberg backing neutral evaluators, Dario Amodei urging a slower pace, and Sam Altman calling for collaboration on standards - is creating operational challenges for enterprise IT. Analysts from Gartner and others say divergent vendor release schedules, access tiers, and regional restrictions will make frontier model access less predictable, effectively treating frontier AI as a managed supply with pricing premiums. Recommendations include routing layers between applications and providers, contractual deprecation terms, and independent validation of models before production use.

CSO Online16:19 UTC · 1h agoAI industry

DeepZero: Open-source hunting for vulnerable Windows drivers

DeepZero, a new open-source engine, automates discovery of exploitable Windows kernel drivers for BYOVD attacks using Ghidra, Semgrep, and an LLM.

DeepZero is a free, open-source Python pipeline orchestrator that automates hunting for exploitable Windows kernel drivers relevant to BYOVD (bring your own vulnerable driver) attacks. Its seven-stage YAML pipeline parses PE headers, filters for kernel-mode drivers with IOCTL surfaces, excludes drivers listed on loldrivers.io, then runs headless Ghidra decompilation, Semgrep scanning, and an LLM-based exploitability assessment. The maintainer reports multiple verified vulnerabilities in the Snappy Driver Installer corpus, some still in the disclosure process, and notes findings involving plug-and-play-created device objects may need physical hardware to confirm.

Help Net Security05:30 UTC · 12h agoTools

Cohesity adds recovery capabilities for AI agents and the data they manage

Cohesity launched Agent Resilience to discover, protect, and recover AI agent memory, configuration, and agent-managed data, debuting with Amazon Bedrock integration.

At Cohesity Catalyst, Cohesity introduced Agent Resilience within Cohesity Data Cloud, protecting AI agent memory and configuration with snapshot architecture, immutable backups, and clean-room recovery, plus recovery for databases and file systems that agents manage. It launches with Amazon Bedrock integration, support for Microsoft and Google platforms planned, and general availability targeted for year-end. The company cited Gartner's prediction that up to 40% of enterprise applications will include task-specific agents by 2026, and Cohesity research showing 56% of organizations are unprepared to detect or contain unintended agent actions while 58% lack confidence in verifying AI model integrity after attacks. Cohesity also outlined an Autonomous Cyber Resilience vision using agentic workflows and introduced the AI Resilience Academy.

Help Net Security10:58 UTC · 7h agoTools

Top 10 Best AWS Security Tools in 2026

Editorial roundup ranking the ten best AWS security tools of 2026, from native GuardDuty and Security Hub to CNAPPs like Wiz and Prisma Cloud.

The article recommends enabling AWS-native services first: GuardDuty for threat detection, Security Hub for posture aggregation, the free IAM Access Analyzer, plus CloudTrail logging and Config rules. It then reviews third-party platforms including Wiz, Palo Alto Prisma Cloud, CrowdStrike Falcon Cloud Security, Trend Micro Cloud One, and Orca Security. It is an editorial vendor assessment with pricing described by model only, highlighting cross-account correlation and attack-path prioritization as third-party differentiators.

Cyber Security News09:57 UTC · 8h agoTools

A brief history of AI executives calling for regulation

The Verge chronicles the history of AI executives, from Samuel Butler and Turing-era warnings to Altman and Musk, publicly calling for AI regulation.

The article traces recurring calls for AI regulation, from Samuel Butler's 1863 warnings and Alan Turing's 1951 lecture to Bill Joy's 2000 essay and Microsoft's 2018 facial recognition stance. Modern examples include Elon Musk's 2017 remarks to US governors, the 2023 Future of Life Institute pause letter, and Sam Altman's 2023 Senate testimony. It argues such appeals from industry leaders who profit from AI warrant skepticism.

The Verge · AI12:00 UTC · 6h agoAI policy