Search: “ArcBridge”

Smart search ranks by meaning as well as keywords (one row per story, last 45 days).

GPT-6 Astra, Looped Transformers, and Hidden Reasoning

OpenAI released GPT-6 Astra, its strongest model to date, with standout 3D rendering and computer-use performance and 99.9% on ARC-AGI-3.

Sebastian Raschka reviews OpenAI's GPT-6 Astra, calling it the best model he has used, with disproportionate gains in 3D rendering, animation, and computer use through the Codex/ChatGPT harness. The model scores 99.9% on ARC-AGI-3 versus 7.8% for GPT-5.6 Sol and leads the Artificial Analysis Coding Agent Index, though gains on independent aggregate indices are more incremental. The article also explains looped transformer/recurrent depth architecture rumors, speculation that Astra hides its chain-of-thought reasoning, and recent research insights on the topic.

Hacker News · AI·updated Sep 12, 13:10 UTC · 3d ago·first Sep 9, 14:37 UTC · 6d agoModel release 10 sourcesHN 84↑ · 12 comments2

92

Chinese espionage groups swarm to exploit triple-link chain of zero-days

At least four China-aligned espionage groups chained three zero-days in Chromium browsers and Windows ALPC for espionage since late August.

Proofpoint observed at least four state-aligned threat groups, starting with TA412/Violet Typhoon/APT31 on August 28, chaining three zero-days in the 'BlueMoon' exploit chain targeting Chrome, Chromium-based browsers and Microsoft Windows. The chain includes RCE flaws in Chromium's JavaScript engine (CVE-2026-85046, CVE-2026-87491) and a Windows Advanced Local Procedure Call privilege-escalation zero-day (CVE-2026-85880), enabling sandbox code execution, sandbox escape and system privileges. APT31 delivered the chain via phishing links to NGOs, mining and commodity trading firms in the US, installing a browser extension disguised as Google Gemini to surveil activity and steal credentials. Other groups (UNK_LateNight, UNK_DoubleCheck, UNK_QuietRacket) targeted US aerospace, Vietnamese manufacturing, and Indonesian and Singaporean organizations; fewer than 20 victims were directly observed but the true count is likely higher.

CyberScoop·updated Sep 15, 10:17 UTC · 21h ago·first Sep 9, 21:17 UTC · 6d agoExploit / PoC in the wild 20 sourcesCVE-2026-85046CVE-2026-87491CVE-2026-858802· 1 read

88

Nimbus Manticore Expands Toolset With TWOSTROKE

Group-IB found new infrastructure and TWOSTROKE-like malware used by IRGC-linked Nimbus Manticore, indicating expanded Middle East and Europe targeting.

Group-IB reported new Tortoiseshell infrastructure spanning Europe and the Middle East and two previously undocumented tools from IRGC-linked Nimbus Manticore (UNC1549): a reverse SSH tunneling utility connecting to 172.86.98.113 on port 443, and a C++ backdoor masquerading as wtsapi32.dll with three hard-coded C2 servers. The backdoor overlaps with TWOSTROKE and supports file transfer, execution, host information gathering, and persistence. Findings build on Kaspersky's report of the NightLedger backdoor and WebSocket tunnelers BridgeHead and ArcBridge, and suggest expanded targeting beyond the Middle East into Europe.

The Hacker News·Aug 26, 15:35 UTC · 20d agoThreat actor in the wild

60

Technical Manual for a Toolkit for Measuring Contextual Individuation in Transformer Language Models

An open methodology toolkit measures whether transformer language models contextualize fixed word forms across domains using bridge forms and layer-wise silhouette analysis.

The manual documents an open toolkit built around 'bridge forms' - identical written words recurring across two or more subject domains with a different sense in each - to test whether transformer language models individuate word occurrences by context beyond the embedding layer. It covers declarative specification of bridge forms, Wikipedia corpus acquisition, occurrence localization, layer-wise representation extraction, domain-pairwise silhouette measurement, and visualization, justifying each choice against failure modes such as sense contamination and subword-tokenization misalignment. It is a methodological and implementation reference and reports no empirical results.

arXiv cs.AI / cs.LG / cs.CL·Sep 4, 16:38 UTC · 11d agoAI research

14

Angry Birds: Toy Ghouls’ new toys

Kaspersky tracks ransomware group Toy Ghouls deploying new custom backdoors, mqtt-bird-agent and matrix-bird-agent, using HiveMQ MQTT and Element as C2 channels.

Kaspersky reports that Toy Ghouls (also known as Bearlyfy, Laboo.boo and Feral Wolf), a financially motivated group targeting Russian organizations since 2025, shifted from leaked Babuk and LockBit builders and public GitHub tools to its custom GenieLocker ransomware. In early July 2026 the group deployed two custom backdoors: mqtt-bird-agent 0.1.0 using the public HiveMQ MQTT broker as C2, and matrix-bird-agent 0.1.0 using the Element messenger. The backdoors are delivered via WinRM using Evil-WinRM and WinRM-fs, persist as Windows services, and encrypt their configuration with ChaCha20-Poly1305 keyed to the machine's MachineGuid registry value.

Kaspersky Securelist·Sep 4, 10:00 UTC · 11d agoThreat actor

45

IntentFuzz: A Protocol-Aware Fuzzer for Automated Invariant Violation Detection in Intent-Based Cross-Chain Bridges

IntentFuzz protocol-aware fuzzer recovers bridge structure from unannotated Solidity and confirmed 22 invariant violations across 24 real-world deployments.

IntentFuzz formalizes a taxonomy separating invariant violations from settlement exposures in intent-based cross-chain bridges, then recovers a bridge's intent structure and deposit/fill function roles from unannotated Solidity source. It classified deposit and fill functions with 100% recall and 82% combined precision, and achieved 100% recall and precision on 23 planted-bug mutants. Across 24 real-world deployments it confirmed 17 genuine invariant violations with heuristic-only input generation, rising to 22 with its LLM-assisted tier, spanning eight vulnerable GitHub repositories with findings reproducible against public deployed bytecode.

arXiv cs.CR·Sep 11, 16:03 UTC · 4d agoResearch1

50

Iranian Hackers Pose as Recruiters to Deliver Cross

Kaspersky attributes new cross-platform RATs NodeRabbit and PollCat to Iranian group Nimbus Manticore, spread via recruiter-themed LinkedIn lures.

Kaspersky links two previously undocumented malware families, NodeRabbit (Node.js) and PollCat (obfuscated JavaScript), to the Iranian threat actor Nimbus Manticore, also known as Iranian Dream Job. Victims in Afghanistan, Egypt, and Ethiopia received trojanized coding challenge archives containing fake npm packages (colorized_terminal, pretty-log) that silently launched the RATs as background processes. NodeRabbit contacts Azure-hosted C2 servers via checkin, task, and result API endpoints and supports 11 commands including shell execution, file operations, and network enumeration. Persistence is platform-specific: Windows Run keys or scheduled tasks, Linux cron entries, and macOS launch agents, impersonating Microsoft Edge updates or Intel's Driver & Support Assistant.

The Hacker News·Sep 2, 10:20 UTC · 13d agoThreat actor

55

How law firm Gilbert + Tobin governs and scales AI with OpenAI

OpenAI details how law firm Gilbert + Tobin scales ChatGPT Enterprise and Codex firm-wide under CEO-led governance with human accountability.

OpenAI published a customer story describing Gilbert + Tobin's adoption of ChatGPT Enterprise and Codex across the law firm. The firm pairs executive-level commitment with formal governance and human accountability to expand AI use in legal workflows. The piece is a promotional case study, with no new product capabilities or research announced.

OpenAI News·Sep 1, 01:00 UTC · 15d agoAI industry1

15

An open letter to Dario: if you mean it, open the weights

Open letter urges Dario Amodei to champion a law forcing all publicly released AI models to ship as open weights, arguing regulation otherwise gets captured.

A blogger responds to Anthropic's essay 'We Must Pace the Frontier' by proposing a law requiring any AI model offered to the public be released as open weights, citing Anthropic's 'Fable' and OpenAI's 'Astra' as examples. The author argues frontier lab valuations depend on proprietary weights, so mandatory openness would cut funding for future training runs and slow progress across all labs. The letter contends regulatory approaches like embedded evaluators, compute thresholds, and antitrust waivers inevitably lead to regulatory capture favoring incumbents. It appeals to Amodei's record on safety, export controls, and Anthropic's PBC structure to back the proposal.

Hacker News · AI·Sep 12, 19:15 UTC · 3d agoAI policyHN 40↑ · 1 comments1

15

Attack Chains, Not Just Attack Surfaces: Why Testing Individual Techniques Misses the Point

Filigran introduces Attack Chaining in OpenAEV to continuously simulate multi-stage attack paths, exposing gaps that isolated MITRE ATT&CK technique testing misses.

Filigran announced Attack Chaining, a new scenario type in its OpenAEV platform that links individual techniques into automated, continuously-run multi-stage attack paths, using each step's real output (credentials, tokens, open ports) to branch dynamically toward a final objective. The article cites Filigran's State of Threat Management report, in which 93% of security leaders reported a business-impacting cyberattack in the past 12 months, 88% said AI accelerates attackers, and 84% blamed siloed tools and disconnected testing. The 2025 DGFiP breach is cited as an example where individually survivable weaknesses chained into a major intrusion. The feature includes conditional chaining logic, live attack path mapping, structured findings for identifying chokepoints, and predefined scope and safety guardrails.

The Hacker News·Sep 15, 11:26 UTC · 20h agoTools

18

ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding

ShallowStream builds streaming-video retrieval indexes from shallow MLLM layers, cutting per-frame prefill latency by up to 52.1x.

ShallowStream is a framework for streaming video understanding with multimodal LLMs that uses the model's shallow layers to simultaneously encode frames and maintain an always-on lightweight retrieval index via shallow-layer KV caches, avoiding full-depth prefill for every incoming frame. At query time, shallow-layer attention scores plus a diversity-aware selection strategy retrieve relevant context frames. It reports performance on par with the strongest existing streaming methods while reducing per-frame prefill latency by up to 52.1x and 10-second end-to-end latency by up to 11.9x, with code released on GitHub.

Hugging Face daily papers·Sep 1, 20:00 UTC · 14d agoAI research

24

Legora reviewed 41 documents in minutes with GPT-6 Astra

Legal-tech firm Legora says GPT-6 Astra reviewed 41 financial documents in minutes, catching all four planted errors and boosting accuracy about 40%.

Legal technology company Legora reported using OpenAI's GPT-6 Astra to review 41 financial-statement documents in minutes. The workflow found all four planted errors and improved performance by nearly 40% compared to prior processes. The case study highlights AI-assisted financial review adoption in professional services.

OpenAI News·Sep 3, 12:00 UTC · 12d agoAI industry

15

Ambient @ EgoLongQA 2026: Distilling Long-Video perception into a Sub-2B Model

Ambient team wins EgoLongQA 2026 sub-2B division by distilling an agentic long-video perception pipeline into a 2B vision-language model.

Ambient's entry to the EgoLongQA track of the Wearable-AI Challenge at ECCV 2026 placed first in the <=2B parameter division with 0.8279 on the held-out test set. The system distills the junior perception module of a tool-using agentic pipeline into a 2B student, reaching 89% of the pipeline's accuracy with 1.1% of its parameters and lifting a 27.1% base model to 81.4%. To meet the division limit, the multilingual embedding table is pruned from 248,320 to 143,469 rows, reaching 1.9985B parameters with provably identical logits on retained rows.

Hugging Face daily papers·Sep 9, 20:00 UTC · 6d agoAI research

35

GPT-6 Astra: an automated AI Engineer you can hire for <$6 an hour

OpenAI launches GPT-6 Astra, a frontier model scoring 97.6% on FrontierMath and 99.9% on ARC-AGI-3, capable of autonomous AI engineering at roughly $6 per hour.

OpenAI launched GPT-6 Astra, described as its first Stargate and lightly looped frontier model, beating Fable 5.1 on many metrics and saturating the hardest FrontierMath (97.6%) and ARC-AGI-3 (99.9%) benchmarks. Latent Space tested the model with over 20 billion tokens, reporting it can train and select models, label data, deploy and debug systems, and orchestrate 20-50 parallel subagents. The authors measured about $6 per hour of agentic engineering at 33 tokens per second, with token efficiency independently confirmed by Artificial Analysis.

Latent Space·Sep 3, 21:09 UTC · 12d agoModel release1

93

How Fragile Is Safety Alignment at Frontier Scale? A Single-Direction Attack on a 320B MoE

Researchers show directional ablation breaks refusal in GLM-5.3-Flash, a 320B-parameter MoE, cutting refusal by 41–89 points across seven benchmarks.

The study extends directional ablation, a white-box attack that removes an aligned LLM's refusal behavior, from dense models up to ~70B parameters to GLM-5.3-Flash, a 320B-parameter mixture-of-experts model with 288 routed experts, four-wide hyper-connection residual, and block-FP8 quantization. Editing attention, dense, and routed-expert writers jointly removes 0.776 of refusal, with 74% of the effect existing only under the joint intervention; the conventional module-name-based recipe reaches only 0.066 and fails silently on MoE architectures. The attack yields 41–89 percentage-point reductions in refusal across seven harmful benchmarks with no detected capability change, and a category-concentrated refusal residue survives all edits at ranks 1 to 12.

arXiv cs.CR·Sep 9, 06:48 UTC · 7d agoAI safety & security

45

SenseNova-U1.5: Towards Native Unified Visual Intelligence

SenseTime releases SenseNova-U1.5, an 8B-MoT encoder-free multimodal model unifying visual understanding, reasoning, and generation with native 4K resolution.

SenseNova-U1.5 is an 8B mixture-of-transformers multimodal model with an encoder-free, VAE-free architecture that understands, reasons about, and generates visual content at native resolutions up to 4K. Post-training optimizes specialized experts for visual aesthetics, bilingual text rendering, infographic generation, and image editing, consolidated through multi-expert on-policy distillation. Evaluations report gains in image fidelity, text rendering, multi-reference editing, and instruction following. The team plans to open-source training code including supervised fine-tuning, reinforcement learning, and on-policy distillation.

Hugging Face daily papers·Sep 9, 20:00 UTC · 6d agoModel release

48

[AINews] Muse Spark 1.3 matches GPT-5.6-Sol, confirming Meta Superintelligence as the newest Frontier Lab, >90% discount for training

Meta's Muse Spark 1.3 reportedly ranks as the world's #3 model, matching frontier models from OpenAI and Anthropic with planned open weights.

The Latent Space AI News roundup leads with Muse Spark 1.3, promised in Zuckerberg's letter, which ranks #3 worldwide per AAII, is slated for open weights, and uses a pricing model over 90% cheaper when users opt in to training. The issue also covers the rumored Gemini 3.8 Flash launch and analysis arguing OpenAI's rumored looped-transformer 'Astra' architecture is a modest tweak rather than a breakthrough. Additional coverage includes ByteDance Seed's HarnessDev harness-evaluation benchmark, a retrieval-invoked actual-use evaluation method, Stanford's revamped agent engineering curricula, and Photon 2.1 adding TTS models and NVIDIA B200 support.

Latent Space·Sep 3, 04:38 UTC · 13d agoModel release1

74

MOONWALK: Mediating Operations with Intent-Evidence-Action Alignment Across Junior-Supervisor Review Workflows in Animation/VFX Pre-Production

MOONWALK introduces an intent-evidence-action alignment workflow for animation/VFX reviews where AI handles administrative coordination while artists keep creative authority.

MOONWALK is a pre-production review system that articulates creative intent into a shared project record, anchors review judgments to grounded evidence, and converts authorized decisions into concrete revision tasks. AI components handle administrative coordination such as flagging missing context and organizing notes, not creative direction. An in-studio study against a chat-only AI interface showed stronger intent alignment, decision traceability, and checklist executability.

arXiv cs.AI / cs.LG / cs.CL·Sep 9, 16:10 UTC · 6d agoAI research

15

Inside Meta’s Infrastructure Lab

Meta offers a tour of its Infrastructure Lab, showcasing custom hardware being developed to power next-generation AI systems.

Meta Newsroom published a post in which Tom Shaw gives an inside look at Meta's Infrastructure Lab and the hardware the company is developing to support its next generation of AI workloads. The piece is a corporate showcase of custom infrastructure efforts rather than a product launch, benchmark result, or security event.

Meta Newsroom·Sep 1, 20:24 UTC · 14d agoAI industry

22

Propagation Model for SSC attacks: Why SBOM (tools) don't tell the whole truth

Study shows open-source SBOM tools only cover structural exposure and vulnerability presence, missing code reachability and taint-path analysis stages.

An arXiv paper proposes a four-stage propagation model for software supply chain attack effects and empirically evaluates four open-source SBOM tools against it using three projects and the Log4j vulnerability as the test case. Current SBOM tools systematically support only Stage 1 (structural exposure) and Stage 2 (vulnerability class presence), while Stage 3 (code reachability) and Stage 4 (taint path analysis) require capabilities absent from the SBOM ecosystem. The authors argue propagation-centred SSC security research is needed to prevent cyber risk from evolving into systemic risk.

arXiv cs.CR·Sep 4, 17:31 UTC · 11d agoResearch1

38

GPT‑6 Astra

OpenAI launches GPT-6 Astra, a frontier model scoring 99.9% on ARC-AGI 3, priced $10/$50 per million tokens, rolling out to ChatGPT and API.

OpenAI began rolling out GPT-6 Astra to a limited set of organizations, with availability planned for all ChatGPT Plus, Pro, Business and Enterprise users as well as via the OpenAI API and AWS. API pricing matches Anthropic's Claude Fable 5 and 5.1 at $10 per million input tokens and $50 per million output tokens. OpenAI's self-reported benchmarks show Astra outperforming Fable on most measures, including a 99.9% score on the ARC-AGI 3 benchmark released in March.

Simon Willison·Sep 3, 20:18 UTC · 12d agoModel release1

90

Agnes-AI/Agnes-3.0-Flash — new model trending #30 on Hugging Face

Agnes AI releases open-weight Agnes-3.0-Flash Preview, a 33B multimodal model with 262k-token context under Apache 2.0.

Agnes AI released Agnes-3.0-Flash Preview, an open-weights multimodal checkpoint with 33B parameters and a 262,144-token context window under Apache 2.0. The model supports text, image, and video understanding, tool calling, and adjustable reasoning effort. The repo clarifies this preview checkpoint is distinct from the production/API Agnes 3.0 Flash model, which uses a different configuration with a 1M-token context window. Reported reference results include IFBench 74.20 and SciCode 38.08 against peers such as Qwen3.6-35B-A3B, Kimi K2.5, and MiniMax M3.

Hugging Face trending models·Sep 11, 15:50 UTC · 4d agoModel release

45

Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama

Opinion piece urges migrating 35KB preprompts from Anthropic/OpenAI to self-hosted Ollama, citing session privacy risks and safety filters blocking security research.

The author documents gotchas migrating 35KB preprompts from Claude Opus to self-hosted Ollama, motivated by fears that frontier providers train on user sessions, citing the OpenAI Navier-Stokes controversy. The piece argues inference providers cannot audit their own retention or training pipelines and that only self-hosted hardware offers verifiable privacy. It also criticizes frontier safety filters for refusing vulnerability research tasks and calls for models that support exploitability testing in CI/CD pipelines.

Hacker News · AI·Sep 14, 13:59 UTC · 1d agoAI industryHN 41↑ · 13 comments1

15

Stampli cuts launch hours by 68% using ChatGPT Work

AP automation firm Stampli used OpenAI Codex and ChatGPT Work to cut product launch production hours by 68%.

Stampli, an accounts-payable automation company, compressed weeks of launch production into days using Codex and ChatGPT Work. Facing a fixed deadline with design resources committed elsewhere, the team reported a 68% reduction in launch hours. The piece is an OpenAI customer adoption case study.

OpenAI News·Aug 20, 00:00 UTC · 27d agoAI industry

20

Tables Decoded: DELTA for Structure, TARQA for Understanding

DELTA extracts tables into compact OTSL text and TARQA fine-tunes LLMs on it, beating VLM baselines on table QA.

DELTA separates physical structure recognition, logical structure recognition, and OCR to output tables in Optimised Table Structure Language (OTSL), a compact unified format encoding cell arrangements and content. It achieves TEDS-Structure scores comparable to state-of-the-art methods across FinTabNet, PubTabNet, and PubTables-1M, with robustness tested on a curated Hindi benchmark, TORQUE. TARQA, an LLM fine-tuned on OTSL sequences, gains 9.3 percentage points on WTQ TabQA and 9.2 points on FinTabNetQA TabVQA; code, models, and the benchmark are released on GitHub.

arXiv cs.AI / cs.LG / cs.CL·Sep 15, 16:59 UTC · 15h agoAI research

18

GPT-6 Astra appears to show a "step change" in spatial reasoning based on early benchmarks

Early StationeryBench robotics results show OpenAI's GPT-6 Astra far ahead of Ai2's MolmoAct2 at dual-arm manipulation, completing 7 of 100 tasks versus zero.

A new robotics benchmark called StationeryBench tested OpenAI's GPT-6 Astra against Ai2's MolmoAct2 on five desk-object tasks using identical dual-arm YAM robots over 200 trials. Astra fully completed 7 of 100 tasks with a median progress score of 46 out of 100, while MolmoAct2 completed zero with a median score of 12. Cornell and Google DeepMind researcher Yoav Artzi called the result a 'step change in spatial reasoning' and noted Astra approaches human-level accuracy on the unpublished REMAP benchmark. He speculated OpenAI trained the model on large amounts of 3D data such as Blender scenes, and OpenAI reportedly plans consumer robots.

The Decoder·Sep 12, 14:26 UTC · 3d agoAI industry1

48

Polimill builds Japan's next-generation public AI infrastructure

OpenAI says Japanese company Polimill uses GPT models and Codex to give municipalities searchable access to administrative knowledge.

OpenAI published a customer story describing how Polimill, a Japanese civic technology company, builds public AI infrastructure using OpenAI GPT models and Codex. The tools let municipalities search and reuse administrative knowledge and are intended to accelerate internal development workflows.

OpenAI News·Aug 31, 07:00 UTC · 16d agoAI industry

25

Emergency Department Revisit Quality Review Screening: Exploring Human Decision-Making and Artificial Intelligence Support

A retrospective study found GPT-4 over-flagged emergency department revisit cases while an LLM knowledge-graph screener achieved 83-100% positive predictive value.

In an exploratory retrospective study of 99 emergency department diagnosis pairs from a multihospital health system, clinicians and GPT-4 independently judged whether revisit pairs warranted further assessment. GPT-4 responses correlated poorly with clinicians, flagging 94% of pairs for follow-up, 4.4-13.3 times more than clinicians, though prompt engineering was minimal. An algorithm leveraging an LLM-populated knowledge graph (KGA) achieved 83-100% positive predictive value against at least one clinician rater, suggesting LLM-based screening could broaden revisit quality review without substantially increasing reviewer workload.

arXiv cs.AI / cs.LG / cs.CL·Sep 9, 16:37 UTC · 6d agoAI research1

20

GPT-6 Astra Scores 100% on ExploitBench as OpenAI Blocks PoC Exploit Requests

OpenAI releases GPT-6 Astra, scoring 100% on ExploitBench, but restricts it to secure code review by blocking PoC exploit generation.

OpenAI officially unveiled GPT-6 Astra days after the model reached the "Critical" cybersecurity capability threshold under its Preparedness Framework. The model claims 100% on ExploitBench (versus 78.5% for GPT-5.6 Sol), 98% on FrontierMath Tier 4, and 99.9% on ARC-AGI-3, and demonstrated exploit development including on two zero-days disclosed between June and August 2026. The released version is limited to secure code review and patching and refuses proof-of-concept exploit requests, with less restrictive safeguards planned via OpenAI Daybreak. OpenAI also launched a $1 billion "Daybreak for Frontline Defenders" program for critical infrastructure sectors and a pilot with the US MS-ISAC for public sector and water system defenders.

The Hacker News·Sep 4, 06:47 UTC · 12d agoModel release1

92

Bitsight connects threat intelligence and exposure monitoring across the supply chain

Bitsight made Beacon generally available, combining supply-chain exposure monitoring with MCP support to feed threat intelligence into AI workflows.

Bitsight announced general availability of Beacon, which continuously monitors critical vendors for exposure, vulnerabilities, malicious activity, intrusion, stolen credentials and compromise. New Model Context Protocol (MCP) and agentic capabilities push Bitsight intelligence into AI-enabled workflows, with over 400 customers signing up for early access in one month. The company cites data that third parties now account for almost half of enterprise breaches, up over 60% year over year.

Help Net Security·Sep 14, 13:42 UTC · 1d agoTools

18

A Princeton Researcher Proposes Recurrent Looped Transformer (RLT) that Carries Decoder State across Every Token, Fixing 96 Blocks per Token with Unbounded Temporal Depth

Princeton researcher Yifan Zhang proposes Recurrent Looped Transformer, carrying full decoder state across every token for unbounded temporal depth.

Yifan Zhang's technical report defines the Recurrent Looped Transformer (RLT), pairing a causal encoder with a recurrent decoder whose final output and layerwise sliding-window attention cache carry into every subsequent token with no prompt-response boundary reset. The reference configuration ties 48 encoder and 48 decoder layers, executing 96 logical blocks per token while the state path grows to 48t blocks after t tokens at fixed per-token compute. The report details RL replay contracts that rebuild all states under current parameters and exact prefix snapshots for multi-turn serving, but explicitly reports no measured efficiency, reasoning quality, or scaling results.

MarkTechPost·Sep 13, 17:02 UTC · 2d agoAI research1

40