Skip to content
NewA calmer, faster ZeroHour

Illusion of Depth: Revealing Hidden Stereo Vision Vulnerabilities in Depth Estimation

arXiv cs.CRby Sri Hrushikesh Varma Bhupathiraju ()1 min read2 · 1 read
AI summary · glm-5.3Summaries by Vani AI

Simple repeating patterns let attackers shift stereo-camera depth estimates by up to 20 meters, triggering emergency braking in autonomous driving frameworks at 40 km/h.

The paper reveals an intrinsic vulnerability in stereo cameras stemming from pixel sampling and calibration processes, letting attackers finely control estimated depth of real obstacles using simple repeating patterns without adversarial ML techniques. The attack was evaluated against BM and SGBM stereo matching algorithms, deep learning models PSMNet, MoCha-Stereo, and UniMatch, the stereo-LiDAR fusion model SGM-DDC, and commercial cameras ZED2 and Intel RealSense D435; on ZED2, obstacles can be displaced up to 20 meters farther or 12 meters closer. A 0.5-second attack triggered emergency braking in a popular autonomous driving framework, with feasibility confirmed at driving speeds up to 40 km/h using CARLA. State-of-the-art defenses proved ineffective, and the authors propose a similarity-score strategy to dynamically detect and suppress depth discrepancies.

Key facts
  • Repeating patterns displace ZED2 depth estimates up to 20 meters
  • 0.5-second attack triggers emergency braking in autonomous driving framework
  • Affects BM, SGBM, PSMNet, MoCha-Stereo, UniMatch, SGM-DDC, ZED2, RealSense D435
  • Feasible at driving speeds up to 40 km/h in CARLA
  • State-of-the-art defenses ineffective; similarity-score detection and suppression proposed
Analyze this story with Vani AIImpact, who is affected and what defenders should do, in a new chat

From the original article

1 min read at arxiv.org

Stereo cameras are integrated into autonomous systems such as self-driving cars, drones, and robots to offer precise depth estimation in a cost-effective manner compared to LiDAR technology. In this work, we reveal an intrinsic vulnerability in stereo cameras that stems from their pixel sampling and calibration processes, which can influence the outputs of stereo matching algorithms.

arXiv cs.CR

By Sri Hrushikesh Varma Bhupathiraju · arxiv.org

Read the full article at arXiv cs.CR

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.