Combining Exploratory Analysis and Automated Analysis for Anomaly Detection in Real-Time Data Streams
A prototype monitors live BGP traffic, pairing automated anomaly alerts with visualization for hijack and denial-of-service context.
The paper studies how exploratory visualization complements automated analysis when analysts monitor real-time security data and risk missing linked events. Its prototype computes indicators and threat alerts on live Border Gateway Protocol traffic and visualizes the context of each alert. The authors note BGP can be hijacked to propagate spam or launch denial-of-service attacks, and that some attack scenarios are too elaborate to fully automate. The discussion is aimed at students, researchers, and developers of real-time monitoring systems.
- Prototype computes BGP indicators and threat alerts in real time.
- Visualization supplies context that automated alerts alone omit.
- BGP hijacks can spread spam or enable denial-of-service.
- Elaborate BGP attacks are difficult to detect fully automatically.
Full article275 words · extracted from arxiv.org · click to collapse
Security analysts can become overwhelmed with monitoring real-time security information that is important to help them defend their network. They also tend to focus on a limited portion of the alerts, and therefore risk missing important events and links between them. At the heart of the problem is the system that analysts use to detect, explore, and respond to cyber-attacks. Developers of security analysis systems face the challenge of developing a system that can present different sources of information at multiple levels of abstraction, while also creating a system that is intuitive to use. In this article, we examine the complementary nature of exploratory analysis and automated analysis by testing the development of a system that monitors real-time Border Gateway Protocol (BGP) traffic for anomalies that might indicate security threats. BGP is an essential component for supporting the infrastructure of the Internet; however, it is also highly vulnerable and can be hijacked by attackers to propagate spam or launch denial-of-service attacks. Some of the attack scenarios on the BGP infrastructure can be quite elaborate, and it is difficult, if not impossible, to fully automate the detection of such attacks. This article makes two contributions: i) it describes a prototype platform for computing indicators and threat alerts in real time and for visualizing the context of an alert, and ii) it discusses the interaction of exploratory analysis (visualization) and automated analysis. This article is relevant to students, security researchers, and developers who are interested in the development or use of real-time security monitoring systems. They will gain insights into the complementary aspects of automated analysis and exploratory analysis through the development of a real-time streaming system.
Text extracted automatically; images, tables and formatting may be missing. Original: https://arxiv.org/abs/2609.21222