NetInspector: Measuring and Improving LLM Capabilities for Reliable Intent-Based Networking Policy Generation
NetInspector grounds LLM network-policy decisions and cuts security false negatives by over 30%.
The paper finds fine-tuned LLMs can translate operator intent into network configuration but often fail to flag intents that violate existing security policy. The authors attribute those false negatives to a lack of persistent grounding in topology and group hierarchy, not weak logical reasoning. NetInspector is a three-layer agent that retrieves verifiable facts from a live environment before approval. On the 2,224-sample NetInspector-Bench, covering campus, enterprise, and WAN topologies, it cuts false-negative rate by more than 30 percent versus ungrounded baselines and stays robust under phrasing shifts.
- Fine-tuned LLMs translate network intents well but miss policy violations.
- Errors come from missing topology and group-hierarchy grounding, not weak logic.
- NetInspector retrieves live network facts before any policy approval.
- On a 2,224-sample benchmark, relative false negatives fall by over 30 percent.
From the original article
1 min read at arxiv.orgModern networks are large in scale and heterogeneous in configuration, making manual policy management increasingly impractical. Intent-Based Networking (IBN) addresses this by automating the translation of high-level operator goals into low-level network configurations.
By Yuxuan Zhang · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.