Airavat: An Agentic Framework for Internet Measurement

TL;DR

Airavat is an innovative agentic framework that automates the generation, verification, and validation of Internet measurement workflows, ensuring methodological correctness and expert-level solutions through systematic reasoning and established research standards.

Contribution

It introduces the first agentic framework for Internet measurement that automates workflow creation and verification using specialized engines aligned with decades of research.

Findings

Generates workflows matching expert solutions

Ensures methodological correctness through verification

Identifies flaws missed by standard testing

Abstract

Internet measurement faces twin challenges: complex analyses require expert-level orchestration of tools, yet even syntactically correct implementations can have methodological flaws and can be difficult to verify. Democratizing measurement capabilities thus demands automating both workflow generation and verification against methodological standards established through decades of research. We present Airavat, the first agentic framework for Internet measurement workflow generation with systematic verification and validation. Airavat coordinates a set of agents mirroring expert reasoning: three agents handle problem decomposition, solution design, and code implementation, with assistance from a registry of existing tools. Two specialized engines ensure methodological correctness: a Verification Engine evaluates workflows against a knowledge graph encoding five decades of measurement research, while a Validation Engine identifies appropriate validation techniques grounded in established methodologies. Through four Internet measurement case studies, we demonstrate that Airavat (i) generates workflows matching expert-level solutions, (ii) makes sound architectural decisions, (iii) addresses novel problems without ground truth, and (iv) identifies methodological flaws missed by standard execution-based testing.