DepRadar: Agentic Coordination for Context Aware Defect Impact Analysis in Deep Learning Libraries

TL;DR

DepRadar is a framework that coordinates specialized agents to analyze and identify the impact of defects in deep learning libraries on downstream programs, improving accuracy and explainability.

Contribution

It introduces a novel agent coordination framework combining static analysis, domain rules, and client tracing for precise defect impact analysis in DL libraries.

Findings

Achieves 90% precision in defect identification

Identifies affected downstream programs with 90% recall

Outperforms baseline methods in impact analysis

Abstract

Deep learning libraries like Transformers and Megatron are now widely adopted in modern AI programs. However, when these libraries introduce defects, ranging from silent computation errors to subtle performance regressions, it is often challenging for downstream users to assess whether their own programs are affected. Such impact analysis requires not only understanding the defect semantics but also checking whether the client code satisfies complex triggering conditions involving configuration flags, runtime environments, and indirect API usage. We present DepRadar, an agent coordination framework for fine grained defect and impact analysis in DL library updates. DepRadar coordinates four specialized agents across three steps: 1. the PR Miner and Code Diff Analyzer extract structured defect semantics from commits or pull requests, 2. the Orchestrator Agent synthesizes these signals into a unified defect pattern with trigger conditions, and 3. the Impact Analyzer checks downstream programs to determine whether the defect can be triggered. To improve accuracy and explainability, DepRadar integrates static analysis with DL-specific domain rules for defect reasoning and client side tracing. We evaluate DepRadar on 157 PRs and 70 commits across two representative DL libraries. It achieves 90% precision in defect identification and generates high quality structured fields (average field score 1.6). On 122 client programs, DepRadar identifies affected cases with 90% recall and 80% precision, substantially outperforming other baselines.