Beware the evolving 'intelligent' web service! An integration architecture tactic to guard AI-first components
Alex Cummaudo, Scott Barnett, Rajesh Vasa, John Grundy, Mohamed, Abdelrazek

TL;DR
This paper proposes an architectural tactic using benchmark datasets to mitigate risks caused by the evolving nature of AI-powered web services, enhancing application robustness.
Contribution
It introduces a novel integration architecture tactic that helps developers detect and manage evolution in AI services to maintain application quality.
Findings
Identified 1,054 cases of confidence evolution in AI responses.
Detected 2,461 significant changes in response label sets.
Demonstrated effectiveness on a dataset of 331 images.
Abstract
Intelligent services provide the power of AI to developers via simple RESTful API endpoints, abstracting away many complexities of machine learning. However, most of these intelligent services-such as computer vision-continually learn with time. When the internals within the abstracted 'black box' become hidden and evolve, pitfalls emerge in the robustness of applications that depend on these evolving services. Without adapting the way developers plan and construct projects reliant on intelligent services, significant gaps and risks result in both project planning and development. Therefore, how can software engineers best mitigate software evolution risk moving forward, thereby ensuring that their own applications maintain quality? Our proposal is an architectural tactic designed to improve intelligent service-dependent software robustness. The tactic involves creating an…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
