The Threat of Offensive AI to Organizations

TL;DR

This paper analyzes how offensive AI enhances cyber threats to organizations by reviewing capabilities, strategies, and ranking threats through a literature review and user study, highlighting the evolving landscape of AI-driven cyber attacks.

Contribution

It provides a comprehensive survey of 33 offensive AI capabilities, analyzes their impact on organizational cybersecurity, and ranks threats based on industry and academic insights.

Findings

Identification of 33 offensive AI capabilities

Ranking of AI threats to organizations

Insights into adversary strategies and impact

Abstract

AI has provided us with the ability to automate tasks, extract information from vast amounts of data, and synthesize media that is nearly indistinguishable from the real thing. However, positive tools can also be used for negative purposes. In particular, cyber adversaries can use AI (such as machine learning) to enhance their attacks and expand their campaigns. Although offensive AI has been discussed in the past, there is a need to analyze and understand the threat in the context of organizations. For example, how does an AI-capable adversary impact the cyber kill chain? Does AI benefit the attacker more than the defender? What are the most significant AI threats facing organizations today and what will be their impact on the future? In this survey, we explore the threat of offensive AI on organizations. First, we present the background and discuss how AI changes the adversary's methods, strategies, goals, and overall attack model. Then, through a literature review, we identify 33 offensive AI capabilities which adversaries can use to enhance their attacks. Finally, through a user study spanning industry and academia, we rank the AI threats and provide insights on the adversaries.