When and How AI Should Assist Brainstorming for AI Impact Assessment
Jarod Govers, Sanja \v{S}\'cepanovi\'c, Daniele Quercia

TL;DR
This study explores how AI can effectively support team brainstorming in AI impact assessments, emphasizing appropriate timing, interaction style, and role to enhance collaboration and idea quality.
Contribution
The paper adapts and evaluates AI interventions in structured brainstorming methods, providing design guidance for AI support in collaborative impact assessment.
Findings
AI improved impact assessment quality for general-purpose AI but not for specialized applications.
AI should offer hints rather than solutions during early ideation phases.
Effective AI support involves facilitating idea structuring and leveraging team expertise.
Abstract
A key task in AI practice is to assess potential impacts to prevent harm. Current AI tools assisting AI impact assessment have not been designed or evaluated for collaborative team brainstorming, and they do not capture the range of views in diverse teams. We studied how AI can support team brainstorming during AI impact assessment and made three contributions. First, we adapted two structured methods from strategic foresight and co-designed AI interventions for them in five in-person workshops with 28 participants in total. Second, we evaluated the interventions in ten in-person workshops with 54 participants, finding that AI improved impact assessment quality and brainstorming perceptions for a general-purpose AI use (a chatbot companion) but not for a specialised one (a kidney allocation application). Third, our findings result in broader design guidance for AI assistance in…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
