Augmenting the Author: Exploring the Potential of AI Collaboration in Academic Writing

TL;DR

This paper critically examines the integration of Generative AI in academic writing, comparing two models through collaborative prompt design to improve AI-assisted scholarly work.

Contribution

It provides a comparative analysis of Gemini and ChatGPT, emphasizing prompt strategies and AI limitations for responsible academic collaboration.

Findings

Prompt variation impacts output quality

Distinct capabilities and constraints of AI models are revealed

Effective prompt design enhances AI-assisted writing

Abstract

This workshop paper presents a critical examination of the integration of Generative AI (Gen AI) into the academic writing process, focusing on the use of AI as a collaborative tool. It contrasts the performance and interaction of two AI models, Gemini and ChatGPT, through a collaborative inquiry approach where researchers engage in facilitated sessions to design prompts that elicit specific AI responses for crafting research outlines. This case study highlights the importance of prompt design, output analysis, and recognizing the AI's limitations to ensure responsible and effective AI integration in scholarly work. Preliminary findings suggest that prompt variation significantly affects output quality and reveals distinct capabilities and constraints of each model. The paper contributes to the field of Human-Computer Interaction by exploring effective prompt strategies and providing a comparative analysis of Gen AI models, ultimately aiming to enhance AI-assisted academic writing and prompt a deeper dialogue within the HCI community.