Navigating Complexity in Software Engineering: A Prototype for Comparing GPT-n Solutions

TL;DR

This paper introduces GPTCompare, a prototype tool that enables programmers to visually compare multiple code solutions generated by GPT-n models for the same query, addressing limitations of current chatbot interfaces.

Contribution

The paper presents a novel prototype that enhances comparison of multiple GPT-n generated solutions, improving decision-making in software engineering tasks.

Findings

Enables visual comparison of multiple solutions

Highlights similarities and differences effectively

Addresses limitations of existing chatbot interfaces

Abstract

Navigating the diverse solution spaces of non-trivial software engineering tasks requires a combination of technical knowledge, problem-solving skills, and creativity. With multiple possible solutions available, each with its own set of trade-offs, it is essential for programmers to evaluate the various options and select the one that best suits the specific requirements and constraints of a project. Whether it is choosing from a range of libraries, weighing the pros and cons of different architecture and design solutions, or finding unique ways to fulfill user requirements, the ability to think creatively is crucial for making informed decisions that will result in efficient and effective software. However, the interfaces of current chatbot tools for programmers, such as OpenAI's ChatGPT or GitHub Copilot, are optimized for presenting a single solution, even for complex queries. While other solutions can be requested, they are not displayed by default and are not intuitive to access. In this paper, we present our work-in-progress prototype "GPTCompare", which allows programmers to visually compare multiple source code solutions generated by GPT-n models for the same programming-related query by highlighting their similarities and differences.