The Gig's Up: How ChatGPT Stacks Up Against Quora on Gig Economy Insights

TL;DR

This study compares ChatGPT's generated answers to Quora's real responses in the gig economy, revealing that AI provides less personal but more concept-based insights, highlighting its partial replication of human answers.

Contribution

The paper introduces a methodology for comparing AI-generated content with human responses, specifically in the context of the gig economy, to evaluate AI's capabilities and limitations.

Findings

ChatGPT's answers are less personal and more concept-focused.

Quora answers often include personal experiences and examples.

AI responses lack the personal touch found in human answers.

Abstract

Generative AI is changing the way in which humans seek to find answers to questions in different fields including on the gig economy and labour markets, but there is limited information available about closely ChatGPT simulated output matches that obtainable from existing question and answer platforms. This paper uses ChatGPT as a research assistant to explore how far ChatGPT can replicate Quora question and answers, using data from the gig economy as an indicative case study. The results from content analysis suggest that Quora is likely to be asked questions from users looking to make money and answers are likely to include personal experiences and examples. ChatGPT simulated versions are less personal and more concept-based, including considerations on employment implications and labour rights. It appears therefore that generative AI simulates only part of what a human would want in their answers relating to the gig economy. The paper proposes that a similar comparative methodology would also be useful across other research fields to help in establishing the best real world uses of generative AI.