ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review

TL;DR

This review emphasizes the importance of evaluating ChatGPT and similar LLMs on sustainability, privacy, digital divide, and ethics (SPADE), highlighting overlooked issues and proposing policies and mitigations.

Contribution

It introduces the SPADE evaluation framework for conversational AI, addressing critical overlooked aspects like sustainability and ethics, and discusses policy implications.

Findings

Preliminary data supports concerns over privacy and ethics.

SPADE evaluation highlights key sustainability issues.

Recommendations for policy and mitigation are proposed.

Abstract

ChatGPT is another large language model (LLM) vastly available for the consumers on their devices but due to its performance and ability to converse effectively, it has gained a huge popularity amongst research as well as industrial community. Recently, many studies have been published to show the effectiveness, efficiency, integration, and sentiments of chatGPT and other LLMs. In contrast, this study focuses on the important aspects that are mostly overlooked, i.e. sustainability, privacy, digital divide, and ethics and suggests that not only chatGPT but every subsequent entry in the category of conversational bots should undergo Sustainability, PrivAcy, Digital divide, and Ethics (SPADE) evaluation. This paper discusses in detail the issues and concerns raised over chatGPT in line with aforementioned characteristics. We also discuss the recent EU AI Act briefly in accordance with the SPADE evaluation. We support our hypothesis by some preliminary data collection and visualizations along with hypothesized facts. We also suggest mitigations and recommendations for each of the concerns. Furthermore, we also suggest some policies and recommendations for EU AI policy act concerning ethics, digital divide, and sustainability