EmoInHindi: A Multi-label Emotion and Intensity Annotated Dataset in Hindi for Emotion Recognition in Dialogues

TL;DR

This paper introduces EmoInHindi, a large Hindi dialogue dataset with multi-label emotion and intensity annotations, addressing the lack of non-English datasets for emotion recognition in conversations.

Contribution

The creation of EmoInHindi, a comprehensive Hindi dataset with multi-label emotion and intensity annotations, and the development of strong contextual baselines for emotion detection.

Findings

Dataset contains 1,814 dialogues and 44,247 utterances.

Annotations include 16 emotion classes with intensity levels.

Baseline models demonstrate effective emotion and intensity detection.

Abstract

The long-standing goal of Artificial Intelligence (AI) has been to create human-like conversational systems. Such systems should have the ability to develop an emotional connection with the users, hence emotion recognition in dialogues is an important task. Emotion detection in dialogues is a challenging task because humans usually convey multiple emotions with varying degrees of intensities in a single utterance. Moreover, emotion in an utterance of a dialogue may be dependent on previous utterances making the task more complex. Emotion recognition has always been in great demand. However, most of the existing datasets for multi-label emotion and intensity detection in conversations are in English. To this end, we create a large conversational dataset in Hindi named EmoInHindi for multi-label emotion and intensity recognition in conversations containing 1,814 dialogues with a total of 44,247 utterances. We prepare our dataset in a Wizard-of-Oz manner for mental health and legal counselling of crime victims. Each utterance of the dialogue is annotated with one or more emotion categories from the 16 emotion classes including neutral, and their corresponding intensity values. We further propose strong contextual baselines that can detect emotion(s) and the corresponding intensity of an utterance given the conversational context.