Arabic Multimodal Machine Learning: Datasets, Applications, Approaches, and Challenges

TL;DR

This paper provides a comprehensive survey of Arabic Multimodal Machine Learning, categorizing existing research into datasets, applications, approaches, and challenges, and highlighting research gaps and future opportunities.

Contribution

It introduces a novel taxonomy for organizing Arabic MML research and offers a structured overview of the current state and gaps in the field.

Findings

Identification of key datasets in Arabic MML

Analysis of current applications and approaches

Highlighting critical research challenges and gaps

Abstract

Multimodal Machine Learning (MML) aims to integrate and analyze information from diverse modalities, such as text, audio, and visuals, enabling machines to address complex tasks like sentiment analysis, emotion recognition, and multimedia retrieval. Recently, Arabic MML has reached a certain level of maturity in its foundational development, making it time to conduct a comprehensive survey. This paper explores Arabic MML by categorizing efforts through a novel taxonomy and analyzing existing research. Our taxonomy organizes these efforts into four key topics: datasets, applications, approaches, and challenges. By providing a structured overview, this survey offers insights into the current state of Arabic MML, highlighting areas that have not been investigated and critical research gaps. Researchers will be empowered to build upon the identified opportunities and address challenges to advance the field.