Graph Meets LLMs: Towards Large Graph Models

TL;DR

This paper explores the development of large graph models, discussing their challenges, recent advances, and potential applications to advance AI capabilities towards artificial general intelligence.

Contribution

It is the first comprehensive study of large graph models, analyzing their characteristics, challenges, and opportunities across multiple perspectives.

Findings

Identifies key challenges in developing large graph models

Highlights recent advances in graph representation and data handling

Discusses promising applications for large graph models

Abstract

Large models have emerged as the most recent groundbreaking achievements in artificial intelligence, and particularly machine learning. However, when it comes to graphs, large models have not achieved the same level of success as in other fields, such as natural language processing and computer vision. In order to promote applying large models for graphs forward, we present a perspective paper to discuss the challenges and opportunities associated with developing large graph models. First, we discuss the desired characteristics of large graph models. Then, we present detailed discussions from three key perspectives: representation basis, graph data, and graph models. In each category, we provide a brief overview of recent advances and highlight the remaining challenges together with our visions. Finally, we discuss valuable applications of large graph models. We believe this perspective can encourage further investigations into large graph models, ultimately pushing us one step closer towards artificial general intelligence (AGI). We are the first to comprehensively study large graph models, to the best of our knowledge.