Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligence

TL;DR

Fengshenbang 1.0 is an open-source project that provides comprehensive Chinese-language foundation models, tools, and benchmarks to support the development of Chinese cognitive intelligence and democratize access to large-scale models.

Contribution

It introduces a complete ecosystem for Chinese foundation models, including models, frameworks, benchmarks, and datasets, fostering community collaboration and resource sharing.

Findings

Launch of large pre-trained Chinese models

Development of user-friendly APIs and benchmarks

Promotion of open-source ecosystem for Chinese AI models

Abstract

Nowadays, foundation models become one of fundamental infrastructures in artificial intelligence, paving ways to the general intelligence. However, the reality presents two urgent challenges: existing foundation models are dominated by the English-language community; users are often given limited resources and thus cannot always use foundation models. To support the development of the Chinese-language community, we introduce an open-source project, called Fengshenbang, which leads by the research center for Cognitive Computing and Natural Language (CCNL). Our project has comprehensive capabilities, including large pre-trained models, user-friendly APIs, benchmarks, datasets, and others. We wrap all these in three sub-projects: the Fengshenbang Model, the Fengshen Framework, and the Fengshen Benchmark. An open-source roadmap, Fengshenbang, aims to re-evaluate the open-source community of Chinese pre-trained large-scale models, prompting the development of the entire Chinese large-scale model community. We also want to build a user-centered open-source ecosystem to allow individuals to access the desired models to match their computing resources. Furthermore, we invite companies, colleges, and research institutions to collaborate with us to build the large-scale open-source model-based ecosystem. We hope that this project will be the foundation of Chinese cognitive intelligence.