WiNGPT-3.0 Technical Report

TL;DR

WiNGPT-3.0 is a 32-billion parameter language model designed to improve medical reasoning and clinical applicability, demonstrating strong performance and the effectiveness of reinforcement learning with limited data for healthcare AI.

Contribution

The paper introduces WiNGPT-3.0, a large language model tailored for medical reasoning, utilizing a multi-stage training pipeline with reinforcement learning to enhance clinical accuracy.

Findings

Achieved 66.6 on MedCalc and 87.1 on MedQA-USMLE

Improved clinical reasoning score from 58.1 to 62.5 with targeted training

Reinforcement learning effective with only a few thousand examples

Abstract

Current Large Language Models (LLMs) exhibit significant limitations, notably in structured, interpretable, and verifiable medical reasoning, alongside practical deployment challenges related to computational resources and data privacy. This report focused on the development of WiNGPT-3.0, the 32-billion parameter LLMs, engineered with the objective of enhancing its capacity for medical reasoning and exploring its potential for effective integration within healthcare IT infrastructures. The broader aim is to advance towards clinically applicable models. The approach involved a multi-stage training pipeline tailored for general, medical, and clinical reasoning. This pipeline incorporated supervised fine-tuning (SFT) and reinforcement learning (RL), leveraging curated Long Chain-of-Thought (CoT) datasets, auxiliary reward models, and an evidence-based diagnostic chain simulation. WiNGPT-3.0 demonstrated strong performance: specific model variants achieved scores of 66.6 on MedCalc and 87.1 on MedQA-USMLE. Furthermore, targeted training improved performance on a clinical reasoning task from a baseline score of 58.1 to 62.5. These findings suggest that reinforcement learning, even when applied with a limited dataset of only a few thousand examples, can enhance medical reasoning accuracy. Crucially, this demonstration of RL's efficacy with limited data and computation paves the way for more trustworthy and practically deployable LLMs within clinical workflows and health information infrastructures.