XekRung Technical Report

TL;DR

XekRung is a large language model specialized for cybersecurity, built with domain-specific data pipelines and training methods, achieving state-of-the-art results in cybersecurity benchmarks.

Contribution

The paper introduces XekRung, a cybersecurity-focused LLM with a comprehensive training pipeline and evaluation system, setting new performance standards in cybersecurity tasks.

Findings

XekRung outperforms existing models on cybersecurity benchmarks.

The model maintains strong performance on general benchmarks.

A multi-dimensional evaluation system guides iterative improvements.

Abstract

We present XekRung, a frontier large language model for cybersecurity, designed to provide comprehensive security capabilities. To achieve this, we develop diverse data synthesis pipelines tailored to the cybersecurity domain, enabling the scalable construction of high-quality training data and providing a strong foundation for cybersecurity knowledge and understanding. Building on this foundation, we establish a complete training pipeline spanning continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL) to further extend the model's capabilities. We further introduce a multi-dimensional evaluation system to guide the iterative improvement of both domain-specific and general-purpose abilities. Extensive experiments demonstrate that XekRung achieves state-of-the-art performance on cybersecurity-specific benchmarks among models of the same scale, while maintaining strong performance on general benchmarks.