A Systematic Study of Training-Free Methods for Trustworthy Large Language Models

TL;DR

This paper systematically evaluates training-free methods for improving trustworthiness in large language models, analyzing their effectiveness, trade-offs, and limitations across various settings and model types.

Contribution

It introduces a taxonomy of training-free methods based on their intervention points and provides a comprehensive analysis of their impacts on trustworthiness, utility, and robustness.

Findings

Training-free methods vary in effectiveness across trustworthiness dimensions.

Trade-offs exist between trustworthiness improvements and utility degradation.

The study identifies unresolved challenges and offers practical recommendations.

Abstract

As Large Language Models (LLMs) receive increasing attention and are being deployed across various domains, their potential risks, including generating harmful or biased content, producing unsupported claims, and exhibiting vulnerabilities to adversarial attacks, have drawn significant attention. To enable quick and low-cost adaptation, training-free methods have recently emerged as cost-effective alternatives to post-training alignment techniques. Despite their promising results, these methods are evaluated inconsistently across the literature, cover limited dimensions of trustworthiness, and can introduce undesirable side effects, such as utility degradation and increased brittleness. To fully assess the impacts of these training-free methods, we take a step back and systematically re-evaluate the effectiveness of existing training-free methods against various trustworthy settings and their influence on utility, robustness, and computational overhead. We also categorize these methods into three levels (input, internal, and output) based on where they intervene in the model's information flow during inference. Using this taxonomy, we conduct a comprehensive analysis of various representative and effective methods from each level across different LLM families and sizes. Our analysis highlights several trade-offs and unresolved challenges in current approaches. We summarize key findings and limitations in the existing literature, and propose practical recommendations for balancing trustworthiness, utility, and robustness in LLMs without the need for additional training.