LEKA:LLM-Enhanced Knowledge Augmentation

TL;DR

LEKA is a novel knowledge augmentation method that actively retrieves and harmonizes external knowledge sources to improve transfer learning across various domains, reducing costs and enhancing model performance.

Contribution

The paper introduces LEKA, a new approach for knowledge transfer that actively searches for and integrates relevant external knowledge sources for improved transfer learning.

Findings

Significant performance improvements over traditional methods.

Reduced computational costs in transfer learning.

Effective automatic data alignment and knowledge integration.

Abstract

Humans excel in analogical learning and knowledge transfer and, more importantly, possess a unique understanding of identifying appropriate sources of knowledge. From a model's perspective, this presents an interesting challenge. If models could autonomously retrieve knowledge useful for transfer or decision-making to solve problems, they would transition from passively acquiring to actively accessing and learning from knowledge. However, filling models with knowledge is relatively straightforward -- it simply requires more training and accessible knowledge bases. The more complex task is teaching models about which knowledge can be analogized and transferred. Therefore, we design a knowledge augmentation method, LEKA, for knowledge transfer that actively searches for suitable knowledge sources that can enrich the target domain's knowledge. This LEKA method extracts key information from the target domain's textual information, retrieves pertinent data from external data libraries, and harmonizes retrieved data with the target domain data in feature space and marginal probability measures. We validate the effectiveness of our approach through extensive experiments across various domains and demonstrate significant improvements over traditional methods in reducing computational costs, automating data alignment, and optimizing transfer learning outcomes.