PICASO: Enhancing API Recommendations with Relevant Stack Overflow Posts

TL;DR

PICASO is a framework that enhances API recommendation accuracy by leveraging Stack Overflow posts through contrastive learning and query expansion, significantly improving API sequence generation performance.

Contribution

This work introduces a novel approach combining bi-encoder and cross-encoder models to incorporate Stack Overflow data into API recommendation, which was not previously explored.

Findings

BLEU-4 score improved by 10.8% with Stack Overflow integration

Effective use of Stack Overflow titles for query expansion

Enhanced API sequence generation accuracy

Abstract

While having options could be liberating, too many options could lead to the sub-optimal solution being chosen. This is not an exception in the software engineering domain. Nowadays, API has become imperative in making software developers' life easier. APIs help developers implement a function faster and more efficiently. However, given the large number of open-source libraries to choose from, choosing the right APIs is not a simple task. Previous studies on API recommendation leverage natural language (query) to identify which API would be suitable for the given task. However, these studies only consider one source of input, i.e., GitHub or Stack Overflow, independently. There are no existing approaches that utilize Stack Overflow to help generate better API sequence recommendations from queries obtained from GitHub. Therefore, in this study, we aim to provide a framework that could improve the result of the API sequence recommendation by leveraging information from Stack Overflow. In this work, we propose PICASO, which leverages a bi-encoder to do contrastive learning and a cross-encoder to build a classification model in order to find a semantically similar Stack Overflow post given an annotation (i.e., code comment). Subsequently, PICASO then uses the Stack Overflow's title as a query expansion. PICASO then uses the extended queries to fine-tune a CodeBERT, resulting in an API sequence generation model. Based on our experiments, we found that incorporating the Stack Overflow information into CodeBERT would improve the performance of API sequence generation's BLEU-4 score by 10.8%.