LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape

TL;DR

LitPivot is a novel tool that supports researchers in developing research ideas by dynamically integrating literature review and critique, enabling iterative idea refinement based on relevant literature.

Contribution

LitPivot introduces literature-initiated pivots and a system that dynamically retrieves relevant papers to assist in idea development and critique.

Findings

Researchers produced higher-rated ideas with better understanding of literature.

LitPivot facilitated iterative evolution of research ideas.

The system supports concurrent drafting and vetting of ideas.

Abstract

Developing a novel research idea is hard. It must be distinct enough from prior work to claim a contribution while also building on it. This requires iteratively reviewing literature and refining an idea based on what a researcher reads; yet when an idea changes, the literature that matters often changes with it. Most tools offer limited support for this interplay: literature tools help researchers understand a fixed body of work, while ideation tools evaluate ideas against a static, pre-curated set of papers. We introduce literature-initiated pivots, a mechanism where engagement with literature prompts revision to a developing idea, and where that revision changes which literature is relevant. We operationalize this in LitPivot, where researchers concurrently draft and vet an idea. LitPivot dynamically retrieves clusters of papers relevant to a selected part of the idea and proposes literature-informed critiques for how to revise it. A lab study ($n{=}17$) shows researchers produced higher-rated ideas with stronger self-reported understanding of the literature space; an open-ended study ($n{=}5$) reveals how researchers use LitPivot to iteratively evolve their own ideas.