Rethinking Search: A Study of University Students' Perspectives on Using LLMs and Traditional Search Engines in Academic Problem Solving

TL;DR

This study investigates university students' perceptions of using both traditional search engines and large language models for academic problem solving, highlighting their complementary roles and the need for integrated tools.

Contribution

It introduces a prototype hybrid search tool combining GPT and Google, addressing the limitations of each and improving academic research workflows.

Findings

Students switch between Google and GPT for different tasks.

Neither tool alone is sufficient for comprehensive research.

A hybrid chatbot prototype enhances research efficiency.

Abstract

With the increasing integration of Artificial Intelligence (AI) in academic problem solving, university students frequently alternate between traditional search engines like Google and large language models (LLMs) for information retrieval. This study explores students' perceptions of both tools, emphasizing usability, efficiency, and their integration into academic workflows. Employing a mixed-methods approach, we surveyed 109 students from diverse disciplines and conducted in-depth interviews with 12 participants. Quantitative analyses, including ANOVA and chi-square tests, were used to assess differences in efficiency, satisfaction, and tool preference. Qualitative insights revealed that students commonly switch between GPT and Google: using Google for credible, multi-source information and GPT for summarization, explanation, and drafting. While neither tool proved sufficient on its own, there was a strong demand for a hybrid solution. In response, we developed a prototype, a chatbot embedded within the search interface, that combines GPT's conversational capabilities with Google's reliability to enhance academic research and reduce cognitive load.