An Empirical Study of Software Exceptions in the Field using Search Logs
Foyzul Hassan, Chetan Bansal, Nachiappan Nagappan, Thomas Zimmermann,, Ahmed Hassan Awadallah

TL;DR
This study analyzes over a million web search queries related to software exceptions to understand how developers seek exception information online, using machine learning to extract exception data from large-scale query logs.
Contribution
It introduces a novel machine learning model for extracting exceptions from unstructured search queries and provides large-scale insights into exception search behavior across programming languages and domains.
Findings
Identified patterns in exception search queries and their popularity.
Analyzed effort and success rates in exception-related searches.
Provided insights for improving exception handling tools and documentation.
Abstract
Software engineers spend a substantial amount of time using Web search to accomplish software engineering tasks. Such search tasks include finding code snippets, API documentation, seeking help with debugging, etc. While debugging a bug or crash, one of the common practices of software engineers is to search for information about the associated error or exception traces on the internet. In this paper, we analyze query logs from a leading commercial general-purpose search engine (GPSE) such as Google, Yahoo! or Bing to carry out a large scale study of software exceptions. To the best of our knowledge, this is the first large scale study to analyze how Web search is used to find information about exceptions. We analyzed about 1 million exception related search queries from a random sample of 5 billion web search queries. To extract exceptions from unstructured query text, we built a…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
