Similarity Search on Computational Notebooks
Misato Horiuchi (1), Yuya Sasaki (1), Chuan Xiao (1), Makoto Onizuka, (1) ((1) Osaka University)

TL;DR
This paper introduces a novel framework for similarity search in computational notebooks, enabling efficient retrieval of relevant notebooks based on content similarity, which improves search accuracy and speed.
Contribution
It proposes set-based and graph-based similarity measures and develops optimization techniques like caching and indexing for effective notebook retrieval.
Findings
Graph-based similarity achieves high accuracy.
Optimization techniques significantly speed up search.
Framework effectively prunes irrelevant candidates.
Abstract
Computational notebook software such as Jupyter Notebook is popular for data science tasks. Numerous computational notebooks are available on the Web and reusable; however, searching for computational notebooks manually is a tedious task, and so far, there are no tools to search for computational notebooks effectively and efficiently. In this paper, we propose a similarity search on computational notebooks and develop a new framework for the similarity search. Given contents (i.e., source codes, tabular data, libraries, and outputs formats) in computational notebooks as a query, the similarity search problem aims to find top-k computational notebooks with the most similar contents. We define two similarity measures; set-based and graph-based similarities. Set-based similarity handles each content independently, while graph-based similarity captures the relationships between contents.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Data Management and Algorithms
