Advice from the Oracle: Really Intelligent Information Retrieval

TL;DR

This paper explores the concept of 'intelligent' information retrieval by examining human intelligence aspects through the metaphor of a wise Oracle, and discusses a statistical method for text indexing in astrophysics data systems.

Contribution

It introduces a conceptual framework linking human intelligence to information retrieval and presents a statistical factor space method for text indexing in astrophysics data systems.

Findings

Proposes the Oracle as a metaphor for intelligent retrieval

Details the Statistical Factor Space method for text indexing

Illustrates application in astrophysics data systems

Abstract

What is "intelligent" information retrieval? Essentially this is asking what is intelligence, in this article I will attempt to show some of the aspects of human intelligence, as related to information retrieval. I will do this by the device of a semi-imaginary Oracle. Every Observatory has an oracle, someone who is a distinguished scientist, has great administrative responsibilities, acts as mentor to a number of less senior people, and as trusted advisor to even the most accomplished scientists, and knows essentially everyone in the field. In an appendix I will present a brief summary of the Statistical Factor Space method for text indexing and retrieval, and indicate how it will be used in the Astrophysics Data System Abstract Service. 2018 Keywords: Personal Digital Assistant; Supervised Topic Models