The Web is missing an essential part of infrastructure: an Open Web Index

TL;DR

This paper proposes creating a public, open Web index that separates core infrastructure from services, enabling diverse search engines and Web data applications to operate on a shared, accessible foundation.

Contribution

It introduces a novel concept of an open Web index that serves as shared infrastructure, distinct from individual search services.

Findings

Conceptual framework for an open Web index

Potential for increased accessibility and innovation

Foundation for diverse Web services

Abstract

A proposal for building an index of the Web that separates the infrastructure part of the search engine - the index - from the services part that will form the basis for myriad search engines and other services utilizing Web data on top of a public infrastructure open to everyone.